![[Jenkins]](/jenkins/static/b68c8964/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8956 originally caused by: Started by upstream project "master-osmo-mgw" build number 9188 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30077 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37241 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29294 originally caused by: Started by upstream project "master-osmo-msc" build number 34252 originally caused by: Started by upstream project "master-osmo-mgw" build number 9188 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9252 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9123 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 originally caused by: Started by timer Started by user laforge Started by upstream project "master-libosmo-sccp" build number 9122 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8710 originally caused by: Started by upstream project "master-osmo-hlr" build number 8845 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 originally caused by: Started by timer Started by user laforge Started by upstream project "master-osmo-hlr" build number 8844 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17674 originally caused by: Started by upstream project "master-osmo-bsc" build number 20134 originally caused by: Started by upstream project "master-osmo-mgw" build number 9188 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 originally caused by: Started by timer Started by user laforge Started by upstream project "master-osmo-bsc" build number 20133 originally caused by: Started by upstream project "master-osmo-mgw" build number 9188 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30078 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37242 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9123 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 originally caused by: Started by timer Started by user laforge Started by upstream project "master-libosmo-sccp" build number 9122 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29295 originally caused by: Started by upstream project "master-osmo-msc" build number 34253 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9123 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 originally caused by: Started by timer Started by user laforge Started by upstream project "master-libosmo-sccp" build number 9122 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17675 originally caused by: Started by upstream project "master-osmo-bsc" build number 20135 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9123 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 originally caused by: Started by timer Started by user laforge Started by upstream project "master-libosmo-sccp" build number 9122 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12984 originally caused by: Started by upstream project "master-openbsc" build number 13181 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9123 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 originally caused by: Started by timer Started by user laforge Started by upstream project "master-libosmo-sccp" build number 9122 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30079 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37243 originally caused by: Started by upstream project "master-osmo-iuh" build number 12868 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9123 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 originally caused by: Started by timer Started by user laforge Started by upstream project "master-libosmo-sccp" build number 9122 originally caused by: Started by upstream project "master-libosmo-netif" build number 6964 Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8711 originally caused by: Started by upstream project "master-osmo-hlr" build number 8846 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17675 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6687 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8711 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8956 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2978 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29295 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5152 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30079 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4679 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12984 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9252 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4707 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5191 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3909 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins3314872351197130646.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-12 17:41:17 + trial_dir_prefix=trial- + rm -rf trial-2379 trial-2379-bin.tgz trial-2379-run.tgz + trial_dir=trial-2380 + mkdir -p trial-2380 + mv open5gs.build-8.tgz osmo-bsc.build-17675.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6687.tgz osmo-hlr.build-8711.tgz osmo-hnbgw.build-2978.tgz osmo-mgw.build-8956.tgz osmo-msc.build-29295.tgz osmo-nitb.build-12984.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30079.tgz osmo-stp.build-9252.tgz osmo-trx.build-4679.tgz osmocom-bb.build-4707.tgz srslte.build-19.tgz trial-2380 + cat open5gs.build-8.md5 osmo-bsc.build-17675.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6687.md5 osmo-hlr.build-8711.md5 osmo-hnbgw.build-2978.md5 osmo-mgw.build-8956.md5 osmo-msc.build-29295.md5 osmo-nitb.build-12984.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30079.md5 osmo-stp.build-9252.md5 osmo-trx.build-4679.md5 osmocom-bb.build-4707.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17675.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6687.md5 osmo-hlr.build-8711.md5 osmo-hnbgw.build-2978.md5 osmo-mgw.build-8956.md5 osmo-msc.build-29295.md5 osmo-nitb.build-12984.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30079.md5 osmo-stp.build-9252.md5 osmo-trx.build-4679.md5 osmocom-bb.build-4707.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2380 combinations: None trial: 'trial-2380' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2380 -------------------------------------------------------------------------------------------- 17:41:28.660915 tst trial-2380: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/log --------------------------------------------------------------------- trial-2380 nitb_sms:sysmo --------------------------------------------------------------------- 17:43:35.525433 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:43:35.529376 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 17:43:35.551155 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 17:43:35.558246 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 17:43:35.614873 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 17:43:35.636687 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 17:43:35.643705 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 17:43:36.179878 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 17:43:36.184921 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 17:43:36.196565 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 17:43:36.584876 tst mo_mt_sms.py: using LAC 30437 17:43:36.832912 tst mo_mt_sms.py: using RAC 92 17:43:36.954056 tst mo_mt_sms.py: using CellId 30437 17:43:37.074951 tst mo_mt_sms.py: using BVCI 30438 17:43:37.189411 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 17:43:37.369619 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 17:43:37.489394 tst mo_mt_sms.py:9: start nitb and bts... 17:43:37.688910 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:43:39.931672 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8528): Launched 17:43:40.231367 run osmo-nitb_10.42.42.2(pid=8529): Launched 17:43:40.394344 run osmo-nitb_10.42.42.2(pid=8529): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8529)] 17:43:40.517631 run osmo-nitb_10.42.42.2(pid=8529): stdout: | (launched: 2022-12-12_17:43:40.174627) 17:43:40.641944 run osmo-nitb_10.42.42.2(pid=8529): stderr: | (launched: 2022-12-12_17:43:40.218995) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:43:40.766869 run osmo-nitb_10.42.42.2(pid=8529): stdout: | (launched: 2022-12-12_17:43:40.174627) 17:43:40.886057 run osmo-nitb_10.42.42.2(pid=8529): stderr: | (launched: 2022-12-12_17:43:40.218995) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:43:41.028264 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=8529): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8529) [trial-2380↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8529)] [trial-2380↪nitb_sms:sysmo↪mo_mt_sms.py:11] 17:43:41.036480 tst mo_mt_sms.py:11: Test FAILED (4.8 sec) 17:43:41.043058 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8528): Terminating (SIGTERM) 17:43:41.252469 --- ParallelTerminationStrategy: PID 8528 died... 17:43:41.272860 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8528): Terminated: ok {rc=0} 17:43:41.357593 bus /sierra_3: Setting Powered False 17:43:42.460095 bus /sierra_3: Setting Powered False 17:43:43.578435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 sms:sysmo --------------------------------------------------------------------- 17:43:44.763271 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:43:44.767789 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 17:43:44.789543 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 17:43:44.817127 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 17:43:44.873543 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 17:43:44.895040 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 17:43:44.922386 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 17:43:45.469141 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 sms:sysmo mo_mt_sms.py ---------------------------------------------- 17:43:45.474263 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:43:45.485250 tst sms:sysmo: Using 1 x bts (candidates: 1) 17:43:45.520536 tst mo_mt_sms.py: using LAC 30438 17:43:45.646297 tst mo_mt_sms.py: using RAC 93 17:43:45.771751 tst mo_mt_sms.py: using CellId 30438 17:43:45.911573 tst mo_mt_sms.py: using BVCI 30439 17:43:46.023094 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:43:46.034813 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:43:46.046475 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:43:46.059283 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:43:46.073142 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 17:43:46.086198 tst sms:sysmo: Using 1 x modem (candidates: 2) 17:43:46.209714 tst sms:sysmo: Using 1 x modem (candidates: 2) 17:43:46.336439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:43:48.074156 run create_hlr_db(pid=8533): Launched 17:43:48.189159 bus /sierra_2: Setting Powered False 17:43:49.248834 run create_hlr_db(pid=8533): Terminated: ok {rc=0} 17:43:49.668243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8535): Launched 17:43:49.969852 run osmo-hlr_10.42.42.2(pid=8536): Launched 17:43:50.083476 run osmo-stp_10.42.42.5: Starting osmo-stp 17:43:52.556761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8538): Launched 17:43:52.859573 run osmo-stp_10.42.42.5(pid=8539): Launched 17:43:52.975305 run osmo-msc_10.42.42.6: Starting osmo-msc 17:43:58.335919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8541): Launched 17:43:58.639450 run osmo-msc_10.42.42.6(pid=8542): Launched 17:43:58.808123 run osmo-stp_10.42.42.5(pid=8539): ERR: Terminated: ERROR {rc=1} [trial-2380↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8539)] 17:43:58.936172 run osmo-stp_10.42.42.5(pid=8539): stdout: | (launched: 2022-12-12_17:43:52.801985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:59.063881 run osmo-stp_10.42.42.5(pid=8539): stderr: | [0;m[38;5;43m20221212174352970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174352970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174352971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174352971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174352972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174352972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174352972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:59.190171 run osmo-stp_10.42.42.5(pid=8539): stdout: | (launched: 2022-12-12_17:43:52.801985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:43:59.310912 run osmo-stp_10.42.42.5(pid=8539): stderr: | [0;m[38;5;43m20221212174352970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174352970 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174352971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174352971 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174352972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174352972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174352972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:43:59.455006 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8539): Process ended prematurely: osmo-stp_10.42.42.5(pid=8539) [trial-2380↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8539)] [trial-2380↪sms:sysmo↪mo_mt_sms.py:16] 17:43:59.463293 tst mo_mt_sms.py:16: Test FAILED (14.0 sec) 17:43:59.489997 run osmo-hlr_10.42.42.2(pid=8536): ERR: Terminated: ERROR {rc=237} [trial-2380↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8536)] 17:43:59.539132 run osmo-hlr_10.42.42.2(pid=8536): stdout: | (launched: 2022-12-12_17:43:49.912394) 17:43:59.589787 run osmo-hlr_10.42.42.2(pid=8536): stderr: | [0;m[1;31m20221212174350097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174350097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174350097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174350097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174350097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174350097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174350109 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174350117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174350118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174350118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:43:59.660660 run osmo-msc_10.42.42.6(pid=8542): ERR: Terminated: ERROR {rc=2} [trial-2380↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8542)] 17:43:59.710257 run osmo-msc_10.42.42.6(pid=8542): stdout: | (launched: 2022-12-12_17:43:58.582263) 17:43:59.760936 run osmo-msc_10.42.42.6(pid=8542): stderr: | [0;m[38;5;43m20221212174358856 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174358856 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa3c789cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174358856 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174358856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174358856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174358857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174358859 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174358859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174358859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174358859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:43:59.812663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8535): Terminating (SIGTERM) 17:43:59.854625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8538): Terminating (SIGTERM) 17:43:59.895427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8541): Terminating (SIGTERM) 17:43:59.935806 --- ParallelTerminationStrategy: PID 8535 died... 17:43:59.955140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8535): Terminated: ok {rc=0} 17:43:59.999565 --- ParallelTerminationStrategy: PID 8538 died... 17:44:00.018516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8538): Terminated: ok {rc=0} 17:44:00.063762 --- ParallelTerminationStrategy: PID 8541 died... 17:44:00.082486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8541): Terminated: ok {rc=0} 17:44:00.170365 bus /sierra_3: Setting Powered False 17:44:01.277626 bus /sierra_3: Setting Powered False 17:44:02.406067 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_ussd:sysmo --------------------------------------------------------------------- 17:44:03.631593 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:44:03.635560 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 17:44:03.657077 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 17:44:03.664818 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 17:44:03.703160 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 17:44:03.725486 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 17:44:03.733009 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 17:44:04.249095 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2380 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 17:44:04.255134 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 17:44:04.266600 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 17:44:04.302377 tst assert_extension.py: using LAC 30439 17:44:04.430443 tst assert_extension.py: using RAC 94 17:44:04.558231 tst assert_extension.py: using CellId 30439 17:44:04.685304 tst assert_extension.py: using BVCI 30440 17:44:04.802174 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 17:44:04.917713 tst assert_extension.py:10: start nitb and bts... 17:44:05.135201 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:44:05.795265 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8549): Launched 17:44:06.118593 run osmo-nitb_10.42.42.2(pid=8550): Launched 17:44:06.298051 run osmo-nitb_10.42.42.2(pid=8550): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8550)] 17:44:06.441540 run osmo-nitb_10.42.42.2(pid=8550): stdout: | (launched: 2022-12-12_17:44:06.057831) 17:44:06.586477 run osmo-nitb_10.42.42.2(pid=8550): stderr: | (launched: 2022-12-12_17:44:06.105807) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:44:06.731966 run osmo-nitb_10.42.42.2(pid=8550): stdout: | (launched: 2022-12-12_17:44:06.057831) 17:44:06.871505 run osmo-nitb_10.42.42.2(pid=8550): stderr: | (launched: 2022-12-12_17:44:06.105807) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8550): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8550) [trial-2380↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8550)] 17:44:07.241995 tst osmo-nitb_10.42.42.2(pid=8550): stdout: | (launched: 2022-12-12_17:44:06.057831) 17:44:07.372355 tst osmo-nitb_10.42.42.2(pid=8550): stderr: | (launched: 2022-12-12_17:44:06.105807) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:44:07.526361 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8550): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8550) [trial-2380↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8550)] [trial-2380↪nitb_ussd:sysmo↪assert_extension.py:12] 17:44:07.535287 tst assert_extension.py:12: Test FAILED (3.3 sec) 17:44:07.542550 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8549): Terminating (SIGTERM) 17:44:07.753443 --- ParallelTerminationStrategy: PID 8549 died... 17:44:07.774760 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8549): Terminated: ok {rc=0} 17:44:07.862494 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 ussd:sysmo --------------------------------------------------------------------- 17:44:09.025448 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:44:09.029477 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 17:44:09.050359 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 17:44:09.078390 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 17:44:09.114089 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 17:44:09.134770 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 17:44:09.161836 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 17:44:09.689496 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2380 ussd:sysmo assert_extension.py ---------------------------------------------- 17:44:09.694776 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:44:09.705806 tst ussd:sysmo: Using 1 x bts (candidates: 1) 17:44:09.741580 tst assert_extension.py: using LAC 30440 17:44:09.869735 tst assert_extension.py: using RAC 95 17:44:09.997385 tst assert_extension.py: using CellId 30440 17:44:10.123965 tst assert_extension.py: using BVCI 30441 17:44:10.242411 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:44:10.253637 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:44:10.264745 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:44:10.275889 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:44:10.286819 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 17:44:10.297617 tst ussd:sysmo: Using 1 x modem (candidates: 1) 17:44:10.414616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:10.919045 run create_hlr_db(pid=8554): Launched 17:44:11.051088 bus /sierra_2: Setting Powered False 17:44:12.114973 run create_hlr_db(pid=8554): Terminated: ok {rc=0} 17:44:12.549237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8556): Launched 17:44:12.857120 run osmo-hlr_10.42.42.2(pid=8557): Launched 17:44:12.972440 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:13.496396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8559): Launched 17:44:13.802015 run osmo-stp_10.42.42.5(pid=8560): Launched 17:44:13.918067 run osmo-msc_10.42.42.6: Starting osmo-msc 17:44:14.464313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8562): Launched 17:44:14.770259 run osmo-msc_10.42.42.6(pid=8563): Launched 17:44:14.941577 run osmo-stp_10.42.42.5(pid=8560): ERR: Terminated: ERROR {rc=1} [trial-2380↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8560)] 17:44:15.070137 run osmo-stp_10.42.42.5(pid=8560): stdout: | (launched: 2022-12-12_17:44:13.744523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:15.198739 run osmo-stp_10.42.42.5(pid=8560): stderr: | [0;m[38;5;43m20221212174413914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174413914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174413914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174413915 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174413915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174413915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174413915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:15.325234 run osmo-stp_10.42.42.5(pid=8560): stdout: | (launched: 2022-12-12_17:44:13.744523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:15.446106 run osmo-stp_10.42.42.5(pid=8560): stderr: | [0;m[38;5;43m20221212174413914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174413914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174413914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174413915 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174413915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174413915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174413915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:15.591185 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8560): Process ended prematurely: osmo-stp_10.42.42.5(pid=8560) [trial-2380↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8560)] [trial-2380↪ussd:sysmo↪assert_extension.py:17] 17:44:15.599934 tst assert_extension.py:17: Test FAILED (5.9 sec) 17:44:15.626490 run osmo-hlr_10.42.42.2(pid=8557): ERR: Terminated: ERROR {rc=237} [trial-2380↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8557)] 17:44:15.675831 run osmo-hlr_10.42.42.2(pid=8557): stdout: | (launched: 2022-12-12_17:44:12.799345) 17:44:15.726253 run osmo-hlr_10.42.42.2(pid=8557): stderr: | [0;m[1;31m20221212174412977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174412977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174412977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174412977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174412977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174412977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174412989 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174412998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174412998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174412998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:15.796397 run osmo-msc_10.42.42.6(pid=8563): ERR: Terminated: ERROR {rc=2} [trial-2380↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8563)] 17:44:15.863185 run osmo-msc_10.42.42.6(pid=8563): stdout: | (launched: 2022-12-12_17:44:14.712559) 17:44:15.923225 run osmo-msc_10.42.42.6(pid=8563): stderr: | [0;m[38;5;43m20221212174414984 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174414985 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f648a369c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174414985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174414985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174414985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174414986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174414987 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174414988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174414988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174414988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:44:15.980492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8556): Terminating (SIGTERM) 17:44:16.024769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8559): Terminating (SIGTERM) 17:44:16.070590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8562): Terminating (SIGTERM) 17:44:16.118537 --- ParallelTerminationStrategy: PID 8556 died... 17:44:16.139259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8556): Terminated: ok {rc=0} 17:44:16.188771 --- ParallelTerminationStrategy: PID 8559 died... 17:44:16.209333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8559): Terminated: ok {rc=0} 17:44:16.257233 --- ParallelTerminationStrategy: PID 8562 died... 17:44:16.277774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8562): Terminated: ok {rc=0} 17:44:16.369369 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:44:17.565419 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:44:17.572242 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:44:17.593867 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:44:17.621462 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:44:17.674820 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:44:17.696771 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:44:17.724319 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:44:18.275192 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:44:18.330091 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:44:18.341881 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:44:18.400439 tst mo_mt_call.py: using LAC 30441 17:44:18.531234 tst mo_mt_call.py: using RAC 96 17:44:18.660378 tst mo_mt_call.py: using CellId 30441 17:44:18.790583 tst mo_mt_call.py: using BVCI 30442 17:44:18.911046 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:44:18.922716 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:44:18.934124 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:44:18.945881 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:44:18.957534 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:44:18.969328 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:44:19.089991 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:44:19.209433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:19.688069 run create_hlr_db(pid=8568): Launched 17:44:19.808467 bus /sierra_2: Setting Powered False 17:44:20.869935 run create_hlr_db(pid=8568): Terminated: ok {rc=0} 17:44:21.302848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8570): Launched 17:44:21.613905 run osmo-hlr_10.42.42.2(pid=8571): Launched 17:44:21.730944 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:22.273664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8573): Launched 17:44:22.586416 run osmo-stp_10.42.42.5(pid=8574): Launched 17:44:22.703354 run osmo-msc_10.42.42.6: Starting osmo-msc 17:44:23.261224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8576): Launched 17:44:23.571301 run osmo-msc_10.42.42.6(pid=8577): Launched 17:44:23.745114 run osmo-stp_10.42.42.5(pid=8574): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8574)] 17:44:23.875653 run osmo-stp_10.42.42.5(pid=8574): stdout: | (launched: 2022-12-12_17:44:22.528006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:24.005547 run osmo-stp_10.42.42.5(pid=8574): stderr: | [0;m[38;5;43m20221212174422699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174422699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174422699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174422700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174422700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174422700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174422700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:24.133695 run osmo-stp_10.42.42.5(pid=8574): stdout: | (launched: 2022-12-12_17:44:22.528006) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:24.256279 run osmo-stp_10.42.42.5(pid=8574): stderr: | [0;m[38;5;43m20221212174422699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174422699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174422699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174422700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174422700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174422700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174422700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:24.402976 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8574): Process ended prematurely: osmo-stp_10.42.42.5(pid=8574) [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8574)] [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:44:24.411954 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:44:24.439400 run osmo-hlr_10.42.42.2(pid=8571): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8571)] 17:44:24.488531 run osmo-hlr_10.42.42.2(pid=8571): stdout: | (launched: 2022-12-12_17:44:21.555495) 17:44:24.539268 run osmo-hlr_10.42.42.2(pid=8571): stderr: | [0;m[1;31m20221212174421733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174421733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174421733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174421733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174421733 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174421734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174421746 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174421754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174421754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174421755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:24.609593 run osmo-msc_10.42.42.6(pid=8577): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8577)] 17:44:24.658254 run osmo-msc_10.42.42.6(pid=8577): stdout: | (launched: 2022-12-12_17:44:23.512850) 17:44:24.708575 run osmo-msc_10.42.42.6(pid=8577): stderr: | [0;m[38;5;43m20221212174423786 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174423786 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f299b971c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174423786 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174423786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174423786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174423787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174423788 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174423789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174423789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174423789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:44:24.759517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8570): Terminating (SIGTERM) 17:44:24.800027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8573): Terminating (SIGTERM) 17:44:24.840726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8576): Terminating (SIGTERM) 17:44:24.881613 --- ParallelTerminationStrategy: PID 8570 died... 17:44:24.901171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8570): Terminated: ok {rc=0} 17:44:24.946600 --- ParallelTerminationStrategy: PID 8573 died... 17:44:24.965570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8573): Terminated: ok {rc=0} 17:44:25.010531 --- ParallelTerminationStrategy: PID 8576 died... 17:44:25.029461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8576): Terminated: ok {rc=0} 17:44:25.115755 bus /sierra_3: Setting Powered False 17:44:26.215415 bus /sierra_3: Setting Powered False 17:44:27.333623 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:44:28.487352 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:44:28.499842 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:44:28.558492 tst mo_mt_call_osmux.py: using LAC 30442 17:44:28.689920 tst mo_mt_call_osmux.py: using RAC 97 17:44:28.819852 tst mo_mt_call_osmux.py: using CellId 30442 17:44:28.948640 tst mo_mt_call_osmux.py: using BVCI 30443 17:44:29.068059 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:44:29.079699 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:44:29.091196 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:44:29.102922 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:44:29.115386 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:44:29.127186 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:44:29.247572 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:44:29.371339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:29.883769 run create_hlr_db(pid=8579): Launched 17:44:30.019958 bus /sierra_2: Setting Powered False 17:44:31.114477 run create_hlr_db(pid=8579): Terminated: ok {rc=0} 17:44:31.594678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8581): Launched 17:44:31.941103 run osmo-hlr_10.42.42.2(pid=8582): Launched 17:44:32.184858 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:32.762820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8584): Launched 17:44:33.095185 run osmo-stp_10.42.42.5(pid=8585): Launched 17:44:33.222672 run osmo-msc_10.42.42.6: Starting osmo-msc 17:44:33.819128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8587): Launched 17:44:34.150279 run osmo-msc_10.42.42.6(pid=8588): Launched 17:44:34.336391 run osmo-stp_10.42.42.5(pid=8585): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8585)] 17:44:34.477821 run osmo-stp_10.42.42.5(pid=8585): stdout: | (launched: 2022-12-12_17:44:33.033581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:34.616103 run osmo-stp_10.42.42.5(pid=8585): stderr: | [0;m[38;5;43m20221212174433222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174433222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174433223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174433223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174433224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174433224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174433224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:34.753539 run osmo-stp_10.42.42.5(pid=8585): stdout: | (launched: 2022-12-12_17:44:33.033581) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:34.884812 run osmo-stp_10.42.42.5(pid=8585): stderr: | [0;m[38;5;43m20221212174433222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174433222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174433223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174433223 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174433224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174433224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174433224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:35.041632 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8585): Process ended prematurely: osmo-stp_10.42.42.5(pid=8585) [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8585)] [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:44:35.051434 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 17:44:35.079252 run osmo-hlr_10.42.42.2(pid=8582): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8582)] 17:44:35.130003 run osmo-hlr_10.42.42.2(pid=8582): stdout: | (launched: 2022-12-12_17:44:31.878499) 17:44:35.182777 run osmo-hlr_10.42.42.2(pid=8582): stderr: | [0;m[1;31m20221212174432188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174432188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174432188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174432188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174432188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174432188 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174432236 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174432247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174432247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174432247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:35.255618 run osmo-msc_10.42.42.6(pid=8588): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8588)] 17:44:35.306183 run osmo-msc_10.42.42.6(pid=8588): stdout: | (launched: 2022-12-12_17:44:34.088061) 17:44:35.358410 run osmo-msc_10.42.42.6(pid=8588): stderr: | [0;m[38;5;43m20221212174434415 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174434415 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcf542d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174434415 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174434415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174434415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174434415 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174434417 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174434418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174434418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174434418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:44:35.410981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8581): Terminating (SIGTERM) 17:44:35.452910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8584): Terminating (SIGTERM) 17:44:35.494905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8587): Terminating (SIGTERM) 17:44:35.537696 --- ParallelTerminationStrategy: PID 8581 died... 17:44:35.557967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8581): Terminated: ok {rc=0} 17:44:35.604643 --- ParallelTerminationStrategy: PID 8584 died... 17:44:35.624495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8584): Terminated: ok {rc=0} 17:44:35.671283 --- ParallelTerminationStrategy: PID 8587 died... 17:44:35.691039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8587): Terminated: ok {rc=0} 17:44:35.779581 bus /sierra_3: Setting Powered False 17:44:36.881465 bus /sierra_3: Setting Powered False 17:44:37.999232 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:44:39.237496 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:44:39.244607 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:44:39.266102 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:44:39.294108 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:44:39.347432 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:44:39.368713 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:44:39.396063 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:44:39.952883 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:44:40.005450 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:44:40.016898 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:44:40.075321 tst mo_mt_call.py: using LAC 30443 17:44:40.205471 tst mo_mt_call.py: using RAC 98 17:44:40.334073 tst mo_mt_call.py: using CellId 30443 17:44:40.464208 tst mo_mt_call.py: using BVCI 30444 17:44:40.585031 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:44:40.596747 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:44:40.608159 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:44:40.619566 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:44:40.631062 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:44:40.642947 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:44:40.760524 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:44:40.881483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:41.394548 run create_hlr_db(pid=8593): Launched 17:44:41.528490 bus /sierra_2: Setting Powered False 17:44:42.594035 run create_hlr_db(pid=8593): Terminated: ok {rc=0} 17:44:43.054464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8595): Launched 17:44:43.385219 run osmo-hlr_10.42.42.2(pid=8596): Launched 17:44:43.510393 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:44.076476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8598): Launched 17:44:44.407021 run osmo-stp_10.42.42.5(pid=8599): Launched 17:44:44.533739 run osmo-msc_10.42.42.6: Starting osmo-msc 17:44:45.129113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8601): Launched 17:44:45.459702 run osmo-msc_10.42.42.6(pid=8602): Launched 17:44:45.643569 run osmo-stp_10.42.42.5(pid=8599): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8599)] 17:44:45.781691 run osmo-stp_10.42.42.5(pid=8599): stdout: | (launched: 2022-12-12_17:44:44.345255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:46.007332 run osmo-stp_10.42.42.5(pid=8599): stderr: | [0;m[38;5;43m20221212174444536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174444536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174444536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174444537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174444537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174444537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174444537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:46.147480 run osmo-stp_10.42.42.5(pid=8599): stdout: | (launched: 2022-12-12_17:44:44.345255) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:46.280593 run osmo-stp_10.42.42.5(pid=8599): stderr: | [0;m[38;5;43m20221212174444536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174444536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174444536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174444537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174444537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174444537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174444537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:46.441086 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8599): Process ended prematurely: osmo-stp_10.42.42.5(pid=8599) [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8599)] [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:44:46.451729 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 17:44:46.480941 run osmo-hlr_10.42.42.2(pid=8596): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8596)] 17:44:46.531907 run osmo-hlr_10.42.42.2(pid=8596): stdout: | (launched: 2022-12-12_17:44:43.323544) 17:44:46.584848 run osmo-hlr_10.42.42.2(pid=8596): stderr: | [0;m[1;31m20221212174443522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174443522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174443522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174443522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174443522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174443522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174443539 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174443548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174443549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174443549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:46.659756 run osmo-msc_10.42.42.6(pid=8602): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8602)] 17:44:46.710988 run osmo-msc_10.42.42.6(pid=8602): stdout: | (launched: 2022-12-12_17:44:45.398016) 17:44:46.763852 run osmo-msc_10.42.42.6(pid=8602): stderr: | [0;m[38;5;43m20221212174445720 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174445721 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f418e2bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174445721 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174445721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174445721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174445721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174445723 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174445723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174445724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174445724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:44:46.816694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8595): Terminating (SIGTERM) 17:44:46.859176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8598): Terminating (SIGTERM) 17:44:46.902287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8601): Terminating (SIGTERM) 17:44:46.946370 --- ParallelTerminationStrategy: PID 8595 died... 17:44:46.966598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8595): Terminated: ok {rc=0} 17:44:47.013626 --- ParallelTerminationStrategy: PID 8598 died... 17:44:47.033986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8598): Terminated: ok {rc=0} 17:44:47.081370 --- ParallelTerminationStrategy: PID 8601 died... 17:44:47.101616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8601): Terminated: ok {rc=0} 17:44:47.191188 bus /sierra_3: Setting Powered False 17:44:48.291383 bus /sierra_3: Setting Powered False 17:44:49.407673 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:44:50.558130 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:44:50.570533 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:44:50.628854 tst mo_mt_call_osmux.py: using LAC 30444 17:44:50.759666 tst mo_mt_call_osmux.py: using RAC 99 17:44:50.888530 tst mo_mt_call_osmux.py: using CellId 30444 17:44:51.017148 tst mo_mt_call_osmux.py: using BVCI 30445 17:44:51.136342 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:44:51.148004 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:44:51.159408 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:44:51.170750 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:44:51.182138 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:44:51.193593 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:44:51.309992 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:44:51.432201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:44:51.946818 run create_hlr_db(pid=8604): Launched 17:44:52.080232 bus /sierra_2: Setting Powered False 17:44:53.145649 run create_hlr_db(pid=8604): Terminated: ok {rc=0} 17:44:53.587196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8606): Launched 17:44:53.899338 run osmo-hlr_10.42.42.2(pid=8607): Launched 17:44:54.017857 run osmo-stp_10.42.42.5: Starting osmo-stp 17:44:54.552026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8609): Launched 17:44:54.862598 run osmo-stp_10.42.42.5(pid=8610): Launched 17:44:54.981081 run osmo-msc_10.42.42.6: Starting osmo-msc 17:44:55.538639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8612): Launched 17:44:55.848225 run osmo-msc_10.42.42.6(pid=8613): Launched 17:44:56.022325 run osmo-stp_10.42.42.5(pid=8610): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8610)] 17:44:56.152432 run osmo-stp_10.42.42.5(pid=8610): stdout: | (launched: 2022-12-12_17:44:54.804157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:56.282289 run osmo-stp_10.42.42.5(pid=8610): stderr: | [0;m[38;5;43m20221212174454976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174454976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174454977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174454977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174454978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174454978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174454978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:56.410644 run osmo-stp_10.42.42.5(pid=8610): stdout: | (launched: 2022-12-12_17:44:54.804157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:44:56.533851 run osmo-stp_10.42.42.5(pid=8610): stderr: | [0;m[38;5;43m20221212174454976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174454976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174454977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174454977 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174454978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174454978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174454978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:44:56.681096 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8610): Process ended prematurely: osmo-stp_10.42.42.5(pid=8610) [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8610)] [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:44:56.690183 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:44:56.717468 run osmo-hlr_10.42.42.2(pid=8607): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8607)] 17:44:56.766428 run osmo-hlr_10.42.42.2(pid=8607): stdout: | (launched: 2022-12-12_17:44:53.841203) 17:44:56.816909 run osmo-hlr_10.42.42.2(pid=8607): stderr: | [0;m[1;31m20221212174454020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174454020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174454020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174454020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174454020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174454020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174454032 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174454041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174454041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174454041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:44:56.887009 run osmo-msc_10.42.42.6(pid=8613): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8613)] 17:44:56.935479 run osmo-msc_10.42.42.6(pid=8613): stdout: | (launched: 2022-12-12_17:44:55.790003) 17:44:56.985710 run osmo-msc_10.42.42.6(pid=8613): stderr: | [0;m[38;5;43m20221212174456063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174456064 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f864a05bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174456064 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174456064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174456064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174456064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174456066 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174456066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174456066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174456067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:44:57.036068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8606): Terminating (SIGTERM) 17:44:57.076477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8609): Terminating (SIGTERM) 17:44:57.116825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8612): Terminating (SIGTERM) 17:44:57.156929 --- ParallelTerminationStrategy: PID 8606 died... 17:44:57.176679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8606): Terminated: ok {rc=0} 17:44:57.221617 --- ParallelTerminationStrategy: PID 8609 died... 17:44:57.240414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8609): Terminated: ok {rc=0} 17:44:57.285409 --- ParallelTerminationStrategy: PID 8612 died... 17:44:57.304271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8612): Terminated: ok {rc=0} 17:44:57.391700 bus /sierra_3: Setting Powered False 17:44:58.491170 bus /sierra_3: Setting Powered False 17:44:59.607978 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:45:00.852667 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:00.862347 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:45:00.891929 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:45:00.930688 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:45:01.003251 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:45:01.030343 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:45:01.073921 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:45:01.624688 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:45:01.709327 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:45:01.725409 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:45:01.794781 tst mo_mt_call.py: using LAC 30445 17:45:01.926902 tst mo_mt_call.py: using RAC 100 17:45:02.056059 tst mo_mt_call.py: using CellId 30445 17:45:02.215160 tst mo_mt_call.py: using BVCI 30446 17:45:02.361170 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:45:02.373880 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:45:02.386307 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:45:02.398202 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:45:02.409748 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:45:02.421242 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:45:02.539329 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:45:02.656056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:03.137219 run create_hlr_db(pid=8621): Launched 17:45:03.254904 bus /sierra_2: Setting Powered False 17:45:04.316623 run create_hlr_db(pid=8621): Terminated: ok {rc=0} 17:45:04.771363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8623): Launched 17:45:05.104267 run osmo-hlr_10.42.42.2(pid=8624): Launched 17:45:05.230367 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:05.799251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8626): Launched 17:45:06.131018 run osmo-stp_10.42.42.5(pid=8627): Launched 17:45:06.251345 run osmo-msc_10.42.42.6: Starting osmo-msc 17:45:06.823057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8631): Launched 17:45:07.135729 run osmo-msc_10.42.42.6(pid=8632): Launched 17:45:07.309177 run osmo-stp_10.42.42.5(pid=8627): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8627)] 17:45:07.440226 run osmo-stp_10.42.42.5(pid=8627): stdout: | (launched: 2022-12-12_17:45:06.068211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:07.571942 run osmo-stp_10.42.42.5(pid=8627): stderr: | [0;m[38;5;43m20221212174506243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174506243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174506243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174506244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174506244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174506244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174506244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:07.700529 run osmo-stp_10.42.42.5(pid=8627): stdout: | (launched: 2022-12-12_17:45:06.068211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:07.823968 run osmo-stp_10.42.42.5(pid=8627): stderr: | [0;m[38;5;43m20221212174506243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174506243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174506243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174506244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174506244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174506244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174506244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:07.971322 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8627): Process ended prematurely: osmo-stp_10.42.42.5(pid=8627) [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8627)] [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:45:07.980332 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:45:08.007578 run osmo-hlr_10.42.42.2(pid=8624): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8624)] 17:45:08.056463 run osmo-hlr_10.42.42.2(pid=8624): stdout: | (launched: 2022-12-12_17:45:05.042247) 17:45:08.107192 run osmo-hlr_10.42.42.2(pid=8624): stderr: | [0;m[1;31m20221212174505238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174505238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174505238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174505238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174505238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174505238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174505250 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174505259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174505259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174505259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:08.177630 run osmo-msc_10.42.42.6(pid=8632): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8632)] 17:45:08.226480 run osmo-msc_10.42.42.6(pid=8632): stdout: | (launched: 2022-12-12_17:45:07.076838) 17:45:08.276940 run osmo-msc_10.42.42.6(pid=8632): stderr: | [0;m[38;5;43m20221212174507350 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174507351 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd343b0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174507351 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174507351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174507351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174507351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174507353 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174507353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174507354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174507354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:45:08.327947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8623): Terminating (SIGTERM) 17:45:08.368481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8626): Terminating (SIGTERM) 17:45:08.408934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8631): Terminating (SIGTERM) 17:45:08.449761 --- ParallelTerminationStrategy: PID 8623 died... 17:45:08.469068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8623): Terminated: ok {rc=0} 17:45:08.514527 --- ParallelTerminationStrategy: PID 8626 died... 17:45:08.533226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8626): Terminated: ok {rc=0} 17:45:08.578017 --- ParallelTerminationStrategy: PID 8631 died... 17:45:08.596760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8631): Terminated: ok {rc=0} 17:45:08.684111 bus /sierra_3: Setting Powered False 17:45:09.784734 bus /sierra_3: Setting Powered False 17:45:10.901701 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:45:12.053511 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:45:12.065732 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:45:12.123603 tst mo_mt_call_osmux.py: using LAC 30446 17:45:12.250897 tst mo_mt_call_osmux.py: using RAC 101 17:45:12.378918 tst mo_mt_call_osmux.py: using CellId 30446 17:45:12.504731 tst mo_mt_call_osmux.py: using BVCI 30447 17:45:12.621679 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:45:12.633266 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:45:12.644438 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:45:12.655812 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:45:12.667408 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:45:12.678762 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:45:12.796262 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:45:12.915960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:13.418176 run create_hlr_db(pid=8635): Launched 17:45:13.551910 bus /sierra_2: Setting Powered False 17:45:14.616913 run create_hlr_db(pid=8635): Terminated: ok {rc=0} 17:45:15.054630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8637): Launched 17:45:15.362277 run osmo-hlr_10.42.42.2(pid=8638): Launched 17:45:15.480200 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:16.053383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8640): Launched 17:45:16.468397 run osmo-stp_10.42.42.5(pid=8641): Launched 17:45:16.628592 run osmo-msc_10.42.42.6: Starting osmo-msc 17:45:17.337660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8643): Launched 17:45:17.667669 run osmo-msc_10.42.42.6(pid=8644): Launched 17:45:17.851448 run osmo-stp_10.42.42.5(pid=8641): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8641)] 17:45:17.988382 run osmo-stp_10.42.42.5(pid=8641): stdout: | (launched: 2022-12-12_17:45:16.410023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:18.125764 run osmo-stp_10.42.42.5(pid=8641): stderr: | [0;m[38;5;43m20221212174516767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174516768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174516768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174516768 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174516769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174516769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174516769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:18.261957 run osmo-stp_10.42.42.5(pid=8641): stdout: | (launched: 2022-12-12_17:45:16.410023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:18.392158 run osmo-stp_10.42.42.5(pid=8641): stderr: | [0;m[38;5;43m20221212174516767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174516768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174516768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174516768 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174516769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174516769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174516769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:18.548059 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8641): Process ended prematurely: osmo-stp_10.42.42.5(pid=8641) [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8641)] [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:45:18.558024 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 17:45:18.585800 run osmo-hlr_10.42.42.2(pid=8638): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8638)] 17:45:18.635937 run osmo-hlr_10.42.42.2(pid=8638): stdout: | (launched: 2022-12-12_17:45:15.304533) 17:45:18.688172 run osmo-hlr_10.42.42.2(pid=8638): stderr: | [0;m[1;31m20221212174515479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174515479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174515480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174515480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174515480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174515480 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174515491 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174515500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174515500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174515500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:18.760257 run osmo-msc_10.42.42.6(pid=8644): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8644)] 17:45:18.810098 run osmo-msc_10.42.42.6(pid=8644): stdout: | (launched: 2022-12-12_17:45:17.606074) 17:45:18.861543 run osmo-msc_10.42.42.6(pid=8644): stderr: | [0;m[38;5;43m20221212174517926 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174517927 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd63c129c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174517927 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174517927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174517927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174517927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174517929 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174517929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174517929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174517929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:45:18.913348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8637): Terminating (SIGTERM) 17:45:18.954626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8640): Terminating (SIGTERM) 17:45:18.996079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8643): Terminating (SIGTERM) 17:45:19.037830 --- ParallelTerminationStrategy: PID 8637 died... 17:45:19.057883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8637): Terminated: ok {rc=0} 17:45:19.104398 --- ParallelTerminationStrategy: PID 8640 died... 17:45:19.123842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8640): Terminated: ok {rc=0} 17:45:19.169263 --- ParallelTerminationStrategy: PID 8643 died... 17:45:19.188454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8643): Terminated: ok {rc=0} 17:45:19.275900 bus /sierra_3: Setting Powered False 17:45:20.373831 bus /sierra_3: Setting Powered False 17:45:21.492655 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:45:22.735678 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:22.742597 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:45:22.763649 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:45:22.790847 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:45:22.843179 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:45:22.864589 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:45:22.891484 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:45:23.442630 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:45:23.494251 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:45:23.505722 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:45:23.562631 tst mo_mt_call.py: using LAC 30447 17:45:23.690352 tst mo_mt_call.py: using RAC 102 17:45:23.817485 tst mo_mt_call.py: using CellId 30447 17:45:23.942412 tst mo_mt_call.py: using BVCI 30448 17:45:24.059824 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:45:24.071370 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:45:24.082621 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:45:24.093964 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:45:24.105241 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:45:24.116470 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:45:24.231611 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:45:24.349087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:24.819063 run create_hlr_db(pid=8649): Launched 17:45:24.935902 bus /sierra_2: Setting Powered False 17:45:25.996915 run create_hlr_db(pid=8649): Terminated: ok {rc=0} 17:45:26.423404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8651): Launched 17:45:26.731305 run osmo-hlr_10.42.42.2(pid=8652): Launched 17:45:26.848783 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:27.384361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8654): Launched 17:45:27.693520 run osmo-stp_10.42.42.5(pid=8655): Launched 17:45:27.809660 run osmo-msc_10.42.42.6: Starting osmo-msc 17:45:28.361733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8657): Launched 17:45:28.668518 run osmo-msc_10.42.42.6(pid=8658): Launched 17:45:28.841998 run osmo-stp_10.42.42.5(pid=8655): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8655)] 17:45:28.971822 run osmo-stp_10.42.42.5(pid=8655): stdout: | (launched: 2022-12-12_17:45:27.635929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:29.105886 run osmo-stp_10.42.42.5(pid=8655): stderr: | [0;m[38;5;43m20221212174527806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174527806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174527806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174527807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174527807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174527807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174527807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:29.241795 run osmo-stp_10.42.42.5(pid=8655): stdout: | (launched: 2022-12-12_17:45:27.635929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:29.371910 run osmo-stp_10.42.42.5(pid=8655): stderr: | [0;m[38;5;43m20221212174527806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174527806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174527806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174527807 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174527807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174527807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174527807 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:29.527890 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8655): Process ended prematurely: osmo-stp_10.42.42.5(pid=8655) [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8655)] [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:45:29.537610 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:45:29.565406 run osmo-hlr_10.42.42.2(pid=8652): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8652)] 17:45:29.615640 run osmo-hlr_10.42.42.2(pid=8652): stdout: | (launched: 2022-12-12_17:45:26.673603) 17:45:29.667844 run osmo-hlr_10.42.42.2(pid=8652): stderr: | [0;m[1;31m20221212174526848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174526848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174526848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174526848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174526848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174526848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174526861 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174526869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174526869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174526869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:29.739678 run osmo-msc_10.42.42.6(pid=8658): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8658)] 17:45:29.789645 run osmo-msc_10.42.42.6(pid=8658): stdout: | (launched: 2022-12-12_17:45:28.610803) 17:45:29.841094 run osmo-msc_10.42.42.6(pid=8658): stderr: | [0;m[38;5;43m20221212174528883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174528883 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f74d9ec0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174528883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174528883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174528883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174528883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174528885 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174528886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174528886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174528886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:45:29.892920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8651): Terminating (SIGTERM) 17:45:29.934822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8654): Terminating (SIGTERM) 17:45:29.976556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8657): Terminating (SIGTERM) 17:45:30.018455 --- ParallelTerminationStrategy: PID 8651 died... 17:45:30.038494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8651): Terminated: ok {rc=0} 17:45:30.084602 --- ParallelTerminationStrategy: PID 8654 died... 17:45:30.104235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8654): Terminated: ok {rc=0} 17:45:30.150569 --- ParallelTerminationStrategy: PID 8657 died... 17:45:30.170508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8657): Terminated: ok {rc=0} 17:45:30.258481 bus /sierra_3: Setting Powered False 17:45:31.358770 bus /sierra_3: Setting Powered False 17:45:32.476572 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:45:33.625538 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:45:33.637453 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:45:33.699435 tst mo_mt_call_osmux.py: using LAC 30448 17:45:33.819490 tst mo_mt_call_osmux.py: using RAC 103 17:45:33.938042 tst mo_mt_call_osmux.py: using CellId 30448 17:45:34.059145 tst mo_mt_call_osmux.py: using BVCI 30449 17:45:34.170590 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:45:34.181670 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:45:34.192549 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:45:34.204124 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:45:34.215770 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:45:34.227410 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:45:34.345720 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:45:34.465922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:34.976016 run create_hlr_db(pid=8660): Launched 17:45:35.110808 bus /sierra_2: Setting Powered False 17:45:36.175452 run create_hlr_db(pid=8660): Terminated: ok {rc=0} 17:45:36.613092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8662): Launched 17:45:36.922856 run osmo-hlr_10.42.42.2(pid=8663): Launched 17:45:37.040579 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:37.582499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8665): Launched 17:45:37.892445 run osmo-stp_10.42.42.5(pid=8666): Launched 17:45:38.010370 run osmo-msc_10.42.42.6: Starting osmo-msc 17:45:38.565877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8668): Launched 17:45:38.874857 run osmo-msc_10.42.42.6(pid=8669): Launched 17:45:39.047291 run osmo-stp_10.42.42.5(pid=8666): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8666)] 17:45:39.177900 run osmo-stp_10.42.42.5(pid=8666): stdout: | (launched: 2022-12-12_17:45:37.834466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:39.308076 run osmo-stp_10.42.42.5(pid=8666): stderr: | [0;m[38;5;43m20221212174538004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174538004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174538004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174538004 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174538005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174538005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174538005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:39.437095 run osmo-stp_10.42.42.5(pid=8666): stdout: | (launched: 2022-12-12_17:45:37.834466) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:39.560219 run osmo-stp_10.42.42.5(pid=8666): stderr: | [0;m[38;5;43m20221212174538004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174538004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174538004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174538004 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174538005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174538005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174538005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:39.708143 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8666): Process ended prematurely: osmo-stp_10.42.42.5(pid=8666) [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8666)] [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:45:39.717440 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 17:45:39.744713 run osmo-hlr_10.42.42.2(pid=8663): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8663)] 17:45:39.793715 run osmo-hlr_10.42.42.2(pid=8663): stdout: | (launched: 2022-12-12_17:45:36.865275) 17:45:39.843997 run osmo-hlr_10.42.42.2(pid=8663): stderr: | [0;m[1;31m20221212174537038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174537038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174537038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174537038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174537039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174537039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174537051 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174537059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174537059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174537060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:39.914015 run osmo-msc_10.42.42.6(pid=8669): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8669)] 17:45:39.962706 run osmo-msc_10.42.42.6(pid=8669): stdout: | (launched: 2022-12-12_17:45:38.816060) 17:45:40.013288 run osmo-msc_10.42.42.6(pid=8669): stderr: | [0;m[38;5;43m20221212174539091 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174539091 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd7fbb9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174539091 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174539091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174539092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174539092 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174539094 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174539094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174539094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174539094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:45:40.063961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8662): Terminating (SIGTERM) 17:45:40.104469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8665): Terminating (SIGTERM) 17:45:40.145531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8668): Terminating (SIGTERM) 17:45:40.186655 --- ParallelTerminationStrategy: PID 8662 died... 17:45:40.206459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8662): Terminated: ok {rc=0} 17:45:40.251564 --- ParallelTerminationStrategy: PID 8665 died... 17:45:40.270481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8665): Terminated: ok {rc=0} 17:45:40.315272 --- ParallelTerminationStrategy: PID 8668 died... 17:45:40.334085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8668): Terminated: ok {rc=0} 17:45:40.420805 bus /sierra_3: Setting Powered False 17:45:41.520354 bus /sierra_3: Setting Powered False 17:45:42.635588 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:45:43.870345 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:45:43.878713 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:45:43.900133 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:45:43.927580 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:45:43.981264 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:45:44.002701 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:45:44.030172 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:45:44.582630 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:45:44.635215 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:45:44.646830 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:45:44.705405 tst mo_mt_call.py: using LAC 30449 17:45:44.836475 tst mo_mt_call.py: using RAC 104 17:45:44.965688 tst mo_mt_call.py: using CellId 30449 17:45:45.095845 tst mo_mt_call.py: using BVCI 30450 17:45:45.215615 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:45:45.227368 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:45:45.238994 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:45:45.250516 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:45:45.262008 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:45:45.273590 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:45:45.390067 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:45:45.510939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:46.033029 run create_hlr_db(pid=8674): Launched 17:45:46.200741 bus /sierra_2: Setting Powered False 17:45:47.275470 run create_hlr_db(pid=8674): Terminated: ok {rc=0} 17:45:47.723719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8676): Launched 17:45:48.037114 run osmo-hlr_10.42.42.2(pid=8677): Launched 17:45:48.155885 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:48.694737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8679): Launched 17:45:49.007497 run osmo-stp_10.42.42.5(pid=8680): Launched 17:45:49.127986 run osmo-msc_10.42.42.6: Starting osmo-msc 17:45:49.687663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8682): Launched 17:45:50.001493 run osmo-msc_10.42.42.6(pid=8683): Launched 17:45:50.176753 run osmo-stp_10.42.42.5(pid=8680): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8680)] 17:45:50.306551 run osmo-stp_10.42.42.5(pid=8680): stdout: | (launched: 2022-12-12_17:45:48.949108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:50.436353 run osmo-stp_10.42.42.5(pid=8680): stderr: | [0;m[38;5;43m20221212174549119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174549119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174549119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174549119 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174549120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174549120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174549120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:50.565113 run osmo-stp_10.42.42.5(pid=8680): stdout: | (launched: 2022-12-12_17:45:48.949108) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:45:50.688749 run osmo-stp_10.42.42.5(pid=8680): stderr: | [0;m[38;5;43m20221212174549119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174549119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174549119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174549119 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174549120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174549120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174549120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:45:50.836268 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8680): Process ended prematurely: osmo-stp_10.42.42.5(pid=8680) [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8680)] [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:45:50.845449 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:45:50.872691 run osmo-hlr_10.42.42.2(pid=8677): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8677)] 17:45:50.922044 run osmo-hlr_10.42.42.2(pid=8677): stdout: | (launched: 2022-12-12_17:45:47.978878) 17:45:50.972486 run osmo-hlr_10.42.42.2(pid=8677): stderr: | [0;m[1;31m20221212174548154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174548154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174548154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174548154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174548154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174548154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174548166 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174548174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174548175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174548175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:45:51.042534 run osmo-msc_10.42.42.6(pid=8683): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8683)] 17:45:51.091358 run osmo-msc_10.42.42.6(pid=8683): stdout: | (launched: 2022-12-12_17:45:49.942816) 17:45:51.141676 run osmo-msc_10.42.42.6(pid=8683): stderr: | [0;m[38;5;43m20221212174550218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174550218 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8a07540c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174550218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174550218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174550218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174550219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174550220 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174550221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174550221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174550221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:45:51.205903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8676): Terminating (SIGTERM) 17:45:51.251777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8679): Terminating (SIGTERM) 17:45:51.292622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8682): Terminating (SIGTERM) 17:45:51.333174 --- ParallelTerminationStrategy: PID 8676 died... 17:45:51.352231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8676): Terminated: ok {rc=0} 17:45:51.397316 --- ParallelTerminationStrategy: PID 8679 died... 17:45:51.416102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8679): Terminated: ok {rc=0} 17:45:51.460912 --- ParallelTerminationStrategy: PID 8682 died... 17:45:51.480216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8682): Terminated: ok {rc=0} 17:45:51.567780 bus /sierra_3: Setting Powered False 17:45:52.669463 bus /sierra_3: Setting Powered False 17:45:53.786530 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:45:54.936251 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:45:54.948613 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:45:55.006815 tst mo_mt_call_osmux.py: using LAC 30450 17:45:55.136304 tst mo_mt_call_osmux.py: using RAC 105 17:45:55.263384 tst mo_mt_call_osmux.py: using CellId 30450 17:45:55.390521 tst mo_mt_call_osmux.py: using BVCI 30451 17:45:55.509991 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:45:55.521714 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:45:55.533781 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:45:55.545259 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:45:55.556558 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:45:55.568052 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:45:55.685701 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:45:55.809869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:45:56.281512 run create_hlr_db(pid=8685): Launched 17:45:56.399428 bus /sierra_2: Setting Powered False 17:45:57.459554 run create_hlr_db(pid=8685): Terminated: ok {rc=0} 17:45:57.906861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8687): Launched 17:45:58.232214 run osmo-hlr_10.42.42.2(pid=8688): Launched 17:45:58.356004 run osmo-stp_10.42.42.5: Starting osmo-stp 17:45:58.914283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8690): Launched 17:45:59.239250 run osmo-stp_10.42.42.5(pid=8691): Launched 17:45:59.363433 run osmo-msc_10.42.42.6: Starting osmo-msc 17:45:59.952001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8693): Launched 17:46:00.280125 run osmo-msc_10.42.42.6(pid=8694): Launched 17:46:00.463340 run osmo-stp_10.42.42.5(pid=8691): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8691)] 17:46:00.600147 run osmo-stp_10.42.42.5(pid=8691): stdout: | (launched: 2022-12-12_17:45:59.179862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:00.738195 run osmo-stp_10.42.42.5(pid=8691): stderr: | [0;m[38;5;43m20221212174559367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174559368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174559368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174559368 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174559369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174559369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174559369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:00.875862 run osmo-stp_10.42.42.5(pid=8691): stdout: | (launched: 2022-12-12_17:45:59.179862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:01.021735 run osmo-stp_10.42.42.5(pid=8691): stderr: | [0;m[38;5;43m20221212174559367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174559368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174559368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174559368 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174559369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174559369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174559369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:01.178569 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8691): Process ended prematurely: osmo-stp_10.42.42.5(pid=8691) [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8691)] [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:46:01.188855 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:46:01.219893 run osmo-hlr_10.42.42.2(pid=8688): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8688)] 17:46:01.271599 run osmo-hlr_10.42.42.2(pid=8688): stdout: | (launched: 2022-12-12_17:45:58.172804) 17:46:01.325666 run osmo-hlr_10.42.42.2(pid=8688): stderr: | [0;m[1;31m20221212174558368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174558368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174558368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174558368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174558368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174558368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174558381 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174558389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174558389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174558389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:01.398927 run osmo-msc_10.42.42.6(pid=8694): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8694)] 17:46:01.450051 run osmo-msc_10.42.42.6(pid=8694): stdout: | (launched: 2022-12-12_17:46:00.219858) 17:46:01.502848 run osmo-msc_10.42.42.6(pid=8694): stderr: | [0;m[38;5;43m20221212174600541 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174600542 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f43cd040c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174600542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174600542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174600542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174600542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174600544 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174600544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174600544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174600544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:01.557300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8687): Terminating (SIGTERM) 17:46:01.601337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8690): Terminating (SIGTERM) 17:46:01.646141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8693): Terminating (SIGTERM) 17:46:01.691425 --- ParallelTerminationStrategy: PID 8687 died... 17:46:01.712843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8687): Terminated: ok {rc=0} 17:46:01.762392 --- ParallelTerminationStrategy: PID 8690 died... 17:46:01.782466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8690): Terminated: ok {rc=0} 17:46:01.831816 --- ParallelTerminationStrategy: PID 8693 died... 17:46:01.852079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8693): Terminated: ok {rc=0} 17:46:01.942790 bus /sierra_3: Setting Powered False 17:46:03.043130 bus /sierra_3: Setting Powered False 17:46:04.160360 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:46:05.402146 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:05.409856 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:46:05.431173 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:46:05.458229 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:46:05.512206 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:46:05.533331 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:46:05.560176 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:46:06.110065 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:46:06.160679 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:46:06.172015 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:46:06.229149 tst mo_mt_call.py: using LAC 30451 17:46:06.350193 tst mo_mt_call.py: using RAC 106 17:46:06.471397 tst mo_mt_call.py: using CellId 30451 17:46:06.593378 tst mo_mt_call.py: using BVCI 30452 17:46:06.706325 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:46:06.717584 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:46:06.728605 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:46:06.740078 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:46:06.751587 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:46:06.763177 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:46:06.880503 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:46:06.997648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:07.470717 run create_hlr_db(pid=8699): Launched 17:46:07.587790 bus /sierra_2: Setting Powered False 17:46:08.648278 run create_hlr_db(pid=8699): Terminated: ok {rc=0} 17:46:09.097284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8701): Launched 17:46:09.426229 run osmo-hlr_10.42.42.2(pid=8702): Launched 17:46:09.552304 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:10.122640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8704): Launched 17:46:10.450897 run osmo-stp_10.42.42.5(pid=8705): Launched 17:46:10.576555 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:11.171585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8707): Launched 17:46:11.499310 run osmo-msc_10.42.42.6(pid=8708): Launched 17:46:11.683962 run osmo-stp_10.42.42.5(pid=8705): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8705)] 17:46:11.822484 run osmo-stp_10.42.42.5(pid=8705): stdout: | (launched: 2022-12-12_17:46:10.390675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:11.961798 run osmo-stp_10.42.42.5(pid=8705): stderr: | [0;m[38;5;43m20221212174610580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174610580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174610580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174610581 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174610581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174610581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174610581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:12.098245 run osmo-stp_10.42.42.5(pid=8705): stdout: | (launched: 2022-12-12_17:46:10.390675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:12.228658 run osmo-stp_10.42.42.5(pid=8705): stderr: | [0;m[38;5;43m20221212174610580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174610580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174610580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174610581 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174610581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174610581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174610581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:12.385146 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8705): Process ended prematurely: osmo-stp_10.42.42.5(pid=8705) [trial-2380↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8705)] [trial-2380↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:46:12.394892 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 17:46:12.422821 run osmo-hlr_10.42.42.2(pid=8702): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8702)] 17:46:12.473264 run osmo-hlr_10.42.42.2(pid=8702): stdout: | (launched: 2022-12-12_17:46:09.365930) 17:46:12.525083 run osmo-hlr_10.42.42.2(pid=8702): stderr: | [0;m[1;31m20221212174609562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174609562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174609562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174609562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174609562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174609562 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174609574 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174609583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174609583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174609583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:12.597074 run osmo-msc_10.42.42.6(pid=8708): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8708)] 17:46:12.647292 run osmo-msc_10.42.42.6(pid=8708): stdout: | (launched: 2022-12-12_17:46:11.439274) 17:46:12.699629 run osmo-msc_10.42.42.6(pid=8708): stderr: | [0;m[38;5;43m20221212174611758 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174611759 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f02a5b97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174611759 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174611759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174611759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174611759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174611761 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174611761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174611761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174611761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:12.751997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8701): Terminating (SIGTERM) 17:46:12.793911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8704): Terminating (SIGTERM) 17:46:12.835937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8707): Terminating (SIGTERM) 17:46:12.878104 --- ParallelTerminationStrategy: PID 8701 died... 17:46:12.898330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8701): Terminated: ok {rc=0} 17:46:12.944998 --- ParallelTerminationStrategy: PID 8704 died... 17:46:12.964779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8704): Terminated: ok {rc=0} 17:46:13.011142 --- ParallelTerminationStrategy: PID 8707 died... 17:46:13.030956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8707): Terminated: ok {rc=0} 17:46:13.119339 bus /sierra_3: Setting Powered False 17:46:14.219969 bus /sierra_3: Setting Powered False 17:46:15.334879 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:46:16.484100 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:46:16.497526 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:46:16.558997 tst mo_mt_call_osmux.py: using LAC 30452 17:46:16.728677 tst mo_mt_call_osmux.py: using RAC 107 17:46:16.853536 tst mo_mt_call_osmux.py: using CellId 30452 17:46:16.978538 tst mo_mt_call_osmux.py: using BVCI 30453 17:46:17.121987 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:46:17.134334 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:46:17.147052 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:46:17.159300 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:46:17.171437 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:46:17.183714 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:46:17.304273 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:46:17.424280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:17.935307 run create_hlr_db(pid=8710): Launched 17:46:18.068633 bus /sierra_2: Setting Powered False 17:46:19.133678 run create_hlr_db(pid=8710): Terminated: ok {rc=0} 17:46:19.571626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8712): Launched 17:46:19.879959 run osmo-hlr_10.42.42.2(pid=8713): Launched 17:46:19.997846 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:20.538203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8715): Launched 17:46:20.845667 run osmo-stp_10.42.42.5(pid=8716): Launched 17:46:20.962623 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:21.515234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8718): Launched 17:46:21.822777 run osmo-msc_10.42.42.6(pid=8719): Launched 17:46:21.994140 run osmo-stp_10.42.42.5(pid=8716): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8716)] 17:46:22.123755 run osmo-stp_10.42.42.5(pid=8716): stdout: | (launched: 2022-12-12_17:46:20.788629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:22.253191 run osmo-stp_10.42.42.5(pid=8716): stderr: | [0;m[38;5;43m20221212174620956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174620956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174620956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174620957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174620957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174620957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174620957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:22.380923 run osmo-stp_10.42.42.5(pid=8716): stdout: | (launched: 2022-12-12_17:46:20.788629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:22.502989 run osmo-stp_10.42.42.5(pid=8716): stderr: | [0;m[38;5;43m20221212174620956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174620956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174620956 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174620957 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174620957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174620957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174620957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:22.649116 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8716): Process ended prematurely: osmo-stp_10.42.42.5(pid=8716) [trial-2380↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8716)] [trial-2380↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:46:22.658151 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 17:46:22.684869 run osmo-hlr_10.42.42.2(pid=8713): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8713)] 17:46:22.733396 run osmo-hlr_10.42.42.2(pid=8713): stdout: | (launched: 2022-12-12_17:46:19.823317) 17:46:22.782951 run osmo-hlr_10.42.42.2(pid=8713): stderr: | [0;m[1;31m20221212174619997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174619997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174619997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174619997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174619997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174619998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174620010 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174620018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174620019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174620019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:22.852029 run osmo-msc_10.42.42.6(pid=8719): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8719)] 17:46:22.900400 run osmo-msc_10.42.42.6(pid=8719): stdout: | (launched: 2022-12-12_17:46:21.766055) 17:46:22.949821 run osmo-msc_10.42.42.6(pid=8719): stderr: | [0;m[38;5;43m20221212174622038 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174622038 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff74f667c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174622038 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174622039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174622039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174622039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174622041 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174622041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174622041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174622041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:22.999622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8712): Terminating (SIGTERM) 17:46:23.039351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8715): Terminating (SIGTERM) 17:46:23.079154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8718): Terminating (SIGTERM) 17:46:23.119149 --- ParallelTerminationStrategy: PID 8712 died... 17:46:23.138313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8712): Terminated: ok {rc=0} 17:46:23.182925 --- ParallelTerminationStrategy: PID 8715 died... 17:46:23.201527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8715): Terminated: ok {rc=0} 17:46:23.245857 --- ParallelTerminationStrategy: PID 8718 died... 17:46:23.264402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8718): Terminated: ok {rc=0} 17:46:23.350938 bus /sierra_3: Setting Powered False 17:46:24.449137 bus /sierra_3: Setting Powered False 17:46:25.563728 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:46:26.803486 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:26.809797 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:46:26.832374 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:46:26.860558 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:46:26.914830 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:46:26.936029 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:46:26.963690 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:46:27.513880 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:46:27.567185 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:46:27.578700 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:46:27.638822 tst mo_mt_call.py: using LAC 30453 17:46:27.769619 tst mo_mt_call.py: using RAC 108 17:46:27.897476 tst mo_mt_call.py: using CellId 30453 17:46:28.026859 tst mo_mt_call.py: using BVCI 30454 17:46:28.147708 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:46:28.159187 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:46:28.170407 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:46:28.181601 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:46:28.192706 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:46:28.203935 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:46:28.322032 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:46:28.443603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:28.918561 run create_hlr_db(pid=8724): Launched 17:46:29.037309 bus /sierra_2: Setting Powered False 17:46:30.102360 run create_hlr_db(pid=8724): Terminated: ok {rc=0} 17:46:30.540172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8726): Launched 17:46:30.858389 run osmo-hlr_10.42.42.2(pid=8727): Launched 17:46:31.035195 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:31.864496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8729): Launched 17:46:32.227621 run osmo-stp_10.42.42.5(pid=8730): Launched 17:46:32.391458 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:32.998551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8732): Launched 17:46:33.327223 run osmo-msc_10.42.42.6(pid=8733): Launched 17:46:33.509599 run osmo-stp_10.42.42.5(pid=8730): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8730)] 17:46:33.649347 run osmo-stp_10.42.42.5(pid=8730): stdout: | (launched: 2022-12-12_17:46:32.165944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:33.787511 run osmo-stp_10.42.42.5(pid=8730): stderr: | [0;m[38;5;43m20221212174632473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174632473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174632474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174632474 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174632474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174632475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174632475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:33.924243 run osmo-stp_10.42.42.5(pid=8730): stdout: | (launched: 2022-12-12_17:46:32.165944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:34.055347 run osmo-stp_10.42.42.5(pid=8730): stderr: | [0;m[38;5;43m20221212174632473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174632473 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174632474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174632474 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174632474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174632475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174632475 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:34.212827 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8730): Process ended prematurely: osmo-stp_10.42.42.5(pid=8730) [trial-2380↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8730)] [trial-2380↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:46:34.222776 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 17:46:34.251214 run osmo-hlr_10.42.42.2(pid=8727): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8727)] 17:46:34.302119 run osmo-hlr_10.42.42.2(pid=8727): stdout: | (launched: 2022-12-12_17:46:30.790464) 17:46:34.354589 run osmo-hlr_10.42.42.2(pid=8727): stderr: | [0;m[1;31m20221212174631112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174631112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174631112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174631112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174631112 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174631113 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174631126 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174631154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174631156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174631156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:34.427845 run osmo-msc_10.42.42.6(pid=8733): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8733)] 17:46:34.478571 run osmo-msc_10.42.42.6(pid=8733): stdout: | (launched: 2022-12-12_17:46:33.267126) 17:46:34.530954 run osmo-msc_10.42.42.6(pid=8733): stderr: | [0;m[38;5;43m20221212174633586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174633586 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f21e7442c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174633586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174633586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174633587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174633587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174633588 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174633589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174633589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174633589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:34.583807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8726): Terminating (SIGTERM) 17:46:34.626459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8729): Terminating (SIGTERM) 17:46:34.668873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8732): Terminating (SIGTERM) 17:46:34.711809 --- ParallelTerminationStrategy: PID 8726 died... 17:46:34.732209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8726): Terminated: ok {rc=0} 17:46:34.779299 --- ParallelTerminationStrategy: PID 8729 died... 17:46:34.799116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8729): Terminated: ok {rc=0} 17:46:34.846214 --- ParallelTerminationStrategy: PID 8732 died... 17:46:34.866103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8732): Terminated: ok {rc=0} 17:46:34.955612 bus /sierra_3: Setting Powered False 17:46:36.055155 bus /sierra_3: Setting Powered False 17:46:37.175231 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:46:38.326964 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:46:38.339394 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:46:38.398079 tst mo_mt_call_osmux.py: using LAC 30454 17:46:38.525678 tst mo_mt_call_osmux.py: using RAC 109 17:46:38.646763 tst mo_mt_call_osmux.py: using CellId 30454 17:46:38.770355 tst mo_mt_call_osmux.py: using BVCI 30455 17:46:38.889989 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:46:38.901838 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:46:38.913322 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:46:38.924701 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:46:38.936135 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:46:38.949075 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:46:39.066970 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:46:39.188272 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:39.697373 run create_hlr_db(pid=8735): Launched 17:46:39.831968 bus /sierra_2: Setting Powered False 17:46:40.897366 run create_hlr_db(pid=8735): Terminated: ok {rc=0} 17:46:41.353933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8737): Launched 17:46:41.682402 run osmo-hlr_10.42.42.2(pid=8738): Launched 17:46:41.807594 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:42.375292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8740): Launched 17:46:42.704275 run osmo-stp_10.42.42.5(pid=8741): Launched 17:46:42.831146 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:43.424523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8743): Launched 17:46:43.754338 run osmo-msc_10.42.42.6(pid=8744): Launched 17:46:43.939725 run osmo-stp_10.42.42.5(pid=8741): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8741)] 17:46:44.077800 run osmo-stp_10.42.42.5(pid=8741): stdout: | (launched: 2022-12-12_17:46:42.643786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:44.216360 run osmo-stp_10.42.42.5(pid=8741): stderr: | [0;m[38;5;43m20221212174642833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174642833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174642833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174642834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174642834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174642834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174642834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:44.352717 run osmo-stp_10.42.42.5(pid=8741): stdout: | (launched: 2022-12-12_17:46:42.643786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:44.483314 run osmo-stp_10.42.42.5(pid=8741): stderr: | [0;m[38;5;43m20221212174642833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174642833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174642833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174642834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174642834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174642834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174642834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:44.639185 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8741): Process ended prematurely: osmo-stp_10.42.42.5(pid=8741) [trial-2380↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8741)] [trial-2380↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:46:44.648781 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:46:44.676561 run osmo-hlr_10.42.42.2(pid=8738): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8738)] 17:46:44.727089 run osmo-hlr_10.42.42.2(pid=8738): stdout: | (launched: 2022-12-12_17:46:41.622046) 17:46:44.779065 run osmo-hlr_10.42.42.2(pid=8738): stderr: | [0;m[1;31m20221212174641820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174641820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174641820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174641820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174641820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174641820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174641836 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174641846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174641846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174641846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:44.851314 run osmo-msc_10.42.42.6(pid=8744): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8744)] 17:46:44.901528 run osmo-msc_10.42.42.6(pid=8744): stdout: | (launched: 2022-12-12_17:46:43.693625) 17:46:44.953377 run osmo-msc_10.42.42.6(pid=8744): stderr: | [0;m[38;5;43m20221212174644014 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174644014 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa9b65a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174644014 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174644014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174644014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174644014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174644016 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174644016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174644017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174644017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:45.005661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8737): Terminating (SIGTERM) 17:46:45.047667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8740): Terminating (SIGTERM) 17:46:45.089685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8743): Terminating (SIGTERM) 17:46:45.132070 --- ParallelTerminationStrategy: PID 8737 died... 17:46:45.152241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8737): Terminated: ok {rc=0} 17:46:45.199104 --- ParallelTerminationStrategy: PID 8740 died... 17:46:45.218900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8740): Terminated: ok {rc=0} 17:46:45.264805 --- ParallelTerminationStrategy: PID 8743 died... 17:46:45.284751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8743): Terminated: ok {rc=0} 17:46:45.373587 bus /sierra_3: Setting Powered False 17:46:46.472228 bus /sierra_3: Setting Powered False 17:46:47.605128 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 emergency:sysmo --------------------------------------------------------------------- 17:46:48.844011 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:46:48.849291 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 17:46:48.870066 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 17:46:48.896900 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 17:46:48.986475 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 17:46:49.008732 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 17:46:49.036209 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 17:46:49.616605 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2380 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 17:46:49.622045 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:46:49.633080 tst emergency:sysmo: Using 1 x bts (candidates: 1) 17:46:49.669767 tst emergency_mo_mt_call.py: using LAC 30455 17:46:49.788534 tst emergency_mo_mt_call.py: using RAC 110 17:46:49.905034 tst emergency_mo_mt_call.py: using CellId 30455 17:46:50.021392 tst emergency_mo_mt_call.py: using BVCI 30456 17:46:50.132273 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:46:50.143219 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:46:50.154017 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:46:50.164786 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:46:50.175661 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:46:50.186493 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:46:50.305951 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:46:50.423169 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:46:50.891800 run create_hlr_db(pid=8750): Launched 17:46:51.007434 bus /sierra_2: Setting Powered False 17:46:52.067542 run create_hlr_db(pid=8750): Terminated: ok {rc=0} 17:46:52.490631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8752): Launched 17:46:52.793513 run osmo-hlr_10.42.42.2(pid=8753): Launched 17:46:52.910031 run osmo-stp_10.42.42.5: Starting osmo-stp 17:46:53.441474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8755): Launched 17:46:53.745104 run osmo-stp_10.42.42.5(pid=8756): Launched 17:46:53.871228 tst emergency_mo_mt_call.py: using MSISDN 7895 17:46:54.037510 run osmo-msc_10.42.42.6: Starting osmo-msc 17:46:54.619363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8758): Launched 17:46:54.943059 run osmo-msc_10.42.42.6(pid=8759): Launched 17:46:55.122232 run osmo-stp_10.42.42.5(pid=8756): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8756)] 17:46:55.257156 run osmo-stp_10.42.42.5(pid=8756): stdout: | (launched: 2022-12-12_17:46:53.688595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:55.392395 run osmo-stp_10.42.42.5(pid=8756): stderr: | [0;m[38;5;43m20221212174653857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174653857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174653857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174653857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174653858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174653858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174653858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:55.527073 run osmo-stp_10.42.42.5(pid=8756): stdout: | (launched: 2022-12-12_17:46:53.688595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:46:55.655406 run osmo-stp_10.42.42.5(pid=8756): stderr: | [0;m[38;5;43m20221212174653857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174653857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174653857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174653857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174653858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174653858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174653858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:46:55.809461 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8756): Process ended prematurely: osmo-stp_10.42.42.5(pid=8756) [trial-2380↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8756)] [trial-2380↪emergency:sysmo↪emergency_mo_mt_call.py:19] 17:46:55.818470 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 17:46:55.845987 run osmo-hlr_10.42.42.2(pid=8753): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8753)] 17:46:55.896386 run osmo-hlr_10.42.42.2(pid=8753): stdout: | (launched: 2022-12-12_17:46:52.737551) 17:46:55.948364 run osmo-hlr_10.42.42.2(pid=8753): stderr: | [0;m[1;31m20221212174652911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174652911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174652911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174652911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174652911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174652911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174652923 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174652931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174652931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174652931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:46:56.020661 run osmo-msc_10.42.42.6(pid=8759): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8759)] 17:46:56.071218 run osmo-msc_10.42.42.6(pid=8759): stdout: | (launched: 2022-12-12_17:46:54.883704) 17:46:56.122977 run osmo-msc_10.42.42.6(pid=8759): stderr: | [0;m[38;5;43m20221212174655202 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174655202 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb25ae99c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174655202 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174655202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174655202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174655203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174655204 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174655205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174655205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174655205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:46:56.174957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8752): Terminating (SIGTERM) 17:46:56.216703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8755): Terminating (SIGTERM) 17:46:56.259239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8758): Terminating (SIGTERM) 17:46:56.301997 --- ParallelTerminationStrategy: PID 8752 died... 17:46:56.322223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8752): Terminated: ok {rc=0} 17:46:56.368926 --- ParallelTerminationStrategy: PID 8755 died... 17:46:56.388711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8755): Terminated: ok {rc=0} 17:46:56.435086 --- ParallelTerminationStrategy: PID 8758 died... 17:46:56.454553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8758): Terminated: ok {rc=0} 17:46:56.542042 bus /sierra_3: Setting Powered False 17:46:57.641319 bus /sierra_3: Setting Powered False 17:46:58.758610 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 17:46:59.846709 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:46:59.858957 tst emergency:sysmo: Using 1 x bts (candidates: 1) 17:46:59.898111 tst emergency_preemptive_call.py: using LAC 30456 17:47:00.019580 tst emergency_preemptive_call.py: using RAC 111 17:47:00.136067 tst emergency_preemptive_call.py: using CellId 30456 17:47:00.255270 tst emergency_preemptive_call.py: using BVCI 30457 17:47:00.363936 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:47:00.374586 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:47:00.385080 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:47:00.395828 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:47:00.406589 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 17:47:00.417323 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:47:00.532305 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:47:00.655224 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:47:00.774952 tst emergency:sysmo: Using 1 x modem (candidates: 4) 17:47:00.903003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:01.406830 run create_hlr_db(pid=8761): Launched 17:47:01.555521 bus /sierra_2: Setting Powered False 17:47:02.615745 run create_hlr_db(pid=8761): Terminated: ok {rc=0} 17:47:03.062066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8763): Launched 17:47:03.387608 run osmo-hlr_10.42.42.2(pid=8764): Launched 17:47:03.511095 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:04.068284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8766): Launched 17:47:04.392695 run osmo-stp_10.42.42.5(pid=8767): Launched 17:47:04.525396 tst emergency_preemptive_call.py: using MSISDN 7896 17:47:04.690717 run osmo-msc_10.42.42.6: Starting osmo-msc 17:47:05.270005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8769): Launched 17:47:05.593618 run osmo-msc_10.42.42.6(pid=8770): Launched 17:47:05.782123 run osmo-stp_10.42.42.5(pid=8767): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8767)] 17:47:05.918019 run osmo-stp_10.42.42.5(pid=8767): stdout: | (launched: 2022-12-12_17:47:04.332201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:06.054620 run osmo-stp_10.42.42.5(pid=8767): stderr: | [0;m[38;5;43m20221212174704522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174704522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174704522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174704523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174704523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174704523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174704523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:06.189231 run osmo-stp_10.42.42.5(pid=8767): stdout: | (launched: 2022-12-12_17:47:04.332201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:06.317927 run osmo-stp_10.42.42.5(pid=8767): stderr: | [0;m[38;5;43m20221212174704522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174704522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174704522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174704523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174704523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174704523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174704523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:06.471903 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8767): Process ended prematurely: osmo-stp_10.42.42.5(pid=8767) [trial-2380↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8767)] [trial-2380↪emergency:sysmo↪emergency_preemptive_call.py:32] 17:47:06.480634 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 17:47:06.507977 run osmo-hlr_10.42.42.2(pid=8764): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8764)] 17:47:06.558578 run osmo-hlr_10.42.42.2(pid=8764): stdout: | (launched: 2022-12-12_17:47:03.327601) 17:47:06.610608 run osmo-hlr_10.42.42.2(pid=8764): stderr: | [0;m[1;31m20221212174703522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174703522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174703522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174703522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174703522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174703522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174703534 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174703545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174703545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174703545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:06.683394 run osmo-msc_10.42.42.6(pid=8770): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8770)] 17:47:06.734130 run osmo-msc_10.42.42.6(pid=8770): stdout: | (launched: 2022-12-12_17:47:05.533783) 17:47:06.786182 run osmo-msc_10.42.42.6(pid=8770): stderr: | [0;m[38;5;43m20221212174705854 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212174705854 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0f36de5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212174705854 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212174705854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212174705854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212174705855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212174705856 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212174705857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212174705857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212174705857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:47:06.838670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8763): Terminating (SIGTERM) 17:47:06.880815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8766): Terminating (SIGTERM) 17:47:06.923067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8769): Terminating (SIGTERM) 17:47:06.965478 --- ParallelTerminationStrategy: PID 8763 died... 17:47:06.985562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8763): Terminated: ok {rc=0} 17:47:07.032161 --- ParallelTerminationStrategy: PID 8766 died... 17:47:07.051778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8766): Terminated: ok {rc=0} 17:47:07.098460 --- ParallelTerminationStrategy: PID 8769 died... 17:47:07.118068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8769): Terminated: ok {rc=0} 17:47:07.205107 bus /sierra_9: Setting Powered False 17:47:08.304450 bus /sierra_9: Setting Powered False 17:47:09.423451 bus /sierra_8: Setting Powered False 17:47:10.523285 bus /sierra_8: Setting Powered False 17:47:11.637801 bus /sierra_3: Setting Powered False 17:47:12.737178 bus /sierra_3: Setting Powered False 17:47:13.852644 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:sysmo --------------------------------------------------------------------- 17:47:15.114945 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:47:15.119204 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 17:47:15.139890 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 17:47:15.179687 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 17:47:15.266986 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 17:47:15.288602 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 17:47:15.328432 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 17:47:15.950497 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 17:47:16.006173 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:16.018209 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:47:16.058268 tst cs_paging_gprs_active.py: using LAC 30457 17:47:16.190345 tst cs_paging_gprs_active.py: using RAC 112 17:47:16.313220 tst cs_paging_gprs_active.py: using CellId 30457 17:47:16.473084 tst cs_paging_gprs_active.py: using BVCI 30458 17:47:16.628011 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:16.642742 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:16.656711 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:16.673177 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:16.689114 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:16.705444 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:16.722566 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:16.739202 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:16.755432 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:47:16.885870 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:47:17.012198 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:47:17.274929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:47:17.590223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8776): Launched 17:47:17.859539 run iperf3-srv_10.42.42.10(pid=8777): Launched 17:47:17.976248 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:47:18.183078 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:47:18.492008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8778): Launched 17:47:18.761203 run iperf3-srv_10.42.42.10(pid=8779): Launched 17:47:18.877377 tst cs_paging_gprs_active.py:38: start network... 17:47:19.083583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:19.558725 run create_hlr_db(pid=8780): Launched 17:47:19.677187 bus /sierra_2: Setting Powered False 17:47:20.738157 run create_hlr_db(pid=8780): Terminated: ok {rc=0} 17:47:21.185453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8782): Launched 17:47:21.515082 run osmo-hlr_10.42.42.2(pid=8783): Launched 17:47:21.641780 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:22.212794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8785): Launched 17:47:22.542809 run osmo-stp_10.42.42.5(pid=8786): Launched 17:47:22.668268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:47:24.258220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8788): Launched 17:47:24.384664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:47:24.663622 run patchelf(pid=8789): Launched 17:47:24.850610 run osmo-stp_10.42.42.5(pid=8786): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8786)] 17:47:24.989184 run osmo-stp_10.42.42.5(pid=8786): stdout: | (launched: 2022-12-12_17:47:22.481859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:25.129267 run osmo-stp_10.42.42.5(pid=8786): stderr: | [0;m[38;5;43m20221212174722670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174722670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174722671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174722671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174722672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174722672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174722672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:25.268770 run osmo-stp_10.42.42.5(pid=8786): stdout: | (launched: 2022-12-12_17:47:22.481859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:25.402714 run osmo-stp_10.42.42.5(pid=8786): stderr: | [0;m[38;5;43m20221212174722670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174722670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174722671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174722671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174722672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174722672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174722672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:25.561827 run patchelf(pid=8789): Terminating (SIGINT) 17:47:25.746463 run patchelf(pid=8789): Terminated: ok {rc=0} 17:47:25.878742 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8786): Process ended prematurely: osmo-stp_10.42.42.5(pid=8786) [trial-2380↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8786)] [trial-2380↪gprs:sysmo↪cs_paging_gprs_active.py:38] 17:47:25.888756 tst cs_paging_gprs_active.py:38: Test FAILED (9.9 sec) 17:47:25.917472 run osmo-hlr_10.42.42.2(pid=8783): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8783)] 17:47:25.967568 run osmo-hlr_10.42.42.2(pid=8783): stdout: | (launched: 2022-12-12_17:47:21.454768) 17:47:26.019366 run osmo-hlr_10.42.42.2(pid=8783): stderr: | [0;m[1;31m20221212174721650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174721650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174721650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174721650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174721650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174721650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174721663 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174721672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174721672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174721672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:26.071492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8776): Terminating (SIGTERM) 17:47:26.113669 run iperf3-srv_10.42.42.10(pid=8777): Terminating (SIGTERM) 17:47:26.155626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8778): Terminating (SIGTERM) 17:47:26.197874 run iperf3-srv_10.42.42.10(pid=8779): Terminating (SIGTERM) 17:47:26.239902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8782): Terminating (SIGTERM) 17:47:26.282086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8785): Terminating (SIGTERM) 17:47:26.323998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8788): Terminating (SIGTERM) 17:47:26.366079 --- ParallelTerminationStrategy: PID 8776 died... 17:47:26.386077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8776): Terminated: ok {rc=0} 17:47:26.432498 --- ParallelTerminationStrategy: PID 8777 died... 17:47:26.452011 run iperf3-srv_10.42.42.10(pid=8777): Terminated {rc=256} 17:47:26.497922 --- ParallelTerminationStrategy: PID 8778 died... 17:47:26.517744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8778): Terminated: ok {rc=0} 17:47:26.564071 --- ParallelTerminationStrategy: PID 8779 died... 17:47:26.583656 run iperf3-srv_10.42.42.10(pid=8779): Terminated {rc=256} 17:47:26.629619 --- ParallelTerminationStrategy: PID 8782 died... 17:47:26.649316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8782): Terminated: ok {rc=0} 17:47:26.695936 --- ParallelTerminationStrategy: PID 8785 died... 17:47:26.715469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8785): Terminated: ok {rc=0} 17:47:26.762368 --- ParallelTerminationStrategy: PID 8788 died... 17:47:26.782055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8788): Terminated: ok {rc=0} 17:47:26.870499 bus /gobi_0: Setting Powered False 17:47:27.970745 bus /gobi_0: Setting Powered False 17:47:29.089462 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo iperf3.py ---------------------------------------------- 17:47:30.242974 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:30.254904 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:47:30.291979 tst iperf3.py: using LAC 30458 17:47:30.422401 tst iperf3.py: using RAC 113 17:47:30.553248 tst iperf3.py: using CellId 30458 17:47:30.675580 tst iperf3.py: using BVCI 30459 17:47:30.789475 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:30.800167 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:30.810928 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:30.822785 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:30.843900 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:30.863786 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:30.880495 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:30.895227 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:30.908492 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:47:31.039283 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:47:31.270509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:47:31.611017 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8790): Launched 17:47:31.921777 run iperf3-srv_10.42.42.10(pid=8791): Launched 17:47:32.047896 tst iperf3.py:8: start network... 17:47:32.260851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:32.772369 run create_hlr_db(pid=8792): Launched 17:47:32.908713 bus /gobi_6: Setting Powered False 17:47:33.970272 run create_hlr_db(pid=8792): Terminated: ok {rc=0} 17:47:34.427234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8794): Launched 17:47:34.759395 run osmo-hlr_10.42.42.2(pid=8795): Launched 17:47:34.886020 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:35.452179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8797): Launched 17:47:35.783315 run osmo-stp_10.42.42.5(pid=8798): Launched 17:47:35.910586 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:47:36.478166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8800): Launched 17:47:36.604615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:47:36.883961 run patchelf(pid=8801): Launched 17:47:37.068467 run osmo-stp_10.42.42.5(pid=8798): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8798)] 17:47:37.206891 run osmo-stp_10.42.42.5(pid=8798): stdout: | (launched: 2022-12-12_17:47:35.722316) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:37.347634 run osmo-stp_10.42.42.5(pid=8798): stderr: | [0;m[38;5;43m20221212174735911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174735911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174735911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174735912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174735912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174735912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174735912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:37.488048 run osmo-stp_10.42.42.5(pid=8798): stdout: | (launched: 2022-12-12_17:47:35.722316) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:37.622557 run osmo-stp_10.42.42.5(pid=8798): stderr: | [0;m[38;5;43m20221212174735911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174735911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174735911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174735912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174735912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174735912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174735912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:37.782341 run patchelf(pid=8801): Terminating (SIGINT) 17:47:37.966454 run patchelf(pid=8801): Terminated: ok {rc=0} 17:47:38.098909 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8798): Process ended prematurely: osmo-stp_10.42.42.5(pid=8798) [trial-2380↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8798)] [trial-2380↪gprs:sysmo↪iperf3.py:8] 17:47:38.109211 tst iperf3.py:8: Test FAILED (7.9 sec) 17:47:38.137837 run osmo-hlr_10.42.42.2(pid=8795): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8795)] 17:47:38.187878 run osmo-hlr_10.42.42.2(pid=8795): stdout: | (launched: 2022-12-12_17:47:34.698301) 17:47:38.239696 run osmo-hlr_10.42.42.2(pid=8795): stderr: | [0;m[1;31m20221212174734895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174734895 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174734896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174734896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174734896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174734896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174734909 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174734921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174734921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174734921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:38.292089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8790): Terminating (SIGTERM) 17:47:38.334156 run iperf3-srv_10.42.42.10(pid=8791): Terminating (SIGTERM) 17:47:38.376222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8794): Terminating (SIGTERM) 17:47:38.418160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8797): Terminating (SIGTERM) 17:47:38.460297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8800): Terminating (SIGTERM) 17:47:38.502746 --- ParallelTerminationStrategy: PID 8790 died... 17:47:38.522941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8790): Terminated: ok {rc=0} 17:47:38.570352 --- ParallelTerminationStrategy: PID 8791 died... 17:47:38.590288 run iperf3-srv_10.42.42.10(pid=8791): Terminated {rc=256} 17:47:38.637628 --- ParallelTerminationStrategy: PID 8794 died... 17:47:38.657382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8794): Terminated: ok {rc=0} 17:47:38.703973 --- ParallelTerminationStrategy: PID 8797 died... 17:47:38.723916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8797): Terminated: ok {rc=0} 17:47:38.771021 --- ParallelTerminationStrategy: PID 8800 died... 17:47:38.790979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8800): Terminated: ok {rc=0} 17:47:38.879722 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo iperf3m4.py ---------------------------------------------- 17:47:40.028043 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:40.039394 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:47:40.075529 tst iperf3m4.py: using LAC 30459 17:47:40.197680 tst iperf3m4.py: using RAC 114 17:47:40.321827 tst iperf3m4.py: using CellId 30459 17:47:40.453270 tst iperf3m4.py: using BVCI 30460 17:47:40.565640 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:40.576200 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:40.586901 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:40.597917 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:40.608449 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:40.619392 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:40.630379 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:40.641383 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:47:40.652274 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:47:40.770242 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:47:40.891828 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:47:41.013222 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:47:41.128340 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:47:41.334696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:47:41.643836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8802): Launched 17:47:41.913315 run iperf3-srv_10.42.42.10(pid=8803): Launched 17:47:42.029567 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:47:42.235395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:47:42.544307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8804): Launched 17:47:42.814236 run iperf3-srv_10.42.42.10(pid=8805): Launched 17:47:42.932062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:47:43.137735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:47:43.449738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8806): Launched 17:47:43.737453 run iperf3-srv_10.42.42.10(pid=8807): Launched 17:47:43.861546 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:47:44.083536 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:47:44.414899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8808): Launched 17:47:44.717537 run iperf3-srv_10.42.42.10(pid=8809): Launched 17:47:44.843570 tst iperf3m4.py:8: start network... 17:47:45.065857 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:47:45.582103 run create_hlr_db(pid=8810): Launched 17:47:45.717688 bus /gobi_6: Setting Powered False 17:47:46.784394 run create_hlr_db(pid=8810): Terminated: ok {rc=0} 17:47:47.313339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8812): Launched 17:47:47.644736 run osmo-hlr_10.42.42.2(pid=8813): Launched 17:47:47.773783 run osmo-stp_10.42.42.5: Starting osmo-stp 17:47:48.345079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8815): Launched 17:47:48.675662 run osmo-stp_10.42.42.5(pid=8816): Launched 17:47:48.803443 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:47:49.368747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8818): Launched 17:47:49.496106 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:47:49.775124 run patchelf(pid=8819): Launched 17:47:49.959626 run osmo-stp_10.42.42.5(pid=8816): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8816)] 17:47:50.098523 run osmo-stp_10.42.42.5(pid=8816): stdout: | (launched: 2022-12-12_17:47:48.615363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:50.238916 run osmo-stp_10.42.42.5(pid=8816): stderr: | [0;m[38;5;43m20221212174748804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174748805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174748805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174748805 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174748806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174748806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174748806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:50.379684 run osmo-stp_10.42.42.5(pid=8816): stdout: | (launched: 2022-12-12_17:47:48.615363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:47:50.514379 run osmo-stp_10.42.42.5(pid=8816): stderr: | [0;m[38;5;43m20221212174748804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174748805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174748805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174748805 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174748806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174748806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174748806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:47:50.673871 run patchelf(pid=8819): Terminating (SIGINT) 17:47:50.858611 run patchelf(pid=8819): Terminated: ok {rc=0} 17:47:50.990308 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8816): Process ended prematurely: osmo-stp_10.42.42.5(pid=8816) [trial-2380↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8816)] [trial-2380↪gprs:sysmo↪iperf3m4.py:8] 17:47:51.000417 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:47:51.029345 run osmo-hlr_10.42.42.2(pid=8813): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8813)] 17:47:51.079645 run osmo-hlr_10.42.42.2(pid=8813): stdout: | (launched: 2022-12-12_17:47:47.584023) 17:47:51.131607 run osmo-hlr_10.42.42.2(pid=8813): stderr: | [0;m[1;31m20221212174747779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174747779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174747779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174747779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174747779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174747779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174747792 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174747801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174747801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174747801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:47:51.183971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8802): Terminating (SIGTERM) 17:47:51.226101 run iperf3-srv_10.42.42.10(pid=8803): Terminating (SIGTERM) 17:47:51.268152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8804): Terminating (SIGTERM) 17:47:51.310160 run iperf3-srv_10.42.42.10(pid=8805): Terminating (SIGTERM) 17:47:51.351957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8806): Terminating (SIGTERM) 17:47:51.394310 run iperf3-srv_10.42.42.10(pid=8807): Terminating (SIGTERM) 17:47:51.436188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8808): Terminating (SIGTERM) 17:47:51.478231 run iperf3-srv_10.42.42.10(pid=8809): Terminating (SIGTERM) 17:47:51.520000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8812): Terminating (SIGTERM) 17:47:51.562346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8815): Terminating (SIGTERM) 17:47:51.604219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8818): Terminating (SIGTERM) 17:47:51.646472 --- ParallelTerminationStrategy: PID 8802 died... 17:47:51.666802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8802): Terminated: ok {rc=0} 17:47:51.713571 --- ParallelTerminationStrategy: PID 8803 died... 17:47:51.733367 run iperf3-srv_10.42.42.10(pid=8803): Terminated {rc=256} 17:47:51.779964 --- ParallelTerminationStrategy: PID 8804 died... 17:47:51.799873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8804): Terminated: ok {rc=0} 17:47:51.846214 --- ParallelTerminationStrategy: PID 8805 died... 17:47:51.865939 run iperf3-srv_10.42.42.10(pid=8805): Terminated {rc=256} 17:47:51.913066 --- ParallelTerminationStrategy: PID 8806 died... 17:47:51.932823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8806): Terminated: ok {rc=0} 17:47:51.979326 --- ParallelTerminationStrategy: PID 8807 died... 17:47:51.999129 run iperf3-srv_10.42.42.10(pid=8807): Terminated {rc=256} 17:47:52.045284 --- ParallelTerminationStrategy: PID 8808 died... 17:47:52.065092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8808): Terminated: ok {rc=0} 17:47:52.111480 --- ParallelTerminationStrategy: PID 8809 died... 17:47:52.131270 run iperf3-srv_10.42.42.10(pid=8809): Terminated {rc=256} 17:47:52.177443 --- ParallelTerminationStrategy: PID 8812 died... 17:47:52.197329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8812): Terminated: ok {rc=0} 17:47:52.243440 --- ParallelTerminationStrategy: PID 8815 died... 17:47:52.263276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8815): Terminated: ok {rc=0} 17:47:52.309529 --- ParallelTerminationStrategy: PID 8818 died... 17:47:52.329538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8818): Terminated: ok {rc=0} 17:47:52.418571 bus /gobi_4: Setting Powered False 17:47:53.519356 bus /gobi_4: Setting Powered False 17:47:54.636585 bus /gobi_1: Setting Powered False 17:47:55.735612 bus /gobi_1: Setting Powered False 17:47:56.853089 bus /gobi_0: Setting Powered False 17:47:57.951095 bus /gobi_0: Setting Powered False 17:47:59.067207 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo ping.py ---------------------------------------------- 17:48:00.166899 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:00.178686 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:48:00.214237 tst ping.py: using LAC 30460 17:48:00.335478 tst ping.py: using RAC 115 17:48:00.457112 tst ping.py: using CellId 30460 17:48:00.584927 tst ping.py: using BVCI 30461 17:48:00.703475 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:00.714792 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:00.725979 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:00.737924 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:00.750024 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:00.761680 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:00.773547 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:00.785477 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:48:00.914601 tst ping.py:19: start network... 17:48:01.146906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:01.658416 run create_hlr_db(pid=8820): Launched 17:48:01.832621 bus /gobi_6: Setting Powered False 17:48:02.895624 run create_hlr_db(pid=8820): Terminated: ok {rc=0} 17:48:03.334217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8822): Launched 17:48:03.636925 run osmo-hlr_10.42.42.2(pid=8823): Launched 17:48:03.753245 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:04.283546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8825): Launched 17:48:04.587224 run osmo-stp_10.42.42.5(pid=8826): Launched 17:48:04.703386 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:48:05.224400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8828): Launched 17:48:05.340824 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:48:05.596389 run patchelf(pid=8829): Launched 17:48:05.765406 run osmo-stp_10.42.42.5(pid=8826): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8826)] 17:48:05.893445 run osmo-stp_10.42.42.5(pid=8826): stdout: | (launched: 2022-12-12_17:48:04.531145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:06.023614 run osmo-stp_10.42.42.5(pid=8826): stderr: | [0;m[38;5;43m20221212174804699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174804699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174804699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174804700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174804700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174804700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174804700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:06.153236 run osmo-stp_10.42.42.5(pid=8826): stdout: | (launched: 2022-12-12_17:48:04.531145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:06.277277 run osmo-stp_10.42.42.5(pid=8826): stderr: | [0;m[38;5;43m20221212174804699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174804699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174804699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174804700 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174804700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174804700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174804700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:06.424199 run patchelf(pid=8829): Terminating (SIGINT) 17:48:06.593603 run patchelf(pid=8829): Terminated: ok {rc=0} 17:48:06.715723 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8826): Process ended prematurely: osmo-stp_10.42.42.5(pid=8826) [trial-2380↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8826)] [trial-2380↪gprs:sysmo↪ping.py:22] 17:48:06.724904 tst ping.py:22: Test FAILED (6.6 sec) 17:48:06.752905 run osmo-hlr_10.42.42.2(pid=8823): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8823)] 17:48:06.801647 run osmo-hlr_10.42.42.2(pid=8823): stdout: | (launched: 2022-12-12_17:48:03.580720) 17:48:06.852510 run osmo-hlr_10.42.42.2(pid=8823): stderr: | [0;m[1;31m20221212174803756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174803756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174803756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174803756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174803756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174803756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174803768 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174803777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174803777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174803777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:06.903474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8822): Terminating (SIGTERM) 17:48:06.944507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8825): Terminating (SIGTERM) 17:48:06.985636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8828): Terminating (SIGTERM) 17:48:07.026999 --- ParallelTerminationStrategy: PID 8822 died... 17:48:07.046590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8822): Terminated: ok {rc=0} 17:48:07.091941 --- ParallelTerminationStrategy: PID 8825 died... 17:48:07.110966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8825): Terminated: ok {rc=0} 17:48:07.156513 --- ParallelTerminationStrategy: PID 8828 died... 17:48:07.175517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8828): Terminated: ok {rc=0} 17:48:07.263491 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 17:48:08.353843 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:08.366014 tst gprs:sysmo: Using 1 x bts (candidates: 1) 17:48:08.404540 tst ping_idle_ping.py: using LAC 30461 17:48:08.526391 tst ping_idle_ping.py: using RAC 116 17:48:08.647177 tst ping_idle_ping.py: using CellId 30461 17:48:08.766012 tst ping_idle_ping.py: using BVCI 30462 17:48:08.876193 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:08.886949 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:08.897552 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:08.907806 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:08.918905 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:08.929597 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:08.940347 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 17:48:08.951016 tst gprs:sysmo: Using 1 x modem (candidates: 4) 17:48:09.077928 tst ping_idle_ping.py:24: start network... 17:48:09.297255 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:09.799982 run create_hlr_db(pid=8830): Launched 17:48:09.934657 bus /gobi_6: Setting Powered False 17:48:10.998485 run create_hlr_db(pid=8830): Terminated: ok {rc=0} 17:48:11.449384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8832): Launched 17:48:11.775683 run osmo-hlr_10.42.42.2(pid=8833): Launched 17:48:11.901185 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:12.459826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8835): Launched 17:48:12.786609 run osmo-stp_10.42.42.5(pid=8836): Launched 17:48:12.913412 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:48:13.475060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8838): Launched 17:48:13.601263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:48:13.876337 run patchelf(pid=8839): Launched 17:48:14.057510 run osmo-stp_10.42.42.5(pid=8836): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8836)] 17:48:14.194071 run osmo-stp_10.42.42.5(pid=8836): stdout: | (launched: 2022-12-12_17:48:12.726702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:14.332445 run osmo-stp_10.42.42.5(pid=8836): stderr: | [0;m[38;5;43m20221212174812917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174812917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174812917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174812918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174812918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174812918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174812918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:14.470578 run osmo-stp_10.42.42.5(pid=8836): stdout: | (launched: 2022-12-12_17:48:12.726702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:14.603364 run osmo-stp_10.42.42.5(pid=8836): stderr: | [0;m[38;5;43m20221212174812917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174812917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174812917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174812918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174812918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174812918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174812918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:14.760618 run patchelf(pid=8839): Terminating (SIGINT) 17:48:14.941898 run patchelf(pid=8839): Terminated: ok {rc=0} 17:48:15.071781 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8836): Process ended prematurely: osmo-stp_10.42.42.5(pid=8836) [trial-2380↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8836)] [trial-2380↪gprs:sysmo↪ping_idle_ping.py:27] 17:48:15.081463 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:48:15.109466 run osmo-hlr_10.42.42.2(pid=8833): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8833)] 17:48:15.159677 run osmo-hlr_10.42.42.2(pid=8833): stdout: | (launched: 2022-12-12_17:48:11.715655) 17:48:15.211186 run osmo-hlr_10.42.42.2(pid=8833): stderr: | [0;m[1;31m20221212174811911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174811911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174811911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174811911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174811911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174811911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174811922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174811931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174811931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174811931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:15.263329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8832): Terminating (SIGTERM) 17:48:15.305373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8835): Terminating (SIGTERM) 17:48:15.347300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8838): Terminating (SIGTERM) 17:48:15.389343 --- ParallelTerminationStrategy: PID 8832 died... 17:48:15.409349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8832): Terminated: ok {rc=0} 17:48:15.455937 --- ParallelTerminationStrategy: PID 8835 died... 17:48:15.475584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8835): Terminated: ok {rc=0} 17:48:15.522464 --- ParallelTerminationStrategy: PID 8838 died... 17:48:15.542307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8838): Terminated: ok {rc=0} 17:48:15.631414 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 17:48:16.939000 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:48:16.944792 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:48:16.980510 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:48:17.030838 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:48:17.123649 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:48:17.152542 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:48:17.198071 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:48:17.779270 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:48:17.833411 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:17.844722 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:48:17.883237 tst cs_paging_gprs_active.py: using LAC 30462 17:48:18.014110 tst cs_paging_gprs_active.py: using RAC 117 17:48:18.144923 tst cs_paging_gprs_active.py: using CellId 30462 17:48:18.273914 tst cs_paging_gprs_active.py: using BVCI 30463 17:48:18.387385 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:18.398381 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:18.409400 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:18.420290 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:18.431109 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:18.442109 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:18.453155 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:18.463850 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:18.474767 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:48:18.596101 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:48:18.714421 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:48:18.923047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:48:19.233428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8843): Launched 17:48:19.502656 run iperf3-srv_10.42.42.10(pid=8844): Launched 17:48:19.620695 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:48:19.827108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:48:20.136336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8845): Launched 17:48:20.405063 run iperf3-srv_10.42.42.10(pid=8846): Launched 17:48:20.521881 tst cs_paging_gprs_active.py:38: start network... 17:48:20.728323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:21.205080 run create_hlr_db(pid=8847): Launched 17:48:21.323284 bus /gobi_6: Setting Powered False 17:48:22.384400 run create_hlr_db(pid=8847): Terminated: ok {rc=0} 17:48:22.833414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8849): Launched 17:48:23.163971 run osmo-hlr_10.42.42.2(pid=8850): Launched 17:48:23.289565 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:23.856051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8852): Launched 17:48:24.188455 run osmo-stp_10.42.42.5(pid=8853): Launched 17:48:24.314423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:48:24.883318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8855): Launched 17:48:25.011878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:48:25.291415 run patchelf(pid=8856): Launched 17:48:25.477147 run osmo-stp_10.42.42.5(pid=8853): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8853)] 17:48:25.616014 run osmo-stp_10.42.42.5(pid=8853): stdout: | (launched: 2022-12-12_17:48:24.127358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:25.756801 run osmo-stp_10.42.42.5(pid=8853): stderr: | [0;m[38;5;43m20221212174824316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174824316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174824317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174824317 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174824317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174824318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174824318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:25.897919 run osmo-stp_10.42.42.5(pid=8853): stdout: | (launched: 2022-12-12_17:48:24.127358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:26.032306 run osmo-stp_10.42.42.5(pid=8853): stderr: | [0;m[38;5;43m20221212174824316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174824316 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174824317 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174824317 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174824317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174824318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174824318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:26.192318 run patchelf(pid=8856): Terminating (SIGINT) 17:48:26.376858 run patchelf(pid=8856): Terminated: ok {rc=0} 17:48:26.509895 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8853): Process ended prematurely: osmo-stp_10.42.42.5(pid=8853) [trial-2380↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8853)] [trial-2380↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:48:26.520205 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:48:26.549091 run osmo-hlr_10.42.42.2(pid=8850): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8850)] 17:48:26.599420 run osmo-hlr_10.42.42.2(pid=8850): stdout: | (launched: 2022-12-12_17:48:23.103604) 17:48:26.651548 run osmo-hlr_10.42.42.2(pid=8850): stderr: | [0;m[1;31m20221212174823300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174823300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174823300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174823300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174823300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174823301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174823312 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174823322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174823322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174823322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:26.704090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8843): Terminating (SIGTERM) 17:48:26.746403 run iperf3-srv_10.42.42.10(pid=8844): Terminating (SIGTERM) 17:48:26.789224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8845): Terminating (SIGTERM) 17:48:26.831756 run iperf3-srv_10.42.42.10(pid=8846): Terminating (SIGTERM) 17:48:26.873534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8849): Terminating (SIGTERM) 17:48:26.915528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8852): Terminating (SIGTERM) 17:48:26.957359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8855): Terminating (SIGTERM) 17:48:26.999764 --- ParallelTerminationStrategy: PID 8843 died... 17:48:27.020145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8843): Terminated: ok {rc=0} 17:48:27.066638 --- ParallelTerminationStrategy: PID 8844 died... 17:48:27.086037 run iperf3-srv_10.42.42.10(pid=8844): Terminated {rc=256} 17:48:27.132038 --- ParallelTerminationStrategy: PID 8845 died... 17:48:27.151633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8845): Terminated: ok {rc=0} 17:48:27.197890 --- ParallelTerminationStrategy: PID 8846 died... 17:48:27.217487 run iperf3-srv_10.42.42.10(pid=8846): Terminated {rc=256} 17:48:27.263195 --- ParallelTerminationStrategy: PID 8849 died... 17:48:27.282752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8849): Terminated: ok {rc=0} 17:48:27.328722 --- ParallelTerminationStrategy: PID 8852 died... 17:48:27.348402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8852): Terminated: ok {rc=0} 17:48:27.394634 --- ParallelTerminationStrategy: PID 8855 died... 17:48:27.414405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8855): Terminated: ok {rc=0} 17:48:27.503145 bus /gobi_0: Setting Powered False 17:48:28.603347 bus /gobi_0: Setting Powered False 17:48:29.720686 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:48:30.878266 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:30.903140 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:48:30.948479 tst iperf3.py: using LAC 30463 17:48:31.080165 tst iperf3.py: using RAC 118 17:48:31.251015 tst iperf3.py: using CellId 30463 17:48:31.397928 tst iperf3.py: using BVCI 30464 17:48:31.516212 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:31.529271 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:31.540665 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:31.553713 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:31.565797 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:31.579236 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:31.592324 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:31.604098 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:31.616559 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:48:31.742392 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:48:31.998294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:48:32.331787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8857): Launched 17:48:32.619105 run iperf3-srv_10.42.42.10(pid=8858): Launched 17:48:32.742918 tst iperf3.py:8: start network... 17:48:32.964778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:33.474371 run create_hlr_db(pid=8859): Launched 17:48:33.610234 bus /gobi_6: Setting Powered False 17:48:34.675168 run create_hlr_db(pid=8859): Terminated: ok {rc=0} 17:48:35.134034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8861): Launched 17:48:35.464901 run osmo-hlr_10.42.42.2(pid=8862): Launched 17:48:35.592090 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:36.159623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8864): Launched 17:48:36.491401 run osmo-stp_10.42.42.5(pid=8865): Launched 17:48:36.618813 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:48:37.186844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8867): Launched 17:48:37.314161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:48:37.592269 run patchelf(pid=8868): Launched 17:48:37.777068 run osmo-stp_10.42.42.5(pid=8865): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8865)] 17:48:37.915655 run osmo-stp_10.42.42.5(pid=8865): stdout: | (launched: 2022-12-12_17:48:36.430970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:38.055797 run osmo-stp_10.42.42.5(pid=8865): stderr: | [0;m[38;5;43m20221212174836623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174836623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174836624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174836624 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174836624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174836625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174836625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:38.196005 run osmo-stp_10.42.42.5(pid=8865): stdout: | (launched: 2022-12-12_17:48:36.430970) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:38.330210 run osmo-stp_10.42.42.5(pid=8865): stderr: | [0;m[38;5;43m20221212174836623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174836623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174836624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174836624 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174836624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174836625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174836625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:38.488746 run patchelf(pid=8868): Terminating (SIGINT) 17:48:38.672587 run patchelf(pid=8868): Terminated: ok {rc=0} 17:48:38.805405 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8865): Process ended prematurely: osmo-stp_10.42.42.5(pid=8865) [trial-2380↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8865)] [trial-2380↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 17:48:38.815734 tst iperf3.py:8: Test FAILED (8.0 sec) 17:48:38.844547 run osmo-hlr_10.42.42.2(pid=8862): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8862)] 17:48:38.894653 run osmo-hlr_10.42.42.2(pid=8862): stdout: | (launched: 2022-12-12_17:48:35.404298) 17:48:38.946583 run osmo-hlr_10.42.42.2(pid=8862): stderr: | [0;m[1;31m20221212174835602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174835602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174835602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174835602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174835603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174835603 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174835615 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174835624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174835624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174835624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:38.998976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8857): Terminating (SIGTERM) 17:48:39.040937 run iperf3-srv_10.42.42.10(pid=8858): Terminating (SIGTERM) 17:48:39.083221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8861): Terminating (SIGTERM) 17:48:39.125412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8864): Terminating (SIGTERM) 17:48:39.167124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8867): Terminating (SIGTERM) 17:48:39.209238 --- ParallelTerminationStrategy: PID 8857 died... 17:48:39.229337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8857): Terminated: ok {rc=0} 17:48:39.275701 --- ParallelTerminationStrategy: PID 8858 died... 17:48:39.295180 run iperf3-srv_10.42.42.10(pid=8858): Terminated {rc=256} 17:48:39.340893 --- ParallelTerminationStrategy: PID 8861 died... 17:48:39.360827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8861): Terminated: ok {rc=0} 17:48:39.406729 --- ParallelTerminationStrategy: PID 8864 died... 17:48:39.426246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8864): Terminated: ok {rc=0} 17:48:39.472199 --- ParallelTerminationStrategy: PID 8867 died... 17:48:39.491678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8867): Terminated: ok {rc=0} 17:48:39.579583 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:48:40.732362 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:40.744334 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:48:40.785850 tst iperf3m4.py: using LAC 30464 17:48:40.918498 tst iperf3m4.py: using RAC 119 17:48:41.047489 tst iperf3m4.py: using CellId 30464 17:48:41.175779 tst iperf3m4.py: using BVCI 30465 17:48:41.295827 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:41.307236 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:41.318512 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:41.330367 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:41.342199 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:41.353885 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:41.365824 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:41.377392 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:48:41.389253 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:48:41.509294 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:48:41.631162 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:48:41.752070 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:48:41.874268 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:48:42.099344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:48:42.432486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8869): Launched 17:48:42.722934 run iperf3-srv_10.42.42.10(pid=8870): Launched 17:48:42.849553 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:48:43.071575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:48:43.403008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8871): Launched 17:48:43.690051 run iperf3-srv_10.42.42.10(pid=8872): Launched 17:48:43.814424 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:48:44.035854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:48:44.366779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8873): Launched 17:48:44.655198 run iperf3-srv_10.42.42.10(pid=8874): Launched 17:48:44.780691 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:48:45.002074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:48:45.333738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8875): Launched 17:48:45.621322 run iperf3-srv_10.42.42.10(pid=8876): Launched 17:48:45.746534 tst iperf3m4.py:8: start network... 17:48:45.973297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:48:46.484468 run create_hlr_db(pid=8877): Launched 17:48:46.650598 bus /gobi_6: Setting Powered False 17:48:47.716569 run create_hlr_db(pid=8877): Terminated: ok {rc=0} 17:48:48.157261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8879): Launched 17:48:48.466191 run osmo-hlr_10.42.42.2(pid=8880): Launched 17:48:48.585131 run osmo-stp_10.42.42.5: Starting osmo-stp 17:48:49.127790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8882): Launched 17:48:49.436704 run osmo-stp_10.42.42.5(pid=8883): Launched 17:48:49.554887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:48:50.083586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8885): Launched 17:48:50.202827 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:48:50.462635 run patchelf(pid=8886): Launched 17:48:50.635383 run osmo-stp_10.42.42.5(pid=8883): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8883)] 17:48:50.765447 run osmo-stp_10.42.42.5(pid=8883): stdout: | (launched: 2022-12-12_17:48:49.379812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:50.896751 run osmo-stp_10.42.42.5(pid=8883): stderr: | [0;m[38;5;43m20221212174849549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174849549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174849550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174849550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174849550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174849551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174849551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:51.028422 run osmo-stp_10.42.42.5(pid=8883): stdout: | (launched: 2022-12-12_17:48:49.379812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:48:51.154304 run osmo-stp_10.42.42.5(pid=8883): stderr: | [0;m[38;5;43m20221212174849549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174849549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174849550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174849550 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174849550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174849551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174849551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:48:51.303427 run patchelf(pid=8886): Terminating (SIGINT) 17:48:51.475745 run patchelf(pid=8886): Terminated: ok {rc=0} 17:48:51.599699 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8883): Process ended prematurely: osmo-stp_10.42.42.5(pid=8883) [trial-2380↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8883)] [trial-2380↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 17:48:51.609306 tst iperf3m4.py:8: Test FAILED (10.9 sec) 17:48:51.637613 run osmo-hlr_10.42.42.2(pid=8880): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8880)] 17:48:51.685867 run osmo-hlr_10.42.42.2(pid=8880): stdout: | (launched: 2022-12-12_17:48:48.409197) 17:48:51.735649 run osmo-hlr_10.42.42.2(pid=8880): stderr: | [0;m[1;31m20221212174848583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174848583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174848583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174848583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174848584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174848584 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174848596 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174848606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174848606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174848606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:48:51.785957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8869): Terminating (SIGTERM) 17:48:51.825580 run iperf3-srv_10.42.42.10(pid=8870): Terminating (SIGTERM) 17:48:51.865525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8871): Terminating (SIGTERM) 17:48:51.906411 run iperf3-srv_10.42.42.10(pid=8872): Terminating (SIGTERM) 17:48:51.946217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8873): Terminating (SIGTERM) 17:48:51.986023 run iperf3-srv_10.42.42.10(pid=8874): Terminating (SIGTERM) 17:48:52.025829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8875): Terminating (SIGTERM) 17:48:52.065340 run iperf3-srv_10.42.42.10(pid=8876): Terminating (SIGTERM) 17:48:52.105321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8879): Terminating (SIGTERM) 17:48:52.145801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8882): Terminating (SIGTERM) 17:48:52.185512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8885): Terminating (SIGTERM) 17:48:52.226008 --- ParallelTerminationStrategy: PID 8869 died... 17:48:52.245042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8869): Terminated: ok {rc=0} 17:48:52.289701 --- ParallelTerminationStrategy: PID 8870 died... 17:48:52.308352 run iperf3-srv_10.42.42.10(pid=8870): Terminated {rc=256} 17:48:52.352599 --- ParallelTerminationStrategy: PID 8871 died... 17:48:52.371370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8871): Terminated: ok {rc=0} 17:48:52.415737 --- ParallelTerminationStrategy: PID 8872 died... 17:48:52.434393 run iperf3-srv_10.42.42.10(pid=8872): Terminated {rc=256} 17:48:52.478736 --- ParallelTerminationStrategy: PID 8873 died... 17:48:52.497251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8873): Terminated: ok {rc=0} 17:48:52.541717 --- ParallelTerminationStrategy: PID 8874 died... 17:48:52.560442 run iperf3-srv_10.42.42.10(pid=8874): Terminated {rc=256} 17:48:52.604816 --- ParallelTerminationStrategy: PID 8875 died... 17:48:52.623943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8875): Terminated: ok {rc=0} 17:48:52.668718 --- ParallelTerminationStrategy: PID 8876 died... 17:48:52.687498 run iperf3-srv_10.42.42.10(pid=8876): Terminated {rc=256} 17:48:52.731980 --- ParallelTerminationStrategy: PID 8879 died... 17:48:52.750754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8879): Terminated: ok {rc=0} 17:48:52.795141 --- ParallelTerminationStrategy: PID 8882 died... 17:48:52.813894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8882): Terminated: ok {rc=0} 17:48:52.858733 --- ParallelTerminationStrategy: PID 8885 died... 17:48:52.877411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8885): Terminated: ok {rc=0} 17:48:52.964569 bus /gobi_4: Setting Powered False 17:48:54.068231 bus /gobi_4: Setting Powered False 17:48:55.185301 bus /gobi_1: Setting Powered False 17:48:56.282263 bus /gobi_1: Setting Powered False 17:48:57.400633 bus /gobi_0: Setting Powered False 17:48:58.497275 bus /gobi_0: Setting Powered False 17:48:59.615133 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 17:49:00.720286 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:00.732528 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:49:00.771154 tst ping.py: using LAC 30465 17:49:00.924258 tst ping.py: using RAC 120 17:49:01.053296 tst ping.py: using CellId 30465 17:49:01.176444 tst ping.py: using BVCI 30466 17:49:01.296775 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:01.309237 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:01.321366 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:01.333512 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:01.346149 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:01.358302 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:01.370448 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:01.382661 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:49:01.506039 tst ping.py:19: start network... 17:49:01.732697 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:02.283846 run create_hlr_db(pid=8888): Launched 17:49:02.405295 bus /gobi_6: Setting Powered False 17:49:03.465597 run create_hlr_db(pid=8888): Terminated: ok {rc=0} 17:49:03.889852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8890): Launched 17:49:04.194024 run osmo-hlr_10.42.42.2(pid=8891): Launched 17:49:04.309690 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:04.840425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8893): Launched 17:49:05.143013 run osmo-stp_10.42.42.5(pid=8894): Launched 17:49:05.259060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:49:05.779496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8896): Launched 17:49:05.896890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:49:06.152436 run patchelf(pid=8897): Launched 17:49:06.321197 run osmo-stp_10.42.42.5(pid=8894): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8894)] 17:49:06.448653 run osmo-stp_10.42.42.5(pid=8894): stdout: | (launched: 2022-12-12_17:49:05.086925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:06.577768 run osmo-stp_10.42.42.5(pid=8894): stderr: | [0;m[38;5;43m20221212174905255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174905255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174905256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174905256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174905257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174905257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174905257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:06.707391 run osmo-stp_10.42.42.5(pid=8894): stdout: | (launched: 2022-12-12_17:49:05.086925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:06.831388 run osmo-stp_10.42.42.5(pid=8894): stderr: | [0;m[38;5;43m20221212174905255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174905255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174905256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174905256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174905257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174905257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174905257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:06.978156 run patchelf(pid=8897): Terminating (SIGINT) 17:49:07.147391 run patchelf(pid=8897): Terminated: ok {rc=0} 17:49:07.269124 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8894): Process ended prematurely: osmo-stp_10.42.42.5(pid=8894) [trial-2380↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8894)] [trial-2380↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 17:49:07.278086 tst ping.py:22: Test FAILED (6.6 sec) 17:49:07.305702 run osmo-hlr_10.42.42.2(pid=8891): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8891)] 17:49:07.354320 run osmo-hlr_10.42.42.2(pid=8891): stdout: | (launched: 2022-12-12_17:49:04.137804) 17:49:07.404554 run osmo-hlr_10.42.42.2(pid=8891): stderr: | [0;m[1;31m20221212174904311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174904311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174904311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174904311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174904311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174904311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174904323 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174904333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174904333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174904333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:07.455082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8890): Terminating (SIGTERM) 17:49:07.495741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8893): Terminating (SIGTERM) 17:49:07.536336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8896): Terminating (SIGTERM) 17:49:07.577249 --- ParallelTerminationStrategy: PID 8890 died... 17:49:07.596663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8890): Terminated: ok {rc=0} 17:49:07.642261 --- ParallelTerminationStrategy: PID 8893 died... 17:49:07.661183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8893): Terminated: ok {rc=0} 17:49:07.707041 --- ParallelTerminationStrategy: PID 8896 died... 17:49:07.725924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8896): Terminated: ok {rc=0} 17:49:07.811321 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:49:08.899490 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:08.912237 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:49:08.953909 tst ping_idle_ping.py: using LAC 30466 17:49:09.082794 tst ping_idle_ping.py: using RAC 121 17:49:09.211192 tst ping_idle_ping.py: using CellId 30466 17:49:09.337653 tst ping_idle_ping.py: using BVCI 30467 17:49:09.456081 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:09.467808 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:09.479195 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:09.491038 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:09.502772 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:09.514499 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:09.526529 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:49:09.538330 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:49:09.663660 tst ping_idle_ping.py:24: start network... 17:49:09.866492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:10.335035 run create_hlr_db(pid=8898): Launched 17:49:10.453823 bus /gobi_6: Setting Powered False 17:49:11.514174 run create_hlr_db(pid=8898): Terminated: ok {rc=0} 17:49:11.958180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8900): Launched 17:49:12.282919 run osmo-hlr_10.42.42.2(pid=8901): Launched 17:49:12.410725 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:12.971008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8903): Launched 17:49:13.296788 run osmo-stp_10.42.42.5(pid=8904): Launched 17:49:13.423328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:49:13.986291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8906): Launched 17:49:14.111087 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:49:14.386394 run patchelf(pid=8907): Launched 17:49:14.566770 run osmo-stp_10.42.42.5(pid=8904): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8904)] 17:49:14.703386 run osmo-stp_10.42.42.5(pid=8904): stdout: | (launched: 2022-12-12_17:49:13.237302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:14.842408 run osmo-stp_10.42.42.5(pid=8904): stderr: | [0;m[38;5;43m20221212174913426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174913426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174913427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174913427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174913427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174913428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174913428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:14.980582 run osmo-stp_10.42.42.5(pid=8904): stdout: | (launched: 2022-12-12_17:49:13.237302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:15.113563 run osmo-stp_10.42.42.5(pid=8904): stderr: | [0;m[38;5;43m20221212174913426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174913426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174913427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174913427 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174913427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174913428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174913428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:15.271014 run patchelf(pid=8907): Terminating (SIGINT) 17:49:15.453058 run patchelf(pid=8907): Terminated: ok {rc=0} 17:49:15.583547 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8904): Process ended prematurely: osmo-stp_10.42.42.5(pid=8904) [trial-2380↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8904)] [trial-2380↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 17:49:15.593376 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:49:15.621409 run osmo-hlr_10.42.42.2(pid=8901): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8901)] 17:49:15.671508 run osmo-hlr_10.42.42.2(pid=8901): stdout: | (launched: 2022-12-12_17:49:12.223482) 17:49:15.723218 run osmo-hlr_10.42.42.2(pid=8901): stderr: | [0;m[1;31m20221212174912418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174912418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174912418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174912418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174912418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174912418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174912429 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174912438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174912439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174912439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:15.775624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8900): Terminating (SIGTERM) 17:49:15.818180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8903): Terminating (SIGTERM) 17:49:15.861402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8906): Terminating (SIGTERM) 17:49:15.904572 --- ParallelTerminationStrategy: PID 8900 died... 17:49:15.924714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8900): Terminated: ok {rc=0} 17:49:15.972261 --- ParallelTerminationStrategy: PID 8903 died... 17:49:15.992466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8903): Terminated: ok {rc=0} 17:49:16.039268 --- ParallelTerminationStrategy: PID 8906 died... 17:49:16.059536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8906): Terminated: ok {rc=0} 17:49:16.151085 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:49:17.444221 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:49:17.450751 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:49:17.472124 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:49:17.514890 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:49:17.602629 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:49:17.623387 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:49:17.663003 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:49:18.254801 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:49:18.305523 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:18.316435 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:49:18.372355 tst cs_paging_gprs_active.py: using LAC 30467 17:49:18.494317 tst cs_paging_gprs_active.py: using RAC 122 17:49:18.616378 tst cs_paging_gprs_active.py: using CellId 30467 17:49:18.736431 tst cs_paging_gprs_active.py: using BVCI 30468 17:49:18.847866 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:18.858802 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:18.869549 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:18.880395 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:18.891904 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:18.903094 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:18.914387 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:18.925439 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:18.937254 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:49:19.055144 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:49:19.176772 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:49:19.400329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:19.731581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8911): Launched 17:49:20.019320 run iperf3-srv_10.42.42.10(pid=8912): Launched 17:49:20.144815 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:49:20.367147 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:20.698697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8913): Launched 17:49:20.986715 run iperf3-srv_10.42.42.10(pid=8914): Launched 17:49:21.112503 tst cs_paging_gprs_active.py:38: start network... 17:49:21.335663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:21.849854 run create_hlr_db(pid=8915): Launched 17:49:21.985779 bus /gobi_6: Setting Powered False 17:49:23.050860 run create_hlr_db(pid=8915): Terminated: ok {rc=0} 17:49:23.492439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8917): Launched 17:49:23.802779 run osmo-hlr_10.42.42.2(pid=8918): Launched 17:49:23.921186 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:24.456506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8920): Launched 17:49:24.766724 run osmo-stp_10.42.42.5(pid=8921): Launched 17:49:24.885292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:49:25.417484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8923): Launched 17:49:25.536285 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:49:25.798704 run patchelf(pid=8924): Launched 17:49:25.971056 run osmo-stp_10.42.42.5(pid=8921): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8921)] 17:49:26.101364 run osmo-stp_10.42.42.5(pid=8921): stdout: | (launched: 2022-12-12_17:49:24.709333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:26.233329 run osmo-stp_10.42.42.5(pid=8921): stderr: | [0;m[38;5;43m20221212174924880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174924880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174924880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174924881 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174924881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174924881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174924881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:26.365227 run osmo-stp_10.42.42.5(pid=8921): stdout: | (launched: 2022-12-12_17:49:24.709333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:26.491337 run osmo-stp_10.42.42.5(pid=8921): stderr: | [0;m[38;5;43m20221212174924880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174924880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174924880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174924881 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174924881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174924881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174924881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:26.641099 run patchelf(pid=8924): Terminating (SIGINT) 17:49:26.814045 run patchelf(pid=8924): Terminated: ok {rc=0} 17:49:26.938130 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8921): Process ended prematurely: osmo-stp_10.42.42.5(pid=8921) [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8921)] [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:49:26.947594 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:49:26.975205 run osmo-hlr_10.42.42.2(pid=8918): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8918)] 17:49:27.023545 run osmo-hlr_10.42.42.2(pid=8918): stdout: | (launched: 2022-12-12_17:49:23.745887) 17:49:27.073483 run osmo-hlr_10.42.42.2(pid=8918): stderr: | [0;m[1;31m20221212174923924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174923924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174923924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174923924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174923924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174923924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174923936 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174923945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174923945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174923945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:27.124096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8911): Terminating (SIGTERM) 17:49:27.164407 run iperf3-srv_10.42.42.10(pid=8912): Terminating (SIGTERM) 17:49:27.204817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8913): Terminating (SIGTERM) 17:49:27.245072 run iperf3-srv_10.42.42.10(pid=8914): Terminating (SIGTERM) 17:49:27.285409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8917): Terminating (SIGTERM) 17:49:27.325720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8920): Terminating (SIGTERM) 17:49:27.365819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8923): Terminating (SIGTERM) 17:49:27.406359 --- ParallelTerminationStrategy: PID 8911 died... 17:49:27.425492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8911): Terminated: ok {rc=0} 17:49:27.470709 --- ParallelTerminationStrategy: PID 8912 died... 17:49:27.489541 run iperf3-srv_10.42.42.10(pid=8912): Terminated {rc=256} 17:49:27.534125 --- ParallelTerminationStrategy: PID 8913 died... 17:49:27.552867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8913): Terminated: ok {rc=0} 17:49:27.597438 --- ParallelTerminationStrategy: PID 8914 died... 17:49:27.616021 run iperf3-srv_10.42.42.10(pid=8914): Terminated {rc=256} 17:49:27.660488 --- ParallelTerminationStrategy: PID 8917 died... 17:49:27.679186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8917): Terminated: ok {rc=0} 17:49:27.723643 --- ParallelTerminationStrategy: PID 8920 died... 17:49:27.742487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8920): Terminated: ok {rc=0} 17:49:27.787193 --- ParallelTerminationStrategy: PID 8923 died... 17:49:27.806103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8923): Terminated: ok {rc=0} 17:49:27.891391 bus /gobi_0: Setting Powered False 17:49:28.987307 bus /gobi_0: Setting Powered False 17:49:30.102633 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:49:31.256499 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:31.269470 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:49:31.332223 tst iperf3.py: using LAC 30468 17:49:31.458651 tst iperf3.py: using RAC 123 17:49:31.609701 tst iperf3.py: using CellId 30468 17:49:31.768610 tst iperf3.py: using BVCI 30469 17:49:31.900807 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:31.913012 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:31.926984 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:31.939190 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:31.951536 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:31.964537 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:31.977400 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:31.990058 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:32.003020 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:49:32.128469 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:49:32.357595 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:32.689491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8925): Launched 17:49:32.977334 run iperf3-srv_10.42.42.10(pid=8926): Launched 17:49:33.101702 tst iperf3.py:8: start network... 17:49:33.323688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:33.834162 run create_hlr_db(pid=8927): Launched 17:49:33.970305 bus /gobi_6: Setting Powered False 17:49:35.035556 run create_hlr_db(pid=8927): Terminated: ok {rc=0} 17:49:35.491940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8930): Launched 17:49:35.823734 run osmo-hlr_10.42.42.2(pid=8931): Launched 17:49:35.948798 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:36.520252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8933): Launched 17:49:36.851210 run osmo-stp_10.42.42.5(pid=8934): Launched 17:49:36.977455 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:49:37.543777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8936): Launched 17:49:37.672337 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:49:37.951631 run patchelf(pid=8937): Launched 17:49:38.137572 run osmo-stp_10.42.42.5(pid=8934): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8934)] 17:49:38.276340 run osmo-stp_10.42.42.5(pid=8934): stdout: | (launched: 2022-12-12_17:49:36.790544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:38.416362 run osmo-stp_10.42.42.5(pid=8934): stderr: | [0;m[38;5;43m20221212174936981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174936981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174936981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174936982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174936982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174936982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174936982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:38.556880 run osmo-stp_10.42.42.5(pid=8934): stdout: | (launched: 2022-12-12_17:49:36.790544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:38.691384 run osmo-stp_10.42.42.5(pid=8934): stderr: | [0;m[38;5;43m20221212174936981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174936981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174936981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174936982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174936982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174936982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174936982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:38.851868 run patchelf(pid=8937): Terminating (SIGINT) 17:49:39.035816 run patchelf(pid=8937): Terminated: ok {rc=0} 17:49:39.168132 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8934): Process ended prematurely: osmo-stp_10.42.42.5(pid=8934) [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8934)] [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 17:49:39.178448 tst iperf3.py:8: Test FAILED (8.0 sec) 17:49:39.207007 run osmo-hlr_10.42.42.2(pid=8931): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8931)] 17:49:39.257791 run osmo-hlr_10.42.42.2(pid=8931): stdout: | (launched: 2022-12-12_17:49:35.762912) 17:49:39.309661 run osmo-hlr_10.42.42.2(pid=8931): stderr: | [0;m[1;31m20221212174935961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174935961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174935961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174935961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174935961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174935962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174935974 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174935983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174935983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174935983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:39.362396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8925): Terminating (SIGTERM) 17:49:39.404314 run iperf3-srv_10.42.42.10(pid=8926): Terminating (SIGTERM) 17:49:39.446284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8930): Terminating (SIGTERM) 17:49:39.488306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8933): Terminating (SIGTERM) 17:49:39.530078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8936): Terminating (SIGTERM) 17:49:39.572641 --- ParallelTerminationStrategy: PID 8925 died... 17:49:39.593168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8925): Terminated: ok {rc=0} 17:49:39.639909 --- ParallelTerminationStrategy: PID 8926 died... 17:49:39.659572 run iperf3-srv_10.42.42.10(pid=8926): Terminated {rc=256} 17:49:39.706859 --- ParallelTerminationStrategy: PID 8930 died... 17:49:39.726577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8930): Terminated: ok {rc=0} 17:49:39.772937 --- ParallelTerminationStrategy: PID 8933 died... 17:49:39.792845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8933): Terminated: ok {rc=0} 17:49:39.839170 --- ParallelTerminationStrategy: PID 8936 died... 17:49:39.859234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8936): Terminated: ok {rc=0} 17:49:39.947553 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:49:41.098501 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:41.110684 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:49:41.169657 tst iperf3m4.py: using LAC 30469 17:49:41.299283 tst iperf3m4.py: using RAC 124 17:49:41.427895 tst iperf3m4.py: using CellId 30469 17:49:41.558300 tst iperf3m4.py: using BVCI 30470 17:49:41.672268 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:41.683780 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:41.694788 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:41.706352 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:41.717933 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:41.729432 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:41.741128 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:41.752540 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:49:41.764332 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:49:41.888575 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:49:42.007707 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:49:42.130329 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:49:42.250984 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:49:42.464087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:42.773690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8938): Launched 17:49:43.042978 run iperf3-srv_10.42.42.10(pid=8939): Launched 17:49:43.160050 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:49:43.367333 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:43.677578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8940): Launched 17:49:43.947211 run iperf3-srv_10.42.42.10(pid=8941): Launched 17:49:44.065335 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:49:44.271332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:44.580390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8942): Launched 17:49:44.849584 run iperf3-srv_10.42.42.10(pid=8943): Launched 17:49:44.965916 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:49:45.172220 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:49:45.481960 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8944): Launched 17:49:45.753952 run iperf3-srv_10.42.42.10(pid=8945): Launched 17:49:45.902460 tst iperf3m4.py:8: start network... 17:49:46.130560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:49:46.617073 run create_hlr_db(pid=8946): Launched 17:49:46.796926 bus /gobi_6: Setting Powered False 17:49:47.858703 run create_hlr_db(pid=8946): Terminated: ok {rc=0} 17:49:48.354917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8948): Launched 17:49:48.687165 run osmo-hlr_10.42.42.2(pid=8949): Launched 17:49:48.814617 run osmo-stp_10.42.42.5: Starting osmo-stp 17:49:49.386652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8951): Launched 17:49:49.717940 run osmo-stp_10.42.42.5(pid=8952): Launched 17:49:49.844314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:49:50.410875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8954): Launched 17:49:50.537793 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:49:50.816321 run patchelf(pid=8955): Launched 17:49:50.999506 run osmo-stp_10.42.42.5(pid=8952): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8952)] 17:49:51.138447 run osmo-stp_10.42.42.5(pid=8952): stdout: | (launched: 2022-12-12_17:49:49.657160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:51.278612 run osmo-stp_10.42.42.5(pid=8952): stderr: | [0;m[38;5;43m20221212174949849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174949849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174949849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174949849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174949850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174949850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174949850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:51.419096 run osmo-stp_10.42.42.5(pid=8952): stdout: | (launched: 2022-12-12_17:49:49.657160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:49:51.553603 run osmo-stp_10.42.42.5(pid=8952): stderr: | [0;m[38;5;43m20221212174949849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212174949849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212174949849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212174949849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212174949850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212174949850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212174949850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:49:51.714057 run patchelf(pid=8955): Terminating (SIGINT) 17:49:51.898174 run patchelf(pid=8955): Terminated: ok {rc=0} 17:49:52.030433 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8952): Process ended prematurely: osmo-stp_10.42.42.5(pid=8952) [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8952)] [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:49:52.040609 tst iperf3m4.py:8: Test FAILED (11.0 sec) 17:49:52.069450 run osmo-hlr_10.42.42.2(pid=8949): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8949)] 17:49:52.120173 run osmo-hlr_10.42.42.2(pid=8949): stdout: | (launched: 2022-12-12_17:49:48.626287) 17:49:52.172104 run osmo-hlr_10.42.42.2(pid=8949): stderr: | [0;m[1;31m20221212174948821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212174948821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212174948822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212174948822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212174948822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212174948822 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212174948836 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212174948845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212174948845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212174948845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:49:52.224218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8938): Terminating (SIGTERM) 17:49:52.266162 run iperf3-srv_10.42.42.10(pid=8939): Terminating (SIGTERM) 17:49:52.308099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8940): Terminating (SIGTERM) 17:49:52.350177 run iperf3-srv_10.42.42.10(pid=8941): Terminating (SIGTERM) 17:49:52.392059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8942): Terminating (SIGTERM) 17:49:52.433987 run iperf3-srv_10.42.42.10(pid=8943): Terminating (SIGTERM) 17:49:52.475722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8944): Terminating (SIGTERM) 17:49:52.517750 run iperf3-srv_10.42.42.10(pid=8945): Terminating (SIGTERM) 17:49:52.559552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8948): Terminating (SIGTERM) 17:49:52.601309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8951): Terminating (SIGTERM) 17:49:52.642976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8954): Terminating (SIGTERM) 17:49:52.684889 --- ParallelTerminationStrategy: PID 8938 died... 17:49:52.705197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8938): Terminated: ok {rc=0} 17:49:52.751594 --- ParallelTerminationStrategy: PID 8939 died... 17:49:52.771230 run iperf3-srv_10.42.42.10(pid=8939): Terminated {rc=256} 17:49:52.817779 --- ParallelTerminationStrategy: PID 8940 died... 17:49:52.837319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8940): Terminated: ok {rc=0} 17:49:52.883725 --- ParallelTerminationStrategy: PID 8941 died... 17:49:52.903374 run iperf3-srv_10.42.42.10(pid=8941): Terminated {rc=256} 17:49:52.949313 --- ParallelTerminationStrategy: PID 8942 died... 17:49:52.968989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8942): Terminated: ok {rc=0} 17:49:53.015253 --- ParallelTerminationStrategy: PID 8943 died... 17:49:53.034744 run iperf3-srv_10.42.42.10(pid=8943): Terminated {rc=256} 17:49:53.080646 --- ParallelTerminationStrategy: PID 8944 died... 17:49:53.100329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8944): Terminated: ok {rc=0} 17:49:53.146437 --- ParallelTerminationStrategy: PID 8945 died... 17:49:53.166057 run iperf3-srv_10.42.42.10(pid=8945): Terminated {rc=256} 17:49:53.211890 --- ParallelTerminationStrategy: PID 8948 died... 17:49:53.231464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8948): Terminated: ok {rc=0} 17:49:53.277724 --- ParallelTerminationStrategy: PID 8951 died... 17:49:53.297386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8951): Terminated: ok {rc=0} 17:49:53.344463 --- ParallelTerminationStrategy: PID 8954 died... 17:49:53.364114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8954): Terminated: ok {rc=0} 17:49:53.452057 bus /gobi_4: Setting Powered False 17:49:54.551052 bus /gobi_4: Setting Powered False 17:49:55.666737 bus /gobi_1: Setting Powered False 17:49:56.766033 bus /gobi_1: Setting Powered False 17:49:57.882501 bus /gobi_0: Setting Powered False 17:49:58.980838 bus /gobi_0: Setting Powered False 17:50:00.098257 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:50:01.213273 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:01.232081 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:50:01.291897 tst ping.py: using LAC 30470 17:50:01.417690 tst ping.py: using RAC 125 17:50:01.549036 tst ping.py: using CellId 30470 17:50:01.684449 tst ping.py: using BVCI 30471 17:50:01.806058 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:01.818351 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:01.830451 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:01.842942 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:01.855484 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:01.868526 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:01.881421 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:01.893308 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:50:02.016539 tst ping.py:19: start network... 17:50:02.292832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:02.797761 run create_hlr_db(pid=8959): Launched 17:50:02.931985 bus /gobi_6: Setting Powered False 17:50:03.996331 run create_hlr_db(pid=8959): Terminated: ok {rc=0} 17:50:04.430240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8961): Launched 17:50:04.736715 run osmo-hlr_10.42.42.2(pid=8962): Launched 17:50:04.852305 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:05.393388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8964): Launched 17:50:05.696933 run osmo-stp_10.42.42.5(pid=8965): Launched 17:50:05.812814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:06.332398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8967): Launched 17:50:06.448795 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:06.705287 run patchelf(pid=8968): Launched 17:50:06.873896 run osmo-stp_10.42.42.5(pid=8965): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8965)] 17:50:07.001245 run osmo-stp_10.42.42.5(pid=8965): stdout: | (launched: 2022-12-12_17:50:05.640702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:07.130022 run osmo-stp_10.42.42.5(pid=8965): stderr: | [0;m[38;5;43m20221212175005811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175005811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175005811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175005812 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175005812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175005812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175005812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:07.258869 run osmo-stp_10.42.42.5(pid=8965): stdout: | (launched: 2022-12-12_17:50:05.640702) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:07.382515 run osmo-stp_10.42.42.5(pid=8965): stderr: | [0;m[38;5;43m20221212175005811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175005811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175005811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175005812 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175005812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175005812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175005812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:07.528781 run patchelf(pid=8968): Terminating (SIGINT) 17:50:07.697800 run patchelf(pid=8968): Terminated: ok {rc=0} 17:50:07.819428 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8965): Process ended prematurely: osmo-stp_10.42.42.5(pid=8965) [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8965)] [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 17:50:07.828477 tst ping.py:22: Test FAILED (6.6 sec) 17:50:07.855319 run osmo-hlr_10.42.42.2(pid=8962): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8962)] 17:50:07.903246 run osmo-hlr_10.42.42.2(pid=8962): stdout: | (launched: 2022-12-12_17:50:04.680268) 17:50:07.952342 run osmo-hlr_10.42.42.2(pid=8962): stderr: | [0;m[1;31m20221212175004855 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175004856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175004856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175004856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175004856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175004856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175004868 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175004877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175004877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175004877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:08.001730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8961): Terminating (SIGTERM) 17:50:08.041507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8964): Terminating (SIGTERM) 17:50:08.081563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8967): Terminating (SIGTERM) 17:50:08.121987 --- ParallelTerminationStrategy: PID 8961 died... 17:50:08.141228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8961): Terminated: ok {rc=0} 17:50:08.186797 --- ParallelTerminationStrategy: PID 8964 died... 17:50:08.205331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8964): Terminated: ok {rc=0} 17:50:08.249517 --- ParallelTerminationStrategy: PID 8967 died... 17:50:08.268054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8967): Terminated: ok {rc=0} 17:50:08.353763 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:50:09.442657 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:09.454891 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:50:09.514995 tst ping_idle_ping.py: using LAC 30471 17:50:09.632473 tst ping_idle_ping.py: using RAC 126 17:50:09.748840 tst ping_idle_ping.py: using CellId 30471 17:50:09.866246 tst ping_idle_ping.py: using BVCI 30472 17:50:09.977588 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:09.988375 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:09.999160 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:10.010182 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:10.021048 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:10.031904 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:10.043018 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:50:10.054067 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:50:10.175912 tst ping_idle_ping.py:24: start network... 17:50:10.394523 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:10.899631 run create_hlr_db(pid=8969): Launched 17:50:11.032475 bus /gobi_6: Setting Powered False 17:50:12.096678 run create_hlr_db(pid=8969): Terminated: ok {rc=0} 17:50:12.530497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8971): Launched 17:50:12.835659 run osmo-hlr_10.42.42.2(pid=8972): Launched 17:50:12.952358 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:13.487246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8974): Launched 17:50:13.791597 run osmo-stp_10.42.42.5(pid=8975): Launched 17:50:13.910709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:14.433069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8977): Launched 17:50:14.548760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:14.804888 run patchelf(pid=8978): Launched 17:50:14.973873 run osmo-stp_10.42.42.5(pid=8975): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8975)] 17:50:15.101400 run osmo-stp_10.42.42.5(pid=8975): stdout: | (launched: 2022-12-12_17:50:13.735250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:15.230668 run osmo-stp_10.42.42.5(pid=8975): stderr: | [0;m[38;5;43m20221212175013906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175013906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175013907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175013907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175013907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175013907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175013908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:15.360306 run osmo-stp_10.42.42.5(pid=8975): stdout: | (launched: 2022-12-12_17:50:13.735250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:15.484146 run osmo-stp_10.42.42.5(pid=8975): stderr: | [0;m[38;5;43m20221212175013906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175013906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175013907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175013907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175013907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175013907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175013908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:15.630693 run patchelf(pid=8978): Terminating (SIGINT) 17:50:15.800128 run patchelf(pid=8978): Terminated: ok {rc=0} 17:50:15.949959 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8975): Process ended prematurely: osmo-stp_10.42.42.5(pid=8975) [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8975)] [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:50:15.960130 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:50:15.989953 run osmo-hlr_10.42.42.2(pid=8972): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8972)] 17:50:16.040368 run osmo-hlr_10.42.42.2(pid=8972): stdout: | (launched: 2022-12-12_17:50:12.779089) 17:50:16.092731 run osmo-hlr_10.42.42.2(pid=8972): stderr: | [0;m[1;31m20221212175012953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175012953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175012954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175012954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175012954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175012954 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175012966 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175012976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175012977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175012977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:16.146211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8971): Terminating (SIGTERM) 17:50:16.189014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8974): Terminating (SIGTERM) 17:50:16.231573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8977): Terminating (SIGTERM) 17:50:16.274953 --- ParallelTerminationStrategy: PID 8971 died... 17:50:16.295145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8971): Terminated: ok {rc=0} 17:50:16.342862 --- ParallelTerminationStrategy: PID 8974 died... 17:50:16.363462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8974): Terminated: ok {rc=0} 17:50:16.410862 --- ParallelTerminationStrategy: PID 8977 died... 17:50:16.430924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8977): Terminated: ok {rc=0} 17:50:16.519325 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:50:17.804641 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:50:17.811009 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:50:17.832372 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:50:17.871204 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:50:17.957672 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:50:17.978259 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:50:18.017062 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:50:18.615306 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:50:18.670901 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:18.682928 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:50:18.746878 tst cs_paging_gprs_active.py: using LAC 30472 17:50:18.868351 tst cs_paging_gprs_active.py: using RAC 127 17:50:18.987738 tst cs_paging_gprs_active.py: using CellId 30472 17:50:19.106605 tst cs_paging_gprs_active.py: using BVCI 30473 17:50:19.220310 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:19.231213 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:19.241856 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:19.253458 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:19.264883 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:19.276336 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:19.287909 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:19.299204 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:19.310834 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:50:19.433997 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:50:19.557170 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:50:19.779391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:20.111067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8983): Launched 17:50:20.399453 run iperf3-srv_10.42.42.10(pid=8984): Launched 17:50:20.525344 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:50:20.747527 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:21.079007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8985): Launched 17:50:21.365446 run iperf3-srv_10.42.42.10(pid=8986): Launched 17:50:21.489579 tst cs_paging_gprs_active.py:38: start network... 17:50:21.711211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:22.222679 run create_hlr_db(pid=8987): Launched 17:50:22.359503 bus /gobi_6: Setting Powered False 17:50:23.424375 run create_hlr_db(pid=8987): Terminated: ok {rc=0} 17:50:23.861373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8989): Launched 17:50:24.170286 run osmo-hlr_10.42.42.2(pid=8990): Launched 17:50:24.287755 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:24.827317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8992): Launched 17:50:25.135413 run osmo-stp_10.42.42.5(pid=8993): Launched 17:50:25.255415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:25.785285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8995): Launched 17:50:25.904172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:26.165356 run patchelf(pid=8996): Launched 17:50:26.337393 run osmo-stp_10.42.42.5(pid=8993): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8993)] 17:50:26.467522 run osmo-stp_10.42.42.5(pid=8993): stdout: | (launched: 2022-12-12_17:50:25.078513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:26.599653 run osmo-stp_10.42.42.5(pid=8993): stderr: | [0;m[38;5;43m20221212175025246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175025246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175025246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175025247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175025247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175025247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175025247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:26.732004 run osmo-stp_10.42.42.5(pid=8993): stdout: | (launched: 2022-12-12_17:50:25.078513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:26.857744 run osmo-stp_10.42.42.5(pid=8993): stderr: | [0;m[38;5;43m20221212175025246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175025246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175025246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175025247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175025247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175025247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175025247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:27.007026 run patchelf(pid=8996): Terminating (SIGINT) 17:50:27.179742 run patchelf(pid=8996): Terminated: ok {rc=0} 17:50:27.304130 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8993): Process ended prematurely: osmo-stp_10.42.42.5(pid=8993) [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8993)] [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:50:27.313866 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 17:50:27.341558 run osmo-hlr_10.42.42.2(pid=8990): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8990)] 17:50:27.390137 run osmo-hlr_10.42.42.2(pid=8990): stdout: | (launched: 2022-12-12_17:50:24.113489) 17:50:27.440074 run osmo-hlr_10.42.42.2(pid=8990): stderr: | [0;m[1;31m20221212175024288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175024288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175024288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175024288 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175024289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175024289 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175024300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175024309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175024309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175024309 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:27.490325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8983): Terminating (SIGTERM) 17:50:27.530885 run iperf3-srv_10.42.42.10(pid=8984): Terminating (SIGTERM) 17:50:27.571011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8985): Terminating (SIGTERM) 17:50:27.611400 run iperf3-srv_10.42.42.10(pid=8986): Terminating (SIGTERM) 17:50:27.651459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8989): Terminating (SIGTERM) 17:50:27.691610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8992): Terminating (SIGTERM) 17:50:27.731665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8995): Terminating (SIGTERM) 17:50:27.772084 --- ParallelTerminationStrategy: PID 8983 died... 17:50:27.791345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8983): Terminated: ok {rc=0} 17:50:27.836480 --- ParallelTerminationStrategy: PID 8984 died... 17:50:27.855356 run iperf3-srv_10.42.42.10(pid=8984): Terminated {rc=256} 17:50:27.900090 --- ParallelTerminationStrategy: PID 8985 died... 17:50:27.918889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8985): Terminated: ok {rc=0} 17:50:27.963892 --- ParallelTerminationStrategy: PID 8986 died... 17:50:27.982632 run iperf3-srv_10.42.42.10(pid=8986): Terminated {rc=256} 17:50:28.027556 --- ParallelTerminationStrategy: PID 8989 died... 17:50:28.046243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8989): Terminated: ok {rc=0} 17:50:28.090868 --- ParallelTerminationStrategy: PID 8992 died... 17:50:28.109753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8992): Terminated: ok {rc=0} 17:50:28.154034 --- ParallelTerminationStrategy: PID 8995 died... 17:50:28.173313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8995): Terminated: ok {rc=0} 17:50:28.257773 bus /gobi_0: Setting Powered False 17:50:29.354715 bus /gobi_0: Setting Powered False 17:50:30.471093 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:50:31.651540 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:31.664428 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:50:31.734902 tst iperf3.py: using LAC 30473 17:50:31.899670 tst iperf3.py: using RAC 128 17:50:32.032453 tst iperf3.py: using CellId 30473 17:50:32.185421 tst iperf3.py: using BVCI 30474 17:50:32.307368 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:32.318694 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:32.329803 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:32.342009 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:32.353852 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:32.365823 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:32.377786 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:32.389685 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:32.401676 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:50:32.524525 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:50:32.748044 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:33.079061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8997): Launched 17:50:33.366283 run iperf3-srv_10.42.42.10(pid=8998): Launched 17:50:33.490011 tst iperf3.py:8: start network... 17:50:33.711702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:34.222644 run create_hlr_db(pid=8999): Launched 17:50:34.354539 bus /gobi_6: Setting Powered False 17:50:35.415349 run create_hlr_db(pid=8999): Terminated: ok {rc=0} 17:50:35.865512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9001): Launched 17:50:36.196433 run osmo-hlr_10.42.42.2(pid=9002): Launched 17:50:36.324460 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:36.892458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9004): Launched 17:50:37.222834 run osmo-stp_10.42.42.5(pid=9005): Launched 17:50:37.350654 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:37.921783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9007): Launched 17:50:38.047817 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:38.326802 run patchelf(pid=9008): Launched 17:50:38.510423 run osmo-stp_10.42.42.5(pid=9005): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9005)] 17:50:38.649360 run osmo-stp_10.42.42.5(pid=9005): stdout: | (launched: 2022-12-12_17:50:37.162158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:38.789900 run osmo-stp_10.42.42.5(pid=9005): stderr: | [0;m[38;5;43m20221212175037353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175037353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175037353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175037354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175037354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175037354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175037354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:38.931410 run osmo-stp_10.42.42.5(pid=9005): stdout: | (launched: 2022-12-12_17:50:37.162158) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:39.066353 run osmo-stp_10.42.42.5(pid=9005): stderr: | [0;m[38;5;43m20221212175037353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175037353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175037353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175037354 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175037354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175037354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175037354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:39.226091 run patchelf(pid=9008): Terminating (SIGINT) 17:50:39.411190 run patchelf(pid=9008): Terminated: ok {rc=0} 17:50:39.543862 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9005): Process ended prematurely: osmo-stp_10.42.42.5(pid=9005) [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9005)] [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 17:50:39.554218 tst iperf3.py:8: Test FAILED (8.0 sec) 17:50:39.582949 run osmo-hlr_10.42.42.2(pid=9002): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9002)] 17:50:39.633343 run osmo-hlr_10.42.42.2(pid=9002): stdout: | (launched: 2022-12-12_17:50:36.135902) 17:50:39.685403 run osmo-hlr_10.42.42.2(pid=9002): stderr: | [0;m[1;31m20221212175036333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175036333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175036333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175036333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175036334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175036334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175036346 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175036355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175036355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175036355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:39.737854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8997): Terminating (SIGTERM) 17:50:39.779956 run iperf3-srv_10.42.42.10(pid=8998): Terminating (SIGTERM) 17:50:39.822580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9001): Terminating (SIGTERM) 17:50:39.864926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9004): Terminating (SIGTERM) 17:50:39.907267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9007): Terminating (SIGTERM) 17:50:39.949812 --- ParallelTerminationStrategy: PID 8997 died... 17:50:39.970053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8997): Terminated: ok {rc=0} 17:50:40.016920 --- ParallelTerminationStrategy: PID 8998 died... 17:50:40.036691 run iperf3-srv_10.42.42.10(pid=8998): Terminated {rc=256} 17:50:40.083344 --- ParallelTerminationStrategy: PID 9001 died... 17:50:40.102977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9001): Terminated: ok {rc=0} 17:50:40.149397 --- ParallelTerminationStrategy: PID 9004 died... 17:50:40.169216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9004): Terminated: ok {rc=0} 17:50:40.215468 --- ParallelTerminationStrategy: PID 9007 died... 17:50:40.235114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9007): Terminated: ok {rc=0} 17:50:40.323849 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:50:41.476348 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:41.488483 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:50:41.550624 tst iperf3m4.py: using LAC 30474 17:50:41.678762 tst iperf3m4.py: using RAC 129 17:50:41.807041 tst iperf3m4.py: using CellId 30474 17:50:41.934490 tst iperf3m4.py: using BVCI 30475 17:50:42.054008 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:42.065680 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:42.077074 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:42.088509 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:42.099858 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:42.111203 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:42.122652 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:42.134190 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:50:42.145652 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:50:42.264600 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:50:42.387897 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:50:42.505409 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:50:42.622451 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:50:42.829184 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:43.138552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9009): Launched 17:50:43.410024 run iperf3-srv_10.42.42.10(pid=9010): Launched 17:50:43.528297 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:50:43.733522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:44.042319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9011): Launched 17:50:44.313888 run iperf3-srv_10.42.42.10(pid=9012): Launched 17:50:44.431689 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:50:44.649331 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:44.979942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9013): Launched 17:50:45.268901 run iperf3-srv_10.42.42.10(pid=9014): Launched 17:50:45.393802 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:50:45.615268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:50:45.981736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9015): Launched 17:50:46.347824 run iperf3-srv_10.42.42.10(pid=9016): Launched 17:50:46.485865 tst iperf3m4.py:8: start network... 17:50:46.703455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:50:47.212476 run create_hlr_db(pid=9017): Launched 17:50:47.332465 bus /gobi_6: Setting Powered False 17:50:48.392619 run create_hlr_db(pid=9017): Terminated: ok {rc=0} 17:50:48.821431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9019): Launched 17:50:49.130702 run osmo-hlr_10.42.42.2(pid=9020): Launched 17:50:49.250466 run osmo-stp_10.42.42.5: Starting osmo-stp 17:50:49.794977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9022): Launched 17:50:50.103439 run osmo-stp_10.42.42.5(pid=9023): Launched 17:50:50.221588 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:50:50.750768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9025): Launched 17:50:50.870598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:50:51.132510 run patchelf(pid=9026): Launched 17:50:51.304723 run osmo-stp_10.42.42.5(pid=9023): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9023)] 17:50:51.435421 run osmo-stp_10.42.42.5(pid=9023): stdout: | (launched: 2022-12-12_17:50:50.046426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:51.567603 run osmo-stp_10.42.42.5(pid=9023): stderr: | [0;m[38;5;43m20221212175050218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175050219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175050219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175050219 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175050220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175050220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175050220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:51.700725 run osmo-stp_10.42.42.5(pid=9023): stdout: | (launched: 2022-12-12_17:50:50.046426) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:50:51.827461 run osmo-stp_10.42.42.5(pid=9023): stderr: | [0;m[38;5;43m20221212175050218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175050219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175050219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175050219 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175050220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175050220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175050220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:50:52.002354 run patchelf(pid=9026): Terminating (SIGINT) 17:50:52.176168 run patchelf(pid=9026): Terminated: ok {rc=0} 17:50:52.300856 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9023): Process ended prematurely: osmo-stp_10.42.42.5(pid=9023) [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9023)] [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:50:52.310632 tst iperf3m4.py:8: Test FAILED (10.9 sec) 17:50:52.338883 run osmo-hlr_10.42.42.2(pid=9020): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9020)] 17:50:52.387329 run osmo-hlr_10.42.42.2(pid=9020): stdout: | (launched: 2022-12-12_17:50:49.073226) 17:50:52.437610 run osmo-hlr_10.42.42.2(pid=9020): stderr: | [0;m[1;31m20221212175049247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175049247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175049247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175049247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175049247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175049247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175049259 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175049267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175049268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175049268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:50:52.488094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9009): Terminating (SIGTERM) 17:50:52.528128 run iperf3-srv_10.42.42.10(pid=9010): Terminating (SIGTERM) 17:50:52.568643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9011): Terminating (SIGTERM) 17:50:52.609491 run iperf3-srv_10.42.42.10(pid=9012): Terminating (SIGTERM) 17:50:52.649901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9013): Terminating (SIGTERM) 17:50:52.690650 run iperf3-srv_10.42.42.10(pid=9014): Terminating (SIGTERM) 17:50:52.732071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9015): Terminating (SIGTERM) 17:50:52.776812 run iperf3-srv_10.42.42.10(pid=9016): Terminating (SIGTERM) 17:50:52.819117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9019): Terminating (SIGTERM) 17:50:52.862336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9022): Terminating (SIGTERM) 17:50:52.904709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9025): Terminating (SIGTERM) 17:50:52.947948 --- ParallelTerminationStrategy: PID 9009 died... 17:50:52.968330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9009): Terminated: ok {rc=0} 17:50:53.015736 --- ParallelTerminationStrategy: PID 9010 died... 17:50:53.035755 run iperf3-srv_10.42.42.10(pid=9010): Terminated {rc=256} 17:50:53.082523 --- ParallelTerminationStrategy: PID 9011 died... 17:50:53.102510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9011): Terminated: ok {rc=0} 17:50:53.149169 --- ParallelTerminationStrategy: PID 9012 died... 17:50:53.169138 run iperf3-srv_10.42.42.10(pid=9012): Terminated {rc=256} 17:50:53.215690 --- ParallelTerminationStrategy: PID 9013 died... 17:50:53.235597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9013): Terminated: ok {rc=0} 17:50:53.282371 --- ParallelTerminationStrategy: PID 9014 died... 17:50:53.302400 run iperf3-srv_10.42.42.10(pid=9014): Terminated {rc=256} 17:50:53.349180 --- ParallelTerminationStrategy: PID 9015 died... 17:50:53.368874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9015): Terminated: ok {rc=0} 17:50:53.416259 --- ParallelTerminationStrategy: PID 9016 died... 17:50:53.436240 run iperf3-srv_10.42.42.10(pid=9016): Terminated {rc=256} 17:50:53.482979 --- ParallelTerminationStrategy: PID 9019 died... 17:50:53.503026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9019): Terminated: ok {rc=0} 17:50:53.549862 --- ParallelTerminationStrategy: PID 9022 died... 17:50:53.569957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9022): Terminated: ok {rc=0} 17:50:53.617084 --- ParallelTerminationStrategy: PID 9025 died... 17:50:53.637214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9025): Terminated: ok {rc=0} 17:50:53.726697 bus /gobi_4: Setting Powered False 17:50:54.826457 bus /gobi_4: Setting Powered False 17:50:55.945523 bus /gobi_1: Setting Powered False 17:50:57.045553 bus /gobi_1: Setting Powered False 17:50:58.163261 bus /gobi_0: Setting Powered False 17:50:59.263507 bus /gobi_0: Setting Powered False 17:51:00.379066 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:51:01.481211 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:01.494003 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:51:01.555323 tst ping.py: using LAC 30475 17:51:01.686826 tst ping.py: using RAC 130 17:51:01.848463 tst ping.py: using CellId 30475 17:51:02.017613 tst ping.py: using BVCI 30476 17:51:02.176352 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:02.188387 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:02.200168 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:02.212173 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:02.224437 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:02.236547 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:02.248850 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:02.260832 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:51:02.384498 tst ping.py:19: start network... 17:51:02.604002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:03.109834 run create_hlr_db(pid=9027): Launched 17:51:03.243584 bus /gobi_6: Setting Powered False 17:51:04.307976 run create_hlr_db(pid=9027): Terminated: ok {rc=0} 17:51:04.743273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9029): Launched 17:51:05.048785 run osmo-hlr_10.42.42.2(pid=9030): Launched 17:51:05.167973 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:05.703722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9032): Launched 17:51:06.008101 run osmo-stp_10.42.42.5(pid=9033): Launched 17:51:06.124513 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:06.647828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9035): Launched 17:51:06.763980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:07.020770 run patchelf(pid=9036): Launched 17:51:07.191085 run osmo-stp_10.42.42.5(pid=9033): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9033)] 17:51:07.318444 run osmo-stp_10.42.42.5(pid=9033): stdout: | (launched: 2022-12-12_17:51:05.951676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:07.447835 run osmo-stp_10.42.42.5(pid=9033): stderr: | [0;m[38;5;43m20221212175106119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175106120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175106120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175106120 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175106121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175106121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175106121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:07.577445 run osmo-stp_10.42.42.5(pid=9033): stdout: | (launched: 2022-12-12_17:51:05.951676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:07.701462 run osmo-stp_10.42.42.5(pid=9033): stderr: | [0;m[38;5;43m20221212175106119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175106120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175106120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175106120 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175106121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175106121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175106121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:07.848055 run patchelf(pid=9036): Terminating (SIGINT) 17:51:08.017757 run patchelf(pid=9036): Terminated: ok {rc=0} 17:51:08.139671 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9033): Process ended prematurely: osmo-stp_10.42.42.5(pid=9033) [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9033)] [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 17:51:08.148690 tst ping.py:22: Test FAILED (6.7 sec) 17:51:08.176019 run osmo-hlr_10.42.42.2(pid=9030): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9030)] 17:51:08.224451 run osmo-hlr_10.42.42.2(pid=9030): stdout: | (launched: 2022-12-12_17:51:04.991990) 17:51:08.274698 run osmo-hlr_10.42.42.2(pid=9030): stderr: | [0;m[1;31m20221212175105168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175105168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175105168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175105168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175105168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175105168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175105179 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175105188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175105188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175105188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:08.325442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9029): Terminating (SIGTERM) 17:51:08.365548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9032): Terminating (SIGTERM) 17:51:08.405719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9035): Terminating (SIGTERM) 17:51:08.445992 --- ParallelTerminationStrategy: PID 9029 died... 17:51:08.465247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9029): Terminated: ok {rc=0} 17:51:08.510238 --- ParallelTerminationStrategy: PID 9032 died... 17:51:08.529121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9032): Terminated: ok {rc=0} 17:51:08.573860 --- ParallelTerminationStrategy: PID 9035 died... 17:51:08.592900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9035): Terminated: ok {rc=0} 17:51:08.680785 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:51:09.772123 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:09.784462 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:51:09.843547 tst ping_idle_ping.py: using LAC 30476 17:51:09.963237 tst ping_idle_ping.py: using RAC 131 17:51:10.082105 tst ping_idle_ping.py: using CellId 30476 17:51:10.203228 tst ping_idle_ping.py: using BVCI 30477 17:51:10.316792 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:10.328134 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:10.339105 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:10.350367 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:10.361561 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:10.372604 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:10.384512 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:51:10.395704 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:51:10.517774 tst ping_idle_ping.py:24: start network... 17:51:10.737936 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:11.245610 run create_hlr_db(pid=9037): Launched 17:51:11.378877 bus /gobi_6: Setting Powered False 17:51:12.443309 run create_hlr_db(pid=9037): Terminated: ok {rc=0} 17:51:12.878532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9039): Launched 17:51:13.185163 run osmo-hlr_10.42.42.2(pid=9040): Launched 17:51:13.303014 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:13.841014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9042): Launched 17:51:14.146299 run osmo-stp_10.42.42.5(pid=9043): Launched 17:51:14.263270 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:14.789125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9045): Launched 17:51:14.906002 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:15.164210 run patchelf(pid=9046): Launched 17:51:15.335825 run osmo-stp_10.42.42.5(pid=9043): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9043)] 17:51:15.464449 run osmo-stp_10.42.42.5(pid=9043): stdout: | (launched: 2022-12-12_17:51:14.089279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:15.594871 run osmo-stp_10.42.42.5(pid=9043): stderr: | [0;m[38;5;43m20221212175114258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175114258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175114258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175114259 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175114259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175114259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175114259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:15.725504 run osmo-stp_10.42.42.5(pid=9043): stdout: | (launched: 2022-12-12_17:51:14.089279) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:15.867181 run osmo-stp_10.42.42.5(pid=9043): stderr: | [0;m[38;5;43m20221212175114258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175114258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175114258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175114259 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175114259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175114259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175114259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:16.037556 run patchelf(pid=9046): Terminating (SIGINT) 17:51:16.225492 run patchelf(pid=9046): Terminated: ok {rc=0} 17:51:16.361819 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9043): Process ended prematurely: osmo-stp_10.42.42.5(pid=9043) [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9043)] [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:51:16.372280 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 17:51:16.401629 run osmo-hlr_10.42.42.2(pid=9040): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9040)] 17:51:16.453778 run osmo-hlr_10.42.42.2(pid=9040): stdout: | (launched: 2022-12-12_17:51:13.128224) 17:51:16.507443 run osmo-hlr_10.42.42.2(pid=9040): stderr: | [0;m[1;31m20221212175113303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175113303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175113303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175113303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175113303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175113303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175113315 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175113324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175113324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175113324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:16.562587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9039): Terminating (SIGTERM) 17:51:16.606948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9042): Terminating (SIGTERM) 17:51:16.652528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9045): Terminating (SIGTERM) 17:51:16.698672 --- ParallelTerminationStrategy: PID 9039 died... 17:51:16.719449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9039): Terminated: ok {rc=0} 17:51:16.769732 --- ParallelTerminationStrategy: PID 9042 died... 17:51:16.790445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9042): Terminated: ok {rc=0} 17:51:16.838400 --- ParallelTerminationStrategy: PID 9045 died... 17:51:16.859917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9045): Terminated: ok {rc=0} 17:51:16.956883 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:51:18.257475 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:51:18.264861 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:51:18.286312 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:51:18.322199 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:51:18.378702 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:51:18.400788 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:51:18.436379 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:51:18.994782 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:51:19.000172 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:51:19.011946 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:51:19.069399 tst switch_tch_pdch.py: using LAC 30477 17:51:19.197152 tst switch_tch_pdch.py: using RAC 132 17:51:19.329375 tst switch_tch_pdch.py: using CellId 30477 17:51:19.463587 tst switch_tch_pdch.py: using BVCI 30478 17:51:19.575832 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:51:19.587281 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:51:19.598543 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:51:19.609754 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:51:19.620758 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:51:19.632065 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:51:19.643958 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:51:19.655271 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:51:19.776852 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:51:19.899484 tst switch_tch_pdch.py:51: start network... 17:51:20.117437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:20.620390 run create_hlr_db(pid=9052): Launched 17:51:20.752550 bus /gobi_6: Setting Powered False 17:51:21.816548 run create_hlr_db(pid=9052): Terminated: ok {rc=0} 17:51:22.249309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9054): Launched 17:51:22.552333 run osmo-hlr_10.42.42.2(pid=9055): Launched 17:51:22.668612 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:23.205449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9057): Launched 17:51:23.510344 run osmo-stp_10.42.42.5(pid=9058): Launched 17:51:23.628935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:24.150562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9060): Launched 17:51:24.267517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:24.525936 run patchelf(pid=9061): Launched 17:51:24.695289 run osmo-stp_10.42.42.5(pid=9058): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9058)] 17:51:24.823054 run osmo-stp_10.42.42.5(pid=9058): stdout: | (launched: 2022-12-12_17:51:23.453745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:24.952624 run osmo-stp_10.42.42.5(pid=9058): stderr: | [0;m[38;5;43m20221212175123624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175123624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175123625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175123625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175123626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175123626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175123626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:25.081868 run osmo-stp_10.42.42.5(pid=9058): stdout: | (launched: 2022-12-12_17:51:23.453745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:25.205665 run osmo-stp_10.42.42.5(pid=9058): stderr: | [0;m[38;5;43m20221212175123624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175123624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175123625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175123625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175123626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175123626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175123626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:25.352248 run patchelf(pid=9061): Terminating (SIGINT) 17:51:25.522847 run patchelf(pid=9061): Terminated: ok {rc=0} 17:51:25.645101 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9058): Process ended prematurely: osmo-stp_10.42.42.5(pid=9058) [trial-2380↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9058)] [trial-2380↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:51:25.654020 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 17:51:25.681214 run osmo-hlr_10.42.42.2(pid=9055): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9055)] 17:51:25.729425 run osmo-hlr_10.42.42.2(pid=9055): stdout: | (launched: 2022-12-12_17:51:22.496000) 17:51:25.779257 run osmo-hlr_10.42.42.2(pid=9055): stderr: | [0;m[1;31m20221212175122672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175122672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175122672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175122672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175122672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175122672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175122684 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175122693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175122693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175122693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:25.829408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9054): Terminating (SIGTERM) 17:51:25.869627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9057): Terminating (SIGTERM) 17:51:25.909405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9060): Terminating (SIGTERM) 17:51:25.950091 --- ParallelTerminationStrategy: PID 9054 died... 17:51:25.969333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9054): Terminated: ok {rc=0} 17:51:26.013908 --- ParallelTerminationStrategy: PID 9057 died... 17:51:26.032512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9057): Terminated: ok {rc=0} 17:51:26.077097 --- ParallelTerminationStrategy: PID 9060 died... 17:51:26.095840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9060): Terminated: ok {rc=0} 17:51:26.183247 bus /gobi_0: Setting Powered False 17:51:27.282078 bus /gobi_0: Setting Powered False 17:51:28.398305 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:51:29.645523 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:51:29.651827 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:51:29.673322 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:51:29.709297 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:51:29.763422 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:51:29.784169 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:51:29.818953 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:51:30.377402 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:51:30.382998 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:51:30.394767 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:51:30.452467 tst switch_tch_pdch.py: using LAC 30478 17:51:30.578719 tst switch_tch_pdch.py: using RAC 133 17:51:30.703960 tst switch_tch_pdch.py: using CellId 30478 17:51:30.831447 tst switch_tch_pdch.py: using BVCI 30479 17:51:30.978253 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:51:30.990720 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:51:31.002680 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:51:31.014616 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:51:31.028815 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:51:31.041855 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:51:31.055250 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:51:31.068582 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:51:31.209845 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:51:31.340577 tst switch_tch_pdch.py:51: start network... 17:51:31.554529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:32.059603 run create_hlr_db(pid=9065): Launched 17:51:32.214010 bus /gobi_6: Setting Powered False 17:51:33.274288 run create_hlr_db(pid=9065): Terminated: ok {rc=0} 17:51:33.691124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9067): Launched 17:51:34.018926 run osmo-hlr_10.42.42.2(pid=9068): Launched 17:51:34.143585 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:34.678872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9070): Launched 17:51:35.004618 run osmo-stp_10.42.42.5(pid=9071): Launched 17:51:35.129172 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:51:35.659209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9073): Launched 17:51:35.785886 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:51:36.061103 run patchelf(pid=9074): Launched 17:51:36.242956 run osmo-stp_10.42.42.5(pid=9071): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9071)] 17:51:36.379701 run osmo-stp_10.42.42.5(pid=9071): stdout: | (launched: 2022-12-12_17:51:34.944322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:36.519059 run osmo-stp_10.42.42.5(pid=9071): stderr: | [0;m[38;5;43m20221212175135137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175135137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175135137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175135138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175135138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175135138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175135138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:36.657436 run osmo-stp_10.42.42.5(pid=9071): stdout: | (launched: 2022-12-12_17:51:34.944322) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:36.790052 run osmo-stp_10.42.42.5(pid=9071): stderr: | [0;m[38;5;43m20221212175135137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175135137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175135137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175135138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175135138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175135138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175135138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:36.948106 run patchelf(pid=9074): Terminating (SIGINT) 17:51:37.129586 run patchelf(pid=9074): Terminated: ok {rc=0} 17:51:37.259876 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9071): Process ended prematurely: osmo-stp_10.42.42.5(pid=9071) [trial-2380↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9071)] [trial-2380↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:51:37.269662 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 17:51:37.297669 run osmo-hlr_10.42.42.2(pid=9068): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9068)] 17:51:37.348081 run osmo-hlr_10.42.42.2(pid=9068): stdout: | (launched: 2022-12-12_17:51:33.958737) 17:51:37.400100 run osmo-hlr_10.42.42.2(pid=9068): stderr: | [0;m[1;31m20221212175134157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175134157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175134157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175134157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175134157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175134157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175134169 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175134178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175134178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175134178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:37.452350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9067): Terminating (SIGTERM) 17:51:37.494448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9070): Terminating (SIGTERM) 17:51:37.536216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9073): Terminating (SIGTERM) 17:51:37.578600 --- ParallelTerminationStrategy: PID 9067 died... 17:51:37.598729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9067): Terminated: ok {rc=0} 17:51:37.645045 --- ParallelTerminationStrategy: PID 9070 died... 17:51:37.664601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9070): Terminated: ok {rc=0} 17:51:37.710907 --- ParallelTerminationStrategy: PID 9073 died... 17:51:37.730484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9073): Terminated: ok {rc=0} 17:51:37.819051 bus /gobi_0: Setting Powered False 17:51:38.918667 bus /gobi_0: Setting Powered False 17:51:40.034768 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_sms:oc2g --------------------------------------------------------------------- 17:51:41.277821 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:51:41.281878 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 17:51:41.303020 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 17:51:41.310092 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 17:51:41.363358 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 17:51:41.384463 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 17:51:41.391329 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 17:51:41.929946 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 17:51:41.935076 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 17:51:41.946264 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 17:51:41.981159 tst mo_mt_sms.py: using LAC 30479 17:51:42.107916 tst mo_mt_sms.py: using RAC 134 17:51:42.234434 tst mo_mt_sms.py: using CellId 30479 17:51:42.362683 tst mo_mt_sms.py: using BVCI 30480 17:51:42.481777 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 17:51:42.601872 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 17:51:42.721659 tst mo_mt_sms.py:9: start nitb and bts... 17:51:42.940513 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:51:43.602932 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9079): Launched 17:51:43.931249 run osmo-nitb_10.42.42.2(pid=9080): Launched 17:51:44.113414 run osmo-nitb_10.42.42.2(pid=9080): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9080)] 17:51:44.257877 run osmo-nitb_10.42.42.2(pid=9080): stdout: | (launched: 2022-12-12_17:51:43.870888) 17:51:44.404588 run osmo-nitb_10.42.42.2(pid=9080): stderr: | (launched: 2022-12-12_17:51:43.919399) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:51:44.551273 run osmo-nitb_10.42.42.2(pid=9080): stdout: | (launched: 2022-12-12_17:51:43.870888) 17:51:44.692788 run osmo-nitb_10.42.42.2(pid=9080): stderr: | (launched: 2022-12-12_17:51:43.919399) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9080): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9080) [trial-2380↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9080)] 17:51:45.056787 tst osmo-nitb_10.42.42.2(pid=9080): stdout: | (launched: 2022-12-12_17:51:43.870888) 17:51:45.188151 tst osmo-nitb_10.42.42.2(pid=9080): stderr: | (launched: 2022-12-12_17:51:43.919399) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:51:45.343544 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9080): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9080) [trial-2380↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9080)] [trial-2380↪nitb_sms:oc2g↪mo_mt_sms.py:11] 17:51:45.352471 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 17:51:45.359583 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9079): Terminating (SIGTERM) 17:51:45.572161 --- ParallelTerminationStrategy: PID 9079 died... 17:51:45.593984 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9079): Terminated: ok {rc=0} 17:51:45.684280 bus /sierra_3: Setting Powered False 17:51:46.787085 bus /sierra_3: Setting Powered False 17:51:47.907944 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 sms:oc2g --------------------------------------------------------------------- 17:51:49.095292 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:51:49.099765 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 17:51:49.121189 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 17:51:49.149920 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 17:51:49.203433 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 17:51:49.224779 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 17:51:49.252407 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 17:51:49.799264 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 sms:oc2g mo_mt_sms.py ---------------------------------------------- 17:51:49.804315 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:51:49.815389 tst sms:oc2g: Using 1 x bts (candidates: 1) 17:51:49.850165 tst mo_mt_sms.py: using LAC 30480 17:51:49.978072 tst mo_mt_sms.py: using RAC 135 17:51:50.109344 tst mo_mt_sms.py: using CellId 30480 17:51:50.236284 tst mo_mt_sms.py: using BVCI 30481 17:51:50.355464 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:51:50.366643 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:51:50.377579 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:51:50.388451 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:51:50.399416 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 17:51:50.410381 tst sms:oc2g: Using 1 x modem (candidates: 2) 17:51:50.526869 tst sms:oc2g: Using 1 x modem (candidates: 2) 17:51:50.647451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:51:51.153587 run create_hlr_db(pid=9084): Launched 17:51:51.285486 bus /sierra_2: Setting Powered False 17:51:52.349775 run create_hlr_db(pid=9084): Terminated: ok {rc=0} 17:51:52.784891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9086): Launched 17:51:53.088452 run osmo-hlr_10.42.42.2(pid=9087): Launched 17:51:53.204638 run osmo-stp_10.42.42.5: Starting osmo-stp 17:51:53.736704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9089): Launched 17:51:54.040670 run osmo-stp_10.42.42.5(pid=9090): Launched 17:51:54.156107 run osmo-msc_10.42.42.6: Starting osmo-msc 17:51:54.704023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9092): Launched 17:51:55.009318 run osmo-msc_10.42.42.6(pid=9093): Launched 17:51:55.179958 run osmo-stp_10.42.42.5(pid=9090): ERR: Terminated: ERROR {rc=1} [trial-2380↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9090)] 17:51:55.308550 run osmo-stp_10.42.42.5(pid=9090): stdout: | (launched: 2022-12-12_17:51:53.984152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:55.437387 run osmo-stp_10.42.42.5(pid=9090): stderr: | [0;m[38;5;43m20221212175154155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175154155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175154155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175154156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175154156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175154156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175154156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:55.563648 run osmo-stp_10.42.42.5(pid=9090): stdout: | (launched: 2022-12-12_17:51:53.984152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:51:55.684412 run osmo-stp_10.42.42.5(pid=9090): stderr: | [0;m[38;5;43m20221212175154155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175154155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175154155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175154156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175154156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175154156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175154156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:51:55.829327 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9090): Process ended prematurely: osmo-stp_10.42.42.5(pid=9090) [trial-2380↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9090)] [trial-2380↪sms:oc2g↪mo_mt_sms.py:16] 17:51:55.837832 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 17:51:55.864428 run osmo-hlr_10.42.42.2(pid=9087): ERR: Terminated: ERROR {rc=237} [trial-2380↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9087)] 17:51:55.913086 run osmo-hlr_10.42.42.2(pid=9087): stdout: | (launched: 2022-12-12_17:51:53.031978) 17:51:55.963171 run osmo-hlr_10.42.42.2(pid=9087): stderr: | [0;m[1;31m20221212175153205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175153205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175153205 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175153206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175153206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175153206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175153218 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175153226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175153226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175153226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:51:56.032848 run osmo-msc_10.42.42.6(pid=9093): ERR: Terminated: ERROR {rc=2} [trial-2380↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9093)] 17:51:56.080790 run osmo-msc_10.42.42.6(pid=9093): stdout: | (launched: 2022-12-12_17:51:54.952459) 17:51:56.130591 run osmo-msc_10.42.42.6(pid=9093): stderr: | [0;m[38;5;43m20221212175155225 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175155225 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd797c1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175155225 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175155225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175155225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175155226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175155227 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175155228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175155228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175155228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:51:56.180554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9086): Terminating (SIGTERM) 17:51:56.220547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9089): Terminating (SIGTERM) 17:51:56.260574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9092): Terminating (SIGTERM) 17:51:56.301045 --- ParallelTerminationStrategy: PID 9086 died... 17:51:56.320208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9086): Terminated: ok {rc=0} 17:51:56.364909 --- ParallelTerminationStrategy: PID 9089 died... 17:51:56.384080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9089): Terminated: ok {rc=0} 17:51:56.428740 --- ParallelTerminationStrategy: PID 9092 died... 17:51:56.447592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9092): Terminated: ok {rc=0} 17:51:56.532579 bus /sierra_3: Setting Powered False 17:51:57.630305 bus /sierra_3: Setting Powered False 17:51:58.747498 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_ussd:oc2g --------------------------------------------------------------------- 17:51:59.964601 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:51:59.968323 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 17:51:59.988720 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 17:51:59.996279 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 17:52:00.031773 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 17:52:00.053213 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 17:52:00.060268 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 17:52:00.580748 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2380 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 17:52:00.585949 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 17:52:00.597015 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 17:52:00.636681 tst assert_extension.py: using LAC 30481 17:52:00.754519 tst assert_extension.py: using RAC 136 17:52:00.906540 tst assert_extension.py: using CellId 30481 17:52:01.038381 tst assert_extension.py: using BVCI 30482 17:52:01.150500 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 17:52:01.269380 tst assert_extension.py:10: start nitb and bts... 17:52:01.495970 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:52:02.178180 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9098): Launched 17:52:02.505525 run osmo-nitb_10.42.42.2(pid=9099): Launched 17:52:02.687289 run osmo-nitb_10.42.42.2(pid=9099): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9099)] 17:52:02.832678 run osmo-nitb_10.42.42.2(pid=9099): stdout: | (launched: 2022-12-12_17:52:02.444877) 17:52:02.979420 run osmo-nitb_10.42.42.2(pid=9099): stderr: | (launched: 2022-12-12_17:52:02.493444) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:52:03.126097 run osmo-nitb_10.42.42.2(pid=9099): stdout: | (launched: 2022-12-12_17:52:02.444877) 17:52:03.266971 run osmo-nitb_10.42.42.2(pid=9099): stderr: | (launched: 2022-12-12_17:52:02.493444) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9099): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9099) [trial-2380↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9099)] 17:52:03.629884 tst osmo-nitb_10.42.42.2(pid=9099): stdout: | (launched: 2022-12-12_17:52:02.444877) 17:52:03.761080 tst osmo-nitb_10.42.42.2(pid=9099): stderr: | (launched: 2022-12-12_17:52:02.493444) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:52:03.916206 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9099): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9099) [trial-2380↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9099)] [trial-2380↪nitb_ussd:oc2g↪assert_extension.py:12] 17:52:03.925324 tst assert_extension.py:12: Test FAILED (3.3 sec) 17:52:03.932545 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9098): Terminating (SIGTERM) 17:52:04.143445 --- ParallelTerminationStrategy: PID 9098 died... 17:52:04.165325 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9098): Terminated: ok {rc=0} 17:52:04.254320 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 ussd:oc2g --------------------------------------------------------------------- 17:52:05.418921 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:52:05.423148 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 17:52:05.444361 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 17:52:05.472526 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 17:52:05.511466 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 17:52:05.533035 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 17:52:05.560367 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 17:52:06.086774 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2380 ussd:oc2g assert_extension.py ---------------------------------------------- 17:52:06.092015 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:52:06.103103 tst ussd:oc2g: Using 1 x bts (candidates: 1) 17:52:06.139575 tst assert_extension.py: using LAC 30482 17:52:06.261083 tst assert_extension.py: using RAC 137 17:52:06.389374 tst assert_extension.py: using CellId 30482 17:52:06.517419 tst assert_extension.py: using BVCI 30483 17:52:06.635612 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:52:06.646818 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:52:06.657776 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:52:06.668603 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:52:06.680513 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 17:52:06.691899 tst ussd:oc2g: Using 1 x modem (candidates: 1) 17:52:06.809339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:07.315607 run create_hlr_db(pid=9103): Launched 17:52:07.449230 bus /sierra_2: Setting Powered False 17:52:08.513752 run create_hlr_db(pid=9103): Terminated: ok {rc=0} 17:52:08.948032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9105): Launched 17:52:09.276110 run osmo-hlr_10.42.42.2(pid=9106): Launched 17:52:09.402697 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:09.971544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9108): Launched 17:52:10.298034 run osmo-stp_10.42.42.5(pid=9109): Launched 17:52:10.423526 run osmo-msc_10.42.42.6: Starting osmo-msc 17:52:11.009722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9111): Launched 17:52:11.335116 run osmo-msc_10.42.42.6(pid=9112): Launched 17:52:11.518309 run osmo-stp_10.42.42.5(pid=9109): ERR: Terminated: ERROR {rc=1} [trial-2380↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9109)] 17:52:11.655872 run osmo-stp_10.42.42.5(pid=9109): stdout: | (launched: 2022-12-12_17:52:10.237710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:11.792883 run osmo-stp_10.42.42.5(pid=9109): stderr: | [0;m[38;5;43m20221212175210430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175210431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175210431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175210431 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175210432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175210432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175210432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:11.929676 run osmo-stp_10.42.42.5(pid=9109): stdout: | (launched: 2022-12-12_17:52:10.237710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:12.058799 run osmo-stp_10.42.42.5(pid=9109): stderr: | [0;m[38;5;43m20221212175210430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175210431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175210431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175210431 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175210432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175210432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175210432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:12.213947 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9109): Process ended prematurely: osmo-stp_10.42.42.5(pid=9109) [trial-2380↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9109)] [trial-2380↪ussd:oc2g↪assert_extension.py:17] 17:52:12.222881 tst assert_extension.py:17: Test FAILED (6.1 sec) 17:52:12.250471 run osmo-hlr_10.42.42.2(pid=9106): ERR: Terminated: ERROR {rc=237} [trial-2380↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9106)] 17:52:12.300712 run osmo-hlr_10.42.42.2(pid=9106): stdout: | (launched: 2022-12-12_17:52:09.215653) 17:52:12.352541 run osmo-hlr_10.42.42.2(pid=9106): stderr: | [0;m[1;31m20221212175209415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175209415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175209415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175209415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175209415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175209415 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175209428 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175209436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175209437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175209437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:12.424560 run osmo-msc_10.42.42.6(pid=9112): ERR: Terminated: ERROR {rc=2} [trial-2380↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9112)] 17:52:12.474865 run osmo-msc_10.42.42.6(pid=9112): stdout: | (launched: 2022-12-12_17:52:11.274763) 17:52:12.527002 run osmo-msc_10.42.42.6(pid=9112): stderr: | [0;m[38;5;43m20221212175211597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175211597 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa1fb247c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175211597 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175211597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175211597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175211598 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175211599 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175211600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175211600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175211600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:52:12.579072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9105): Terminating (SIGTERM) 17:52:12.620727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9108): Terminating (SIGTERM) 17:52:12.662380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9111): Terminating (SIGTERM) 17:52:12.704440 --- ParallelTerminationStrategy: PID 9105 died... 17:52:12.724170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9105): Terminated: ok {rc=0} 17:52:12.770499 --- ParallelTerminationStrategy: PID 9108 died... 17:52:12.790274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9108): Terminated: ok {rc=0} 17:52:12.836627 --- ParallelTerminationStrategy: PID 9111 died... 17:52:12.856175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9111): Terminated: ok {rc=0} 17:52:12.943947 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 17:52:14.139770 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:52:14.146265 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 17:52:14.167001 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 17:52:14.195714 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 17:52:14.251970 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 17:52:14.273616 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 17:52:14.300619 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 17:52:14.846684 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 17:52:14.898684 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:52:14.909982 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:52:14.965047 tst mo_mt_call.py: using LAC 30483 17:52:15.084282 tst mo_mt_call.py: using RAC 138 17:52:15.202994 tst mo_mt_call.py: using CellId 30483 17:52:15.325061 tst mo_mt_call.py: using BVCI 30484 17:52:15.438479 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:52:15.449734 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:52:15.460490 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:52:15.471905 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:52:15.483599 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:52:15.495198 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:52:15.615487 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:52:15.736807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:16.261223 run create_hlr_db(pid=9117): Launched 17:52:16.432364 bus /sierra_2: Setting Powered False 17:52:17.494428 run create_hlr_db(pid=9117): Terminated: ok {rc=0} 17:52:17.962404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9119): Launched 17:52:18.296477 run osmo-hlr_10.42.42.2(pid=9120): Launched 17:52:18.424526 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:19.002206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9122): Launched 17:52:19.335751 run osmo-stp_10.42.42.5(pid=9123): Launched 17:52:19.464402 run osmo-msc_10.42.42.6: Starting osmo-msc 17:52:20.064393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9125): Launched 17:52:20.399148 run osmo-msc_10.42.42.6(pid=9126): Launched 17:52:20.585083 run osmo-stp_10.42.42.5(pid=9123): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9123)] 17:52:20.723941 run osmo-stp_10.42.42.5(pid=9123): stdout: | (launched: 2022-12-12_17:52:19.274410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:20.863538 run osmo-stp_10.42.42.5(pid=9123): stderr: | [0;m[38;5;43m20221212175219465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175219466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175219466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175219466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175219467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175219467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175219467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:21.001984 run osmo-stp_10.42.42.5(pid=9123): stdout: | (launched: 2022-12-12_17:52:19.274410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:21.133882 run osmo-stp_10.42.42.5(pid=9123): stderr: | [0;m[38;5;43m20221212175219465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175219466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175219466 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175219466 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175219467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175219467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175219467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:21.291768 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9123): Process ended prematurely: osmo-stp_10.42.42.5(pid=9123) [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9123)] [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 17:52:21.301507 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:52:21.329686 run osmo-hlr_10.42.42.2(pid=9120): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9120)] 17:52:21.380621 run osmo-hlr_10.42.42.2(pid=9120): stdout: | (launched: 2022-12-12_17:52:18.235312) 17:52:21.433290 run osmo-hlr_10.42.42.2(pid=9120): stderr: | [0;m[1;31m20221212175218434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175218434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175218434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175218434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175218434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175218434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175218446 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175218455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175218455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175218455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:21.505861 run osmo-msc_10.42.42.6(pid=9126): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9126)] 17:52:21.556583 run osmo-msc_10.42.42.6(pid=9126): stdout: | (launched: 2022-12-12_17:52:20.337788) 17:52:21.608538 run osmo-msc_10.42.42.6(pid=9126): stderr: | [0;m[38;5;43m20221212175220660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175220660 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efeff4aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175220660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175220660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175220661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175220661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175220663 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175220663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175220663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175220663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:52:21.660997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9119): Terminating (SIGTERM) 17:52:21.702925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9122): Terminating (SIGTERM) 17:52:21.745125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9125): Terminating (SIGTERM) 17:52:21.787539 --- ParallelTerminationStrategy: PID 9119 died... 17:52:21.808134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9119): Terminated: ok {rc=0} 17:52:21.854823 --- ParallelTerminationStrategy: PID 9122 died... 17:52:21.874916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9122): Terminated: ok {rc=0} 17:52:21.921576 --- ParallelTerminationStrategy: PID 9125 died... 17:52:21.941373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9125): Terminated: ok {rc=0} 17:52:22.031079 bus /sierra_3: Setting Powered False 17:52:23.131727 bus /sierra_3: Setting Powered False 17:52:24.251313 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 17:52:25.404544 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:52:25.417164 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 17:52:25.475880 tst mo_mt_call_osmux.py: using LAC 30484 17:52:25.605112 tst mo_mt_call_osmux.py: using RAC 139 17:52:25.734298 tst mo_mt_call_osmux.py: using CellId 30484 17:52:25.867848 tst mo_mt_call_osmux.py: using BVCI 30485 17:52:25.982679 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:52:25.993958 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:52:26.005125 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:52:26.016433 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:52:26.027802 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 17:52:26.039087 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:52:26.160177 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 17:52:26.281029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:26.759702 run create_hlr_db(pid=9132): Launched 17:52:26.878696 bus /sierra_2: Setting Powered False 17:52:27.940476 run create_hlr_db(pid=9132): Terminated: ok {rc=0} 17:52:28.392311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9134): Launched 17:52:28.726523 run osmo-hlr_10.42.42.2(pid=9135): Launched 17:52:28.854618 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:29.426140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9137): Launched 17:52:29.758281 run osmo-stp_10.42.42.5(pid=9138): Launched 17:52:29.885497 run osmo-msc_10.42.42.6: Starting osmo-msc 17:52:30.482828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9140): Launched 17:52:30.815080 run osmo-msc_10.42.42.6(pid=9141): Launched 17:52:31.154691 run osmo-stp_10.42.42.5(pid=9138): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9138)] 17:52:31.411549 run osmo-stp_10.42.42.5(pid=9138): stdout: | (launched: 2022-12-12_17:52:29.696843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:31.699115 run osmo-stp_10.42.42.5(pid=9138): stderr: | [0;m[38;5;43m20221212175229888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175229889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175229889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175229889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175229890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175229890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175229890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:31.833993 run osmo-stp_10.42.42.5(pid=9138): stdout: | (launched: 2022-12-12_17:52:29.696843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:31.995694 run osmo-stp_10.42.42.5(pid=9138): stderr: | [0;m[38;5;43m20221212175229888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175229889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175229889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175229889 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175229890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175229890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175229890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:32.165653 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9138): Process ended prematurely: osmo-stp_10.42.42.5(pid=9138) [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9138)] [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 17:52:32.176033 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 17:52:32.206539 run osmo-hlr_10.42.42.2(pid=9135): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9135)] 17:52:32.257100 run osmo-hlr_10.42.42.2(pid=9135): stdout: | (launched: 2022-12-12_17:52:28.665454) 17:52:32.309675 run osmo-hlr_10.42.42.2(pid=9135): stderr: | [0;m[1;31m20221212175228866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175228866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175228866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175228866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175228866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175228866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175228915 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175228925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175228925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175228926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:32.380419 run osmo-msc_10.42.42.6(pid=9141): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9141)] 17:52:32.429421 run osmo-msc_10.42.42.6(pid=9141): stdout: | (launched: 2022-12-12_17:52:30.753829) 17:52:32.480162 run osmo-msc_10.42.42.6(pid=9141): stderr: | [0;m[38;5;43m20221212175231283 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175231284 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3f8557ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175231284 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175231284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175231284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175231284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175231292 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175231293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175231293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175231293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:52:32.530904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9134): Terminating (SIGTERM) 17:52:32.571511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9137): Terminating (SIGTERM) 17:52:32.612202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9140): Terminating (SIGTERM) 17:52:32.653097 --- ParallelTerminationStrategy: PID 9134 died... 17:52:32.672401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9134): Terminated: ok {rc=0} 17:52:32.718387 --- ParallelTerminationStrategy: PID 9137 died... 17:52:32.737089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9137): Terminated: ok {rc=0} 17:52:32.783021 --- ParallelTerminationStrategy: PID 9140 died... 17:52:32.801912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9140): Terminated: ok {rc=0} 17:52:32.887771 bus /sierra_3: Setting Powered False 17:52:33.987816 bus /sierra_3: Setting Powered False 17:52:35.106086 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 17:52:36.343194 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:52:36.349850 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 17:52:36.371053 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 17:52:36.398487 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 17:52:36.451983 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 17:52:36.472809 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 17:52:36.499804 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 17:52:37.047876 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 17:52:37.098512 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:52:37.109696 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:52:37.166318 tst mo_mt_call.py: using LAC 30485 17:52:37.287408 tst mo_mt_call.py: using RAC 140 17:52:37.410014 tst mo_mt_call.py: using CellId 30485 17:52:37.533882 tst mo_mt_call.py: using BVCI 30486 17:52:37.648033 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:52:37.659152 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:52:37.670200 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:52:37.681447 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:52:37.692600 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:52:37.703872 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:52:37.825415 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:52:37.943357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:38.426171 run create_hlr_db(pid=9147): Launched 17:52:38.547285 bus /sierra_2: Setting Powered False 17:52:39.609315 run create_hlr_db(pid=9147): Terminated: ok {rc=0} 17:52:40.041978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9149): Launched 17:52:40.355014 run osmo-hlr_10.42.42.2(pid=9150): Launched 17:52:40.474404 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:41.007445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9152): Launched 17:52:41.320440 run osmo-stp_10.42.42.5(pid=9153): Launched 17:52:41.439778 run osmo-msc_10.42.42.6: Starting osmo-msc 17:52:42.000058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9155): Launched 17:52:42.312900 run osmo-msc_10.42.42.6(pid=9156): Launched 17:52:42.488344 run osmo-stp_10.42.42.5(pid=9153): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9153)] 17:52:42.618914 run osmo-stp_10.42.42.5(pid=9153): stdout: | (launched: 2022-12-12_17:52:41.262706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:42.749765 run osmo-stp_10.42.42.5(pid=9153): stderr: | [0;m[38;5;43m20221212175241434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175241434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175241434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175241435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175241435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175241435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175241435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:42.878375 run osmo-stp_10.42.42.5(pid=9153): stdout: | (launched: 2022-12-12_17:52:41.262706) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:43.001522 run osmo-stp_10.42.42.5(pid=9153): stderr: | [0;m[38;5;43m20221212175241434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175241434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175241434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175241435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175241435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175241435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175241435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:43.149701 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9153): Process ended prematurely: osmo-stp_10.42.42.5(pid=9153) [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9153)] [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 17:52:43.158578 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 17:52:43.185784 run osmo-hlr_10.42.42.2(pid=9150): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9150)] 17:52:43.235016 run osmo-hlr_10.42.42.2(pid=9150): stdout: | (launched: 2022-12-12_17:52:40.297269) 17:52:43.286025 run osmo-hlr_10.42.42.2(pid=9150): stderr: | [0;m[1;31m20221212175240471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175240471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175240472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175240472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175240472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175240472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175240484 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175240492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175240492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175240492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:43.356405 run osmo-msc_10.42.42.6(pid=9156): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9156)] 17:52:43.405136 run osmo-msc_10.42.42.6(pid=9156): stdout: | (launched: 2022-12-12_17:52:42.255009) 17:52:43.455454 run osmo-msc_10.42.42.6(pid=9156): stderr: | [0;m[38;5;43m20221212175242527 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175242528 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc748869c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175242528 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175242528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175242528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175242528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175242530 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175242530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175242530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175242531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:52:43.505982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9149): Terminating (SIGTERM) 17:52:43.546538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9152): Terminating (SIGTERM) 17:52:43.587249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9155): Terminating (SIGTERM) 17:52:43.627977 --- ParallelTerminationStrategy: PID 9149 died... 17:52:43.647444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9149): Terminated: ok {rc=0} 17:52:43.692540 --- ParallelTerminationStrategy: PID 9152 died... 17:52:43.711434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9152): Terminated: ok {rc=0} 17:52:43.756800 --- ParallelTerminationStrategy: PID 9155 died... 17:52:43.776048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9155): Terminated: ok {rc=0} 17:52:43.864161 bus /sierra_3: Setting Powered False 17:52:44.965967 bus /sierra_3: Setting Powered False 17:52:46.085236 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 17:52:47.246494 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:52:47.258667 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 17:52:47.316127 tst mo_mt_call_osmux.py: using LAC 30486 17:52:47.435702 tst mo_mt_call_osmux.py: using RAC 141 17:52:47.561385 tst mo_mt_call_osmux.py: using CellId 30486 17:52:47.684793 tst mo_mt_call_osmux.py: using BVCI 30487 17:52:47.801202 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:52:47.812935 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:52:47.824474 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:52:47.835945 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:52:47.847573 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 17:52:47.859191 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:52:47.981440 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 17:52:48.109824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:48.624343 run create_hlr_db(pid=9158): Launched 17:52:48.761298 bus /sierra_2: Setting Powered False 17:52:49.826982 run create_hlr_db(pid=9158): Terminated: ok {rc=0} 17:52:50.288740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9160): Launched 17:52:50.623029 run osmo-hlr_10.42.42.2(pid=9161): Launched 17:52:50.751644 run osmo-stp_10.42.42.5: Starting osmo-stp 17:52:51.325940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9163): Launched 17:52:51.658994 run osmo-stp_10.42.42.5(pid=9164): Launched 17:52:51.787209 run osmo-msc_10.42.42.6: Starting osmo-msc 17:52:52.386598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9166): Launched 17:52:52.721157 run osmo-msc_10.42.42.6(pid=9167): Launched 17:52:52.908117 run osmo-stp_10.42.42.5(pid=9164): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9164)] 17:52:53.047083 run osmo-stp_10.42.42.5(pid=9164): stdout: | (launched: 2022-12-12_17:52:51.597662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:53.187122 run osmo-stp_10.42.42.5(pid=9164): stderr: | [0;m[38;5;43m20221212175251789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175251790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175251790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175251790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175251791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175251791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175251791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:53.324358 run osmo-stp_10.42.42.5(pid=9164): stdout: | (launched: 2022-12-12_17:52:51.597662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:52:53.456115 run osmo-stp_10.42.42.5(pid=9164): stderr: | [0;m[38;5;43m20221212175251789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175251790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175251790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175251790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175251791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175251791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175251791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:52:53.613492 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9164): Process ended prematurely: osmo-stp_10.42.42.5(pid=9164) [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9164)] [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 17:52:53.623159 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:52:53.651102 run osmo-hlr_10.42.42.2(pid=9161): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9161)] 17:52:53.701318 run osmo-hlr_10.42.42.2(pid=9161): stdout: | (launched: 2022-12-12_17:52:50.561735) 17:52:53.753306 run osmo-hlr_10.42.42.2(pid=9161): stderr: | [0;m[1;31m20221212175250760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175250760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175250760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175250760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175250760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175250760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175250775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175250785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175250785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175250785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:52:53.825693 run osmo-msc_10.42.42.6(pid=9167): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9167)] 17:52:53.875787 run osmo-msc_10.42.42.6(pid=9167): stdout: | (launched: 2022-12-12_17:52:52.659525) 17:52:53.927849 run osmo-msc_10.42.42.6(pid=9167): stderr: | [0;m[38;5;43m20221212175252986 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175252986 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe2b2f30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175252986 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175252986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175252986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175252987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175252988 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175252989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175252989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175252989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:52:53.980262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9160): Terminating (SIGTERM) 17:52:54.022074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9163): Terminating (SIGTERM) 17:52:54.063851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9166): Terminating (SIGTERM) 17:52:54.105790 --- ParallelTerminationStrategy: PID 9160 died... 17:52:54.125935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9160): Terminated: ok {rc=0} 17:52:54.171793 --- ParallelTerminationStrategy: PID 9163 died... 17:52:54.191259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9163): Terminated: ok {rc=0} 17:52:54.237224 --- ParallelTerminationStrategy: PID 9166 died... 17:52:54.256554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9166): Terminated: ok {rc=0} 17:52:54.345529 bus /sierra_3: Setting Powered False 17:52:55.443135 bus /sierra_3: Setting Powered False 17:52:56.556627 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 17:52:57.793728 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:52:57.800635 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 17:52:57.822046 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 17:52:57.849972 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 17:52:57.903891 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 17:52:57.925203 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 17:52:57.952570 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 17:52:58.505639 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 17:52:58.558940 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:52:58.570581 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:52:58.629063 tst mo_mt_call.py: using LAC 30487 17:52:58.762141 tst mo_mt_call.py: using RAC 142 17:52:58.893421 tst mo_mt_call.py: using CellId 30487 17:52:59.024349 tst mo_mt_call.py: using BVCI 30488 17:52:59.145940 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:52:59.157675 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:52:59.169346 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:52:59.180656 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:52:59.192255 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:52:59.203723 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:52:59.325884 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:52:59.448659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:52:59.963180 run create_hlr_db(pid=9172): Launched 17:53:00.100072 bus /sierra_2: Setting Powered False 17:53:01.164938 run create_hlr_db(pid=9172): Terminated: ok {rc=0} 17:53:01.634058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9174): Launched 17:53:01.989291 run osmo-hlr_10.42.42.2(pid=9175): Launched 17:53:02.164326 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:02.750710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9177): Launched 17:53:03.063398 run osmo-stp_10.42.42.5(pid=9178): Launched 17:53:03.183787 run osmo-msc_10.42.42.6: Starting osmo-msc 17:53:03.743701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9180): Launched 17:53:04.056181 run osmo-msc_10.42.42.6(pid=9181): Launched 17:53:04.231216 run osmo-stp_10.42.42.5(pid=9178): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9178)] 17:53:04.362121 run osmo-stp_10.42.42.5(pid=9178): stdout: | (launched: 2022-12-12_17:53:03.005607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:04.492511 run osmo-stp_10.42.42.5(pid=9178): stderr: | [0;m[38;5;43m20221212175303175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175303175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175303175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175303175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175303176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175303176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175303176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:04.620779 run osmo-stp_10.42.42.5(pid=9178): stdout: | (launched: 2022-12-12_17:53:03.005607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:04.744294 run osmo-stp_10.42.42.5(pid=9178): stderr: | [0;m[38;5;43m20221212175303175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175303175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175303175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175303175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175303176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175303176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175303176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:04.892235 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9178): Process ended prematurely: osmo-stp_10.42.42.5(pid=9178) [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9178)] [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 17:53:04.901495 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:53:04.928565 run osmo-hlr_10.42.42.2(pid=9175): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9175)] 17:53:04.977174 run osmo-hlr_10.42.42.2(pid=9175): stdout: | (launched: 2022-12-12_17:53:01.927801) 17:53:05.026828 run osmo-hlr_10.42.42.2(pid=9175): stderr: | [0;m[1;31m20221212175302242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175302242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175302242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175302242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175302242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175302242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175302256 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175302264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175302264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175302264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:05.096306 run osmo-msc_10.42.42.6(pid=9181): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9181)] 17:53:05.144453 run osmo-msc_10.42.42.6(pid=9181): stdout: | (launched: 2022-12-12_17:53:03.998481) 17:53:05.194257 run osmo-msc_10.42.42.6(pid=9181): stderr: | [0;m[38;5;43m20221212175304270 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175304271 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f012ba36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175304271 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175304271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175304271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175304271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175304273 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175304273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175304273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175304274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:53:05.245087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9174): Terminating (SIGTERM) 17:53:05.285200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9177): Terminating (SIGTERM) 17:53:05.325377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9180): Terminating (SIGTERM) 17:53:05.365782 --- ParallelTerminationStrategy: PID 9174 died... 17:53:05.384992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9174): Terminated: ok {rc=0} 17:53:05.429481 --- ParallelTerminationStrategy: PID 9177 died... 17:53:05.448027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9177): Terminated: ok {rc=0} 17:53:05.492692 --- ParallelTerminationStrategy: PID 9180 died... 17:53:05.511469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9180): Terminated: ok {rc=0} 17:53:05.595883 bus /sierra_3: Setting Powered False 17:53:06.694549 bus /sierra_3: Setting Powered False 17:53:07.815444 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 17:53:08.963903 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:53:08.976236 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 17:53:09.033622 tst mo_mt_call_osmux.py: using LAC 30488 17:53:09.157857 tst mo_mt_call_osmux.py: using RAC 143 17:53:09.289800 tst mo_mt_call_osmux.py: using CellId 30488 17:53:09.423304 tst mo_mt_call_osmux.py: using BVCI 30489 17:53:09.545264 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:53:09.557154 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:53:09.568869 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:53:09.580506 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:53:09.592024 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 17:53:09.603506 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:53:09.727252 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 17:53:09.849326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:10.365284 run create_hlr_db(pid=9183): Launched 17:53:10.500541 bus /sierra_2: Setting Powered False 17:53:11.566407 run create_hlr_db(pid=9183): Terminated: ok {rc=0} 17:53:12.027309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9185): Launched 17:53:12.359884 run osmo-hlr_10.42.42.2(pid=9186): Launched 17:53:12.487754 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:13.058181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9188): Launched 17:53:13.390624 run osmo-stp_10.42.42.5(pid=9189): Launched 17:53:13.517941 run osmo-msc_10.42.42.6: Starting osmo-msc 17:53:14.116751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9191): Launched 17:53:14.450252 run osmo-msc_10.42.42.6(pid=9192): Launched 17:53:14.636237 run osmo-stp_10.42.42.5(pid=9189): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9189)] 17:53:14.774507 run osmo-stp_10.42.42.5(pid=9189): stdout: | (launched: 2022-12-12_17:53:13.329248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:14.913446 run osmo-stp_10.42.42.5(pid=9189): stderr: | [0;m[38;5;43m20221212175313520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175313520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175313521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175313521 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175313522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175313522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175313522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:15.050457 run osmo-stp_10.42.42.5(pid=9189): stdout: | (launched: 2022-12-12_17:53:13.329248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:15.182022 run osmo-stp_10.42.42.5(pid=9189): stderr: | [0;m[38;5;43m20221212175313520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175313520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175313521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175313521 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175313522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175313522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175313522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:15.339755 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9189): Process ended prematurely: osmo-stp_10.42.42.5(pid=9189) [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9189)] [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 17:53:15.349185 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:53:15.377193 run osmo-hlr_10.42.42.2(pid=9186): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9186)] 17:53:15.427236 run osmo-hlr_10.42.42.2(pid=9186): stdout: | (launched: 2022-12-12_17:53:12.298436) 17:53:15.478667 run osmo-hlr_10.42.42.2(pid=9186): stderr: | [0;m[1;31m20221212175312497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175312497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175312497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175312497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175312498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175312498 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175312544 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175312553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175312553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175312553 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:15.550633 run osmo-msc_10.42.42.6(pid=9192): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9192)] 17:53:15.600746 run osmo-msc_10.42.42.6(pid=9192): stdout: | (launched: 2022-12-12_17:53:14.388865) 17:53:15.652421 run osmo-msc_10.42.42.6(pid=9192): stderr: | [0;m[38;5;43m20221212175314712 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175314712 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f901730fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175314712 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175314712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175314713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175314713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175314715 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175314715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175314715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175314715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:53:15.704721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9185): Terminating (SIGTERM) 17:53:15.746345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9188): Terminating (SIGTERM) 17:53:15.787868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9191): Terminating (SIGTERM) 17:53:15.833860 --- ParallelTerminationStrategy: PID 9185 died... 17:53:15.855619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9185): Terminated: ok {rc=0} 17:53:15.910200 --- ParallelTerminationStrategy: PID 9188 died... 17:53:15.930643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9188): Terminated: ok {rc=0} 17:53:15.978020 --- ParallelTerminationStrategy: PID 9191 died... 17:53:15.998997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9191): Terminated: ok {rc=0} 17:53:16.090645 bus /sierra_3: Setting Powered False 17:53:17.189825 bus /sierra_3: Setting Powered False 17:53:18.309623 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 17:53:19.547274 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:53:19.554752 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 17:53:19.576098 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 17:53:19.603778 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 17:53:19.658239 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 17:53:19.679485 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 17:53:19.706600 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 17:53:20.258379 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 17:53:20.311350 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:53:20.323004 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:53:20.381172 tst mo_mt_call.py: using LAC 30489 17:53:20.513026 tst mo_mt_call.py: using RAC 144 17:53:20.649161 tst mo_mt_call.py: using CellId 30489 17:53:20.778787 tst mo_mt_call.py: using BVCI 30490 17:53:20.900935 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:53:20.913069 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:53:20.924488 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:53:20.935852 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:53:20.947234 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:53:20.958787 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:53:21.075182 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:53:21.198449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:21.714369 run create_hlr_db(pid=9197): Launched 17:53:21.848318 bus /sierra_2: Setting Powered False 17:53:22.914381 run create_hlr_db(pid=9197): Terminated: ok {rc=0} 17:53:23.376105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9199): Launched 17:53:23.711643 run osmo-hlr_10.42.42.2(pid=9200): Launched 17:53:23.839560 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:24.409637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9202): Launched 17:53:24.743332 run osmo-stp_10.42.42.5(pid=9203): Launched 17:53:24.871371 run osmo-msc_10.42.42.6: Starting osmo-msc 17:53:25.469357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9205): Launched 17:53:25.803544 run osmo-msc_10.42.42.6(pid=9206): Launched 17:53:25.990577 run osmo-stp_10.42.42.5(pid=9203): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9203)] 17:53:26.129364 run osmo-stp_10.42.42.5(pid=9203): stdout: | (launched: 2022-12-12_17:53:24.682009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:26.271154 run osmo-stp_10.42.42.5(pid=9203): stderr: | [0;m[38;5;43m20221212175324874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175324875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175324875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175324875 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175324876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175324876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175324876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:26.408625 run osmo-stp_10.42.42.5(pid=9203): stdout: | (launched: 2022-12-12_17:53:24.682009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:26.540262 run osmo-stp_10.42.42.5(pid=9203): stderr: | [0;m[38;5;43m20221212175324874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175324875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175324875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175324875 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175324876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175324876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175324876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:26.698026 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9203): Process ended prematurely: osmo-stp_10.42.42.5(pid=9203) [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9203)] [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 17:53:26.707835 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:53:26.735709 run osmo-hlr_10.42.42.2(pid=9200): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9200)] 17:53:26.786219 run osmo-hlr_10.42.42.2(pid=9200): stdout: | (launched: 2022-12-12_17:53:23.650547) 17:53:26.838242 run osmo-hlr_10.42.42.2(pid=9200): stderr: | [0;m[1;31m20221212175323848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175323848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175323848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175323848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175323848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175323848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175323861 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175323869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175323870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175323870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:26.910879 run osmo-msc_10.42.42.6(pid=9206): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9206)] 17:53:26.961239 run osmo-msc_10.42.42.6(pid=9206): stdout: | (launched: 2022-12-12_17:53:25.742082) 17:53:27.012749 run osmo-msc_10.42.42.6(pid=9206): stderr: | [0;m[38;5;43m20221212175326064 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175326065 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdeff6c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175326065 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175326065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175326065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175326065 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175326067 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175326067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175326067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175326068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:53:27.065334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9199): Terminating (SIGTERM) 17:53:27.106929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9202): Terminating (SIGTERM) 17:53:27.148676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9205): Terminating (SIGTERM) 17:53:27.191558 --- ParallelTerminationStrategy: PID 9199 died... 17:53:27.211862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9199): Terminated: ok {rc=0} 17:53:27.258402 --- ParallelTerminationStrategy: PID 9202 died... 17:53:27.278162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9202): Terminated: ok {rc=0} 17:53:27.324301 --- ParallelTerminationStrategy: PID 9205 died... 17:53:27.343998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9205): Terminated: ok {rc=0} 17:53:27.432898 bus /sierra_3: Setting Powered False 17:53:28.530583 bus /sierra_3: Setting Powered False 17:53:29.646288 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 17:53:30.793981 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:53:30.805991 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 17:53:30.874691 tst mo_mt_call_osmux.py: using LAC 30490 17:53:31.017166 tst mo_mt_call_osmux.py: using RAC 145 17:53:31.146611 tst mo_mt_call_osmux.py: using CellId 30490 17:53:31.273322 tst mo_mt_call_osmux.py: using BVCI 30491 17:53:31.390666 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:53:31.403483 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:53:31.416171 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:53:31.429349 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:53:31.443821 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 17:53:31.456100 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:53:31.581036 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 17:53:31.726585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:32.220063 run create_hlr_db(pid=9208): Launched 17:53:32.386311 bus /sierra_2: Setting Powered False 17:53:33.452418 run create_hlr_db(pid=9208): Terminated: ok {rc=0} 17:53:33.895901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9210): Launched 17:53:34.207000 run osmo-hlr_10.42.42.2(pid=9211): Launched 17:53:34.327274 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:34.870309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9213): Launched 17:53:35.181236 run osmo-stp_10.42.42.5(pid=9214): Launched 17:53:35.300400 run osmo-msc_10.42.42.6: Starting osmo-msc 17:53:35.860324 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9216): Launched 17:53:36.173326 run osmo-msc_10.42.42.6(pid=9217): Launched 17:53:36.349600 run osmo-stp_10.42.42.5(pid=9214): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9214)] 17:53:36.480578 run osmo-stp_10.42.42.5(pid=9214): stdout: | (launched: 2022-12-12_17:53:35.123541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:36.610837 run osmo-stp_10.42.42.5(pid=9214): stderr: | [0;m[38;5;43m20221212175335295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175335295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175335296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175335296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175335297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175335297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175335297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:36.738942 run osmo-stp_10.42.42.5(pid=9214): stdout: | (launched: 2022-12-12_17:53:35.123541) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:36.861904 run osmo-stp_10.42.42.5(pid=9214): stderr: | [0;m[38;5;43m20221212175335295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175335295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175335296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175335296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175335297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175335297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175335297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:37.008438 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9214): Process ended prematurely: osmo-stp_10.42.42.5(pid=9214) [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9214)] [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 17:53:37.017428 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:53:37.044408 run osmo-hlr_10.42.42.2(pid=9211): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9211)] 17:53:37.092882 run osmo-hlr_10.42.42.2(pid=9211): stdout: | (launched: 2022-12-12_17:53:34.149378) 17:53:37.142673 run osmo-hlr_10.42.42.2(pid=9211): stderr: | [0;m[1;31m20221212175334325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175334325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175334325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175334326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175334326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175334326 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175334338 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175334348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175334349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175334349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:37.212335 run osmo-msc_10.42.42.6(pid=9217): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9217)] 17:53:37.260341 run osmo-msc_10.42.42.6(pid=9217): stdout: | (launched: 2022-12-12_17:53:36.115324) 17:53:37.310119 run osmo-msc_10.42.42.6(pid=9217): stderr: | [0;m[38;5;43m20221212175336385 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175336385 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5682edbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175336385 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175336385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175336385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175336386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175336387 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175336388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175336388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175336388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:53:37.360148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9210): Terminating (SIGTERM) 17:53:37.399921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9213): Terminating (SIGTERM) 17:53:37.439640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9216): Terminating (SIGTERM) 17:53:37.480125 --- ParallelTerminationStrategy: PID 9210 died... 17:53:37.499465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9210): Terminated: ok {rc=0} 17:53:37.543793 --- ParallelTerminationStrategy: PID 9213 died... 17:53:37.562538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9213): Terminated: ok {rc=0} 17:53:37.606761 --- ParallelTerminationStrategy: PID 9216 died... 17:53:37.625320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9216): Terminated: ok {rc=0} 17:53:37.711617 bus /sierra_3: Setting Powered False 17:53:38.812659 bus /sierra_3: Setting Powered False 17:53:39.930928 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 17:53:41.169977 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:53:41.177179 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 17:53:41.199622 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 17:53:41.227930 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 17:53:41.283620 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 17:53:41.306061 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 17:53:41.334454 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 17:53:41.882786 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 17:53:41.936425 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:53:41.948113 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:53:42.010781 tst mo_mt_call.py: using LAC 30491 17:53:42.140545 tst mo_mt_call.py: using RAC 146 17:53:42.268864 tst mo_mt_call.py: using CellId 30491 17:53:42.400282 tst mo_mt_call.py: using BVCI 30492 17:53:42.522145 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:53:42.533906 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:53:42.545349 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:53:42.556701 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:53:42.568457 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:53:42.580008 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:53:42.697779 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:53:42.815309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:43.297299 run create_hlr_db(pid=9222): Launched 17:53:43.418256 bus /sierra_2: Setting Powered False 17:53:44.480584 run create_hlr_db(pid=9222): Terminated: ok {rc=0} 17:53:44.934276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9224): Launched 17:53:45.268604 run osmo-hlr_10.42.42.2(pid=9225): Launched 17:53:45.396543 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:45.992645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9227): Launched 17:53:46.403735 run osmo-stp_10.42.42.5(pid=9255): Launched 17:53:46.733219 run osmo-msc_10.42.42.6: Starting osmo-msc 17:53:47.456472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9290): Launched 17:53:47.892862 run osmo-msc_10.42.42.6(pid=9309): Launched 17:53:48.367138 run osmo-stp_10.42.42.5(pid=9255): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9255)] 17:53:48.709489 run osmo-stp_10.42.42.5(pid=9255): stdout: | (launched: 2022-12-12_17:53:46.327902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:49.049214 run osmo-stp_10.42.42.5(pid=9255): stderr: | [0;m[38;5;43m20221212175346589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175346589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175346589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175346590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175346590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175346590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175346590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:49.211388 run osmo-stp_10.42.42.5(pid=9255): stdout: | (launched: 2022-12-12_17:53:46.327902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:53:49.368459 run osmo-stp_10.42.42.5(pid=9255): stderr: | [0;m[38;5;43m20221212175346589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175346589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175346589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175346590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175346590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175346590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175346590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:53:49.563382 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9255): Process ended prematurely: osmo-stp_10.42.42.5(pid=9255) [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9255)] [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 17:53:49.574795 tst mo_mt_call.py:8: Test FAILED (7.7 sec) 17:53:49.611974 run osmo-hlr_10.42.42.2(pid=9225): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9225)] 17:53:49.672930 run osmo-hlr_10.42.42.2(pid=9225): stdout: | (launched: 2022-12-12_17:53:45.207280) 17:53:49.740065 run osmo-hlr_10.42.42.2(pid=9225): stderr: | [0;m[1;31m20221212175345406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175345406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175345406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175345406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175345406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175345406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175345419 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175345428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175345428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175345428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:53:49.815179 run osmo-msc_10.42.42.6(pid=9309): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9309)] 17:53:49.866470 run osmo-msc_10.42.42.6(pid=9309): stdout: | (launched: 2022-12-12_17:53:47.822551) 17:53:49.922157 run osmo-msc_10.42.42.6(pid=9309): stderr: | [0;m[38;5;43m20221212175348540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175348540 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4df63b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175348540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175348554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175348555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175348555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175348557 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175348557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175348557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175348557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:53:49.977394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9224): Terminating (SIGTERM) 17:53:50.021722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9227): Terminating (SIGTERM) 17:53:50.066722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9290): Terminating (SIGTERM) 17:53:50.112737 --- ParallelTerminationStrategy: PID 9224 died... 17:53:50.133240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9224): Terminated: ok {rc=0} 17:53:50.183862 --- ParallelTerminationStrategy: PID 9227 died... 17:53:50.203847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9227): Terminated: ok {rc=0} 17:53:50.252191 --- ParallelTerminationStrategy: PID 9290 died... 17:53:50.272303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9290): Terminated: ok {rc=0} 17:53:50.364087 bus /sierra_3: Setting Powered False 17:53:51.466133 bus /sierra_3: Setting Powered False 17:53:52.587122 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 17:53:53.744034 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:53:53.757815 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 17:53:53.818644 tst mo_mt_call_osmux.py: using LAC 30492 17:53:53.952267 tst mo_mt_call_osmux.py: using RAC 147 17:53:54.087277 tst mo_mt_call_osmux.py: using CellId 30492 17:53:54.218610 tst mo_mt_call_osmux.py: using BVCI 30493 17:53:54.341223 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:53:54.354235 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:53:54.367808 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:53:54.380671 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:53:54.393517 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 17:53:54.406323 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:53:54.533542 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 17:53:54.661772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:53:55.194662 run create_hlr_db(pid=9506): Launched 17:53:55.352661 bus /sierra_2: Setting Powered False 17:53:56.416922 run create_hlr_db(pid=9506): Terminated: ok {rc=0} 17:53:56.871714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9508): Launched 17:53:57.209685 run osmo-hlr_10.42.42.2(pid=9509): Launched 17:53:57.461086 run osmo-stp_10.42.42.5: Starting osmo-stp 17:53:58.173572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9511): Launched 17:53:58.521219 run osmo-stp_10.42.42.5(pid=9512): Launched 17:53:58.771016 run osmo-msc_10.42.42.6: Starting osmo-msc 17:53:59.462780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9514): Launched 17:53:59.811804 run osmo-msc_10.42.42.6(pid=9515): Launched 17:54:00.180753 run osmo-stp_10.42.42.5(pid=9512): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9512)] 17:54:00.463945 run osmo-stp_10.42.42.5(pid=9512): stdout: | (launched: 2022-12-12_17:53:58.459655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:00.635529 run osmo-stp_10.42.42.5(pid=9512): stderr: | [0;m[38;5;43m20221212175358752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175358752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175358753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175358753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175358754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175358754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175358754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:00.775673 run osmo-stp_10.42.42.5(pid=9512): stdout: | (launched: 2022-12-12_17:53:58.459655) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:00.948724 run osmo-stp_10.42.42.5(pid=9512): stderr: | [0;m[38;5;43m20221212175358752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175358752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175358753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175358753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175358754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175358754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175358754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:01.111436 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9512): Process ended prematurely: osmo-stp_10.42.42.5(pid=9512) [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9512)] [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 17:54:01.121788 tst mo_mt_call_osmux.py:8: Test FAILED (7.4 sec) 17:54:01.151256 run osmo-hlr_10.42.42.2(pid=9509): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9509)] 17:54:01.203622 run osmo-hlr_10.42.42.2(pid=9509): stdout: | (launched: 2022-12-12_17:53:57.148504) 17:54:01.257717 run osmo-hlr_10.42.42.2(pid=9509): stderr: | [0;m[1;31m20221212175357487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175357487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175357487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175357487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175357487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175357487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175357505 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175357522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175357522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175357522 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:01.331716 run osmo-msc_10.42.42.6(pid=9515): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9515)] 17:54:01.383336 run osmo-msc_10.42.42.6(pid=9515): stdout: | (launched: 2022-12-12_17:53:59.750451) 17:54:01.436664 run osmo-msc_10.42.42.6(pid=9515): stderr: | [0;m[38;5;43m20221212175400253 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175400254 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fedd0949c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175400254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175400254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175400254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175400254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175400256 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175400256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175400257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175400257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:54:01.490511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9508): Terminating (SIGTERM) 17:54:01.533973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9511): Terminating (SIGTERM) 17:54:01.577583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9514): Terminating (SIGTERM) 17:54:01.623266 --- ParallelTerminationStrategy: PID 9508 died... 17:54:01.644314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9508): Terminated: ok {rc=0} 17:54:01.693562 --- ParallelTerminationStrategy: PID 9511 died... 17:54:01.713829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9511): Terminated: ok {rc=0} 17:54:01.761667 --- ParallelTerminationStrategy: PID 9514 died... 17:54:01.782272 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9514): Terminated: ok {rc=0} 17:54:01.883533 bus /sierra_3: Setting Powered False 17:54:02.998475 bus /sierra_3: Setting Powered False 17:54:04.118782 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:54:05.369642 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:54:05.377729 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:54:05.400604 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 17:54:05.430099 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:54:05.483810 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:54:05.506389 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 17:54:05.535680 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:54:06.088430 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 17:54:06.145845 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:54:06.158763 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:54:06.222816 tst mo_mt_call.py: using LAC 30493 17:54:06.358119 tst mo_mt_call.py: using RAC 148 17:54:06.491838 tst mo_mt_call.py: using CellId 30493 17:54:06.625259 tst mo_mt_call.py: using BVCI 30494 17:54:06.750932 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:54:06.764029 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:54:06.777652 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:54:06.790893 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:54:06.803000 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:54:06.815660 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:54:06.943696 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:54:07.072358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:07.606246 run create_hlr_db(pid=9520): Launched 17:54:07.780411 bus /sierra_2: Setting Powered False 17:54:08.846937 run create_hlr_db(pid=9520): Terminated: ok {rc=0} 17:54:09.327105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9522): Launched 17:54:09.684304 run osmo-hlr_10.42.42.2(pid=9523): Launched 17:54:09.941740 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:10.555474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9525): Launched 17:54:10.890902 run osmo-stp_10.42.42.5(pid=9526): Launched 17:54:11.018945 run osmo-msc_10.42.42.6: Starting osmo-msc 17:54:11.618367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9528): Launched 17:54:11.952887 run osmo-msc_10.42.42.6(pid=9529): Launched 17:54:12.139832 run osmo-stp_10.42.42.5(pid=9526): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9526)] 17:54:12.278584 run osmo-stp_10.42.42.5(pid=9526): stdout: | (launched: 2022-12-12_17:54:10.829421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:12.418029 run osmo-stp_10.42.42.5(pid=9526): stderr: | [0;m[38;5;43m20221212175411022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175411022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175411023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175411023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175411024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175411024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175411024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:12.556272 run osmo-stp_10.42.42.5(pid=9526): stdout: | (launched: 2022-12-12_17:54:10.829421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:12.688624 run osmo-stp_10.42.42.5(pid=9526): stderr: | [0;m[38;5;43m20221212175411022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175411022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175411023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175411023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175411024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175411024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175411024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:12.847077 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9526): Process ended prematurely: osmo-stp_10.42.42.5(pid=9526) [trial-2380↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9526)] [trial-2380↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 17:54:12.856730 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 17:54:12.885295 run osmo-hlr_10.42.42.2(pid=9523): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9523)] 17:54:12.936291 run osmo-hlr_10.42.42.2(pid=9523): stdout: | (launched: 2022-12-12_17:54:09.621843) 17:54:12.988670 run osmo-hlr_10.42.42.2(pid=9523): stderr: | [0;m[1;31m20221212175409930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175409930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175409930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175409930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175409930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175409930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175409954 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175409962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175409963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175409963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:13.061593 run osmo-msc_10.42.42.6(pid=9529): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9529)] 17:54:13.112257 run osmo-msc_10.42.42.6(pid=9529): stdout: | (launched: 2022-12-12_17:54:11.891071) 17:54:13.164625 run osmo-msc_10.42.42.6(pid=9529): stderr: | [0;m[38;5;43m20221212175412215 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175412215 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9127814c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175412216 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175412216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175412216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175412216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175412218 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175412218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175412218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175412218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:54:13.217445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9522): Terminating (SIGTERM) 17:54:13.259703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9525): Terminating (SIGTERM) 17:54:13.301954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9528): Terminating (SIGTERM) 17:54:13.344293 --- ParallelTerminationStrategy: PID 9522 died... 17:54:13.364729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9522): Terminated: ok {rc=0} 17:54:13.411902 --- ParallelTerminationStrategy: PID 9525 died... 17:54:13.431965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9525): Terminated: ok {rc=0} 17:54:13.478976 --- ParallelTerminationStrategy: PID 9528 died... 17:54:13.498741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9528): Terminated: ok {rc=0} 17:54:13.586662 bus /sierra_3: Setting Powered False 17:54:14.686401 bus /sierra_3: Setting Powered False 17:54:15.803454 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 17:54:16.995271 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:54:17.012996 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:54:17.088446 tst mo_mt_call_osmux.py: using LAC 30494 17:54:17.212309 tst mo_mt_call_osmux.py: using RAC 149 17:54:17.349914 tst mo_mt_call_osmux.py: using CellId 30494 17:54:17.478000 tst mo_mt_call_osmux.py: using BVCI 30495 17:54:17.593639 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:54:17.605125 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:54:17.616332 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:54:17.628039 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:54:17.639651 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 17:54:17.651271 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:54:17.774625 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:54:17.898645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:18.415713 run create_hlr_db(pid=9531): Launched 17:54:18.552265 bus /sierra_2: Setting Powered False 17:54:19.617847 run create_hlr_db(pid=9531): Terminated: ok {rc=0} 17:54:20.062337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9533): Launched 17:54:20.375718 run osmo-hlr_10.42.42.2(pid=9534): Launched 17:54:20.494275 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:21.032375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9536): Launched 17:54:21.346342 run osmo-stp_10.42.42.5(pid=9537): Launched 17:54:21.467200 run osmo-msc_10.42.42.6: Starting osmo-msc 17:54:22.029644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9539): Launched 17:54:22.343122 run osmo-msc_10.42.42.6(pid=9540): Launched 17:54:22.518579 run osmo-stp_10.42.42.5(pid=9537): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9537)] 17:54:22.649583 run osmo-stp_10.42.42.5(pid=9537): stdout: | (launched: 2022-12-12_17:54:21.288138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:22.779934 run osmo-stp_10.42.42.5(pid=9537): stderr: | [0;m[38;5;43m20221212175421459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175421459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175421459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175421459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175421460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175421460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175421460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:22.908537 run osmo-stp_10.42.42.5(pid=9537): stdout: | (launched: 2022-12-12_17:54:21.288138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:23.032155 run osmo-stp_10.42.42.5(pid=9537): stderr: | [0;m[38;5;43m20221212175421459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175421459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175421459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175421459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175421460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175421460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175421460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:23.180457 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9537): Process ended prematurely: osmo-stp_10.42.42.5(pid=9537) [trial-2380↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9537)] [trial-2380↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 17:54:23.189688 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 17:54:23.217293 run osmo-hlr_10.42.42.2(pid=9534): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9534)] 17:54:23.266384 run osmo-hlr_10.42.42.2(pid=9534): stdout: | (launched: 2022-12-12_17:54:20.317978) 17:54:23.316719 run osmo-hlr_10.42.42.2(pid=9534): stderr: | [0;m[1;31m20221212175420491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175420491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175420491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175420491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175420491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175420491 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175420504 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175420514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175420514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175420514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:23.386864 run osmo-msc_10.42.42.6(pid=9540): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9540)] 17:54:23.435112 run osmo-msc_10.42.42.6(pid=9540): stdout: | (launched: 2022-12-12_17:54:22.285269) 17:54:23.485095 run osmo-msc_10.42.42.6(pid=9540): stderr: | [0;m[38;5;43m20221212175422557 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175422557 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc36fd7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175422557 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175422557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175422558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175422558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175422559 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175422560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175422560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175422560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:54:23.535538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9533): Terminating (SIGTERM) 17:54:23.575549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9536): Terminating (SIGTERM) 17:54:23.615711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9539): Terminating (SIGTERM) 17:54:23.656343 --- ParallelTerminationStrategy: PID 9533 died... 17:54:23.675729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9533): Terminated: ok {rc=0} 17:54:23.720847 --- ParallelTerminationStrategy: PID 9536 died... 17:54:23.739589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9536): Terminated: ok {rc=0} 17:54:23.784282 --- ParallelTerminationStrategy: PID 9539 died... 17:54:23.803135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9539): Terminated: ok {rc=0} 17:54:23.888045 bus /sierra_3: Setting Powered False 17:54:24.985343 bus /sierra_3: Setting Powered False 17:54:26.101430 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:54:27.337098 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:54:27.343103 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:54:27.364088 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 17:54:27.391963 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 17:54:27.445592 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:54:27.466713 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 17:54:27.493438 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 17:54:28.039710 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 17:54:28.090062 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:54:28.101016 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:54:28.157358 tst mo_mt_call.py: using LAC 30495 17:54:28.278931 tst mo_mt_call.py: using RAC 150 17:54:28.402201 tst mo_mt_call.py: using CellId 30495 17:54:28.525645 tst mo_mt_call.py: using BVCI 30496 17:54:28.647911 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:54:28.659925 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:54:28.671482 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:54:28.683163 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:54:28.694859 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:54:28.706155 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:54:28.830596 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:54:28.950059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:29.430199 run create_hlr_db(pid=9546): Launched 17:54:29.551412 bus /sierra_2: Setting Powered False 17:54:30.612889 run create_hlr_db(pid=9546): Terminated: ok {rc=0} 17:54:31.093754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9548): Launched 17:54:31.423598 run osmo-hlr_10.42.42.2(pid=9549): Launched 17:54:31.673456 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:32.260216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9551): Launched 17:54:32.590517 run osmo-stp_10.42.42.5(pid=9552): Launched 17:54:32.713590 run osmo-msc_10.42.42.6: Starting osmo-msc 17:54:33.275242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9554): Launched 17:54:33.588660 run osmo-msc_10.42.42.6(pid=9555): Launched 17:54:33.763779 run osmo-stp_10.42.42.5(pid=9552): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9552)] 17:54:33.894389 run osmo-stp_10.42.42.5(pid=9552): stdout: | (launched: 2022-12-12_17:54:32.532319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:34.025280 run osmo-stp_10.42.42.5(pid=9552): stderr: | [0;m[38;5;43m20221212175432697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175432697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175432698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175432698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175432699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175432699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175432699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:34.153826 run osmo-stp_10.42.42.5(pid=9552): stdout: | (launched: 2022-12-12_17:54:32.532319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:34.277527 run osmo-stp_10.42.42.5(pid=9552): stderr: | [0;m[38;5;43m20221212175432697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175432697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175432698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175432698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175432699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175432699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175432699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:34.428495 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9552): Process ended prematurely: osmo-stp_10.42.42.5(pid=9552) [trial-2380↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9552)] [trial-2380↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 17:54:34.437553 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 17:54:34.465044 run osmo-hlr_10.42.42.2(pid=9549): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9549)] 17:54:34.514086 run osmo-hlr_10.42.42.2(pid=9549): stdout: | (launched: 2022-12-12_17:54:31.363221) 17:54:34.564648 run osmo-hlr_10.42.42.2(pid=9549): stderr: | [0;m[1;31m20221212175431586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175431586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175431586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175431586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175431586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175431586 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175431599 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175431616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175431616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175431616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:34.635030 run osmo-msc_10.42.42.6(pid=9555): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9555)] 17:54:34.683752 run osmo-msc_10.42.42.6(pid=9555): stdout: | (launched: 2022-12-12_17:54:33.530784) 17:54:34.733658 run osmo-msc_10.42.42.6(pid=9555): stderr: | [0;m[38;5;43m20221212175433802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175433802 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2ec728dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175433802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175433802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175433802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175433802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175433804 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175433804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175433805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175433805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:54:34.783880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9548): Terminating (SIGTERM) 17:54:34.823917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9551): Terminating (SIGTERM) 17:54:34.864127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9554): Terminating (SIGTERM) 17:54:34.904814 --- ParallelTerminationStrategy: PID 9548 died... 17:54:34.924257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9548): Terminated: ok {rc=0} 17:54:34.969494 --- ParallelTerminationStrategy: PID 9551 died... 17:54:34.988342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9551): Terminated: ok {rc=0} 17:54:35.033220 --- ParallelTerminationStrategy: PID 9554 died... 17:54:35.052048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9554): Terminated: ok {rc=0} 17:54:35.137752 bus /sierra_3: Setting Powered False 17:54:36.236844 bus /sierra_3: Setting Powered False 17:54:37.357118 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 17:54:38.510663 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:54:38.522954 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:54:38.581931 tst mo_mt_call_osmux.py: using LAC 30496 17:54:38.711381 tst mo_mt_call_osmux.py: using RAC 151 17:54:38.840582 tst mo_mt_call_osmux.py: using CellId 30496 17:54:38.970582 tst mo_mt_call_osmux.py: using BVCI 30497 17:54:39.093435 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:54:39.105052 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:54:39.116340 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:54:39.127635 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:54:39.138961 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 17:54:39.150319 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:54:39.267898 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 17:54:39.390698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:39.906842 run create_hlr_db(pid=9560): Launched 17:54:40.042189 bus /sierra_2: Setting Powered False 17:54:41.107835 run create_hlr_db(pid=9560): Terminated: ok {rc=0} 17:54:41.570717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9562): Launched 17:54:41.904032 run osmo-hlr_10.42.42.2(pid=9563): Launched 17:54:42.033551 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:42.604037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9565): Launched 17:54:42.936165 run osmo-stp_10.42.42.5(pid=9566): Launched 17:54:43.064343 run osmo-msc_10.42.42.6: Starting osmo-msc 17:54:43.668861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9568): Launched 17:54:44.004628 run osmo-msc_10.42.42.6(pid=9569): Launched 17:54:44.191496 run osmo-stp_10.42.42.5(pid=9566): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9566)] 17:54:44.330735 run osmo-stp_10.42.42.5(pid=9566): stdout: | (launched: 2022-12-12_17:54:42.874730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:44.470243 run osmo-stp_10.42.42.5(pid=9566): stderr: | [0;m[38;5;43m20221212175443069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175443069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175443070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175443070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175443070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175443071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175443071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:44.608262 run osmo-stp_10.42.42.5(pid=9566): stdout: | (launched: 2022-12-12_17:54:42.874730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:44.740392 run osmo-stp_10.42.42.5(pid=9566): stderr: | [0;m[38;5;43m20221212175443069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175443069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175443070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175443070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175443070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175443071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175443071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:44.898876 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9566): Process ended prematurely: osmo-stp_10.42.42.5(pid=9566) [trial-2380↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9566)] [trial-2380↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 17:54:44.908684 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 17:54:44.937052 run osmo-hlr_10.42.42.2(pid=9563): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9563)] 17:54:44.988026 run osmo-hlr_10.42.42.2(pid=9563): stdout: | (launched: 2022-12-12_17:54:41.842545) 17:54:45.040514 run osmo-hlr_10.42.42.2(pid=9563): stderr: | [0;m[1;31m20221212175442040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175442040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175442040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175442041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175442041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175442041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175442053 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175442062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175442062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175442062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:45.113698 run osmo-msc_10.42.42.6(pid=9569): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9569)] 17:54:45.164563 run osmo-msc_10.42.42.6(pid=9569): stdout: | (launched: 2022-12-12_17:54:43.942633) 17:54:45.216822 run osmo-msc_10.42.42.6(pid=9569): stderr: | [0;m[38;5;43m20221212175444267 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175444267 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff7e1228c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175444267 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175444267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175444267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175444267 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175444269 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175444269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175444270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175444270 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:54:45.269524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9562): Terminating (SIGTERM) 17:54:45.311652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9565): Terminating (SIGTERM) 17:54:45.354084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9568): Terminating (SIGTERM) 17:54:45.396708 --- ParallelTerminationStrategy: PID 9562 died... 17:54:45.417405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9562): Terminated: ok {rc=0} 17:54:45.464514 --- ParallelTerminationStrategy: PID 9565 died... 17:54:45.484570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9565): Terminated: ok {rc=0} 17:54:45.531347 --- ParallelTerminationStrategy: PID 9568 died... 17:54:45.551307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9568): Terminated: ok {rc=0} 17:54:45.640782 bus /sierra_3: Setting Powered False 17:54:46.746912 bus /sierra_3: Setting Powered False 17:54:47.876706 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 emergency:oc2g --------------------------------------------------------------------- 17:54:49.117433 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:54:49.122161 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 17:54:49.143400 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 17:54:49.171056 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 17:54:49.258288 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 17:54:49.279514 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 17:54:49.307103 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 17:54:49.891566 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2380 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 17:54:49.896837 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:54:49.908475 tst emergency:oc2g: Using 1 x bts (candidates: 1) 17:54:49.945227 tst emergency_mo_mt_call.py: using LAC 30497 17:54:50.074013 tst emergency_mo_mt_call.py: using RAC 152 17:54:50.202763 tst emergency_mo_mt_call.py: using CellId 30497 17:54:50.345217 tst emergency_mo_mt_call.py: using BVCI 30498 17:54:50.464216 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:54:50.475384 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:54:50.486501 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:54:50.497517 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:54:50.508416 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:54:50.519377 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:54:50.636163 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:54:50.752586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:54:51.228926 run create_hlr_db(pid=9574): Launched 17:54:51.347613 bus /sierra_2: Setting Powered False 17:54:52.407851 run create_hlr_db(pid=9574): Terminated: ok {rc=0} 17:54:52.856130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9576): Launched 17:54:53.186017 run osmo-hlr_10.42.42.2(pid=9577): Launched 17:54:53.311304 run osmo-stp_10.42.42.5: Starting osmo-stp 17:54:53.874508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9579): Launched 17:54:54.203275 run osmo-stp_10.42.42.5(pid=9580): Launched 17:54:54.338608 tst emergency_mo_mt_call.py: using MSISDN 7897 17:54:54.505571 run osmo-msc_10.42.42.6: Starting osmo-msc 17:54:55.094621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9582): Launched 17:54:55.424109 run osmo-msc_10.42.42.6(pid=9583): Launched 17:54:55.607823 run osmo-stp_10.42.42.5(pid=9580): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9580)] 17:54:55.744779 run osmo-stp_10.42.42.5(pid=9580): stdout: | (launched: 2022-12-12_17:54:54.142560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:55.881931 run osmo-stp_10.42.42.5(pid=9580): stderr: | [0;m[38;5;43m20221212175454333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175454333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175454333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175454334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175454334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175454334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175454334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:56.018465 run osmo-stp_10.42.42.5(pid=9580): stdout: | (launched: 2022-12-12_17:54:54.142560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:54:56.149396 run osmo-stp_10.42.42.5(pid=9580): stderr: | [0;m[38;5;43m20221212175454333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175454333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175454333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175454334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175454334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175454334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175454334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:54:56.304685 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9580): Process ended prematurely: osmo-stp_10.42.42.5(pid=9580) [trial-2380↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9580)] [trial-2380↪emergency:oc2g↪emergency_mo_mt_call.py:19] 17:54:56.313820 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 17:54:56.341535 run osmo-hlr_10.42.42.2(pid=9577): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9577)] 17:54:56.391704 run osmo-hlr_10.42.42.2(pid=9577): stdout: | (launched: 2022-12-12_17:54:53.125263) 17:54:56.443660 run osmo-hlr_10.42.42.2(pid=9577): stderr: | [0;m[1;31m20221212175453322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175453322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175453322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175453322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175453322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175453322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175453338 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175453347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175453347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175453348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:54:56.516057 run osmo-msc_10.42.42.6(pid=9583): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9583)] 17:54:56.566391 run osmo-msc_10.42.42.6(pid=9583): stdout: | (launched: 2022-12-12_17:54:55.363085) 17:54:56.618239 run osmo-msc_10.42.42.6(pid=9583): stderr: | [0;m[38;5;43m20221212175455684 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175455684 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f09c6d3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175455684 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175455685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175455685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175455685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175455687 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175455687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175455687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175455687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:54:56.670512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9576): Terminating (SIGTERM) 17:54:56.712542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9579): Terminating (SIGTERM) 17:54:56.754636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9582): Terminating (SIGTERM) 17:54:56.796913 --- ParallelTerminationStrategy: PID 9576 died... 17:54:56.817282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9576): Terminated: ok {rc=0} 17:54:56.863869 --- ParallelTerminationStrategy: PID 9579 died... 17:54:56.883704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9579): Terminated: ok {rc=0} 17:54:56.930149 --- ParallelTerminationStrategy: PID 9582 died... 17:54:56.950394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9582): Terminated: ok {rc=0} 17:54:57.038739 bus /sierra_3: Setting Powered False 17:54:58.140102 bus /sierra_3: Setting Powered False 17:54:59.256136 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 17:55:00.344225 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:55:00.356214 tst emergency:oc2g: Using 1 x bts (candidates: 1) 17:55:00.396497 tst emergency_preemptive_call.py: using LAC 30498 17:55:00.529231 tst emergency_preemptive_call.py: using RAC 153 17:55:00.657743 tst emergency_preemptive_call.py: using CellId 30498 17:55:00.785738 tst emergency_preemptive_call.py: using BVCI 30499 17:55:00.913441 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:55:00.925255 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:55:00.936719 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:55:00.948712 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:55:00.960731 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 17:55:00.974169 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:55:01.096276 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:55:01.218476 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:55:01.347877 tst emergency:oc2g: Using 1 x modem (candidates: 4) 17:55:01.495167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:02.063198 run create_hlr_db(pid=9588): Launched 17:55:02.232548 bus /sierra_2: Setting Powered False 17:55:03.297728 run create_hlr_db(pid=9588): Terminated: ok {rc=0} 17:55:03.735121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9590): Launched 17:55:04.045019 run osmo-hlr_10.42.42.2(pid=9591): Launched 17:55:04.163233 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:04.693355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9593): Launched 17:55:05.011562 run osmo-stp_10.42.42.5(pid=9594): Launched 17:55:05.140191 tst emergency_preemptive_call.py: using MSISDN 7898 17:55:05.306500 run osmo-msc_10.42.42.6: Starting osmo-msc 17:55:05.852875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9596): Launched 17:55:06.159518 run osmo-msc_10.42.42.6(pid=9597): Launched 17:55:06.332856 run osmo-stp_10.42.42.5(pid=9594): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9594)] 17:55:06.462214 run osmo-stp_10.42.42.5(pid=9594): stdout: | (launched: 2022-12-12_17:55:04.954297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:06.591188 run osmo-stp_10.42.42.5(pid=9594): stderr: | [0;m[38;5;43m20221212175505124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175505124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175505124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175505125 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175505125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175505125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175505125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:06.718015 run osmo-stp_10.42.42.5(pid=9594): stdout: | (launched: 2022-12-12_17:55:04.954297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:06.839355 run osmo-stp_10.42.42.5(pid=9594): stderr: | [0;m[38;5;43m20221212175505124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175505124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175505124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175505125 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175505125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175505125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175505125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:06.984440 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9594): Process ended prematurely: osmo-stp_10.42.42.5(pid=9594) [trial-2380↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9594)] [trial-2380↪emergency:oc2g↪emergency_preemptive_call.py:32] 17:55:06.992907 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 17:55:07.019734 run osmo-hlr_10.42.42.2(pid=9591): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9591)] 17:55:07.068038 run osmo-hlr_10.42.42.2(pid=9591): stdout: | (launched: 2022-12-12_17:55:03.987725) 17:55:07.118051 run osmo-hlr_10.42.42.2(pid=9591): stderr: | [0;m[1;31m20221212175504164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175504164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175504164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175504164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175504164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175504164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175504178 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175504186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175504186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175504186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:07.188443 run osmo-msc_10.42.42.6(pid=9597): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9597)] 17:55:07.236526 run osmo-msc_10.42.42.6(pid=9597): stdout: | (launched: 2022-12-12_17:55:06.102052) 17:55:07.286343 run osmo-msc_10.42.42.6(pid=9597): stderr: | [0;m[38;5;43m20221212175506372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175506372 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc3a23cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175506372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175506372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175506372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175506372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175506374 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175506375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175506375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175506375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:55:07.336452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9590): Terminating (SIGTERM) 17:55:07.376319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9593): Terminating (SIGTERM) 17:55:07.416357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9596): Terminating (SIGTERM) 17:55:07.456644 --- ParallelTerminationStrategy: PID 9590 died... 17:55:07.475930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9590): Terminated: ok {rc=0} 17:55:07.520586 --- ParallelTerminationStrategy: PID 9593 died... 17:55:07.539324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9593): Terminated: ok {rc=0} 17:55:07.584118 --- ParallelTerminationStrategy: PID 9596 died... 17:55:07.603147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9596): Terminated: ok {rc=0} 17:55:07.691198 bus /sierra_9: Setting Powered False 17:55:08.792054 bus /sierra_9: Setting Powered False 17:55:09.910661 bus /sierra_8: Setting Powered False 17:55:11.010159 bus /sierra_8: Setting Powered False 17:55:12.128415 bus /sierra_3: Setting Powered False 17:55:13.228491 bus /sierra_3: Setting Powered False 17:55:14.343939 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:oc2g --------------------------------------------------------------------- 17:55:15.605908 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:55:15.610178 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 17:55:15.630755 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 17:55:15.670191 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 17:55:15.757098 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 17:55:15.777533 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 17:55:15.816125 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 17:55:16.410530 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 17:55:16.464752 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:16.476337 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:55:16.513194 tst cs_paging_gprs_active.py: using LAC 30499 17:55:16.641230 tst cs_paging_gprs_active.py: using RAC 154 17:55:16.774367 tst cs_paging_gprs_active.py: using CellId 30499 17:55:16.908232 tst cs_paging_gprs_active.py: using BVCI 30500 17:55:17.034225 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:17.046012 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:17.057691 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:17.071475 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:17.083582 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:17.095010 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:17.107267 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:17.119297 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:17.131536 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:55:17.255369 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:55:17.374302 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:55:17.601251 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:55:17.937076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9602): Launched 17:55:18.230577 run iperf3-srv_10.42.42.10(pid=9603): Launched 17:55:18.357343 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:55:18.583285 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:55:18.919404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9604): Launched 17:55:19.212288 run iperf3-srv_10.42.42.10(pid=9605): Launched 17:55:19.338414 tst cs_paging_gprs_active.py:38: start network... 17:55:19.564185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:20.082552 run create_hlr_db(pid=9606): Launched 17:55:20.220323 bus /sierra_2: Setting Powered False 17:55:21.286533 run create_hlr_db(pid=9606): Terminated: ok {rc=0} 17:55:21.749936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9608): Launched 17:55:22.087316 run osmo-hlr_10.42.42.2(pid=9609): Launched 17:55:22.215556 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:22.788394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9611): Launched 17:55:23.124568 run osmo-stp_10.42.42.5(pid=9612): Launched 17:55:23.252590 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:55:23.826756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9614): Launched 17:55:23.955974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:55:24.238828 run patchelf(pid=9615): Launched 17:55:24.424487 run osmo-stp_10.42.42.5(pid=9612): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9612)] 17:55:24.564313 run osmo-stp_10.42.42.5(pid=9612): stdout: | (launched: 2022-12-12_17:55:23.062788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:24.706224 run osmo-stp_10.42.42.5(pid=9612): stderr: | [0;m[38;5;43m20221212175523254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175523254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175523254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175523255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175523255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175523255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175523255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:24.847960 run osmo-stp_10.42.42.5(pid=9612): stdout: | (launched: 2022-12-12_17:55:23.062788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:24.983866 run osmo-stp_10.42.42.5(pid=9612): stderr: | [0;m[38;5;43m20221212175523254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175523254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175523254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175523255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175523255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175523255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175523255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:25.144751 run patchelf(pid=9615): Terminating (SIGINT) 17:55:25.331039 run patchelf(pid=9615): Terminated: ok {rc=0} 17:55:25.465027 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9612): Process ended prematurely: osmo-stp_10.42.42.5(pid=9612) [trial-2380↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9612)] [trial-2380↪gprs:oc2g↪cs_paging_gprs_active.py:38] 17:55:25.475175 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 17:55:25.504131 run osmo-hlr_10.42.42.2(pid=9609): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9609)] 17:55:25.554865 run osmo-hlr_10.42.42.2(pid=9609): stdout: | (launched: 2022-12-12_17:55:22.025213) 17:55:25.607137 run osmo-hlr_10.42.42.2(pid=9609): stderr: | [0;m[1;31m20221212175522223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175522224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175522224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175522224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175522224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175522224 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175522236 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175522245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175522245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175522245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:25.659838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9602): Terminating (SIGTERM) 17:55:25.701871 run iperf3-srv_10.42.42.10(pid=9603): Terminating (SIGTERM) 17:55:25.743980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9604): Terminating (SIGTERM) 17:55:25.786233 run iperf3-srv_10.42.42.10(pid=9605): Terminating (SIGTERM) 17:55:25.828448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9608): Terminating (SIGTERM) 17:55:25.870898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9611): Terminating (SIGTERM) 17:55:25.913234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9614): Terminating (SIGTERM) 17:55:25.955867 --- ParallelTerminationStrategy: PID 9602 died... 17:55:25.976571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9602): Terminated: ok {rc=0} 17:55:26.023737 --- ParallelTerminationStrategy: PID 9603 died... 17:55:26.043683 run iperf3-srv_10.42.42.10(pid=9603): Terminated {rc=256} 17:55:26.090253 --- ParallelTerminationStrategy: PID 9604 died... 17:55:26.110103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9604): Terminated: ok {rc=0} 17:55:26.157226 --- ParallelTerminationStrategy: PID 9605 died... 17:55:26.177105 run iperf3-srv_10.42.42.10(pid=9605): Terminated {rc=256} 17:55:26.223244 --- ParallelTerminationStrategy: PID 9608 died... 17:55:26.242945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9608): Terminated: ok {rc=0} 17:55:26.289499 --- ParallelTerminationStrategy: PID 9611 died... 17:55:26.309258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9611): Terminated: ok {rc=0} 17:55:26.356203 --- ParallelTerminationStrategy: PID 9614 died... 17:55:26.376274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9614): Terminated: ok {rc=0} 17:55:26.464491 bus /gobi_0: Setting Powered False 17:55:27.565845 bus /gobi_0: Setting Powered False 17:55:28.682744 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g iperf3.py ---------------------------------------------- 17:55:29.834448 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:29.846387 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:55:29.883509 tst iperf3.py: using LAC 30500 17:55:30.015844 tst iperf3.py: using RAC 155 17:55:30.145670 tst iperf3.py: using CellId 30500 17:55:30.277118 tst iperf3.py: using BVCI 30501 17:55:30.398678 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:30.409801 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:30.421058 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:30.432131 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:30.443474 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:30.454411 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:30.465468 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:30.476318 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:30.487350 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:55:30.608454 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:55:30.819080 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:55:31.153164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9616): Launched 17:55:31.435573 run iperf3-srv_10.42.42.10(pid=9617): Launched 17:55:31.572525 tst iperf3.py:8: start network... 17:55:31.802695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:32.331678 run create_hlr_db(pid=9618): Launched 17:55:32.470058 bus /gobi_6: Setting Powered False 17:55:33.536295 run create_hlr_db(pid=9618): Terminated: ok {rc=0} 17:55:33.980667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9620): Launched 17:55:34.293412 run osmo-hlr_10.42.42.2(pid=9621): Launched 17:55:34.414432 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:34.958441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9623): Launched 17:55:35.272385 run osmo-stp_10.42.42.5(pid=9624): Launched 17:55:35.393193 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:55:35.930056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9626): Launched 17:55:36.050938 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:55:36.314694 run patchelf(pid=9627): Launched 17:55:36.490261 run osmo-stp_10.42.42.5(pid=9624): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9624)] 17:55:36.621461 run osmo-stp_10.42.42.5(pid=9624): stdout: | (launched: 2022-12-12_17:55:35.214337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:36.753698 run osmo-stp_10.42.42.5(pid=9624): stderr: | [0;m[38;5;43m20221212175535384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175535384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175535384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175535385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175535385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175535385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175535386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:36.886724 run osmo-stp_10.42.42.5(pid=9624): stdout: | (launched: 2022-12-12_17:55:35.214337) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:37.013445 run osmo-stp_10.42.42.5(pid=9624): stderr: | [0;m[38;5;43m20221212175535384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175535384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175535384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175535385 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175535385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175535385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175535386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:37.163844 run patchelf(pid=9627): Terminating (SIGINT) 17:55:37.338413 run patchelf(pid=9627): Terminated: ok {rc=0} 17:55:37.464207 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9624): Process ended prematurely: osmo-stp_10.42.42.5(pid=9624) [trial-2380↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9624)] [trial-2380↪gprs:oc2g↪iperf3.py:8] 17:55:37.473939 tst iperf3.py:8: Test FAILED (7.7 sec) 17:55:37.501761 run osmo-hlr_10.42.42.2(pid=9621): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9621)] 17:55:37.550082 run osmo-hlr_10.42.42.2(pid=9621): stdout: | (launched: 2022-12-12_17:55:34.235526) 17:55:37.600069 run osmo-hlr_10.42.42.2(pid=9621): stderr: | [0;m[1;31m20221212175534413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175534413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175534413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175534413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175534413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175534413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175534426 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175534434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175534434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175534434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:37.650309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9616): Terminating (SIGTERM) 17:55:37.690459 run iperf3-srv_10.42.42.10(pid=9617): Terminating (SIGTERM) 17:55:37.730369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9620): Terminating (SIGTERM) 17:55:37.770468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9623): Terminating (SIGTERM) 17:55:37.810706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9626): Terminating (SIGTERM) 17:55:37.851333 --- ParallelTerminationStrategy: PID 9616 died... 17:55:37.870609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9616): Terminated: ok {rc=0} 17:55:37.915850 --- ParallelTerminationStrategy: PID 9617 died... 17:55:37.934472 run iperf3-srv_10.42.42.10(pid=9617): Terminated {rc=256} 17:55:37.979241 --- ParallelTerminationStrategy: PID 9620 died... 17:55:37.998014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9620): Terminated: ok {rc=0} 17:55:38.042824 --- ParallelTerminationStrategy: PID 9623 died... 17:55:38.061452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9623): Terminated: ok {rc=0} 17:55:38.106388 --- ParallelTerminationStrategy: PID 9626 died... 17:55:38.125172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9626): Terminated: ok {rc=0} 17:55:38.212265 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g iperf3m4.py ---------------------------------------------- 17:55:39.359747 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:39.371318 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:55:39.407956 tst iperf3m4.py: using LAC 30501 17:55:39.531600 tst iperf3m4.py: using RAC 156 17:55:39.655961 tst iperf3m4.py: using CellId 30501 17:55:39.779756 tst iperf3m4.py: using BVCI 30502 17:55:39.903688 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:39.914994 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:39.926219 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:39.937178 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:39.949269 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:39.960375 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:39.971862 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:39.982863 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:39.993978 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:55:40.117963 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:55:40.239592 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:55:40.361317 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:55:40.482661 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:55:40.708029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:55:41.044369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9629): Launched 17:55:41.335989 run iperf3-srv_10.42.42.10(pid=9630): Launched 17:55:41.463710 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:55:41.688715 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:55:42.024723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9631): Launched 17:55:42.317185 run iperf3-srv_10.42.42.10(pid=9632): Launched 17:55:42.444717 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:55:42.669864 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:55:43.005298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9633): Launched 17:55:43.298237 run iperf3-srv_10.42.42.10(pid=9634): Launched 17:55:43.425324 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:55:43.649332 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:55:43.984184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9635): Launched 17:55:44.276372 run iperf3-srv_10.42.42.10(pid=9636): Launched 17:55:44.403287 tst iperf3m4.py:8: start network... 17:55:44.628208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:55:45.146699 run create_hlr_db(pid=9637): Launched 17:55:45.284442 bus /gobi_6: Setting Powered False 17:55:46.349635 run create_hlr_db(pid=9637): Terminated: ok {rc=0} 17:55:46.861008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9639): Launched 17:55:47.221623 run osmo-hlr_10.42.42.2(pid=9640): Launched 17:55:47.348061 run osmo-stp_10.42.42.5: Starting osmo-stp 17:55:47.898482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9642): Launched 17:55:48.212358 run osmo-stp_10.42.42.5(pid=9643): Launched 17:55:48.331087 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:55:48.869601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9645): Launched 17:55:48.991403 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:55:49.256180 run patchelf(pid=9646): Launched 17:55:49.431803 run osmo-stp_10.42.42.5(pid=9643): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9643)] 17:55:49.562666 run osmo-stp_10.42.42.5(pid=9643): stdout: | (launched: 2022-12-12_17:55:48.153717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:49.695087 run osmo-stp_10.42.42.5(pid=9643): stderr: | [0;m[38;5;43m20221212175548323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175548323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175548323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175548324 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175548324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175548324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175548324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:49.827933 run osmo-stp_10.42.42.5(pid=9643): stdout: | (launched: 2022-12-12_17:55:48.153717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:55:49.954687 run osmo-stp_10.42.42.5(pid=9643): stderr: | [0;m[38;5;43m20221212175548323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175548323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175548323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175548324 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175548324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175548324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175548324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:55:50.105900 run patchelf(pid=9646): Terminating (SIGINT) 17:55:50.279390 run patchelf(pid=9646): Terminated: ok {rc=0} 17:55:50.404519 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9643): Process ended prematurely: osmo-stp_10.42.42.5(pid=9643) [trial-2380↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9643)] [trial-2380↪gprs:oc2g↪iperf3m4.py:8] 17:55:50.414254 tst iperf3m4.py:8: Test FAILED (11.1 sec) 17:55:50.442627 run osmo-hlr_10.42.42.2(pid=9640): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9640)] 17:55:50.490509 run osmo-hlr_10.42.42.2(pid=9640): stdout: | (launched: 2022-12-12_17:55:47.154966) 17:55:50.540525 run osmo-hlr_10.42.42.2(pid=9640): stderr: | [0;m[1;31m20221212175547343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175547343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175547343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175547343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175547343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175547343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175547354 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175547362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175547362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175547362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:55:50.590874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9629): Terminating (SIGTERM) 17:55:50.631085 run iperf3-srv_10.42.42.10(pid=9630): Terminating (SIGTERM) 17:55:50.671251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9631): Terminating (SIGTERM) 17:55:50.711245 run iperf3-srv_10.42.42.10(pid=9632): Terminating (SIGTERM) 17:55:50.751284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9633): Terminating (SIGTERM) 17:55:50.791263 run iperf3-srv_10.42.42.10(pid=9634): Terminating (SIGTERM) 17:55:50.831251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9635): Terminating (SIGTERM) 17:55:50.871196 run iperf3-srv_10.42.42.10(pid=9636): Terminating (SIGTERM) 17:55:50.910961 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9639): Terminating (SIGTERM) 17:55:50.951032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9642): Terminating (SIGTERM) 17:55:50.990923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9645): Terminating (SIGTERM) 17:55:51.031242 --- ParallelTerminationStrategy: PID 9629 died... 17:55:51.050599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9629): Terminated: ok {rc=0} 17:55:51.095386 --- ParallelTerminationStrategy: PID 9630 died... 17:55:51.114230 run iperf3-srv_10.42.42.10(pid=9630): Terminated {rc=256} 17:55:51.158543 --- ParallelTerminationStrategy: PID 9631 died... 17:55:51.177332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9631): Terminated: ok {rc=0} 17:55:51.221715 --- ParallelTerminationStrategy: PID 9632 died... 17:55:51.240272 run iperf3-srv_10.42.42.10(pid=9632): Terminated {rc=256} 17:55:51.284516 --- ParallelTerminationStrategy: PID 9633 died... 17:55:51.303153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9633): Terminated: ok {rc=0} 17:55:51.347543 --- ParallelTerminationStrategy: PID 9634 died... 17:55:51.366134 run iperf3-srv_10.42.42.10(pid=9634): Terminated {rc=256} 17:55:51.410586 --- ParallelTerminationStrategy: PID 9635 died... 17:55:51.429439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9635): Terminated: ok {rc=0} 17:55:51.473830 --- ParallelTerminationStrategy: PID 9636 died... 17:55:51.492585 run iperf3-srv_10.42.42.10(pid=9636): Terminated {rc=256} 17:55:51.537555 --- ParallelTerminationStrategy: PID 9639 died... 17:55:51.556278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9639): Terminated: ok {rc=0} 17:55:51.600634 --- ParallelTerminationStrategy: PID 9642 died... 17:55:51.619402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9642): Terminated: ok {rc=0} 17:55:51.663883 --- ParallelTerminationStrategy: PID 9645 died... 17:55:51.682562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9645): Terminated: ok {rc=0} 17:55:51.769477 bus /gobi_4: Setting Powered False 17:55:52.869836 bus /gobi_4: Setting Powered False 17:55:53.986754 bus /gobi_1: Setting Powered False 17:55:55.086823 bus /gobi_1: Setting Powered False 17:55:56.203272 bus /gobi_0: Setting Powered False 17:55:57.302067 bus /gobi_0: Setting Powered False 17:55:58.418621 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g ping.py ---------------------------------------------- 17:55:59.521614 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:55:59.533439 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:55:59.569708 tst ping.py: using LAC 30502 17:55:59.698589 tst ping.py: using RAC 157 17:55:59.828759 tst ping.py: using CellId 30502 17:55:59.958341 tst ping.py: using BVCI 30503 17:56:00.079646 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:00.090834 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:00.101815 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:00.113266 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:00.124511 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:00.135912 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:00.147457 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:00.158943 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:56:00.279643 tst ping.py:19: start network... 17:56:00.500803 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:01.030494 run create_hlr_db(pid=9647): Launched 17:56:01.194406 bus /gobi_6: Setting Powered False 17:56:02.258659 run create_hlr_db(pid=9647): Terminated: ok {rc=0} 17:56:02.695888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9649): Launched 17:56:03.005525 run osmo-hlr_10.42.42.2(pid=9650): Launched 17:56:03.123120 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:03.664552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9652): Launched 17:56:03.974032 run osmo-stp_10.42.42.5(pid=9653): Launched 17:56:04.092028 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:56:04.623091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9655): Launched 17:56:04.749512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:56:05.028765 run patchelf(pid=9656): Launched 17:56:05.212823 run osmo-stp_10.42.42.5(pid=9653): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9653)] 17:56:05.350476 run osmo-stp_10.42.42.5(pid=9653): stdout: | (launched: 2022-12-12_17:56:03.916087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:05.489987 run osmo-stp_10.42.42.5(pid=9653): stderr: | [0;m[38;5;43m20221212175604086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175604086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175604086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175604086 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175604087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175604087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175604087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:05.629524 run osmo-stp_10.42.42.5(pid=9653): stdout: | (launched: 2022-12-12_17:56:03.916087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:05.763614 run osmo-stp_10.42.42.5(pid=9653): stderr: | [0;m[38;5;43m20221212175604086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175604086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175604086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175604086 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175604087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175604087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175604087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:05.922459 run patchelf(pid=9656): Terminating (SIGINT) 17:56:06.106404 run patchelf(pid=9656): Terminated: ok {rc=0} 17:56:06.238086 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9653): Process ended prematurely: osmo-stp_10.42.42.5(pid=9653) [trial-2380↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9653)] [trial-2380↪gprs:oc2g↪ping.py:22] 17:56:06.247856 tst ping.py:22: Test FAILED (6.7 sec) 17:56:06.276648 run osmo-hlr_10.42.42.2(pid=9650): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9650)] 17:56:06.327676 run osmo-hlr_10.42.42.2(pid=9650): stdout: | (launched: 2022-12-12_17:56:02.947810) 17:56:06.380391 run osmo-hlr_10.42.42.2(pid=9650): stderr: | [0;m[1;31m20221212175603123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175603123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175603124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175603124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175603124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175603124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175603139 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175603149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175603149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175603149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:06.433550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9649): Terminating (SIGTERM) 17:56:06.476241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9652): Terminating (SIGTERM) 17:56:06.519000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9655): Terminating (SIGTERM) 17:56:06.562016 --- ParallelTerminationStrategy: PID 9649 died... 17:56:06.582522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9649): Terminated: ok {rc=0} 17:56:06.629647 --- ParallelTerminationStrategy: PID 9652 died... 17:56:06.650025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9652): Terminated: ok {rc=0} 17:56:06.697498 --- ParallelTerminationStrategy: PID 9655 died... 17:56:06.717490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9655): Terminated: ok {rc=0} 17:56:06.807638 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 17:56:07.895961 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:07.907820 tst gprs:oc2g: Using 1 x bts (candidates: 1) 17:56:07.945358 tst ping_idle_ping.py: using LAC 30503 17:56:08.068029 tst ping_idle_ping.py: using RAC 158 17:56:08.193692 tst ping_idle_ping.py: using CellId 30503 17:56:08.314313 tst ping_idle_ping.py: using BVCI 30504 17:56:08.427787 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:08.438661 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:08.449484 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:08.460204 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:08.470866 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:08.481816 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:08.492572 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 17:56:08.503466 tst gprs:oc2g: Using 1 x modem (candidates: 4) 17:56:08.623807 tst ping_idle_ping.py:24: start network... 17:56:08.844903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:09.356910 run create_hlr_db(pid=9657): Launched 17:56:09.492113 bus /gobi_6: Setting Powered False 17:56:10.557831 run create_hlr_db(pid=9657): Terminated: ok {rc=0} 17:56:10.996851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9659): Launched 17:56:11.307855 run osmo-hlr_10.42.42.2(pid=9660): Launched 17:56:11.427453 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:11.970313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9662): Launched 17:56:12.280555 run osmo-stp_10.42.42.5(pid=9663): Launched 17:56:12.398359 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:56:12.928561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9665): Launched 17:56:13.047381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:56:13.307030 run patchelf(pid=9666): Launched 17:56:13.479495 run osmo-stp_10.42.42.5(pid=9663): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9663)] 17:56:13.608370 run osmo-stp_10.42.42.5(pid=9663): stdout: | (launched: 2022-12-12_17:56:12.222814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:13.739437 run osmo-stp_10.42.42.5(pid=9663): stderr: | [0;m[38;5;43m20221212175612394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175612395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175612395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175612395 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175612396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175612396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175612396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:13.870337 run osmo-stp_10.42.42.5(pid=9663): stdout: | (launched: 2022-12-12_17:56:12.222814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:13.995271 run osmo-stp_10.42.42.5(pid=9663): stderr: | [0;m[38;5;43m20221212175612394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175612395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175612395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175612395 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175612396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175612396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175612396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:14.143694 run patchelf(pid=9666): Terminating (SIGINT) 17:56:14.315300 run patchelf(pid=9666): Terminated: ok {rc=0} 17:56:14.438342 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9663): Process ended prematurely: osmo-stp_10.42.42.5(pid=9663) [trial-2380↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9663)] [trial-2380↪gprs:oc2g↪ping_idle_ping.py:27] 17:56:14.447357 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 17:56:14.474900 run osmo-hlr_10.42.42.2(pid=9660): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9660)] 17:56:14.522900 run osmo-hlr_10.42.42.2(pid=9660): stdout: | (launched: 2022-12-12_17:56:11.249896) 17:56:14.572508 run osmo-hlr_10.42.42.2(pid=9660): stderr: | [0;m[1;31m20221212175611425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175611425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175611425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175611425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175611425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175611425 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175611437 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175611445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175611446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175611446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:14.622518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9659): Terminating (SIGTERM) 17:56:14.662601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9662): Terminating (SIGTERM) 17:56:14.702781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9665): Terminating (SIGTERM) 17:56:14.743262 --- ParallelTerminationStrategy: PID 9659 died... 17:56:14.762485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9659): Terminated: ok {rc=0} 17:56:14.807135 --- ParallelTerminationStrategy: PID 9662 died... 17:56:14.825985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9662): Terminated: ok {rc=0} 17:56:14.870644 --- ParallelTerminationStrategy: PID 9665 died... 17:56:14.889470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9665): Terminated: ok {rc=0} 17:56:14.976503 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 17:56:16.273990 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:56:16.283206 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 17:56:16.312820 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 17:56:16.360367 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 17:56:16.465088 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 17:56:16.494391 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 17:56:16.547995 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 17:56:17.165641 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 17:56:17.224019 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:17.235807 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:56:17.274850 tst cs_paging_gprs_active.py: using LAC 30504 17:56:17.404467 tst cs_paging_gprs_active.py: using RAC 159 17:56:17.531969 tst cs_paging_gprs_active.py: using CellId 30504 17:56:17.659696 tst cs_paging_gprs_active.py: using BVCI 30505 17:56:17.779933 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:17.791310 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:17.802597 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:17.814401 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:17.826033 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:17.837745 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:17.849610 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:17.861104 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:17.872819 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:56:17.992170 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:56:18.110963 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:56:18.331437 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:56:18.658658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9670): Launched 17:56:18.945123 run iperf3-srv_10.42.42.10(pid=9671): Launched 17:56:19.070278 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:56:19.290534 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:56:19.617729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9672): Launched 17:56:19.903418 run iperf3-srv_10.42.42.10(pid=9673): Launched 17:56:20.027281 tst cs_paging_gprs_active.py:38: start network... 17:56:20.246414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:20.754206 run create_hlr_db(pid=9674): Launched 17:56:20.889093 bus /gobi_6: Setting Powered False 17:56:21.953648 run create_hlr_db(pid=9674): Terminated: ok {rc=0} 17:56:22.408137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9676): Launched 17:56:22.738101 run osmo-hlr_10.42.42.2(pid=9677): Launched 17:56:22.863871 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:23.426842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9679): Launched 17:56:23.754079 run osmo-stp_10.42.42.5(pid=9680): Launched 17:56:23.879626 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:56:24.443234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9682): Launched 17:56:24.570237 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:56:24.846729 run patchelf(pid=9683): Launched 17:56:25.029957 run osmo-stp_10.42.42.5(pid=9680): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9680)] 17:56:25.167139 run osmo-stp_10.42.42.5(pid=9680): stdout: | (launched: 2022-12-12_17:56:23.693431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:25.305958 run osmo-stp_10.42.42.5(pid=9680): stderr: | [0;m[38;5;43m20221212175623886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175623886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175623886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175623887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175623887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175623887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175623887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:25.444864 run osmo-stp_10.42.42.5(pid=9680): stdout: | (launched: 2022-12-12_17:56:23.693431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:25.577902 run osmo-stp_10.42.42.5(pid=9680): stderr: | [0;m[38;5;43m20221212175623886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175623886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175623886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175623887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175623887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175623887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175623887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:25.735907 run patchelf(pid=9683): Terminating (SIGINT) 17:56:25.917921 run patchelf(pid=9683): Terminated: ok {rc=0} 17:56:26.049637 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9680): Process ended prematurely: osmo-stp_10.42.42.5(pid=9680) [trial-2380↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9680)] [trial-2380↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 17:56:26.060051 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:56:26.088515 run osmo-hlr_10.42.42.2(pid=9677): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9677)] 17:56:26.138305 run osmo-hlr_10.42.42.2(pid=9677): stdout: | (launched: 2022-12-12_17:56:22.677376) 17:56:26.189912 run osmo-hlr_10.42.42.2(pid=9677): stderr: | [0;m[1;31m20221212175622878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175622878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175622878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175622878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175622878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175622878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175622891 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175622899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175622900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175622900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:26.241895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9670): Terminating (SIGTERM) 17:56:26.283669 run iperf3-srv_10.42.42.10(pid=9671): Terminating (SIGTERM) 17:56:26.325455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9672): Terminating (SIGTERM) 17:56:26.367102 run iperf3-srv_10.42.42.10(pid=9673): Terminating (SIGTERM) 17:56:26.409002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9676): Terminating (SIGTERM) 17:56:26.450982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9679): Terminating (SIGTERM) 17:56:26.492643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9682): Terminating (SIGTERM) 17:56:26.534783 --- ParallelTerminationStrategy: PID 9670 died... 17:56:26.554794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9670): Terminated: ok {rc=0} 17:56:26.600806 --- ParallelTerminationStrategy: PID 9671 died... 17:56:26.620124 run iperf3-srv_10.42.42.10(pid=9671): Terminated {rc=256} 17:56:26.665758 --- ParallelTerminationStrategy: PID 9672 died... 17:56:26.685261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9672): Terminated: ok {rc=0} 17:56:26.730884 --- ParallelTerminationStrategy: PID 9673 died... 17:56:26.750316 run iperf3-srv_10.42.42.10(pid=9673): Terminated {rc=256} 17:56:26.796166 --- ParallelTerminationStrategy: PID 9676 died... 17:56:26.815819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9676): Terminated: ok {rc=0} 17:56:26.861679 --- ParallelTerminationStrategy: PID 9679 died... 17:56:26.881336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9679): Terminated: ok {rc=0} 17:56:26.927371 --- ParallelTerminationStrategy: PID 9682 died... 17:56:26.947149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9682): Terminated: ok {rc=0} 17:56:27.035978 bus /gobi_0: Setting Powered False 17:56:28.137890 bus /gobi_0: Setting Powered False 17:56:29.255181 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 17:56:30.406655 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:30.418800 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:56:30.457926 tst iperf3.py: using LAC 30505 17:56:30.580329 tst iperf3.py: using RAC 160 17:56:30.701989 tst iperf3.py: using CellId 30505 17:56:30.824023 tst iperf3.py: using BVCI 30506 17:56:30.963951 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:30.976056 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:30.987965 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:31.000405 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:31.012925 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:31.025604 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:31.038349 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:31.052089 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:31.063968 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:56:31.193540 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:56:31.456109 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:56:31.770407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9684): Launched 17:56:32.054755 run iperf3-srv_10.42.42.10(pid=9685): Launched 17:56:32.178102 tst iperf3.py:8: start network... 17:56:32.386057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:32.860036 run create_hlr_db(pid=9686): Launched 17:56:32.980897 bus /gobi_6: Setting Powered False 17:56:34.045531 run create_hlr_db(pid=9686): Terminated: ok {rc=0} 17:56:34.498320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9688): Launched 17:56:34.824501 run osmo-hlr_10.42.42.2(pid=9689): Launched 17:56:34.950807 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:35.514445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9691): Launched 17:56:35.841402 run osmo-stp_10.42.42.5(pid=9692): Launched 17:56:35.965290 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:56:36.527188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9694): Launched 17:56:36.651819 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:56:36.928390 run patchelf(pid=9695): Launched 17:56:37.109985 run osmo-stp_10.42.42.5(pid=9692): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9692)] 17:56:37.247455 run osmo-stp_10.42.42.5(pid=9692): stdout: | (launched: 2022-12-12_17:56:35.780800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:37.386856 run osmo-stp_10.42.42.5(pid=9692): stderr: | [0;m[38;5;43m20221212175635972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175635973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175635973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175635973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175635974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175635974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175635974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:37.526198 run osmo-stp_10.42.42.5(pid=9692): stdout: | (launched: 2022-12-12_17:56:35.780800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:37.659207 run osmo-stp_10.42.42.5(pid=9692): stderr: | [0;m[38;5;43m20221212175635972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175635973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175635973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175635973 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175635974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175635974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175635974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:37.817439 run patchelf(pid=9695): Terminating (SIGINT) 17:56:37.999545 run patchelf(pid=9695): Terminated: ok {rc=0} 17:56:38.131128 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9692): Process ended prematurely: osmo-stp_10.42.42.5(pid=9692) [trial-2380↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9692)] [trial-2380↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 17:56:38.141424 tst iperf3.py:8: Test FAILED (7.8 sec) 17:56:38.169927 run osmo-hlr_10.42.42.2(pid=9689): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9689)] 17:56:38.219997 run osmo-hlr_10.42.42.2(pid=9689): stdout: | (launched: 2022-12-12_17:56:34.763973) 17:56:38.271733 run osmo-hlr_10.42.42.2(pid=9689): stderr: | [0;m[1;31m20221212175634961 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175634962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175634962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175634962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175634962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175634962 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175634974 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175634983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175634983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175634983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:38.324078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9684): Terminating (SIGTERM) 17:56:38.366314 run iperf3-srv_10.42.42.10(pid=9685): Terminating (SIGTERM) 17:56:38.408457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9688): Terminating (SIGTERM) 17:56:38.450696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9691): Terminating (SIGTERM) 17:56:38.492785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9694): Terminating (SIGTERM) 17:56:38.535246 --- ParallelTerminationStrategy: PID 9684 died... 17:56:38.555414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9684): Terminated: ok {rc=0} 17:56:38.602047 --- ParallelTerminationStrategy: PID 9685 died... 17:56:38.621561 run iperf3-srv_10.42.42.10(pid=9685): Terminated {rc=256} 17:56:38.667871 --- ParallelTerminationStrategy: PID 9688 died... 17:56:38.687620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9688): Terminated: ok {rc=0} 17:56:38.734049 --- ParallelTerminationStrategy: PID 9691 died... 17:56:38.753778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9691): Terminated: ok {rc=0} 17:56:38.800212 --- ParallelTerminationStrategy: PID 9694 died... 17:56:38.819973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9694): Terminated: ok {rc=0} 17:56:38.909447 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 17:56:40.060694 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:40.073043 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:56:40.111433 tst iperf3m4.py: using LAC 30506 17:56:40.240418 tst iperf3m4.py: using RAC 161 17:56:40.367926 tst iperf3m4.py: using CellId 30506 17:56:40.497399 tst iperf3m4.py: using BVCI 30507 17:56:40.615595 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:40.627099 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:40.638613 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:40.650147 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:40.661473 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:40.672713 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:40.684313 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:40.695827 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:40.707608 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:56:40.832368 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:56:40.950454 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:56:41.072441 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:56:41.193405 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:56:41.413933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:56:41.744334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9696): Launched 17:56:42.032099 run iperf3-srv_10.42.42.10(pid=9697): Launched 17:56:42.157120 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:56:42.376378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:56:42.705520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9698): Launched 17:56:42.994352 run iperf3-srv_10.42.42.10(pid=9699): Launched 17:56:43.119448 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:56:43.338519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:56:43.666929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9700): Launched 17:56:43.952166 run iperf3-srv_10.42.42.10(pid=9701): Launched 17:56:44.076940 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:56:44.295959 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:56:44.624598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9702): Launched 17:56:44.911333 run iperf3-srv_10.42.42.10(pid=9703): Launched 17:56:45.036151 tst iperf3m4.py:8: start network... 17:56:45.255710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:56:45.762752 run create_hlr_db(pid=9704): Launched 17:56:45.915810 bus /gobi_6: Setting Powered False 17:56:46.980222 run create_hlr_db(pid=9704): Terminated: ok {rc=0} 17:56:47.446307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9706): Launched 17:56:47.755502 run osmo-hlr_10.42.42.2(pid=9707): Launched 17:56:47.872594 run osmo-stp_10.42.42.5: Starting osmo-stp 17:56:48.401699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9709): Launched 17:56:48.708893 run osmo-stp_10.42.42.5(pid=9710): Launched 17:56:48.825732 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:56:49.356081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9712): Launched 17:56:49.477068 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:56:49.736143 run patchelf(pid=9713): Launched 17:56:49.908644 run osmo-stp_10.42.42.5(pid=9710): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9710)] 17:56:50.037710 run osmo-stp_10.42.42.5(pid=9710): stdout: | (launched: 2022-12-12_17:56:48.651645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:50.168613 run osmo-stp_10.42.42.5(pid=9710): stderr: | [0;m[38;5;43m20221212175648821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175648821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175648821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175648822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175648822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175648822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175648822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:50.299700 run osmo-stp_10.42.42.5(pid=9710): stdout: | (launched: 2022-12-12_17:56:48.651645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:56:50.424899 run osmo-stp_10.42.42.5(pid=9710): stderr: | [0;m[38;5;43m20221212175648821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175648821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175648821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175648822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175648822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175648822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175648822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:56:50.573506 run patchelf(pid=9713): Terminating (SIGINT) 17:56:50.745155 run patchelf(pid=9713): Terminated: ok {rc=0} 17:56:50.869452 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9710): Process ended prematurely: osmo-stp_10.42.42.5(pid=9710) [trial-2380↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9710)] [trial-2380↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 17:56:50.879073 tst iperf3m4.py:8: Test FAILED (10.9 sec) 17:56:50.907146 run osmo-hlr_10.42.42.2(pid=9707): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9707)] 17:56:50.955152 run osmo-hlr_10.42.42.2(pid=9707): stdout: | (launched: 2022-12-12_17:56:47.697656) 17:56:51.004847 run osmo-hlr_10.42.42.2(pid=9707): stderr: | [0;m[1;31m20221212175647872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175647872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175647872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175647872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175647872 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175647873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175647884 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175647892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175647893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175647893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:56:51.054992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9696): Terminating (SIGTERM) 17:56:51.095087 run iperf3-srv_10.42.42.10(pid=9697): Terminating (SIGTERM) 17:56:51.135085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9698): Terminating (SIGTERM) 17:56:51.175170 run iperf3-srv_10.42.42.10(pid=9699): Terminating (SIGTERM) 17:56:51.215175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9700): Terminating (SIGTERM) 17:56:51.255040 run iperf3-srv_10.42.42.10(pid=9701): Terminating (SIGTERM) 17:56:51.294841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9702): Terminating (SIGTERM) 17:56:51.334763 run iperf3-srv_10.42.42.10(pid=9703): Terminating (SIGTERM) 17:56:51.374515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9706): Terminating (SIGTERM) 17:56:51.414455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9709): Terminating (SIGTERM) 17:56:51.454247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9712): Terminating (SIGTERM) 17:56:51.494485 --- ParallelTerminationStrategy: PID 9696 died... 17:56:51.513950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9696): Terminated: ok {rc=0} 17:56:51.558536 --- ParallelTerminationStrategy: PID 9697 died... 17:56:51.577130 run iperf3-srv_10.42.42.10(pid=9697): Terminated {rc=256} 17:56:51.621478 --- ParallelTerminationStrategy: PID 9698 died... 17:56:51.640380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9698): Terminated: ok {rc=0} 17:56:51.684487 --- ParallelTerminationStrategy: PID 9699 died... 17:56:51.703104 run iperf3-srv_10.42.42.10(pid=9699): Terminated {rc=256} 17:56:51.747194 --- ParallelTerminationStrategy: PID 9700 died... 17:56:51.765645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9700): Terminated: ok {rc=0} 17:56:51.810400 --- ParallelTerminationStrategy: PID 9701 died... 17:56:51.828811 run iperf3-srv_10.42.42.10(pid=9701): Terminated {rc=256} 17:56:51.873043 --- ParallelTerminationStrategy: PID 9702 died... 17:56:51.892178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9702): Terminated: ok {rc=0} 17:56:51.936299 --- ParallelTerminationStrategy: PID 9703 died... 17:56:51.954829 run iperf3-srv_10.42.42.10(pid=9703): Terminated {rc=256} 17:56:51.999030 --- ParallelTerminationStrategy: PID 9706 died... 17:56:52.017542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9706): Terminated: ok {rc=0} 17:56:52.061737 --- ParallelTerminationStrategy: PID 9709 died... 17:56:52.080252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9709): Terminated: ok {rc=0} 17:56:52.124490 --- ParallelTerminationStrategy: PID 9712 died... 17:56:52.143162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9712): Terminated: ok {rc=0} 17:56:52.228324 bus /gobi_4: Setting Powered False 17:56:53.325046 bus /gobi_4: Setting Powered False 17:56:54.440440 bus /gobi_1: Setting Powered False 17:56:55.539818 bus /gobi_1: Setting Powered False 17:56:56.659694 bus /gobi_0: Setting Powered False 17:56:57.759573 bus /gobi_0: Setting Powered False 17:56:58.876688 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 17:56:59.980281 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:56:59.991921 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:57:00.030950 tst ping.py: using LAC 30507 17:57:00.150465 tst ping.py: using RAC 162 17:57:00.272842 tst ping.py: using CellId 30507 17:57:00.390548 tst ping.py: using BVCI 30508 17:57:00.501986 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:00.512722 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:00.523514 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:00.535042 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:00.546480 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:00.558023 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:00.569588 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:00.581577 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:57:00.700202 tst ping.py:19: start network... 17:57:00.933157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:01.524262 run create_hlr_db(pid=9714): Launched 17:57:01.681171 bus /gobi_6: Setting Powered False 17:57:02.741612 run create_hlr_db(pid=9714): Terminated: ok {rc=0} 17:57:03.183306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9716): Launched 17:57:03.507683 run osmo-hlr_10.42.42.2(pid=9717): Launched 17:57:03.632322 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:04.190574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9719): Launched 17:57:04.513252 run osmo-stp_10.42.42.5(pid=9720): Launched 17:57:04.636639 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:57:05.194550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9722): Launched 17:57:05.318807 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:57:05.590796 run patchelf(pid=9723): Launched 17:57:05.770812 run osmo-stp_10.42.42.5(pid=9720): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9720)] 17:57:05.906792 run osmo-stp_10.42.42.5(pid=9720): stdout: | (launched: 2022-12-12_17:57:04.453099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:06.044729 run osmo-stp_10.42.42.5(pid=9720): stderr: | [0;m[38;5;43m20221212175704646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175704646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175704646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175704647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175704647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175704647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175704647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:06.182558 run osmo-stp_10.42.42.5(pid=9720): stdout: | (launched: 2022-12-12_17:57:04.453099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:06.314332 run osmo-stp_10.42.42.5(pid=9720): stderr: | [0;m[38;5;43m20221212175704646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175704646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175704646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175704647 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175704647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175704647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175704647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:06.470845 run patchelf(pid=9723): Terminating (SIGINT) 17:57:06.651624 run patchelf(pid=9723): Terminated: ok {rc=0} 17:57:06.781245 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9720): Process ended prematurely: osmo-stp_10.42.42.5(pid=9720) [trial-2380↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9720)] [trial-2380↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 17:57:06.790928 tst ping.py:22: Test FAILED (6.8 sec) 17:57:06.819240 run osmo-hlr_10.42.42.2(pid=9717): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9717)] 17:57:06.869362 run osmo-hlr_10.42.42.2(pid=9717): stdout: | (launched: 2022-12-12_17:57:03.447794) 17:57:06.921360 run osmo-hlr_10.42.42.2(pid=9717): stderr: | [0;m[1;31m20221212175703645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175703645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175703645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175703645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175703645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175703645 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175703657 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175703666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175703666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175703666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:06.973737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9716): Terminating (SIGTERM) 17:57:07.016170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9719): Terminating (SIGTERM) 17:57:07.058520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9722): Terminating (SIGTERM) 17:57:07.100782 --- ParallelTerminationStrategy: PID 9716 died... 17:57:07.121252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9716): Terminated: ok {rc=0} 17:57:07.168050 --- ParallelTerminationStrategy: PID 9719 died... 17:57:07.187905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9719): Terminated: ok {rc=0} 17:57:07.234602 --- ParallelTerminationStrategy: PID 9722 died... 17:57:07.254555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9722): Terminated: ok {rc=0} 17:57:07.343889 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 17:57:08.432549 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:08.444862 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 17:57:08.484244 tst ping_idle_ping.py: using LAC 30508 17:57:08.614656 tst ping_idle_ping.py: using RAC 163 17:57:08.753656 tst ping_idle_ping.py: using CellId 30508 17:57:08.879931 tst ping_idle_ping.py: using BVCI 30509 17:57:08.992478 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:09.003600 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:09.014628 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:09.026459 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:09.037907 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:09.049409 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:09.061096 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 17:57:09.072554 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 17:57:09.195160 tst ping_idle_ping.py:24: start network... 17:57:09.412365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:09.915929 run create_hlr_db(pid=9724): Launched 17:57:10.049185 bus /gobi_6: Setting Powered False 17:57:11.113546 run create_hlr_db(pid=9724): Terminated: ok {rc=0} 17:57:11.563653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9726): Launched 17:57:11.888231 run osmo-hlr_10.42.42.2(pid=9727): Launched 17:57:12.013707 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:12.572873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9729): Launched 17:57:12.897175 run osmo-stp_10.42.42.5(pid=9730): Launched 17:57:13.022020 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:57:13.578427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9732): Launched 17:57:13.701631 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:57:13.974445 run patchelf(pid=9733): Launched 17:57:14.154486 run osmo-stp_10.42.42.5(pid=9730): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9730)] 17:57:14.289977 run osmo-stp_10.42.42.5(pid=9730): stdout: | (launched: 2022-12-12_17:57:12.836781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:14.427302 run osmo-stp_10.42.42.5(pid=9730): stderr: | [0;m[38;5;43m20221212175713028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175713029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175713029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175713029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175713030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175713030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175713030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:14.564303 run osmo-stp_10.42.42.5(pid=9730): stdout: | (launched: 2022-12-12_17:57:12.836781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:14.696281 run osmo-stp_10.42.42.5(pid=9730): stderr: | [0;m[38;5;43m20221212175713028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175713029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175713029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175713029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175713030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175713030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175713030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:14.852230 run patchelf(pid=9733): Terminating (SIGINT) 17:57:15.031958 run patchelf(pid=9733): Terminated: ok {rc=0} 17:57:15.161530 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9730): Process ended prematurely: osmo-stp_10.42.42.5(pid=9730) [trial-2380↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9730)] [trial-2380↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 17:57:15.171150 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:57:15.199716 run osmo-hlr_10.42.42.2(pid=9727): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9727)] 17:57:15.249956 run osmo-hlr_10.42.42.2(pid=9727): stdout: | (launched: 2022-12-12_17:57:11.827920) 17:57:15.301585 run osmo-hlr_10.42.42.2(pid=9727): stderr: | [0;m[1;31m20221212175712025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175712025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175712025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175712025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175712025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175712025 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175712037 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175712046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175712046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175712046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:15.353702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9726): Terminating (SIGTERM) 17:57:15.395669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9729): Terminating (SIGTERM) 17:57:15.437670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9732): Terminating (SIGTERM) 17:57:15.479827 --- ParallelTerminationStrategy: PID 9726 died... 17:57:15.500017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9726): Terminated: ok {rc=0} 17:57:15.546919 --- ParallelTerminationStrategy: PID 9729 died... 17:57:15.566671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9729): Terminated: ok {rc=0} 17:57:15.613448 --- ParallelTerminationStrategy: PID 9732 died... 17:57:15.633370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9732): Terminated: ok {rc=0} 17:57:15.722566 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 17:57:17.076453 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:57:17.084070 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 17:57:17.106726 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 17:57:17.148046 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 17:57:17.246243 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 17:57:17.267725 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 17:57:17.307522 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 17:57:17.902908 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 17:57:17.955745 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:17.967227 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:57:18.025405 tst cs_paging_gprs_active.py: using LAC 30509 17:57:18.153858 tst cs_paging_gprs_active.py: using RAC 164 17:57:18.283565 tst cs_paging_gprs_active.py: using CellId 30509 17:57:18.412554 tst cs_paging_gprs_active.py: using BVCI 30510 17:57:18.532695 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:18.544123 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:18.555192 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:18.566410 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:18.577462 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:18.588528 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:18.599769 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:18.610827 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:18.622343 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:57:18.739579 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:57:18.862528 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:57:19.086150 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:57:19.416591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9737): Launched 17:57:19.704174 run iperf3-srv_10.42.42.10(pid=9738): Launched 17:57:19.829944 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:57:20.051950 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:57:20.382680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9739): Launched 17:57:20.668501 run iperf3-srv_10.42.42.10(pid=9740): Launched 17:57:20.793213 tst cs_paging_gprs_active.py:38: start network... 17:57:21.014899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:21.524538 run create_hlr_db(pid=9741): Launched 17:57:21.658982 bus /gobi_6: Setting Powered False 17:57:22.724194 run create_hlr_db(pid=9741): Terminated: ok {rc=0} 17:57:23.180554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9743): Launched 17:57:23.510832 run osmo-hlr_10.42.42.2(pid=9744): Launched 17:57:23.637843 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:24.200838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9746): Launched 17:57:24.530787 run osmo-stp_10.42.42.5(pid=9747): Launched 17:57:24.657143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:57:25.222109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9749): Launched 17:57:25.348208 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:57:25.626843 run patchelf(pid=9750): Launched 17:57:25.809355 run osmo-stp_10.42.42.5(pid=9747): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9747)] 17:57:25.947693 run osmo-stp_10.42.42.5(pid=9747): stdout: | (launched: 2022-12-12_17:57:24.470085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:26.088411 run osmo-stp_10.42.42.5(pid=9747): stderr: | [0;m[38;5;43m20221212175724660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175724660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175724660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175724661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175724661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175724661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175724661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:26.228289 run osmo-stp_10.42.42.5(pid=9747): stdout: | (launched: 2022-12-12_17:57:24.470085) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:26.362600 run osmo-stp_10.42.42.5(pid=9747): stderr: | [0;m[38;5;43m20221212175724660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175724660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175724660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175724661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175724661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175724661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175724661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:26.521521 run patchelf(pid=9750): Terminating (SIGINT) 17:57:26.704605 run patchelf(pid=9750): Terminated: ok {rc=0} 17:57:26.836585 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9747): Process ended prematurely: osmo-stp_10.42.42.5(pid=9747) [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9747)] [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 17:57:26.846927 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 17:57:26.875281 run osmo-hlr_10.42.42.2(pid=9744): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9744)] 17:57:26.925156 run osmo-hlr_10.42.42.2(pid=9744): stdout: | (launched: 2022-12-12_17:57:23.450136) 17:57:26.976539 run osmo-hlr_10.42.42.2(pid=9744): stderr: | [0;m[1;31m20221212175723649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175723649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175723649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175723649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175723649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175723649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175723661 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175723671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175723671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175723671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:27.029054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9737): Terminating (SIGTERM) 17:57:27.070972 run iperf3-srv_10.42.42.10(pid=9738): Terminating (SIGTERM) 17:57:27.112877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9739): Terminating (SIGTERM) 17:57:27.154743 run iperf3-srv_10.42.42.10(pid=9740): Terminating (SIGTERM) 17:57:27.196519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9743): Terminating (SIGTERM) 17:57:27.238622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9746): Terminating (SIGTERM) 17:57:27.280760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9749): Terminating (SIGTERM) 17:57:27.323375 --- ParallelTerminationStrategy: PID 9737 died... 17:57:27.343556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9737): Terminated: ok {rc=0} 17:57:27.389668 --- ParallelTerminationStrategy: PID 9738 died... 17:57:27.409135 run iperf3-srv_10.42.42.10(pid=9738): Terminated {rc=256} 17:57:27.455284 --- ParallelTerminationStrategy: PID 9739 died... 17:57:27.474681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9739): Terminated: ok {rc=0} 17:57:27.520561 --- ParallelTerminationStrategy: PID 9740 died... 17:57:27.540062 run iperf3-srv_10.42.42.10(pid=9740): Terminated {rc=256} 17:57:27.585777 --- ParallelTerminationStrategy: PID 9743 died... 17:57:27.605426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9743): Terminated: ok {rc=0} 17:57:27.651418 --- ParallelTerminationStrategy: PID 9746 died... 17:57:27.671051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9746): Terminated: ok {rc=0} 17:57:27.717151 --- ParallelTerminationStrategy: PID 9749 died... 17:57:27.736618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9749): Terminated: ok {rc=0} 17:57:27.823639 bus /gobi_0: Setting Powered False 17:57:28.923889 bus /gobi_0: Setting Powered False 17:57:30.040183 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 17:57:31.219676 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:31.237204 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:57:31.317302 tst iperf3.py: using LAC 30510 17:57:31.484596 tst iperf3.py: using RAC 165 17:57:31.617987 tst iperf3.py: using CellId 30510 17:57:31.745763 tst iperf3.py: using BVCI 30511 17:57:31.896814 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:31.909233 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:31.921216 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:31.933252 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:31.945074 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:31.956759 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:31.969267 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:31.981025 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:31.993103 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:57:32.117253 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:57:32.366951 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:57:32.696902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9751): Launched 17:57:32.985771 run iperf3-srv_10.42.42.10(pid=9752): Launched 17:57:33.109620 tst iperf3.py:8: start network... 17:57:33.330957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:33.839378 run create_hlr_db(pid=9753): Launched 17:57:33.972772 bus /gobi_6: Setting Powered False 17:57:35.037505 run create_hlr_db(pid=9753): Terminated: ok {rc=0} 17:57:35.477283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9755): Launched 17:57:35.785568 run osmo-hlr_10.42.42.2(pid=9756): Launched 17:57:35.903156 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:36.447262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9758): Launched 17:57:36.756167 run osmo-stp_10.42.42.5(pid=9759): Launched 17:57:36.873974 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:57:37.404861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9761): Launched 17:57:37.524044 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:57:37.785081 run patchelf(pid=9762): Launched 17:57:37.955926 run osmo-stp_10.42.42.5(pid=9759): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9759)] 17:57:38.085960 run osmo-stp_10.42.42.5(pid=9759): stdout: | (launched: 2022-12-12_17:57:36.698665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:38.217647 run osmo-stp_10.42.42.5(pid=9759): stderr: | [0;m[38;5;43m20221212175736870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175736870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175736870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175736870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175736871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175736871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175736871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:38.348907 run osmo-stp_10.42.42.5(pid=9759): stdout: | (launched: 2022-12-12_17:57:36.698665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:38.474841 run osmo-stp_10.42.42.5(pid=9759): stderr: | [0;m[38;5;43m20221212175736870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175736870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175736870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175736870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175736871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175736871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175736871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:38.623424 run patchelf(pid=9762): Terminating (SIGINT) 17:57:38.795631 run patchelf(pid=9762): Terminated: ok {rc=0} 17:57:38.919737 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9759): Process ended prematurely: osmo-stp_10.42.42.5(pid=9759) [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9759)] [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 17:57:38.929576 tst iperf3.py:8: Test FAILED (7.8 sec) 17:57:38.957913 run osmo-hlr_10.42.42.2(pid=9756): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9756)] 17:57:39.006748 run osmo-hlr_10.42.42.2(pid=9756): stdout: | (launched: 2022-12-12_17:57:35.728255) 17:57:39.056748 run osmo-hlr_10.42.42.2(pid=9756): stderr: | [0;m[1;31m20221212175735903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175735903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175735903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175735903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175735903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175735904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175735916 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175735926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175735926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175735926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:39.107393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9751): Terminating (SIGTERM) 17:57:39.147955 run iperf3-srv_10.42.42.10(pid=9752): Terminating (SIGTERM) 17:57:39.188321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9755): Terminating (SIGTERM) 17:57:39.228736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9758): Terminating (SIGTERM) 17:57:39.269248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9761): Terminating (SIGTERM) 17:57:39.309798 --- ParallelTerminationStrategy: PID 9751 died... 17:57:39.329132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9751): Terminated: ok {rc=0} 17:57:39.374056 --- ParallelTerminationStrategy: PID 9752 died... 17:57:39.393327 run iperf3-srv_10.42.42.10(pid=9752): Terminated {rc=256} 17:57:39.438068 --- ParallelTerminationStrategy: PID 9755 died... 17:57:39.456879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9755): Terminated: ok {rc=0} 17:57:39.501519 --- ParallelTerminationStrategy: PID 9758 died... 17:57:39.520304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9758): Terminated: ok {rc=0} 17:57:39.565020 --- ParallelTerminationStrategy: PID 9761 died... 17:57:39.583873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9761): Terminated: ok {rc=0} 17:57:39.671469 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 17:57:40.821556 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:40.833446 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:57:40.890894 tst iperf3m4.py: using LAC 30511 17:57:41.012405 tst iperf3m4.py: using RAC 166 17:57:41.134613 tst iperf3m4.py: using CellId 30511 17:57:41.259290 tst iperf3m4.py: using BVCI 30512 17:57:41.371581 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:41.382608 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:41.393635 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:41.404757 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:41.415875 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:41.426899 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:41.438001 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:41.448869 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:57:41.460053 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:57:41.581576 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:57:41.704338 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:57:41.827926 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:57:41.950391 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:57:42.173087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:57:42.503477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9763): Launched 17:57:42.791435 run iperf3-srv_10.42.42.10(pid=9764): Launched 17:57:42.916772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:57:43.138722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:57:43.470068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9765): Launched 17:57:43.757721 run iperf3-srv_10.42.42.10(pid=9766): Launched 17:57:43.881652 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:57:44.103466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:57:44.434180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9767): Launched 17:57:44.721567 run iperf3-srv_10.42.42.10(pid=9768): Launched 17:57:44.846762 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:57:45.068889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:57:45.399656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9769): Launched 17:57:45.688408 run iperf3-srv_10.42.42.10(pid=9770): Launched 17:57:45.813232 tst iperf3m4.py:8: start network... 17:57:46.038330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:57:46.549695 run create_hlr_db(pid=9771): Launched 17:57:46.716093 bus /gobi_6: Setting Powered False 17:57:47.777694 run create_hlr_db(pid=9771): Terminated: ok {rc=0} 17:57:48.237896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9773): Launched 17:57:48.568743 run osmo-hlr_10.42.42.2(pid=9774): Launched 17:57:48.694548 run osmo-stp_10.42.42.5: Starting osmo-stp 17:57:49.260489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9776): Launched 17:57:49.590676 run osmo-stp_10.42.42.5(pid=9777): Launched 17:57:49.717819 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:57:50.284447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9779): Launched 17:57:50.411500 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:57:50.690707 run patchelf(pid=9780): Launched 17:57:50.874717 run osmo-stp_10.42.42.5(pid=9777): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9777)] 17:57:51.013343 run osmo-stp_10.42.42.5(pid=9777): stdout: | (launched: 2022-12-12_17:57:49.529508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:51.153712 run osmo-stp_10.42.42.5(pid=9777): stderr: | [0;m[38;5;43m20221212175749719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175749719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175749719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175749719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175749720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175749720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175749720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:51.293666 run osmo-stp_10.42.42.5(pid=9777): stdout: | (launched: 2022-12-12_17:57:49.529508) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:57:51.427947 run osmo-stp_10.42.42.5(pid=9777): stderr: | [0;m[38;5;43m20221212175749719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175749719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175749719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175749719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175749720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175749720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175749720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:57:51.587835 run patchelf(pid=9780): Terminating (SIGINT) 17:57:51.771063 run patchelf(pid=9780): Terminated: ok {rc=0} 17:57:51.902993 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9777): Process ended prematurely: osmo-stp_10.42.42.5(pid=9777) [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9777)] [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 17:57:51.913130 tst iperf3m4.py:8: Test FAILED (11.1 sec) 17:57:51.942208 run osmo-hlr_10.42.42.2(pid=9774): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9774)] 17:57:51.992461 run osmo-hlr_10.42.42.2(pid=9774): stdout: | (launched: 2022-12-12_17:57:48.507635) 17:57:52.044560 run osmo-hlr_10.42.42.2(pid=9774): stderr: | [0;m[1;31m20221212175748704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175748704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175748704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175748704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175748704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175748704 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175748716 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175748726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175748726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175748726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:57:52.096886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9763): Terminating (SIGTERM) 17:57:52.138797 run iperf3-srv_10.42.42.10(pid=9764): Terminating (SIGTERM) 17:57:52.180529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9765): Terminating (SIGTERM) 17:57:52.222352 run iperf3-srv_10.42.42.10(pid=9766): Terminating (SIGTERM) 17:57:52.263915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9767): Terminating (SIGTERM) 17:57:52.305794 run iperf3-srv_10.42.42.10(pid=9768): Terminating (SIGTERM) 17:57:52.347379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9769): Terminating (SIGTERM) 17:57:52.389191 run iperf3-srv_10.42.42.10(pid=9770): Terminating (SIGTERM) 17:57:52.430754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9773): Terminating (SIGTERM) 17:57:52.472503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9776): Terminating (SIGTERM) 17:57:52.514310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9779): Terminating (SIGTERM) 17:57:52.556281 --- ParallelTerminationStrategy: PID 9763 died... 17:57:52.576237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9763): Terminated: ok {rc=0} 17:57:52.623066 --- ParallelTerminationStrategy: PID 9764 died... 17:57:52.642567 run iperf3-srv_10.42.42.10(pid=9764): Terminated {rc=256} 17:57:52.688359 --- ParallelTerminationStrategy: PID 9765 died... 17:57:52.707786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9765): Terminated: ok {rc=0} 17:57:52.753602 --- ParallelTerminationStrategy: PID 9766 died... 17:57:52.772929 run iperf3-srv_10.42.42.10(pid=9766): Terminated {rc=256} 17:57:52.818580 --- ParallelTerminationStrategy: PID 9767 died... 17:57:52.838016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9767): Terminated: ok {rc=0} 17:57:52.883686 --- ParallelTerminationStrategy: PID 9768 died... 17:57:52.903018 run iperf3-srv_10.42.42.10(pid=9768): Terminated {rc=256} 17:57:52.948575 --- ParallelTerminationStrategy: PID 9769 died... 17:57:52.968027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9769): Terminated: ok {rc=0} 17:57:53.013718 --- ParallelTerminationStrategy: PID 9770 died... 17:57:53.033498 run iperf3-srv_10.42.42.10(pid=9770): Terminated {rc=256} 17:57:53.079325 --- ParallelTerminationStrategy: PID 9773 died... 17:57:53.098882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9773): Terminated: ok {rc=0} 17:57:53.144597 --- ParallelTerminationStrategy: PID 9776 died... 17:57:53.164128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9776): Terminated: ok {rc=0} 17:57:53.209859 --- ParallelTerminationStrategy: PID 9779 died... 17:57:53.229384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9779): Terminated: ok {rc=0} 17:57:53.317701 bus /gobi_4: Setting Powered False 17:57:54.417963 bus /gobi_4: Setting Powered False 17:57:55.538134 bus /gobi_1: Setting Powered False 17:57:56.641535 bus /gobi_1: Setting Powered False 17:57:57.757842 bus /gobi_0: Setting Powered False 17:57:58.854361 bus /gobi_0: Setting Powered False 17:57:59.970959 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 17:58:01.083478 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:01.100586 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:58:01.172737 tst ping.py: using LAC 30512 17:58:01.303328 tst ping.py: using RAC 167 17:58:01.434545 tst ping.py: using CellId 30512 17:58:01.565674 tst ping.py: using BVCI 30513 17:58:01.688261 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:01.700862 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:01.713699 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:01.725621 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:01.738026 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:01.749777 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:01.762402 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:01.775310 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:58:01.899344 tst ping.py:19: start network... 17:58:02.157300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:02.630458 run create_hlr_db(pid=9782): Launched 17:58:02.748576 bus /gobi_6: Setting Powered False 17:58:03.808008 run create_hlr_db(pid=9782): Terminated: ok {rc=0} 17:58:04.229605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9784): Launched 17:58:04.532687 run osmo-hlr_10.42.42.2(pid=9785): Launched 17:58:04.648726 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:05.182539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9787): Launched 17:58:05.485929 run osmo-stp_10.42.42.5(pid=9788): Launched 17:58:05.603273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:58:06.125378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9790): Launched 17:58:06.241063 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:58:06.497973 run patchelf(pid=9791): Launched 17:58:06.667873 run osmo-stp_10.42.42.5(pid=9788): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9788)] 17:58:06.795506 run osmo-stp_10.42.42.5(pid=9788): stdout: | (launched: 2022-12-12_17:58:05.429460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:06.924552 run osmo-stp_10.42.42.5(pid=9788): stderr: | [0;m[38;5;43m20221212175805601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175805601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175805601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175805602 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175805602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175805602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175805602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:07.054216 run osmo-stp_10.42.42.5(pid=9788): stdout: | (launched: 2022-12-12_17:58:05.429460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:07.178124 run osmo-stp_10.42.42.5(pid=9788): stderr: | [0;m[38;5;43m20221212175805601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175805601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175805601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175805602 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175805602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175805602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175805602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:07.324609 run patchelf(pid=9791): Terminating (SIGINT) 17:58:07.493660 run patchelf(pid=9791): Terminated: ok {rc=0} 17:58:07.615505 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9788): Process ended prematurely: osmo-stp_10.42.42.5(pid=9788) [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9788)] [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 17:58:07.624507 tst ping.py:22: Test FAILED (6.5 sec) 17:58:07.651733 run osmo-hlr_10.42.42.2(pid=9785): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9785)] 17:58:07.699905 run osmo-hlr_10.42.42.2(pid=9785): stdout: | (launched: 2022-12-12_17:58:04.476095) 17:58:07.749774 run osmo-hlr_10.42.42.2(pid=9785): stderr: | [0;m[1;31m20221212175804652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175804652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175804652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175804652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175804652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175804652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175804667 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175804678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175804678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175804678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:07.799948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9784): Terminating (SIGTERM) 17:58:07.840326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9787): Terminating (SIGTERM) 17:58:07.880736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9790): Terminating (SIGTERM) 17:58:07.921187 --- ParallelTerminationStrategy: PID 9784 died... 17:58:07.940363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9784): Terminated: ok {rc=0} 17:58:07.985759 --- ParallelTerminationStrategy: PID 9787 died... 17:58:08.004185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9787): Terminated: ok {rc=0} 17:58:08.048711 --- ParallelTerminationStrategy: PID 9790 died... 17:58:08.067266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9790): Terminated: ok {rc=0} 17:58:08.154580 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 17:58:09.244860 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:09.257232 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 17:58:09.315961 tst ping_idle_ping.py: using LAC 30513 17:58:09.436698 tst ping_idle_ping.py: using RAC 168 17:58:09.555171 tst ping_idle_ping.py: using CellId 30513 17:58:09.676639 tst ping_idle_ping.py: using BVCI 30514 17:58:09.786783 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:09.797827 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:09.808601 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:09.819837 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:09.830899 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:09.841982 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:09.853272 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 17:58:09.864186 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 17:58:09.985375 tst ping_idle_ping.py:24: start network... 17:58:10.189487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:10.662423 run create_hlr_db(pid=9793): Launched 17:58:10.780292 bus /gobi_6: Setting Powered False 17:58:11.843929 run create_hlr_db(pid=9793): Terminated: ok {rc=0} 17:58:12.277639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9795): Launched 17:58:12.582630 run osmo-hlr_10.42.42.2(pid=9796): Launched 17:58:12.700376 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:13.238481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9798): Launched 17:58:13.543958 run osmo-stp_10.42.42.5(pid=9799): Launched 17:58:13.663420 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:58:14.187550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9801): Launched 17:58:14.304478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:58:14.561023 run patchelf(pid=9802): Launched 17:58:14.729248 run osmo-stp_10.42.42.5(pid=9799): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9799)] 17:58:14.856728 run osmo-stp_10.42.42.5(pid=9799): stdout: | (launched: 2022-12-12_17:58:13.486784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:14.986259 run osmo-stp_10.42.42.5(pid=9799): stderr: | [0;m[38;5;43m20221212175813656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175813656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175813656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175813657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175813657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175813657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175813657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:15.115682 run osmo-stp_10.42.42.5(pid=9799): stdout: | (launched: 2022-12-12_17:58:13.486784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:15.239279 run osmo-stp_10.42.42.5(pid=9799): stderr: | [0;m[38;5;43m20221212175813656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175813656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175813656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175813657 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175813657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175813657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175813657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:15.385673 run patchelf(pid=9802): Terminating (SIGINT) 17:58:15.555017 run patchelf(pid=9802): Terminated: ok {rc=0} 17:58:15.677986 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9799): Process ended prematurely: osmo-stp_10.42.42.5(pid=9799) [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9799)] [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 17:58:15.686950 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 17:58:15.714151 run osmo-hlr_10.42.42.2(pid=9796): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9796)] 17:58:15.762204 run osmo-hlr_10.42.42.2(pid=9796): stdout: | (launched: 2022-12-12_17:58:12.525075) 17:58:15.811927 run osmo-hlr_10.42.42.2(pid=9796): stderr: | [0;m[1;31m20221212175812701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175812701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175812701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175812701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175812701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175812701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175812712 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175812721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175812721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175812721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:15.864101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9795): Terminating (SIGTERM) 17:58:15.912006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9798): Terminating (SIGTERM) 17:58:15.954430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9801): Terminating (SIGTERM) 17:58:15.998154 --- ParallelTerminationStrategy: PID 9795 died... 17:58:16.017503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9795): Terminated: ok {rc=0} 17:58:16.065062 --- ParallelTerminationStrategy: PID 9798 died... 17:58:16.084620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9798): Terminated: ok {rc=0} 17:58:16.130354 --- ParallelTerminationStrategy: PID 9801 died... 17:58:16.149768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9801): Terminated: ok {rc=0} 17:58:16.235781 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 17:58:17.531026 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:58:17.538395 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 17:58:17.560748 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 17:58:17.601818 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 17:58:17.691831 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 17:58:17.713230 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 17:58:17.753754 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 17:58:18.348511 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 17:58:18.401932 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:18.413225 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:58:18.472654 tst cs_paging_gprs_active.py: using LAC 30514 17:58:18.601682 tst cs_paging_gprs_active.py: using RAC 169 17:58:18.730479 tst cs_paging_gprs_active.py: using CellId 30514 17:58:18.860739 tst cs_paging_gprs_active.py: using BVCI 30515 17:58:18.981784 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:18.993155 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:19.004236 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:19.015856 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:19.027553 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:19.039250 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:19.051351 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:19.062944 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:19.074729 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:58:19.193929 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:58:19.314623 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 17:58:19.521699 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:19.832894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9807): Launched 17:58:20.102292 run iperf3-srv_10.42.42.10(pid=9808): Launched 17:58:20.219904 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 17:58:20.426122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:20.735904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9809): Launched 17:58:21.006276 run iperf3-srv_10.42.42.10(pid=9810): Launched 17:58:21.123593 tst cs_paging_gprs_active.py:38: start network... 17:58:21.329575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:21.807550 run create_hlr_db(pid=9811): Launched 17:58:21.928011 bus /gobi_6: Setting Powered False 17:58:22.989934 run create_hlr_db(pid=9811): Terminated: ok {rc=0} 17:58:23.439838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9813): Launched 17:58:23.773964 run osmo-hlr_10.42.42.2(pid=9814): Launched 17:58:23.901884 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:24.469315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9816): Launched 17:58:24.802741 run osmo-stp_10.42.42.5(pid=9817): Launched 17:58:24.930239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:58:25.499652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9819): Launched 17:58:25.626315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:58:25.906147 run patchelf(pid=9820): Launched 17:58:26.089170 run osmo-stp_10.42.42.5(pid=9817): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9817)] 17:58:26.227717 run osmo-stp_10.42.42.5(pid=9817): stdout: | (launched: 2022-12-12_17:58:24.741359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:26.368253 run osmo-stp_10.42.42.5(pid=9817): stderr: | [0;m[38;5;43m20221212175824932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175824932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175824933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175824933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175824933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175824934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175824934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:26.508644 run osmo-stp_10.42.42.5(pid=9817): stdout: | (launched: 2022-12-12_17:58:24.741359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:26.643458 run osmo-stp_10.42.42.5(pid=9817): stderr: | [0;m[38;5;43m20221212175824932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175824932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175824933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175824933 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175824933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175824934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175824934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:26.802920 run patchelf(pid=9820): Terminating (SIGINT) 17:58:26.986550 run patchelf(pid=9820): Terminated: ok {rc=0} 17:58:27.119265 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9817): Process ended prematurely: osmo-stp_10.42.42.5(pid=9817) [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9817)] [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 17:58:27.129504 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 17:58:27.157875 run osmo-hlr_10.42.42.2(pid=9814): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9814)] 17:58:27.207747 run osmo-hlr_10.42.42.2(pid=9814): stdout: | (launched: 2022-12-12_17:58:23.711587) 17:58:27.259517 run osmo-hlr_10.42.42.2(pid=9814): stderr: | [0;m[1;31m20221212175823911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175823911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175823911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175823911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175823911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175823911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175823923 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175823932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175823933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175823933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:27.311802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9807): Terminating (SIGTERM) 17:58:27.353560 run iperf3-srv_10.42.42.10(pid=9808): Terminating (SIGTERM) 17:58:27.395277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9809): Terminating (SIGTERM) 17:58:27.436918 run iperf3-srv_10.42.42.10(pid=9810): Terminating (SIGTERM) 17:58:27.478625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9813): Terminating (SIGTERM) 17:58:27.520375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9816): Terminating (SIGTERM) 17:58:27.561906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9819): Terminating (SIGTERM) 17:58:27.603548 --- ParallelTerminationStrategy: PID 9807 died... 17:58:27.623444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9807): Terminated: ok {rc=0} 17:58:27.669521 --- ParallelTerminationStrategy: PID 9808 died... 17:58:27.688845 run iperf3-srv_10.42.42.10(pid=9808): Terminated {rc=256} 17:58:27.734448 --- ParallelTerminationStrategy: PID 9809 died... 17:58:27.754011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9809): Terminated: ok {rc=0} 17:58:27.800373 --- ParallelTerminationStrategy: PID 9810 died... 17:58:27.819809 run iperf3-srv_10.42.42.10(pid=9810): Terminated {rc=256} 17:58:27.866284 --- ParallelTerminationStrategy: PID 9813 died... 17:58:27.885887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9813): Terminated: ok {rc=0} 17:58:27.931847 --- ParallelTerminationStrategy: PID 9816 died... 17:58:27.951338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9816): Terminated: ok {rc=0} 17:58:27.997353 --- ParallelTerminationStrategy: PID 9819 died... 17:58:28.016844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9819): Terminated: ok {rc=0} 17:58:28.104791 bus /gobi_0: Setting Powered False 17:58:29.205505 bus /gobi_0: Setting Powered False 17:58:30.322847 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 17:58:31.495055 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:31.510287 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:58:31.572675 tst iperf3.py: using LAC 30515 17:58:31.734292 tst iperf3.py: using RAC 170 17:58:31.858365 tst iperf3.py: using CellId 30515 17:58:31.994147 tst iperf3.py: using BVCI 30516 17:58:32.134281 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:32.146866 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:32.159683 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:32.172413 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:32.184572 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:32.197475 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:32.210232 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:32.222273 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:32.234229 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:58:32.354759 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 17:58:32.562583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:32.871336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9821): Launched 17:58:33.141076 run iperf3-srv_10.42.42.10(pid=9822): Launched 17:58:33.256764 tst iperf3.py:8: start network... 17:58:33.462495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:33.941407 run create_hlr_db(pid=9823): Launched 17:58:34.059573 bus /gobi_6: Setting Powered False 17:58:35.120598 run create_hlr_db(pid=9823): Terminated: ok {rc=0} 17:58:35.571673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9825): Launched 17:58:35.904058 run osmo-hlr_10.42.42.2(pid=9826): Launched 17:58:36.031558 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:36.603369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9828): Launched 17:58:36.931649 run osmo-stp_10.42.42.5(pid=9829): Launched 17:58:37.058360 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:58:37.624604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9831): Launched 17:58:37.751138 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:58:38.029813 run patchelf(pid=9832): Launched 17:58:38.211922 run osmo-stp_10.42.42.5(pid=9829): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9829)] 17:58:38.350363 run osmo-stp_10.42.42.5(pid=9829): stdout: | (launched: 2022-12-12_17:58:36.870900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:38.490304 run osmo-stp_10.42.42.5(pid=9829): stderr: | [0;m[38;5;43m20221212175837063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175837063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175837063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175837064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175837064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175837064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175837064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:38.630425 run osmo-stp_10.42.42.5(pid=9829): stdout: | (launched: 2022-12-12_17:58:36.870900) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:38.764533 run osmo-stp_10.42.42.5(pid=9829): stderr: | [0;m[38;5;43m20221212175837063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175837063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175837063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175837064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175837064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175837064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175837064 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:38.923216 run patchelf(pid=9832): Terminating (SIGINT) 17:58:39.107451 run patchelf(pid=9832): Terminated: ok {rc=0} 17:58:39.240299 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9829): Process ended prematurely: osmo-stp_10.42.42.5(pid=9829) [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9829)] [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 17:58:39.250620 tst iperf3.py:8: Test FAILED (7.8 sec) 17:58:39.279252 run osmo-hlr_10.42.42.2(pid=9826): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9826)] 17:58:39.329536 run osmo-hlr_10.42.42.2(pid=9826): stdout: | (launched: 2022-12-12_17:58:35.843371) 17:58:39.381542 run osmo-hlr_10.42.42.2(pid=9826): stderr: | [0;m[1;31m20221212175836041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175836041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175836041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175836041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175836041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175836041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175836053 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175836062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175836062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175836062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:39.433819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9821): Terminating (SIGTERM) 17:58:39.475843 run iperf3-srv_10.42.42.10(pid=9822): Terminating (SIGTERM) 17:58:39.517982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9825): Terminating (SIGTERM) 17:58:39.560151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9828): Terminating (SIGTERM) 17:58:39.602433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9831): Terminating (SIGTERM) 17:58:39.644660 --- ParallelTerminationStrategy: PID 9821 died... 17:58:39.664866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9821): Terminated: ok {rc=0} 17:58:39.711437 --- ParallelTerminationStrategy: PID 9822 died... 17:58:39.731130 run iperf3-srv_10.42.42.10(pid=9822): Terminated {rc=256} 17:58:39.777267 --- ParallelTerminationStrategy: PID 9825 died... 17:58:39.796888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9825): Terminated: ok {rc=0} 17:58:39.843152 --- ParallelTerminationStrategy: PID 9828 died... 17:58:39.863464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9828): Terminated: ok {rc=0} 17:58:39.909912 --- ParallelTerminationStrategy: PID 9831 died... 17:58:39.929551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9831): Terminated: ok {rc=0} 17:58:40.019291 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 17:58:41.170907 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:41.183120 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:58:41.242274 tst iperf3m4.py: using LAC 30516 17:58:41.371681 tst iperf3m4.py: using RAC 171 17:58:41.493387 tst iperf3m4.py: using CellId 30516 17:58:41.614536 tst iperf3m4.py: using BVCI 30517 17:58:41.727797 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:41.738979 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:41.750005 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:41.761316 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:41.772245 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:41.783271 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:41.794521 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:41.805556 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:58:41.816414 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:58:41.935178 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:58:42.058428 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:58:42.182203 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:58:42.299968 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 17:58:42.507428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:42.817467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9833): Launched 17:58:43.087630 run iperf3-srv_10.42.42.10(pid=9834): Launched 17:58:43.205167 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 17:58:43.410474 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:43.719421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9835): Launched 17:58:43.990425 run iperf3-srv_10.42.42.10(pid=9836): Launched 17:58:44.108370 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 17:58:44.313989 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:44.623411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9837): Launched 17:58:44.891549 run iperf3-srv_10.42.42.10(pid=9838): Launched 17:58:45.007286 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 17:58:45.212610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 17:58:45.521234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9839): Launched 17:58:45.790178 run iperf3-srv_10.42.42.10(pid=9840): Launched 17:58:45.913602 tst iperf3m4.py:8: start network... 17:58:46.123043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:58:46.611579 run create_hlr_db(pid=9841): Launched 17:58:46.764046 bus /gobi_6: Setting Powered False 17:58:47.824658 run create_hlr_db(pid=9841): Terminated: ok {rc=0} 17:58:48.273263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9843): Launched 17:58:48.602782 run osmo-hlr_10.42.42.2(pid=9844): Launched 17:58:48.728750 run osmo-stp_10.42.42.5: Starting osmo-stp 17:58:49.296262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9846): Launched 17:58:49.627465 run osmo-stp_10.42.42.5(pid=9847): Launched 17:58:49.753621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:58:50.321087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9849): Launched 17:58:50.447995 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:58:50.726878 run patchelf(pid=9850): Launched 17:58:50.909767 run osmo-stp_10.42.42.5(pid=9847): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9847)] 17:58:51.048859 run osmo-stp_10.42.42.5(pid=9847): stdout: | (launched: 2022-12-12_17:58:49.566481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:51.189386 run osmo-stp_10.42.42.5(pid=9847): stderr: | [0;m[38;5;43m20221212175849755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175849755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175849755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175849756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175849756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175849756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175849757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:51.329953 run osmo-stp_10.42.42.5(pid=9847): stdout: | (launched: 2022-12-12_17:58:49.566481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:58:51.464434 run osmo-stp_10.42.42.5(pid=9847): stderr: | [0;m[38;5;43m20221212175849755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175849755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175849755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175849756 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175849756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175849756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175849757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:58:51.624438 run patchelf(pid=9850): Terminating (SIGINT) 17:58:51.807585 run patchelf(pid=9850): Terminated: ok {rc=0} 17:58:51.939761 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9847): Process ended prematurely: osmo-stp_10.42.42.5(pid=9847) [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9847)] [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 17:58:51.950264 tst iperf3m4.py:8: Test FAILED (10.8 sec) 17:58:51.979396 run osmo-hlr_10.42.42.2(pid=9844): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9844)] 17:58:52.029597 run osmo-hlr_10.42.42.2(pid=9844): stdout: | (launched: 2022-12-12_17:58:48.541787) 17:58:52.082002 run osmo-hlr_10.42.42.2(pid=9844): stderr: | [0;m[1;31m20221212175848737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175848737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175848737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175848737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175848737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175848737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175848749 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175848758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175848759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175848759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:58:52.134405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9833): Terminating (SIGTERM) 17:58:52.176618 run iperf3-srv_10.42.42.10(pid=9834): Terminating (SIGTERM) 17:58:52.218765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9835): Terminating (SIGTERM) 17:58:52.261015 run iperf3-srv_10.42.42.10(pid=9836): Terminating (SIGTERM) 17:58:52.303132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9837): Terminating (SIGTERM) 17:58:52.345440 run iperf3-srv_10.42.42.10(pid=9838): Terminating (SIGTERM) 17:58:52.387653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9839): Terminating (SIGTERM) 17:58:52.429952 run iperf3-srv_10.42.42.10(pid=9840): Terminating (SIGTERM) 17:58:52.472123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9843): Terminating (SIGTERM) 17:58:52.514545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9846): Terminating (SIGTERM) 17:58:52.556799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9849): Terminating (SIGTERM) 17:58:52.599205 --- ParallelTerminationStrategy: PID 9833 died... 17:58:52.619717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9833): Terminated: ok {rc=0} 17:58:52.666880 --- ParallelTerminationStrategy: PID 9834 died... 17:58:52.686656 run iperf3-srv_10.42.42.10(pid=9834): Terminated {rc=256} 17:58:52.733210 --- ParallelTerminationStrategy: PID 9835 died... 17:58:52.752827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9835): Terminated: ok {rc=0} 17:58:52.799260 --- ParallelTerminationStrategy: PID 9836 died... 17:58:52.819042 run iperf3-srv_10.42.42.10(pid=9836): Terminated {rc=256} 17:58:52.865906 --- ParallelTerminationStrategy: PID 9837 died... 17:58:52.885608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9837): Terminated: ok {rc=0} 17:58:52.931704 --- ParallelTerminationStrategy: PID 9838 died... 17:58:52.951341 run iperf3-srv_10.42.42.10(pid=9838): Terminated {rc=256} 17:58:52.997601 --- ParallelTerminationStrategy: PID 9839 died... 17:58:53.017382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9839): Terminated: ok {rc=0} 17:58:53.063947 --- ParallelTerminationStrategy: PID 9840 died... 17:58:53.083806 run iperf3-srv_10.42.42.10(pid=9840): Terminated {rc=256} 17:58:53.130499 --- ParallelTerminationStrategy: PID 9843 died... 17:58:53.150382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9843): Terminated: ok {rc=0} 17:58:53.196893 --- ParallelTerminationStrategy: PID 9846 died... 17:58:53.216765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9846): Terminated: ok {rc=0} 17:58:53.263204 --- ParallelTerminationStrategy: PID 9849 died... 17:58:53.283102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9849): Terminated: ok {rc=0} 17:58:53.371174 bus /gobi_4: Setting Powered False 17:58:54.474207 bus /gobi_4: Setting Powered False 17:58:55.591720 bus /gobi_1: Setting Powered False 17:58:56.691751 bus /gobi_1: Setting Powered False 17:58:57.810708 bus /gobi_0: Setting Powered False 17:58:58.910057 bus /gobi_0: Setting Powered False 17:59:00.028617 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 17:59:01.134159 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:01.147612 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:59:01.210794 tst ping.py: using LAC 30517 17:59:01.373772 tst ping.py: using RAC 172 17:59:01.530778 tst ping.py: using CellId 30517 17:59:01.700399 tst ping.py: using BVCI 30518 17:59:01.828447 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:01.840755 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:01.853233 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:01.867563 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:01.879611 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:01.892666 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:01.907190 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:01.920333 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:59:02.044843 tst ping.py:19: start network... 17:59:02.271036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:02.773248 run create_hlr_db(pid=9851): Launched 17:59:02.904419 bus /gobi_6: Setting Powered False 17:59:03.968880 run create_hlr_db(pid=9851): Terminated: ok {rc=0} 17:59:04.403586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9853): Launched 17:59:04.708369 run osmo-hlr_10.42.42.2(pid=9854): Launched 17:59:04.825815 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:05.355743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9856): Launched 17:59:05.659790 run osmo-stp_10.42.42.5(pid=9857): Launched 17:59:05.776737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:06.313789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9859): Launched 17:59:06.430670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:06.687696 run patchelf(pid=9860): Launched 17:59:06.857996 run osmo-stp_10.42.42.5(pid=9857): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9857)] 17:59:06.985489 run osmo-stp_10.42.42.5(pid=9857): stdout: | (launched: 2022-12-12_17:59:05.602968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:07.114898 run osmo-stp_10.42.42.5(pid=9857): stderr: | [0;m[38;5;43m20221212175905771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175905771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175905772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175905772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175905773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175905773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175905773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:07.243961 run osmo-stp_10.42.42.5(pid=9857): stdout: | (launched: 2022-12-12_17:59:05.602968) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:07.367856 run osmo-stp_10.42.42.5(pid=9857): stderr: | [0;m[38;5;43m20221212175905771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175905771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175905772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175905772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175905773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175905773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175905773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:07.515089 run patchelf(pid=9860): Terminating (SIGINT) 17:59:07.684280 run patchelf(pid=9860): Terminated: ok {rc=0} 17:59:07.806532 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9857): Process ended prematurely: osmo-stp_10.42.42.5(pid=9857) [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9857)] [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 17:59:07.815651 tst ping.py:22: Test FAILED (6.7 sec) 17:59:07.843392 run osmo-hlr_10.42.42.2(pid=9854): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9854)] 17:59:07.892352 run osmo-hlr_10.42.42.2(pid=9854): stdout: | (launched: 2022-12-12_17:59:04.651387) 17:59:07.943142 run osmo-hlr_10.42.42.2(pid=9854): stderr: | [0;m[1;31m20221212175904827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175904827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175904827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175904827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175904827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175904827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175904838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175904847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175904847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175904847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:07.993986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9853): Terminating (SIGTERM) 17:59:08.034980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9856): Terminating (SIGTERM) 17:59:08.076032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9859): Terminating (SIGTERM) 17:59:08.117100 --- ParallelTerminationStrategy: PID 9853 died... 17:59:08.136642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9853): Terminated: ok {rc=0} 17:59:08.182053 --- ParallelTerminationStrategy: PID 9856 died... 17:59:08.200929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9856): Terminated: ok {rc=0} 17:59:08.246495 --- ParallelTerminationStrategy: PID 9859 died... 17:59:08.265435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9859): Terminated: ok {rc=0} 17:59:08.353237 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 17:59:09.443674 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:09.455924 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 17:59:09.514772 tst ping_idle_ping.py: using LAC 30518 17:59:09.635254 tst ping_idle_ping.py: using RAC 173 17:59:09.755055 tst ping_idle_ping.py: using CellId 30518 17:59:09.875016 tst ping_idle_ping.py: using BVCI 30519 17:59:09.987147 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:09.998229 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:10.009076 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:10.020264 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:10.031184 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:10.042211 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:10.053425 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 17:59:10.064402 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 17:59:10.184058 tst ping_idle_ping.py:24: start network... 17:59:10.404250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:10.916008 run create_hlr_db(pid=9861): Launched 17:59:11.050170 bus /gobi_6: Setting Powered False 17:59:12.114684 run create_hlr_db(pid=9861): Terminated: ok {rc=0} 17:59:12.548760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9863): Launched 17:59:12.853377 run osmo-hlr_10.42.42.2(pid=9864): Launched 17:59:12.969449 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:13.530358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9866): Launched 17:59:13.855076 run osmo-stp_10.42.42.5(pid=9867): Launched 17:59:13.980170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:14.539702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9869): Launched 17:59:14.663925 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:14.937504 run patchelf(pid=9870): Launched 17:59:15.117506 run osmo-stp_10.42.42.5(pid=9867): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9867)] 17:59:15.253417 run osmo-stp_10.42.42.5(pid=9867): stdout: | (launched: 2022-12-12_17:59:13.794898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:15.390828 run osmo-stp_10.42.42.5(pid=9867): stderr: | [0;m[38;5;43m20221212175913986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175913986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175913987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175913987 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175913987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175913988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175913988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:15.528369 run osmo-stp_10.42.42.5(pid=9867): stdout: | (launched: 2022-12-12_17:59:13.794898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:15.660108 run osmo-stp_10.42.42.5(pid=9867): stderr: | [0;m[38;5;43m20221212175913986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175913986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175913987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175913987 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175913987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175913988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175913988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:15.816477 run patchelf(pid=9870): Terminating (SIGINT) 17:59:15.999695 run patchelf(pid=9870): Terminated: ok {rc=0} 17:59:16.132843 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9867): Process ended prematurely: osmo-stp_10.42.42.5(pid=9867) [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9867)] [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 17:59:16.143605 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 17:59:16.173170 run osmo-hlr_10.42.42.2(pid=9864): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9864)] 17:59:16.223876 run osmo-hlr_10.42.42.2(pid=9864): stdout: | (launched: 2022-12-12_17:59:12.796496) 17:59:16.276626 run osmo-hlr_10.42.42.2(pid=9864): stderr: | [0;m[1;31m20221212175912971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175912971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175912971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175912971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175912971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175912971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175912986 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175912995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175912995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175912995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:16.329707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9863): Terminating (SIGTERM) 17:59:16.372772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9866): Terminating (SIGTERM) 17:59:16.417509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9869): Terminating (SIGTERM) 17:59:16.462408 --- ParallelTerminationStrategy: PID 9863 died... 17:59:16.483445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9863): Terminated: ok {rc=0} 17:59:16.536036 --- ParallelTerminationStrategy: PID 9866 died... 17:59:16.556286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9866): Terminated: ok {rc=0} 17:59:16.604486 --- ParallelTerminationStrategy: PID 9869 died... 17:59:16.624847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9869): Terminated: ok {rc=0} 17:59:16.715753 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 17:59:18.002616 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:59:18.010410 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 17:59:18.031785 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 17:59:18.067750 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 17:59:18.123061 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 17:59:18.143727 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 17:59:18.179176 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 17:59:18.738029 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 17:59:18.744230 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:59:18.756361 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 17:59:18.813310 tst switch_tch_pdch.py: using LAC 30519 17:59:18.944215 tst switch_tch_pdch.py: using RAC 174 17:59:19.069989 tst switch_tch_pdch.py: using CellId 30519 17:59:19.189374 tst switch_tch_pdch.py: using BVCI 30520 17:59:19.298622 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:59:19.309989 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:59:19.321008 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:59:19.332429 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:59:19.343901 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:59:19.355258 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:59:19.366770 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 17:59:19.378211 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:59:19.502531 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 17:59:19.623183 tst switch_tch_pdch.py:51: start network... 17:59:19.840214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:20.342228 run create_hlr_db(pid=9876): Launched 17:59:20.475443 bus /gobi_6: Setting Powered False 17:59:21.540572 run create_hlr_db(pid=9876): Terminated: ok {rc=0} 17:59:21.972205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9878): Launched 17:59:22.276020 run osmo-hlr_10.42.42.2(pid=9879): Launched 17:59:22.392165 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:22.917222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9881): Launched 17:59:23.220003 run osmo-stp_10.42.42.5(pid=9882): Launched 17:59:23.335321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:23.857206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9884): Launched 17:59:23.972623 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:24.230114 run patchelf(pid=9885): Launched 17:59:24.398670 run osmo-stp_10.42.42.5(pid=9882): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9882)] 17:59:24.526279 run osmo-stp_10.42.42.5(pid=9882): stdout: | (launched: 2022-12-12_17:59:23.163328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:24.655773 run osmo-stp_10.42.42.5(pid=9882): stderr: | [0;m[38;5;43m20221212175923331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175923331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175923332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175923332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175923333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175923333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175923333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:24.785065 run osmo-stp_10.42.42.5(pid=9882): stdout: | (launched: 2022-12-12_17:59:23.163328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:24.908320 run osmo-stp_10.42.42.5(pid=9882): stderr: | [0;m[38;5;43m20221212175923331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175923331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175923332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175923332 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175923333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175923333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175923333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:25.054542 run patchelf(pid=9885): Terminating (SIGINT) 17:59:25.223460 run patchelf(pid=9885): Terminated: ok {rc=0} 17:59:25.345244 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9882): Process ended prematurely: osmo-stp_10.42.42.5(pid=9882) [trial-2380↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9882)] [trial-2380↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 17:59:25.354207 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 17:59:25.381353 run osmo-hlr_10.42.42.2(pid=9879): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9879)] 17:59:25.429366 run osmo-hlr_10.42.42.2(pid=9879): stdout: | (launched: 2022-12-12_17:59:22.219228) 17:59:25.479176 run osmo-hlr_10.42.42.2(pid=9879): stderr: | [0;m[1;31m20221212175922392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175922392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175922392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175922392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175922392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175922392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175922409 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175922418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175922418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175922418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:25.529137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9878): Terminating (SIGTERM) 17:59:25.569105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9881): Terminating (SIGTERM) 17:59:25.609273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9884): Terminating (SIGTERM) 17:59:25.650322 --- ParallelTerminationStrategy: PID 9878 died... 17:59:25.669822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9878): Terminated: ok {rc=0} 17:59:25.714271 --- ParallelTerminationStrategy: PID 9881 died... 17:59:25.732835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9881): Terminated: ok {rc=0} 17:59:25.776741 --- ParallelTerminationStrategy: PID 9884 died... 17:59:25.795363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9884): Terminated: ok {rc=0} 17:59:25.882185 bus /gobi_0: Setting Powered False 17:59:26.981452 bus /gobi_0: Setting Powered False 17:59:28.097490 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 17:59:29.332649 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:59:29.338612 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 17:59:29.359145 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 17:59:29.395268 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 17:59:29.448675 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 17:59:29.469156 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 17:59:29.503564 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 17:59:30.057666 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 17:59:30.062717 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:59:30.073681 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 17:59:30.130610 tst switch_tch_pdch.py: using LAC 30520 17:59:30.250274 tst switch_tch_pdch.py: using RAC 175 17:59:30.370359 tst switch_tch_pdch.py: using CellId 30520 17:59:30.490049 tst switch_tch_pdch.py: using BVCI 30521 17:59:30.598683 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:59:30.609718 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:59:30.620413 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:59:30.631450 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:59:30.642375 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:59:30.653513 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:59:30.664610 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 17:59:30.675646 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:59:30.795410 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 17:59:30.936210 tst switch_tch_pdch.py:51: start network... 17:59:31.157899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:31.658785 run create_hlr_db(pid=9890): Launched 17:59:31.832290 bus /gobi_6: Setting Powered False 17:59:32.892706 run create_hlr_db(pid=9890): Terminated: ok {rc=0} 17:59:33.309120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9892): Launched 17:59:33.635096 run osmo-hlr_10.42.42.2(pid=9893): Launched 17:59:33.758051 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:34.287966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9895): Launched 17:59:34.619658 run osmo-stp_10.42.42.5(pid=9899): Launched 17:59:34.742808 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 17:59:35.269880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9901): Launched 17:59:35.386599 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 17:59:35.642945 run patchelf(pid=9902): Launched 17:59:35.811910 run osmo-stp_10.42.42.5(pid=9899): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9899)] 17:59:35.938943 run osmo-stp_10.42.42.5(pid=9899): stdout: | (launched: 2022-12-12_17:59:34.560084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:36.067751 run osmo-stp_10.42.42.5(pid=9899): stderr: | [0;m[38;5;43m20221212175934750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175934750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175934750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175934751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175934751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175934751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175934751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:36.197123 run osmo-stp_10.42.42.5(pid=9899): stdout: | (launched: 2022-12-12_17:59:34.560084) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:36.320661 run osmo-stp_10.42.42.5(pid=9899): stderr: | [0;m[38;5;43m20221212175934750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175934750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175934750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175934751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175934751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175934751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175934751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:36.466972 run patchelf(pid=9902): Terminating (SIGINT) 17:59:36.635544 run patchelf(pid=9902): Terminated: ok {rc=0} 17:59:36.756435 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9899): Process ended prematurely: osmo-stp_10.42.42.5(pid=9899) [trial-2380↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9899)] [trial-2380↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 17:59:36.765666 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 17:59:36.792803 run osmo-hlr_10.42.42.2(pid=9893): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9893)] 17:59:36.841704 run osmo-hlr_10.42.42.2(pid=9893): stdout: | (launched: 2022-12-12_17:59:33.575064) 17:59:36.891851 run osmo-hlr_10.42.42.2(pid=9893): stderr: | [0;m[1;31m20221212175933772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175933772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175933772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175933772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175933772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175933772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175933786 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175933795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175933795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175933795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:36.942570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9892): Terminating (SIGTERM) 17:59:36.983281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9895): Terminating (SIGTERM) 17:59:37.023933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9901): Terminating (SIGTERM) 17:59:37.064793 --- ParallelTerminationStrategy: PID 9892 died... 17:59:37.084127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9892): Terminated: ok {rc=0} 17:59:37.129786 --- ParallelTerminationStrategy: PID 9895 died... 17:59:37.148540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9895): Terminated: ok {rc=0} 17:59:37.193527 --- ParallelTerminationStrategy: PID 9901 died... 17:59:37.212303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9901): Terminated: ok {rc=0} 17:59:37.297554 bus /gobi_0: Setting Powered False 17:59:38.398672 bus /gobi_0: Setting Powered False 17:59:39.515151 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_sms:trx-b200 --------------------------------------------------------------------- 17:59:40.750312 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:59:40.754304 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 17:59:40.788506 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 17:59:40.795432 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 17:59:40.847539 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 17:59:40.880657 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 17:59:40.887539 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 17:59:41.432359 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 17:59:41.438636 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 17:59:41.450418 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 17:59:41.504425 tst mo_mt_sms.py: using LAC 30521 17:59:41.633097 tst mo_mt_sms.py: using RAC 176 17:59:41.763404 tst mo_mt_sms.py: using CellId 30521 17:59:41.889393 tst mo_mt_sms.py: using BVCI 30522 17:59:42.006013 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 17:59:42.121732 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 17:59:42.241727 tst mo_mt_sms.py:9: start nitb and bts... 17:59:42.461176 run osmo-nitb_10.42.42.2: Starting osmo-nitb 17:59:43.122625 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9906): Launched 17:59:43.447007 run osmo-nitb_10.42.42.2(pid=9907): Launched 17:59:43.627674 run osmo-nitb_10.42.42.2(pid=9907): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9907)] 17:59:43.772106 run osmo-nitb_10.42.42.2(pid=9907): stdout: | (launched: 2022-12-12_17:59:43.386983) 17:59:43.917733 run osmo-nitb_10.42.42.2(pid=9907): stderr: | (launched: 2022-12-12_17:59:43.435074) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:59:44.063946 run osmo-nitb_10.42.42.2(pid=9907): stdout: | (launched: 2022-12-12_17:59:43.386983) 17:59:44.204615 run osmo-nitb_10.42.42.2(pid=9907): stderr: | (launched: 2022-12-12_17:59:43.435074) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9907): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9907) [trial-2380↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9907)] 17:59:44.571092 tst osmo-nitb_10.42.42.2(pid=9907): stdout: | (launched: 2022-12-12_17:59:43.386983) 17:59:44.701694 tst osmo-nitb_10.42.42.2(pid=9907): stderr: | (launched: 2022-12-12_17:59:43.435074) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 17:59:44.855053 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9907): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9907) [trial-2380↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9907)] [trial-2380↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 17:59:44.863972 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 17:59:44.871235 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9906): Terminating (SIGTERM) 17:59:45.082155 --- ParallelTerminationStrategy: PID 9906 died... 17:59:45.103169 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9906): Terminated: ok {rc=0} 17:59:45.191950 bus /sierra_3: Setting Powered False 17:59:46.299035 bus /sierra_3: Setting Powered False 17:59:47.432114 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 sms:trx-b200 --------------------------------------------------------------------- 17:59:48.640250 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:59:48.645181 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 17:59:48.679470 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 17:59:48.706988 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 17:59:48.761299 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 17:59:48.795106 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 17:59:48.821648 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 17:59:49.365578 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 17:59:49.370749 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:59:49.381621 tst sms:trx-b200: Using 1 x bts (candidates: 1) 17:59:49.430939 tst mo_mt_sms.py: using LAC 30522 17:59:49.550358 tst mo_mt_sms.py: using RAC 177 17:59:49.670487 tst mo_mt_sms.py: using CellId 30522 17:59:49.801209 tst mo_mt_sms.py: using BVCI 30523 17:59:49.919244 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:59:49.930371 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:59:49.941328 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:59:49.952183 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:59:49.963116 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 17:59:49.974072 tst sms:trx-b200: Using 1 x modem (candidates: 2) 17:59:50.090999 tst sms:trx-b200: Using 1 x modem (candidates: 2) 17:59:50.206127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 17:59:50.678576 run create_hlr_db(pid=9911): Launched 17:59:50.797333 bus /sierra_2: Setting Powered False 17:59:51.857847 run create_hlr_db(pid=9911): Terminated: ok {rc=0} 17:59:52.282897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9913): Launched 17:59:52.587155 run osmo-hlr_10.42.42.2(pid=9914): Launched 17:59:52.703673 run osmo-stp_10.42.42.5: Starting osmo-stp 17:59:53.235243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9916): Launched 17:59:53.540043 run osmo-stp_10.42.42.5(pid=9917): Launched 17:59:53.655966 run osmo-msc_10.42.42.6: Starting osmo-msc 17:59:54.205735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9919): Launched 17:59:54.510002 run osmo-msc_10.42.42.6(pid=9920): Launched 17:59:54.681562 run osmo-stp_10.42.42.5(pid=9917): ERR: Terminated: ERROR {rc=1} [trial-2380↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9917)] 17:59:54.808491 run osmo-stp_10.42.42.5(pid=9917): stdout: | (launched: 2022-12-12_17:59:53.483468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:54.936252 run osmo-stp_10.42.42.5(pid=9917): stderr: | [0;m[38;5;43m20221212175953654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175953654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175953654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175953655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175953655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175953655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175953655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:55.061935 run osmo-stp_10.42.42.5(pid=9917): stdout: | (launched: 2022-12-12_17:59:53.483468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 17:59:55.182122 run osmo-stp_10.42.42.5(pid=9917): stderr: | [0;m[38;5;43m20221212175953654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212175953654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212175953654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212175953655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212175953655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212175953655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212175953655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 17:59:55.325692 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9917): Process ended prematurely: osmo-stp_10.42.42.5(pid=9917) [trial-2380↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9917)] [trial-2380↪sms:trx-b200↪mo_mt_sms.py:16] 17:59:55.334120 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 17:59:55.360597 run osmo-hlr_10.42.42.2(pid=9914): ERR: Terminated: ERROR {rc=237} [trial-2380↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9914)] 17:59:55.409530 run osmo-hlr_10.42.42.2(pid=9914): stdout: | (launched: 2022-12-12_17:59:52.530536) 17:59:55.459693 run osmo-hlr_10.42.42.2(pid=9914): stderr: | [0;m[1;31m20221212175952705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212175952705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212175952705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212175952705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212175952705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212175952705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212175952720 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212175952729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212175952729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212175952729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 17:59:55.529487 run osmo-msc_10.42.42.6(pid=9920): ERR: Terminated: ERROR {rc=2} [trial-2380↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9920)] 17:59:55.577791 run osmo-msc_10.42.42.6(pid=9920): stdout: | (launched: 2022-12-12_17:59:54.453088) 17:59:55.627795 run osmo-msc_10.42.42.6(pid=9920): stderr: | [0;m[38;5;43m20221212175954723 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212175954723 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9f8737fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212175954724 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212175954724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212175954724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212175954724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212175954726 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212175954726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212175954726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212175954727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 17:59:55.678223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9913): Terminating (SIGTERM) 17:59:55.718561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9916): Terminating (SIGTERM) 17:59:55.758903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9919): Terminating (SIGTERM) 17:59:55.799488 --- ParallelTerminationStrategy: PID 9913 died... 17:59:55.818790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9913): Terminated: ok {rc=0} 17:59:55.863497 --- ParallelTerminationStrategy: PID 9916 died... 17:59:55.882042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9916): Terminated: ok {rc=0} 17:59:55.926336 --- ParallelTerminationStrategy: PID 9919 died... 17:59:55.944891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9919): Terminated: ok {rc=0} 17:59:56.032708 bus /sierra_3: Setting Powered False 17:59:57.135367 bus /sierra_3: Setting Powered False 17:59:58.253217 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_ussd:trx-b200 --------------------------------------------------------------------- 17:59:59.485953 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 17:59:59.490032 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 17:59:59.524320 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 17:59:59.531347 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 17:59:59.569115 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 17:59:59.602693 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 17:59:59.609711 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 18:00:00.129930 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2380 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 18:00:00.135006 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 18:00:00.146467 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 18:00:00.196262 tst assert_extension.py: using LAC 30523 18:00:00.322748 tst assert_extension.py: using RAC 178 18:00:00.450817 tst assert_extension.py: using CellId 30523 18:00:00.582184 tst assert_extension.py: using BVCI 30524 18:00:00.700475 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 18:00:00.816685 tst assert_extension.py:10: start nitb and bts... 18:00:01.052697 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:00:01.753882 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9937): Launched 18:00:02.106105 run osmo-nitb_10.42.42.2(pid=9939): Launched 18:00:02.323672 run osmo-nitb_10.42.42.2(pid=9939): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9939)] 18:00:02.473890 run osmo-nitb_10.42.42.2(pid=9939): stdout: | (launched: 2022-12-12_18:00:02.042616) 18:00:02.624649 run osmo-nitb_10.42.42.2(pid=9939): stderr: | (launched: 2022-12-12_18:00:02.092223) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:00:02.770622 run osmo-nitb_10.42.42.2(pid=9939): stdout: | (launched: 2022-12-12_18:00:02.042616) 18:00:02.902817 run osmo-nitb_10.42.42.2(pid=9939): stderr: | (launched: 2022-12-12_18:00:02.092223) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9939): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9939) [trial-2380↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9939)] 18:00:03.264432 tst osmo-nitb_10.42.42.2(pid=9939): stdout: | (launched: 2022-12-12_18:00:02.042616) 18:00:03.386587 tst osmo-nitb_10.42.42.2(pid=9939): stderr: | (launched: 2022-12-12_18:00:02.092223) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:00:03.529837 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9939): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9939) [trial-2380↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9939)] [trial-2380↪nitb_ussd:trx-b200↪assert_extension.py:12] 18:00:03.538228 tst assert_extension.py:12: Test FAILED (3.4 sec) 18:00:03.544790 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9937): Terminating (SIGTERM) 18:00:03.756108 --- ParallelTerminationStrategy: PID 9937 died... 18:00:03.776809 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9937): Terminated: ok {rc=0} 18:00:03.866457 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 ussd:trx-b200 --------------------------------------------------------------------- 18:00:05.047513 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:00:05.051923 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 18:00:05.086433 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 18:00:05.113510 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 18:00:05.149280 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 18:00:05.182417 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 18:00:05.208787 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 18:00:05.736387 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2380 ussd:trx-b200 assert_extension.py ---------------------------------------------- 18:00:05.742900 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:00:05.754562 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 18:00:05.805911 tst assert_extension.py: using LAC 30524 18:00:05.926291 tst assert_extension.py: using RAC 179 18:00:06.046238 tst assert_extension.py: using CellId 30524 18:00:06.167218 tst assert_extension.py: using BVCI 30525 18:00:06.278876 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:00:06.289698 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:00:06.300194 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:00:06.310997 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:00:06.321888 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 18:00:06.332582 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 18:00:06.453180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:06.955588 run create_hlr_db(pid=9954): Launched 18:00:07.089074 bus /sierra_2: Setting Powered False 18:00:08.149804 run create_hlr_db(pid=9954): Terminated: ok {rc=0} 18:00:08.601714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9957): Launched 18:00:08.926022 run osmo-hlr_10.42.42.2(pid=9958): Launched 18:00:09.050520 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:09.611129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9960): Launched 18:00:09.935088 run osmo-stp_10.42.42.5(pid=9961): Launched 18:00:10.060120 run osmo-msc_10.42.42.6: Starting osmo-msc 18:00:10.642085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9963): Launched 18:00:10.964594 run osmo-msc_10.42.42.6(pid=9964): Launched 18:00:11.145595 run osmo-stp_10.42.42.5(pid=9961): ERR: Terminated: ERROR {rc=1} [trial-2380↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9961)] 18:00:11.280916 run osmo-stp_10.42.42.5(pid=9961): stdout: | (launched: 2022-12-12_18:00:09.874951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:11.421307 run osmo-stp_10.42.42.5(pid=9961): stderr: | [0;m[38;5;43m20221212180010067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180010067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180010067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180010067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180010068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180010068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180010068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:11.573527 run osmo-stp_10.42.42.5(pid=9961): stdout: | (launched: 2022-12-12_18:00:09.874951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:11.697723 run osmo-stp_10.42.42.5(pid=9961): stderr: | [0;m[38;5;43m20221212180010067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180010067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180010067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180010067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180010068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180010068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180010068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:11.846598 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9961): Process ended prematurely: osmo-stp_10.42.42.5(pid=9961) [trial-2380↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9961)] [trial-2380↪ussd:trx-b200↪assert_extension.py:17] 18:00:11.855396 tst assert_extension.py:17: Test FAILED (6.1 sec) 18:00:11.882799 run osmo-hlr_10.42.42.2(pid=9958): ERR: Terminated: ERROR {rc=237} [trial-2380↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9958)] 18:00:11.932273 run osmo-hlr_10.42.42.2(pid=9958): stdout: | (launched: 2022-12-12_18:00:08.865876) 18:00:11.983425 run osmo-hlr_10.42.42.2(pid=9958): stderr: | [0;m[1;31m20221212180009066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180009066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180009066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180009066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180009066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180009066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180009078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180009087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180009087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180009087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:12.054986 run osmo-msc_10.42.42.6(pid=9964): ERR: Terminated: ERROR {rc=2} [trial-2380↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9964)] 18:00:12.104661 run osmo-msc_10.42.42.6(pid=9964): stdout: | (launched: 2022-12-12_18:00:10.904476) 18:00:12.155885 run osmo-msc_10.42.42.6(pid=9964): stderr: | [0;m[38;5;43m20221212180011227 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180011227 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f096ad1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180011227 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180011227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180011227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180011227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180011229 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180011229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180011230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180011230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:00:12.207458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9957): Terminating (SIGTERM) 18:00:12.248462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9960): Terminating (SIGTERM) 18:00:12.289860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9963): Terminating (SIGTERM) 18:00:12.332369 --- ParallelTerminationStrategy: PID 9957 died... 18:00:12.352376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9957): Terminated: ok {rc=0} 18:00:12.398342 --- ParallelTerminationStrategy: PID 9960 died... 18:00:12.417614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9960): Terminated: ok {rc=0} 18:00:12.463622 --- ParallelTerminationStrategy: PID 9963 died... 18:00:12.483001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9963): Terminated: ok {rc=0} 18:00:12.571212 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:00:13.782681 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:00:13.790615 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:00:13.824307 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:00:13.851225 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:00:13.903715 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:00:13.937106 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:00:13.963927 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:00:14.516324 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:00:14.567904 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:00:14.579487 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:00:14.651315 tst mo_mt_call.py: using LAC 30525 18:00:14.778251 tst mo_mt_call.py: using RAC 180 18:00:14.904624 tst mo_mt_call.py: using CellId 30525 18:00:15.025889 tst mo_mt_call.py: using BVCI 30526 18:00:15.133796 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:00:15.145162 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:00:15.156105 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:00:15.167648 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:00:15.179307 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:00:15.192412 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:00:15.306105 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:00:15.426347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:15.937683 run create_hlr_db(pid=9970): Launched 18:00:16.080739 bus /sierra_2: Setting Powered False 18:00:17.144156 run create_hlr_db(pid=9970): Terminated: ok {rc=0} 18:00:17.597750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9972): Launched 18:00:17.920602 run osmo-hlr_10.42.42.2(pid=9973): Launched 18:00:18.046047 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:18.597631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9975): Launched 18:00:18.921081 run osmo-stp_10.42.42.5(pid=9976): Launched 18:00:19.043767 run osmo-msc_10.42.42.6: Starting osmo-msc 18:00:19.625617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9978): Launched 18:00:19.949355 run osmo-msc_10.42.42.6(pid=9979): Launched 18:00:20.129707 run osmo-stp_10.42.42.5(pid=9976): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9976)] 18:00:20.265366 run osmo-stp_10.42.42.5(pid=9976): stdout: | (launched: 2022-12-12_18:00:18.861595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:20.401265 run osmo-stp_10.42.42.5(pid=9976): stderr: | [0;m[38;5;43m20221212180019050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180019051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180019051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180019051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180019052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180019052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180019052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:20.535716 run osmo-stp_10.42.42.5(pid=9976): stdout: | (launched: 2022-12-12_18:00:18.861595) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:20.664556 run osmo-stp_10.42.42.5(pid=9976): stderr: | [0;m[38;5;43m20221212180019050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180019051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180019051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180019051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180019052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180019052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180019052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:20.818851 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9976): Process ended prematurely: osmo-stp_10.42.42.5(pid=9976) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9976)] [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:00:20.828702 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:00:20.856322 run osmo-hlr_10.42.42.2(pid=9973): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9973)] 18:00:20.905983 run osmo-hlr_10.42.42.2(pid=9973): stdout: | (launched: 2022-12-12_18:00:17.861214) 18:00:20.957450 run osmo-hlr_10.42.42.2(pid=9973): stderr: | [0;m[1;31m20221212180018056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180018056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180018056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180018056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180018056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180018056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180018069 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180018079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180018079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180018080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:21.028875 run osmo-msc_10.42.42.6(pid=9979): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9979)] 18:00:21.078718 run osmo-msc_10.42.42.6(pid=9979): stdout: | (launched: 2022-12-12_18:00:19.889732) 18:00:21.130426 run osmo-msc_10.42.42.6(pid=9979): stderr: | [0;m[38;5;43m20221212180020209 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180020210 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0a866a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180020210 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180020210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180020210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180020210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180020212 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180020212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180020212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180020212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:00:21.182275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9972): Terminating (SIGTERM) 18:00:21.223664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9975): Terminating (SIGTERM) 18:00:21.265088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9978): Terminating (SIGTERM) 18:00:21.306907 --- ParallelTerminationStrategy: PID 9972 died... 18:00:21.326380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9972): Terminated: ok {rc=0} 18:00:21.372185 --- ParallelTerminationStrategy: PID 9975 died... 18:00:21.391740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9975): Terminated: ok {rc=0} 18:00:21.437469 --- ParallelTerminationStrategy: PID 9978 died... 18:00:21.456707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9978): Terminated: ok {rc=0} 18:00:21.543952 bus /sierra_3: Setting Powered False 18:00:22.643192 bus /sierra_3: Setting Powered False 18:00:23.758237 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:00:24.908337 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:00:24.921251 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:00:24.993459 tst mo_mt_call_osmux.py: using LAC 30526 18:00:25.120746 tst mo_mt_call_osmux.py: using RAC 181 18:00:25.250021 tst mo_mt_call_osmux.py: using CellId 30526 18:00:25.378327 tst mo_mt_call_osmux.py: using BVCI 30527 18:00:25.497130 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:00:25.508601 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:00:25.519969 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:00:25.531483 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:00:25.543177 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:00:25.554719 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:00:25.673715 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:00:25.790316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:26.258435 run create_hlr_db(pid=9981): Launched 18:00:26.374792 bus /sierra_2: Setting Powered False 18:00:27.434846 run create_hlr_db(pid=9981): Terminated: ok {rc=0} 18:00:27.856651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9983): Launched 18:00:28.158513 run osmo-hlr_10.42.42.2(pid=9984): Launched 18:00:28.273561 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:28.795527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9986): Launched 18:00:29.098607 run osmo-stp_10.42.42.5(pid=9987): Launched 18:00:29.214112 run osmo-msc_10.42.42.6: Starting osmo-msc 18:00:29.757677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9989): Launched 18:00:30.059925 run osmo-msc_10.42.42.6(pid=9990): Launched 18:00:30.228191 run osmo-stp_10.42.42.5(pid=9987): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9987)] 18:00:30.354942 run osmo-stp_10.42.42.5(pid=9987): stdout: | (launched: 2022-12-12_18:00:29.042583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:30.481891 run osmo-stp_10.42.42.5(pid=9987): stderr: | [0;m[38;5;43m20221212180029210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180029210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180029211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180029211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180029212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180029212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180029212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:30.607587 run osmo-stp_10.42.42.5(pid=9987): stdout: | (launched: 2022-12-12_18:00:29.042583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:30.727138 run osmo-stp_10.42.42.5(pid=9987): stderr: | [0;m[38;5;43m20221212180029210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180029210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180029211 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180029211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180029212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180029212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180029212 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:30.889248 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9987): Process ended prematurely: osmo-stp_10.42.42.5(pid=9987) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9987)] [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:00:30.898824 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 18:00:30.926896 run osmo-hlr_10.42.42.2(pid=9984): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9984)] 18:00:30.975898 run osmo-hlr_10.42.42.2(pid=9984): stdout: | (launched: 2022-12-12_18:00:28.102382) 18:00:31.026654 run osmo-hlr_10.42.42.2(pid=9984): stderr: | [0;m[1;31m20221212180028276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180028276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180028276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180028276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180028276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180028276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180028288 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180028296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180028296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180028296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:31.097536 run osmo-msc_10.42.42.6(pid=9990): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9990)] 18:00:31.146996 run osmo-msc_10.42.42.6(pid=9990): stdout: | (launched: 2022-12-12_18:00:30.003915) 18:00:31.198042 run osmo-msc_10.42.42.6(pid=9990): stderr: | [0;m[38;5;43m20221212180030273 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180030273 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f874731cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180030273 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180030273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180030273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180030274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180030275 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180030276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180030276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180030276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:00:31.249309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9983): Terminating (SIGTERM) 18:00:31.290685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9986): Terminating (SIGTERM) 18:00:31.333282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9989): Terminating (SIGTERM) 18:00:31.374212 --- ParallelTerminationStrategy: PID 9983 died... 18:00:31.393487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9983): Terminated: ok {rc=0} 18:00:31.438568 --- ParallelTerminationStrategy: PID 9986 died... 18:00:31.457762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9986): Terminated: ok {rc=0} 18:00:31.502878 --- ParallelTerminationStrategy: PID 9989 died... 18:00:31.521981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9989): Terminated: ok {rc=0} 18:00:31.608187 bus /sierra_3: Setting Powered False 18:00:32.704713 bus /sierra_3: Setting Powered False 18:00:33.819140 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:00:35.068524 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:00:35.074981 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:00:35.108241 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:00:35.134424 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:00:35.186706 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:00:35.220007 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:00:35.246509 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:00:35.799212 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:00:35.852786 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:00:35.864456 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:00:35.936467 tst mo_mt_call.py: using LAC 30527 18:00:36.062543 tst mo_mt_call.py: using RAC 182 18:00:36.190320 tst mo_mt_call.py: using CellId 30527 18:00:36.317178 tst mo_mt_call.py: using BVCI 30528 18:00:36.433922 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:00:36.445630 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:00:36.456897 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:00:36.468340 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:00:36.479860 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:00:36.491301 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:00:36.611971 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:00:36.734199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:37.235323 run create_hlr_db(pid=9995): Launched 18:00:37.367056 bus /sierra_2: Setting Powered False 18:00:38.430571 run create_hlr_db(pid=9995): Terminated: ok {rc=0} 18:00:38.863679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9997): Launched 18:00:39.168835 run osmo-hlr_10.42.42.2(pid=9998): Launched 18:00:39.284769 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:39.816746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10000): Launched 18:00:40.119628 run osmo-stp_10.42.42.5(pid=10001): Launched 18:00:40.234585 run osmo-msc_10.42.42.6: Starting osmo-msc 18:00:40.778508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10003): Launched 18:00:41.082610 run osmo-msc_10.42.42.6(pid=10004): Launched 18:00:41.251625 run osmo-stp_10.42.42.5(pid=10001): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10001)] 18:00:41.378797 run osmo-stp_10.42.42.5(pid=10001): stdout: | (launched: 2022-12-12_18:00:40.063045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:41.505987 run osmo-stp_10.42.42.5(pid=10001): stderr: | [0;m[38;5;43m20221212180040231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180040231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180040231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180040232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180040232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180040232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180040232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:41.631945 run osmo-stp_10.42.42.5(pid=10001): stdout: | (launched: 2022-12-12_18:00:40.063045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:41.752150 run osmo-stp_10.42.42.5(pid=10001): stderr: | [0;m[38;5;43m20221212180040231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180040231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180040231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180040232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180040232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180040232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180040232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:41.895992 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10001): Process ended prematurely: osmo-stp_10.42.42.5(pid=10001) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10001)] [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:00:41.904941 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:00:41.931742 run osmo-hlr_10.42.42.2(pid=9998): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9998)] 18:00:41.979790 run osmo-hlr_10.42.42.2(pid=9998): stdout: | (launched: 2022-12-12_18:00:39.111865) 18:00:42.033415 run osmo-hlr_10.42.42.2(pid=9998): stderr: | [0;m[1;31m20221212180039285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180039285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180039285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180039285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180039285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180039285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180039296 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180039304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180039304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180039304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:42.101614 run osmo-msc_10.42.42.6(pid=10004): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10004)] 18:00:42.148816 run osmo-msc_10.42.42.6(pid=10004): stdout: | (launched: 2022-12-12_18:00:41.026676) 18:00:42.197694 run osmo-msc_10.42.42.6(pid=10004): stderr: | [0;m[38;5;43m20221212180041296 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180041296 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe3ba150c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180041296 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180041296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180041296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180041297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180041298 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180041299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180041299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180041299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:00:42.246983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9997): Terminating (SIGTERM) 18:00:42.286670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10000): Terminating (SIGTERM) 18:00:42.326354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10003): Terminating (SIGTERM) 18:00:42.366334 --- ParallelTerminationStrategy: PID 9997 died... 18:00:42.385306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9997): Terminated: ok {rc=0} 18:00:42.429768 --- ParallelTerminationStrategy: PID 10000 died... 18:00:42.447931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10000): Terminated: ok {rc=0} 18:00:42.492909 --- ParallelTerminationStrategy: PID 10003 died... 18:00:42.511880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10003): Terminated: ok {rc=0} 18:00:42.595886 bus /sierra_3: Setting Powered False 18:00:43.692340 bus /sierra_3: Setting Powered False 18:00:44.807800 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:00:45.974188 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:00:45.987991 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:00:46.060719 tst mo_mt_call_osmux.py: using LAC 30528 18:00:46.189882 tst mo_mt_call_osmux.py: using RAC 183 18:00:46.311259 tst mo_mt_call_osmux.py: using CellId 30528 18:00:46.441445 tst mo_mt_call_osmux.py: using BVCI 30529 18:00:46.554174 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:00:46.566441 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:00:46.578648 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:00:46.592252 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:00:46.605859 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:00:46.619048 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:00:46.738916 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:00:46.860155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:47.342195 run create_hlr_db(pid=10007): Launched 18:00:47.461334 bus /sierra_2: Setting Powered False 18:00:48.522003 run create_hlr_db(pid=10007): Terminated: ok {rc=0} 18:00:48.947870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10009): Launched 18:00:49.254250 run osmo-hlr_10.42.42.2(pid=10010): Launched 18:00:49.370343 run osmo-stp_10.42.42.5: Starting osmo-stp 18:00:49.895516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10012): Launched 18:00:50.200186 run osmo-stp_10.42.42.5(pid=10013): Launched 18:00:50.317243 run osmo-msc_10.42.42.6: Starting osmo-msc 18:00:50.874287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10015): Launched 18:00:51.181657 run osmo-msc_10.42.42.6(pid=10016): Launched 18:00:51.353186 run osmo-stp_10.42.42.5(pid=10013): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10013)] 18:00:51.482706 run osmo-stp_10.42.42.5(pid=10013): stdout: | (launched: 2022-12-12_18:00:50.143904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:51.611029 run osmo-stp_10.42.42.5(pid=10013): stderr: | [0;m[38;5;43m20221212180050310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180050310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180050310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180050311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180050311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180050311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180050311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:51.737392 run osmo-stp_10.42.42.5(pid=10013): stdout: | (launched: 2022-12-12_18:00:50.143904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:00:51.858365 run osmo-stp_10.42.42.5(pid=10013): stderr: | [0;m[38;5;43m20221212180050310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180050310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180050310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180050311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180050311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180050311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180050311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:00:52.003877 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10013): Process ended prematurely: osmo-stp_10.42.42.5(pid=10013) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10013)] [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:00:52.012881 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:00:52.039853 run osmo-hlr_10.42.42.2(pid=10010): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10010)] 18:00:52.088315 run osmo-hlr_10.42.42.2(pid=10010): stdout: | (launched: 2022-12-12_18:00:49.197927) 18:00:52.138331 run osmo-hlr_10.42.42.2(pid=10010): stderr: | [0;m[1;31m20221212180049372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180049372 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180049373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180049373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180049373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180049373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180049384 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180049393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180049394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180049394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:00:52.207841 run osmo-msc_10.42.42.6(pid=10016): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10016)] 18:00:52.256079 run osmo-msc_10.42.42.6(pid=10016): stdout: | (launched: 2022-12-12_18:00:51.124532) 18:00:52.311347 run osmo-msc_10.42.42.6(pid=10016): stderr: | [0;m[38;5;43m20221212180051394 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180051394 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f65e3b1fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180051394 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180051394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180051394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180051395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180051396 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180051397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180051397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180051397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:00:52.361275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10009): Terminating (SIGTERM) 18:00:52.401243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10012): Terminating (SIGTERM) 18:00:52.441201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10015): Terminating (SIGTERM) 18:00:52.481265 --- ParallelTerminationStrategy: PID 10009 died... 18:00:52.500333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10009): Terminated: ok {rc=0} 18:00:52.544365 --- ParallelTerminationStrategy: PID 10012 died... 18:00:52.562867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10012): Terminated: ok {rc=0} 18:00:52.606782 --- ParallelTerminationStrategy: PID 10015 died... 18:00:52.625101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10015): Terminated: ok {rc=0} 18:00:52.711635 bus /sierra_3: Setting Powered False 18:00:53.811216 bus /sierra_3: Setting Powered False 18:00:54.928323 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:00:56.178116 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:00:56.186572 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:00:56.220804 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:00:56.248354 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:00:56.302418 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:00:56.336560 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:00:56.364155 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:00:56.914819 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:00:56.967120 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:00:56.978813 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:00:57.052906 tst mo_mt_call.py: using LAC 30529 18:00:57.178125 tst mo_mt_call.py: using RAC 184 18:00:57.302387 tst mo_mt_call.py: using CellId 30529 18:00:57.426549 tst mo_mt_call.py: using BVCI 30530 18:00:57.543414 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:00:57.555115 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:00:57.566575 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:00:57.578049 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:00:57.589875 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:00:57.601465 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:00:57.716462 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:00:57.835928 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:00:58.335731 run create_hlr_db(pid=10021): Launched 18:00:58.466307 bus /sierra_2: Setting Powered False 18:00:59.530228 run create_hlr_db(pid=10021): Terminated: ok {rc=0} 18:00:59.978746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10023): Launched 18:01:00.305044 run osmo-hlr_10.42.42.2(pid=10024): Launched 18:01:00.427178 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:00.991070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10026): Launched 18:01:01.319171 run osmo-stp_10.42.42.5(pid=10027): Launched 18:01:01.580464 run osmo-msc_10.42.42.6: Starting osmo-msc 18:01:02.361412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10029): Launched 18:01:02.666462 run osmo-msc_10.42.42.6(pid=10030): Launched 18:01:02.838719 run osmo-stp_10.42.42.5(pid=10027): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10027)] 18:01:02.966963 run osmo-stp_10.42.42.5(pid=10027): stdout: | (launched: 2022-12-12_18:01:01.261243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:03.094393 run osmo-stp_10.42.42.5(pid=10027): stderr: | [0;m[38;5;43m20221212180101657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180101658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180101658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180101660 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180101661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180101661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180101662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:03.219773 run osmo-stp_10.42.42.5(pid=10027): stdout: | (launched: 2022-12-12_18:01:01.261243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:03.340171 run osmo-stp_10.42.42.5(pid=10027): stderr: | [0;m[38;5;43m20221212180101657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180101658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180101658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180101660 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180101661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180101661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180101662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:03.484574 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10027): Process ended prematurely: osmo-stp_10.42.42.5(pid=10027) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10027)] [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:01:03.493555 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 18:01:03.520785 run osmo-hlr_10.42.42.2(pid=10024): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10024)] 18:01:03.570139 run osmo-hlr_10.42.42.2(pid=10024): stdout: | (launched: 2022-12-12_18:01:00.245502) 18:01:03.620226 run osmo-hlr_10.42.42.2(pid=10024): stderr: | [0;m[1;31m20221212180100443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180100443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180100443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180100443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180100443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180100443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180100455 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180100463 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180100464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180100464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:03.689887 run osmo-msc_10.42.42.6(pid=10030): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10030)] 18:01:03.738467 run osmo-msc_10.42.42.6(pid=10030): stdout: | (launched: 2022-12-12_18:01:02.610156) 18:01:03.788537 run osmo-msc_10.42.42.6(pid=10030): stderr: | [0;m[38;5;43m20221212180102879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180102879 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6d3c0dcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180102879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180102879 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180102880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180102880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180102882 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180102882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180102882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180102882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:01:03.839044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10023): Terminating (SIGTERM) 18:01:03.879424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10026): Terminating (SIGTERM) 18:01:03.919756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10029): Terminating (SIGTERM) 18:01:03.960346 --- ParallelTerminationStrategy: PID 10023 died... 18:01:03.979402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10023): Terminated: ok {rc=0} 18:01:04.024938 --- ParallelTerminationStrategy: PID 10026 died... 18:01:04.043410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10026): Terminated: ok {rc=0} 18:01:04.088625 --- ParallelTerminationStrategy: PID 10029 died... 18:01:04.107330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10029): Terminated: ok {rc=0} 18:01:04.195400 bus /sierra_3: Setting Powered False 18:01:05.295214 bus /sierra_3: Setting Powered False 18:01:06.409040 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:01:07.558116 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:01:07.570643 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:01:07.647320 tst mo_mt_call_osmux.py: using LAC 30530 18:01:07.772721 tst mo_mt_call_osmux.py: using RAC 185 18:01:07.901693 tst mo_mt_call_osmux.py: using CellId 30530 18:01:08.027069 tst mo_mt_call_osmux.py: using BVCI 30531 18:01:08.144443 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:01:08.156216 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:01:08.167696 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:01:08.179220 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:01:08.190742 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:01:08.202209 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:01:08.322384 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:01:08.438832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:08.906392 run create_hlr_db(pid=10032): Launched 18:01:09.023209 bus /sierra_2: Setting Powered False 18:01:10.083128 run create_hlr_db(pid=10032): Terminated: ok {rc=0} 18:01:10.525490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10034): Launched 18:01:10.850648 run osmo-hlr_10.42.42.2(pid=10035): Launched 18:01:10.976159 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:11.530916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10037): Launched 18:01:11.855849 run osmo-stp_10.42.42.5(pid=10038): Launched 18:01:11.978309 run osmo-msc_10.42.42.6: Starting osmo-msc 18:01:12.564034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10040): Launched 18:01:12.889057 run osmo-msc_10.42.42.6(pid=10041): Launched 18:01:13.069585 run osmo-stp_10.42.42.5(pid=10038): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10038)] 18:01:13.205797 run osmo-stp_10.42.42.5(pid=10038): stdout: | (launched: 2022-12-12_18:01:11.796424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:13.341557 run osmo-stp_10.42.42.5(pid=10038): stderr: | [0;m[38;5;43m20221212180111985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180111985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180111985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180111986 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180111986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180111986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180111986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:13.475904 run osmo-stp_10.42.42.5(pid=10038): stdout: | (launched: 2022-12-12_18:01:11.796424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:13.604461 run osmo-stp_10.42.42.5(pid=10038): stderr: | [0;m[38;5;43m20221212180111985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180111985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180111985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180111986 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180111986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180111986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180111986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:13.758836 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10038): Process ended prematurely: osmo-stp_10.42.42.5(pid=10038) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10038)] [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:01:13.768519 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:01:13.796549 run osmo-hlr_10.42.42.2(pid=10035): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10035)] 18:01:13.846760 run osmo-hlr_10.42.42.2(pid=10035): stdout: | (launched: 2022-12-12_18:01:10.791160) 18:01:13.899049 run osmo-hlr_10.42.42.2(pid=10035): stderr: | [0;m[1;31m20221212180110987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180110987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180110987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180110987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180110987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180110987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180111000 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180111010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180111010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180111010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:13.971320 run osmo-msc_10.42.42.6(pid=10041): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10041)] 18:01:14.021377 run osmo-msc_10.42.42.6(pid=10041): stdout: | (launched: 2022-12-12_18:01:12.828734) 18:01:14.073141 run osmo-msc_10.42.42.6(pid=10041): stderr: | [0;m[38;5;43m20221212180113149 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180113149 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb2f636bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180113149 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180113149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180113150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180113150 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180113151 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180113152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180113152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180113152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:01:14.125287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10034): Terminating (SIGTERM) 18:01:14.167312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10037): Terminating (SIGTERM) 18:01:14.209252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10040): Terminating (SIGTERM) 18:01:14.251114 --- ParallelTerminationStrategy: PID 10034 died... 18:01:14.270739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10034): Terminated: ok {rc=0} 18:01:14.317079 --- ParallelTerminationStrategy: PID 10037 died... 18:01:14.336423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10037): Terminated: ok {rc=0} 18:01:14.382341 --- ParallelTerminationStrategy: PID 10040 died... 18:01:14.401719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10040): Terminated: ok {rc=0} 18:01:14.488854 bus /sierra_3: Setting Powered False 18:01:15.588075 bus /sierra_3: Setting Powered False 18:01:16.719118 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:01:17.973945 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:01:17.981136 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:01:18.015205 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:01:18.042772 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:01:18.096262 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:01:18.130621 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:01:18.158060 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:01:18.710496 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:01:18.762078 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:01:18.773712 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:01:18.845491 tst mo_mt_call.py: using LAC 30531 18:01:18.973380 tst mo_mt_call.py: using RAC 186 18:01:19.099925 tst mo_mt_call.py: using CellId 30531 18:01:19.230399 tst mo_mt_call.py: using BVCI 30532 18:01:19.348617 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:01:19.360299 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:01:19.371705 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:01:19.383122 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:01:19.394708 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:01:19.407419 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:01:19.524162 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:01:19.644371 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:20.145147 run create_hlr_db(pid=10046): Launched 18:01:20.277265 bus /sierra_2: Setting Powered False 18:01:21.342174 run create_hlr_db(pid=10046): Terminated: ok {rc=0} 18:01:21.774790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10048): Launched 18:01:22.077770 run osmo-hlr_10.42.42.2(pid=10049): Launched 18:01:22.193350 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:22.713145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10051): Launched 18:01:23.015565 run osmo-stp_10.42.42.5(pid=10052): Launched 18:01:23.131190 run osmo-msc_10.42.42.6: Starting osmo-msc 18:01:23.681119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10054): Launched 18:01:23.985456 run osmo-msc_10.42.42.6(pid=10055): Launched 18:01:24.155186 run osmo-stp_10.42.42.5(pid=10052): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10052)] 18:01:24.284250 run osmo-stp_10.42.42.5(pid=10052): stdout: | (launched: 2022-12-12_18:01:22.959749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:24.411928 run osmo-stp_10.42.42.5(pid=10052): stderr: | [0;m[38;5;43m20221212180123126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180123126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180123127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180123127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180123128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180123128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180123128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:24.537779 run osmo-stp_10.42.42.5(pid=10052): stdout: | (launched: 2022-12-12_18:01:22.959749) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:24.658279 run osmo-stp_10.42.42.5(pid=10052): stderr: | [0;m[38;5;43m20221212180123126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180123126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180123127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180123127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180123128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180123128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180123128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:24.802759 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10052): Process ended prematurely: osmo-stp_10.42.42.5(pid=10052) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10052)] [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:01:24.811929 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:01:24.838906 run osmo-hlr_10.42.42.2(pid=10049): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10049)] 18:01:24.887277 run osmo-hlr_10.42.42.2(pid=10049): stdout: | (launched: 2022-12-12_18:01:22.022229) 18:01:24.937273 run osmo-hlr_10.42.42.2(pid=10049): stderr: | [0;m[1;31m20221212180122196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180122196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180122196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180122196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180122196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180122196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180122208 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180122218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180122218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180122218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:25.005940 run osmo-msc_10.42.42.6(pid=10055): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10055)] 18:01:25.053926 run osmo-msc_10.42.42.6(pid=10055): stdout: | (launched: 2022-12-12_18:01:23.928666) 18:01:25.103443 run osmo-msc_10.42.42.6(pid=10055): stderr: | [0;m[38;5;43m20221212180124198 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180124198 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4cc46e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180124198 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180124198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180124198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180124198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180124200 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180124201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180124201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180124201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:01:25.153365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10048): Terminating (SIGTERM) 18:01:25.194095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10051): Terminating (SIGTERM) 18:01:25.233936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10054): Terminating (SIGTERM) 18:01:25.273629 --- ParallelTerminationStrategy: PID 10048 died... 18:01:25.293148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10048): Terminated: ok {rc=0} 18:01:25.337933 --- ParallelTerminationStrategy: PID 10051 died... 18:01:25.356528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10051): Terminated: ok {rc=0} 18:01:25.401380 --- ParallelTerminationStrategy: PID 10054 died... 18:01:25.420126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10054): Terminated: ok {rc=0} 18:01:25.507651 bus /sierra_3: Setting Powered False 18:01:26.610086 bus /sierra_3: Setting Powered False 18:01:27.728328 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:01:28.879394 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:01:28.891703 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:01:28.963965 tst mo_mt_call_osmux.py: using LAC 30532 18:01:29.092023 tst mo_mt_call_osmux.py: using RAC 187 18:01:29.219114 tst mo_mt_call_osmux.py: using CellId 30532 18:01:29.346905 tst mo_mt_call_osmux.py: using BVCI 30533 18:01:29.465304 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:01:29.476902 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:01:29.488389 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:01:29.499804 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:01:29.511282 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:01:29.522628 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:01:29.640807 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:01:29.760162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:30.229221 run create_hlr_db(pid=10057): Launched 18:01:30.345969 bus /sierra_2: Setting Powered False 18:01:31.434979 run create_hlr_db(pid=10057): Terminated: ok {rc=0} 18:01:31.923401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10059): Launched 18:01:32.261831 run osmo-hlr_10.42.42.2(pid=10060): Launched 18:01:32.386308 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:32.942105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10062): Launched 18:01:33.269198 run osmo-stp_10.42.42.5(pid=10063): Launched 18:01:33.392590 run osmo-msc_10.42.42.6: Starting osmo-msc 18:01:33.977571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10065): Launched 18:01:34.302743 run osmo-msc_10.42.42.6(pid=10066): Launched 18:01:34.483351 run osmo-stp_10.42.42.5(pid=10063): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10063)] 18:01:34.619420 run osmo-stp_10.42.42.5(pid=10063): stdout: | (launched: 2022-12-12_18:01:33.209338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:34.755600 run osmo-stp_10.42.42.5(pid=10063): stderr: | [0;m[38;5;43m20221212180133397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180133397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180133398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180133398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180133399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180133399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180133399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:34.891253 run osmo-stp_10.42.42.5(pid=10063): stdout: | (launched: 2022-12-12_18:01:33.209338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:35.020167 run osmo-stp_10.42.42.5(pid=10063): stderr: | [0;m[38;5;43m20221212180133397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180133397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180133398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180133398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180133399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180133399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180133399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:35.174823 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10063): Process ended prematurely: osmo-stp_10.42.42.5(pid=10063) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10063)] [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:01:35.184374 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:01:35.212667 run osmo-hlr_10.42.42.2(pid=10060): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10060)] 18:01:35.262987 run osmo-hlr_10.42.42.2(pid=10060): stdout: | (launched: 2022-12-12_18:01:32.202599) 18:01:35.314788 run osmo-hlr_10.42.42.2(pid=10060): stderr: | [0;m[1;31m20221212180132396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180132396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180132396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180132396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180132396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180132396 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180132409 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180132418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180132418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180132418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:35.387583 run osmo-msc_10.42.42.6(pid=10066): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10066)] 18:01:35.437547 run osmo-msc_10.42.42.6(pid=10066): stdout: | (launched: 2022-12-12_18:01:34.242966) 18:01:35.489218 run osmo-msc_10.42.42.6(pid=10066): stderr: | [0;m[38;5;43m20221212180134562 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180134562 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e438cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180134562 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180134562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180134562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180134562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180134564 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180134564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180134564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180134565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:01:35.541213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10059): Terminating (SIGTERM) 18:01:35.583241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10062): Terminating (SIGTERM) 18:01:35.625131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10065): Terminating (SIGTERM) 18:01:35.667365 --- ParallelTerminationStrategy: PID 10059 died... 18:01:35.687732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10059): Terminated: ok {rc=0} 18:01:35.734581 --- ParallelTerminationStrategy: PID 10062 died... 18:01:35.754428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10062): Terminated: ok {rc=0} 18:01:35.800733 --- ParallelTerminationStrategy: PID 10065 died... 18:01:35.820488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10065): Terminated: ok {rc=0} 18:01:35.909119 bus /sierra_3: Setting Powered False 18:01:37.008026 bus /sierra_3: Setting Powered False 18:01:38.125910 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:01:39.381980 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:01:39.389080 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:01:39.423716 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:01:39.451294 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:01:39.507525 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:01:39.541862 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:01:39.569400 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:01:40.119177 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:01:40.171149 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:01:40.182780 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:01:40.257626 tst mo_mt_call.py: using LAC 30533 18:01:40.383177 tst mo_mt_call.py: using RAC 188 18:01:40.502791 tst mo_mt_call.py: using CellId 30533 18:01:40.621310 tst mo_mt_call.py: using BVCI 30534 18:01:40.731104 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:01:40.742263 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:01:40.753219 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:01:40.765136 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:01:40.776854 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:01:40.788514 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:01:40.909128 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:01:41.027900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:41.499242 run create_hlr_db(pid=10071): Launched 18:01:41.615029 bus /sierra_2: Setting Powered False 18:01:42.676217 run create_hlr_db(pid=10071): Terminated: ok {rc=0} 18:01:43.119202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10073): Launched 18:01:43.444307 run osmo-hlr_10.42.42.2(pid=10074): Launched 18:01:43.567329 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:44.122200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10076): Launched 18:01:44.446693 run osmo-stp_10.42.42.5(pid=10077): Launched 18:01:44.571582 run osmo-msc_10.42.42.6: Starting osmo-msc 18:01:45.157346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10079): Launched 18:01:45.482038 run osmo-msc_10.42.42.6(pid=10080): Launched 18:01:45.665402 run osmo-stp_10.42.42.5(pid=10077): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10077)] 18:01:45.800574 run osmo-stp_10.42.42.5(pid=10077): stdout: | (launched: 2022-12-12_18:01:44.387431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:46.003134 run osmo-stp_10.42.42.5(pid=10077): stderr: | [0;m[38;5;43m20221212180144573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180144573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180144574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180144574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180144574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180144574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180144575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:46.176383 run osmo-stp_10.42.42.5(pid=10077): stdout: | (launched: 2022-12-12_18:01:44.387431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:46.315193 run osmo-stp_10.42.42.5(pid=10077): stderr: | [0;m[38;5;43m20221212180144573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180144573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180144574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180144574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180144574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180144574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180144575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:46.472113 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10077): Process ended prematurely: osmo-stp_10.42.42.5(pid=10077) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10077)] [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:01:46.482646 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:01:46.511339 run osmo-hlr_10.42.42.2(pid=10074): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10074)] 18:01:46.563471 run osmo-hlr_10.42.42.2(pid=10074): stdout: | (launched: 2022-12-12_18:01:43.384419) 18:01:46.616866 run osmo-hlr_10.42.42.2(pid=10074): stderr: | [0;m[1;31m20221212180143577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180143577 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180143578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180143578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180143578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180143578 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180143590 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180143599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180143599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180143599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:46.690704 run osmo-msc_10.42.42.6(pid=10080): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10080)] 18:01:46.742027 run osmo-msc_10.42.42.6(pid=10080): stdout: | (launched: 2022-12-12_18:01:45.422040) 18:01:46.794956 run osmo-msc_10.42.42.6(pid=10080): stderr: | [0;m[38;5;43m20221212180145740 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180145740 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f52d15e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180145740 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180145740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180145741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180145741 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180145742 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180145743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180145743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180145743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:01:46.848251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10073): Terminating (SIGTERM) 18:01:46.891603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10076): Terminating (SIGTERM) 18:01:46.936482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10079): Terminating (SIGTERM) 18:01:46.981106 --- ParallelTerminationStrategy: PID 10073 died... 18:01:47.001555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10073): Terminated: ok {rc=0} 18:01:47.048558 --- ParallelTerminationStrategy: PID 10076 died... 18:01:47.068792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10076): Terminated: ok {rc=0} 18:01:47.116721 --- ParallelTerminationStrategy: PID 10079 died... 18:01:47.137282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10079): Terminated: ok {rc=0} 18:01:47.227688 bus /sierra_3: Setting Powered False 18:01:48.327305 bus /sierra_3: Setting Powered False 18:01:49.443922 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:01:50.590417 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:01:50.602396 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:01:50.673472 tst mo_mt_call_osmux.py: using LAC 30534 18:01:50.794720 tst mo_mt_call_osmux.py: using RAC 189 18:01:50.915137 tst mo_mt_call_osmux.py: using CellId 30534 18:01:51.034949 tst mo_mt_call_osmux.py: using BVCI 30535 18:01:51.146703 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:01:51.157980 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:01:51.168923 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:01:51.180162 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:01:51.191415 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:01:51.202626 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:01:51.322658 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:01:51.443977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:01:51.947198 run create_hlr_db(pid=10082): Launched 18:01:52.078792 bus /sierra_2: Setting Powered False 18:01:53.142919 run create_hlr_db(pid=10082): Terminated: ok {rc=0} 18:01:53.578911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10084): Launched 18:01:53.883174 run osmo-hlr_10.42.42.2(pid=10085): Launched 18:01:53.998659 run osmo-stp_10.42.42.5: Starting osmo-stp 18:01:54.532815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10087): Launched 18:01:54.836508 run osmo-stp_10.42.42.5(pid=10088): Launched 18:01:54.952352 run osmo-msc_10.42.42.6: Starting osmo-msc 18:01:55.500577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10090): Launched 18:01:55.805377 run osmo-msc_10.42.42.6(pid=10091): Launched 18:01:55.976177 run osmo-stp_10.42.42.5(pid=10088): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10088)] 18:01:56.104480 run osmo-stp_10.42.42.5(pid=10088): stdout: | (launched: 2022-12-12_18:01:54.780587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:56.232621 run osmo-stp_10.42.42.5(pid=10088): stderr: | [0;m[38;5;43m20221212180154948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180154948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180154949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180154949 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180154950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180154950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180154950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:56.358245 run osmo-stp_10.42.42.5(pid=10088): stdout: | (launched: 2022-12-12_18:01:54.780587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:01:56.479232 run osmo-stp_10.42.42.5(pid=10088): stderr: | [0;m[38;5;43m20221212180154948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180154948 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180154949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180154949 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180154950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180154950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180154950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:01:56.623719 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10088): Process ended prematurely: osmo-stp_10.42.42.5(pid=10088) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10088)] [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:01:56.632833 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:01:56.659992 run osmo-hlr_10.42.42.2(pid=10085): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10085)] 18:01:56.708091 run osmo-hlr_10.42.42.2(pid=10085): stdout: | (launched: 2022-12-12_18:01:53.827102) 18:01:56.757803 run osmo-hlr_10.42.42.2(pid=10085): stderr: | [0;m[1;31m20221212180154002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180154002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180154002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180154002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180154002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180154002 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180154015 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180154023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180154023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180154024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:01:56.827121 run osmo-msc_10.42.42.6(pid=10091): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10091)] 18:01:56.875157 run osmo-msc_10.42.42.6(pid=10091): stdout: | (launched: 2022-12-12_18:01:55.748700) 18:01:56.925108 run osmo-msc_10.42.42.6(pid=10091): stderr: | [0;m[38;5;43m20221212180156019 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180156019 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4698729c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180156019 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180156019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180156019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180156020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180156021 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180156022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180156022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180156022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:01:56.975293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10084): Terminating (SIGTERM) 18:01:57.015253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10087): Terminating (SIGTERM) 18:01:57.055166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10090): Terminating (SIGTERM) 18:01:57.095291 --- ParallelTerminationStrategy: PID 10084 died... 18:01:57.114575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10084): Terminated: ok {rc=0} 18:01:57.159112 --- ParallelTerminationStrategy: PID 10087 died... 18:01:57.177687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10087): Terminated: ok {rc=0} 18:01:57.221883 --- ParallelTerminationStrategy: PID 10090 died... 18:01:57.240467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10090): Terminated: ok {rc=0} 18:01:57.325525 bus /sierra_3: Setting Powered False 18:01:58.421862 bus /sierra_3: Setting Powered False 18:01:59.537158 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:02:00.787928 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:02:00.794907 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:02:00.832140 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:02:00.860845 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:02:00.929287 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:02:00.966995 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:02:01.011806 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:02:01.567095 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:02:01.621589 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:02:01.634001 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:02:01.706949 tst mo_mt_call.py: using LAC 30535 18:02:01.835484 tst mo_mt_call.py: using RAC 190 18:02:01.959833 tst mo_mt_call.py: using CellId 30535 18:02:02.087878 tst mo_mt_call.py: using BVCI 30536 18:02:02.220186 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:02:02.232536 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:02:02.244764 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:02:02.256717 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:02:02.268842 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:02:02.280939 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:02:02.405685 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:02:02.525924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:03.027216 run create_hlr_db(pid=10096): Launched 18:02:03.161812 bus /sierra_2: Setting Powered False 18:02:04.225914 run create_hlr_db(pid=10096): Terminated: ok {rc=0} 18:02:04.658856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10098): Launched 18:02:04.963587 run osmo-hlr_10.42.42.2(pid=10099): Launched 18:02:05.078961 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:05.613856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10101): Launched 18:02:05.916104 run osmo-stp_10.42.42.5(pid=10102): Launched 18:02:06.031016 run osmo-msc_10.42.42.6: Starting osmo-msc 18:02:06.576841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10104): Launched 18:02:06.880251 run osmo-msc_10.42.42.6(pid=10105): Launched 18:02:07.049965 run osmo-stp_10.42.42.5(pid=10102): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10102)] 18:02:07.178141 run osmo-stp_10.42.42.5(pid=10102): stdout: | (launched: 2022-12-12_18:02:05.860127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:07.305713 run osmo-stp_10.42.42.5(pid=10102): stderr: | [0;m[38;5;43m20221212180206028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180206028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180206029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180206029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180206030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180206030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180206030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:07.432149 run osmo-stp_10.42.42.5(pid=10102): stdout: | (launched: 2022-12-12_18:02:05.860127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:07.553228 run osmo-stp_10.42.42.5(pid=10102): stderr: | [0;m[38;5;43m20221212180206028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180206028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180206029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180206029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180206030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180206030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180206030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:07.697235 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10102): Process ended prematurely: osmo-stp_10.42.42.5(pid=10102) [trial-2380↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10102)] [trial-2380↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:02:07.706124 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:02:07.733003 run osmo-hlr_10.42.42.2(pid=10099): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10099)] 18:02:07.781290 run osmo-hlr_10.42.42.2(pid=10099): stdout: | (launched: 2022-12-12_18:02:04.907282) 18:02:07.831087 run osmo-hlr_10.42.42.2(pid=10099): stderr: | [0;m[1;31m20221212180205080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180205080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180205080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180205080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180205080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180205080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180205092 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180205101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180205101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180205101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:07.900332 run osmo-msc_10.42.42.6(pid=10105): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10105)] 18:02:07.948422 run osmo-msc_10.42.42.6(pid=10105): stdout: | (launched: 2022-12-12_18:02:06.824165) 18:02:07.997999 run osmo-msc_10.42.42.6(pid=10105): stderr: | [0;m[38;5;43m20221212180207093 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180207093 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f96f870ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180207093 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180207093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180207093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180207094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180207095 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180207096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180207096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180207096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:02:08.048121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10098): Terminating (SIGTERM) 18:02:08.087808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10101): Terminating (SIGTERM) 18:02:08.127930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10104): Terminating (SIGTERM) 18:02:08.168023 --- ParallelTerminationStrategy: PID 10098 died... 18:02:08.187108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10098): Terminated: ok {rc=0} 18:02:08.231482 --- ParallelTerminationStrategy: PID 10101 died... 18:02:08.250146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10101): Terminated: ok {rc=0} 18:02:08.294433 --- ParallelTerminationStrategy: PID 10104 died... 18:02:08.312992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10104): Terminated: ok {rc=0} 18:02:08.399642 bus /sierra_3: Setting Powered False 18:02:09.498897 bus /sierra_3: Setting Powered False 18:02:10.612929 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:02:11.761511 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:02:11.774287 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:02:11.847821 tst mo_mt_call_osmux.py: using LAC 30536 18:02:11.977211 tst mo_mt_call_osmux.py: using RAC 191 18:02:12.104832 tst mo_mt_call_osmux.py: using CellId 30536 18:02:12.231318 tst mo_mt_call_osmux.py: using BVCI 30537 18:02:12.348166 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:02:12.360088 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:02:12.371696 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:02:12.383328 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:02:12.395056 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:02:12.406707 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:02:12.526275 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:02:12.642619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:13.110789 run create_hlr_db(pid=10107): Launched 18:02:13.229849 bus /sierra_2: Setting Powered False 18:02:14.290785 run create_hlr_db(pid=10107): Terminated: ok {rc=0} 18:02:14.734591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10109): Launched 18:02:15.060346 run osmo-hlr_10.42.42.2(pid=10110): Launched 18:02:15.184189 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:15.743466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10112): Launched 18:02:16.080153 run osmo-stp_10.42.42.5(pid=10113): Launched 18:02:16.412053 run osmo-msc_10.42.42.6: Starting osmo-msc 18:02:17.221817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10115): Launched 18:02:17.538912 run osmo-msc_10.42.42.6(pid=10116): Launched 18:02:17.710811 run osmo-stp_10.42.42.5(pid=10113): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10113)] 18:02:17.839143 run osmo-stp_10.42.42.5(pid=10113): stdout: | (launched: 2022-12-12_18:02:16.019341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:17.967057 run osmo-stp_10.42.42.5(pid=10113): stderr: | [0;m[38;5;43m20221212180216354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180216355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180216355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180216358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180216359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180216359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180216359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:18.092848 run osmo-stp_10.42.42.5(pid=10113): stdout: | (launched: 2022-12-12_18:02:16.019341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:18.213507 run osmo-stp_10.42.42.5(pid=10113): stderr: | [0;m[38;5;43m20221212180216354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180216355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180216355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180216358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180216359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180216359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180216359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:18.358381 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10113): Process ended prematurely: osmo-stp_10.42.42.5(pid=10113) [trial-2380↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10113)] [trial-2380↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:02:18.367466 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 18:02:18.394456 run osmo-hlr_10.42.42.2(pid=10110): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10110)] 18:02:18.443154 run osmo-hlr_10.42.42.2(pid=10110): stdout: | (launched: 2022-12-12_18:02:15.000714) 18:02:18.493048 run osmo-hlr_10.42.42.2(pid=10110): stderr: | [0;m[1;31m20221212180215196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180215196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180215196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180215196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180215196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180215196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180215208 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180215217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180215217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180215217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:18.562719 run osmo-msc_10.42.42.6(pid=10116): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10116)] 18:02:18.610813 run osmo-msc_10.42.42.6(pid=10116): stdout: | (launched: 2022-12-12_18:02:17.482563) 18:02:18.660330 run osmo-msc_10.42.42.6(pid=10116): stderr: | [0;m[38;5;43m20221212180217750 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180217750 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fddc9069c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180217750 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180217750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180217750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180217750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180217752 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180217753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180217753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180217753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:02:18.710594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10109): Terminating (SIGTERM) 18:02:18.750803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10112): Terminating (SIGTERM) 18:02:18.791178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10115): Terminating (SIGTERM) 18:02:18.831868 --- ParallelTerminationStrategy: PID 10109 died... 18:02:18.851181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10109): Terminated: ok {rc=0} 18:02:18.896156 --- ParallelTerminationStrategy: PID 10112 died... 18:02:18.915027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10112): Terminated: ok {rc=0} 18:02:18.959753 --- ParallelTerminationStrategy: PID 10115 died... 18:02:18.978508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10115): Terminated: ok {rc=0} 18:02:19.066182 bus /sierra_3: Setting Powered False 18:02:20.166500 bus /sierra_3: Setting Powered False 18:02:21.280346 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:02:22.531243 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:02:22.536813 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:02:22.570778 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:02:22.597201 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:02:22.647292 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:02:22.680542 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:02:22.706953 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:02:23.257517 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:02:23.306646 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:02:23.317673 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:02:23.390659 tst mo_mt_call.py: using LAC 30537 18:02:23.509387 tst mo_mt_call.py: using RAC 192 18:02:23.628719 tst mo_mt_call.py: using CellId 30537 18:02:23.755712 tst mo_mt_call.py: using BVCI 30538 18:02:23.867593 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:02:23.878608 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:02:23.889349 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:02:23.900350 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:02:23.911509 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:02:23.922550 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:02:24.043193 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:02:24.160266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:24.630215 run create_hlr_db(pid=10121): Launched 18:02:24.747836 bus /sierra_2: Setting Powered False 18:02:25.808228 run create_hlr_db(pid=10121): Terminated: ok {rc=0} 18:02:26.253311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Launched 18:02:26.578195 run osmo-hlr_10.42.42.2(pid=10124): Launched 18:02:26.703036 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:27.260093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10126): Launched 18:02:27.584418 run osmo-stp_10.42.42.5(pid=10127): Launched 18:02:27.708552 run osmo-msc_10.42.42.6: Starting osmo-msc 18:02:28.295101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10129): Launched 18:02:28.621178 run osmo-msc_10.42.42.6(pid=10130): Launched 18:02:28.803510 run osmo-stp_10.42.42.5(pid=10127): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10127)] 18:02:28.939463 run osmo-stp_10.42.42.5(pid=10127): stdout: | (launched: 2022-12-12_18:02:27.524763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:29.075825 run osmo-stp_10.42.42.5(pid=10127): stderr: | [0;m[38;5;43m20221212180227712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180227712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180227713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180227713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180227714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180227714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180227714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:29.210917 run osmo-stp_10.42.42.5(pid=10127): stdout: | (launched: 2022-12-12_18:02:27.524763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:29.340141 run osmo-stp_10.42.42.5(pid=10127): stderr: | [0;m[38;5;43m20221212180227712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180227712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180227713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180227713 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180227714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180227714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180227714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:29.494886 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10127): Process ended prematurely: osmo-stp_10.42.42.5(pid=10127) [trial-2380↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10127)] [trial-2380↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:02:29.504444 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:02:29.532544 run osmo-hlr_10.42.42.2(pid=10124): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10124)] 18:02:29.582862 run osmo-hlr_10.42.42.2(pid=10124): stdout: | (launched: 2022-12-12_18:02:26.518637) 18:02:29.634995 run osmo-hlr_10.42.42.2(pid=10124): stderr: | [0;m[1;31m20221212180226714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180226714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180226714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180226714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180226714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180226714 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180226726 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180226737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180226737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180226737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:29.708152 run osmo-msc_10.42.42.6(pid=10130): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10130)] 18:02:29.758789 run osmo-msc_10.42.42.6(pid=10130): stdout: | (launched: 2022-12-12_18:02:28.561330) 18:02:29.810801 run osmo-msc_10.42.42.6(pid=10130): stderr: | [0;m[38;5;43m20221212180228880 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180228880 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1b89187c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180228880 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180228880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180228880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180228881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180228882 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180228883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180228883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180228883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:02:29.863230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Terminating (SIGTERM) 18:02:29.905527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10126): Terminating (SIGTERM) 18:02:29.947527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10129): Terminating (SIGTERM) 18:02:29.989760 --- ParallelTerminationStrategy: PID 10123 died... 18:02:30.009864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Terminated: ok {rc=0} 18:02:30.056116 --- ParallelTerminationStrategy: PID 10126 died... 18:02:30.075781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10126): Terminated: ok {rc=0} 18:02:30.122138 --- ParallelTerminationStrategy: PID 10129 died... 18:02:30.141863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10129): Terminated: ok {rc=0} 18:02:30.230274 bus /sierra_3: Setting Powered False 18:02:31.332344 bus /sierra_3: Setting Powered False 18:02:32.447628 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:02:33.598757 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:02:33.611122 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:02:33.685042 tst mo_mt_call_osmux.py: using LAC 30538 18:02:33.811531 tst mo_mt_call_osmux.py: using RAC 193 18:02:33.931610 tst mo_mt_call_osmux.py: using CellId 30538 18:02:34.050727 tst mo_mt_call_osmux.py: using BVCI 30539 18:02:34.162047 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:02:34.173035 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:02:34.184336 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:02:34.195372 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:02:34.206723 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:02:34.217765 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:02:34.338150 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:02:34.455172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:34.925900 run create_hlr_db(pid=10132): Launched 18:02:35.041789 bus /sierra_2: Setting Powered False 18:02:36.102416 run create_hlr_db(pid=10132): Terminated: ok {rc=0} 18:02:36.548292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10134): Launched 18:02:36.874088 run osmo-hlr_10.42.42.2(pid=10135): Launched 18:02:36.999412 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:37.557685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10137): Launched 18:02:37.883562 run osmo-stp_10.42.42.5(pid=10138): Launched 18:02:38.008074 run osmo-msc_10.42.42.6: Starting osmo-msc 18:02:38.593857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10140): Launched 18:02:38.918414 run osmo-msc_10.42.42.6(pid=10141): Launched 18:02:39.099882 run osmo-stp_10.42.42.5(pid=10138): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10138)] 18:02:39.236562 run osmo-stp_10.42.42.5(pid=10138): stdout: | (launched: 2022-12-12_18:02:37.823831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:39.372565 run osmo-stp_10.42.42.5(pid=10138): stderr: | [0;m[38;5;43m20221212180238012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180238012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180238012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180238012 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180238013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180238013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180238013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:39.507196 run osmo-stp_10.42.42.5(pid=10138): stdout: | (launched: 2022-12-12_18:02:37.823831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:39.635723 run osmo-stp_10.42.42.5(pid=10138): stderr: | [0;m[38;5;43m20221212180238012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180238012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180238012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180238012 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180238013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180238013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180238013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:39.790770 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10138): Process ended prematurely: osmo-stp_10.42.42.5(pid=10138) [trial-2380↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10138)] [trial-2380↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:02:39.800419 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:02:39.828451 run osmo-hlr_10.42.42.2(pid=10135): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10135)] 18:02:39.878570 run osmo-hlr_10.42.42.2(pid=10135): stdout: | (launched: 2022-12-12_18:02:36.814452) 18:02:39.930246 run osmo-hlr_10.42.42.2(pid=10135): stderr: | [0;m[1;31m20221212180237010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180237010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180237010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180237010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180237010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180237010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180237022 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180237031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180237031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180237031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:40.002372 run osmo-msc_10.42.42.6(pid=10141): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10141)] 18:02:40.052451 run osmo-msc_10.42.42.6(pid=10141): stdout: | (launched: 2022-12-12_18:02:38.858955) 18:02:40.104140 run osmo-msc_10.42.42.6(pid=10141): stderr: | [0;m[38;5;43m20221212180239179 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180239179 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f092e043c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180239179 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180239179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180239179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180239180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180239181 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180239182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180239182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180239182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:02:40.156055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10134): Terminating (SIGTERM) 18:02:40.198008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10137): Terminating (SIGTERM) 18:02:40.239641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10140): Terminating (SIGTERM) 18:02:40.281515 --- ParallelTerminationStrategy: PID 10134 died... 18:02:40.301481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10134): Terminated: ok {rc=0} 18:02:40.347671 --- ParallelTerminationStrategy: PID 10137 died... 18:02:40.367226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10137): Terminated: ok {rc=0} 18:02:40.413383 --- ParallelTerminationStrategy: PID 10140 died... 18:02:40.432906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10140): Terminated: ok {rc=0} 18:02:40.521681 bus /sierra_3: Setting Powered False 18:02:41.622575 bus /sierra_3: Setting Powered False 18:02:42.738742 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 18:02:43.997816 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:02:44.003577 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 18:02:44.037608 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 18:02:44.065150 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 18:02:44.119871 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 18:02:44.154073 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 18:02:44.181899 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 18:02:44.730695 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 18:02:44.782622 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:02:44.794108 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 18:02:44.846138 tst mo_mt_call.py: using LAC 30539 18:02:44.974298 tst mo_mt_call.py: using RAC 194 18:02:45.101034 tst mo_mt_call.py: using CellId 30539 18:02:45.228338 tst mo_mt_call.py: using BVCI 30540 18:02:45.347299 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:02:45.358835 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:02:45.370151 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:02:45.381502 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:02:45.392786 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:02:45.404185 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 18:02:45.521431 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 18:02:45.636563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:46.208574 run create_hlr_db(pid=10146): Launched 18:02:46.403326 bus /sierra_2: Setting Powered False 18:02:47.463188 run create_hlr_db(pid=10146): Terminated: ok {rc=0} 18:02:47.921706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10148): Launched 18:02:48.247266 run osmo-hlr_10.42.42.2(pid=10149): Launched 18:02:48.370420 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:48.925982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10151): Launched 18:02:49.252552 run osmo-stp_10.42.42.5(pid=10152): Launched 18:02:49.375494 run osmo-msc_10.42.42.6: Starting osmo-msc 18:02:49.960360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10154): Launched 18:02:50.284865 run osmo-msc_10.42.42.6(pid=10155): Launched 18:02:50.463727 run osmo-stp_10.42.42.5(pid=10152): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10152)] 18:02:50.599107 run osmo-stp_10.42.42.5(pid=10152): stdout: | (launched: 2022-12-12_18:02:49.192873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:50.734958 run osmo-stp_10.42.42.5(pid=10152): stderr: | [0;m[38;5;43m20221212180249381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180249381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180249381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180249381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180249382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180249382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180249382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:50.869334 run osmo-stp_10.42.42.5(pid=10152): stdout: | (launched: 2022-12-12_18:02:49.192873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:02:50.997858 run osmo-stp_10.42.42.5(pid=10152): stderr: | [0;m[38;5;43m20221212180249381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180249381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180249381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180249381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180249382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180249382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180249382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:02:51.151958 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10152): Process ended prematurely: osmo-stp_10.42.42.5(pid=10152) [trial-2380↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10152)] [trial-2380↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 18:02:51.161741 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:02:51.189856 run osmo-hlr_10.42.42.2(pid=10149): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10149)] 18:02:51.240027 run osmo-hlr_10.42.42.2(pid=10149): stdout: | (launched: 2022-12-12_18:02:48.187567) 18:02:51.291653 run osmo-hlr_10.42.42.2(pid=10149): stderr: | [0;m[1;31m20221212180248380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180248380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180248380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180248380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180248380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180248380 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180248392 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180248402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180248402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180248402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:02:51.363667 run osmo-msc_10.42.42.6(pid=10155): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10155)] 18:02:51.413628 run osmo-msc_10.42.42.6(pid=10155): stdout: | (launched: 2022-12-12_18:02:50.225409) 18:02:51.465073 run osmo-msc_10.42.42.6(pid=10155): stderr: | [0;m[38;5;43m20221212180250546 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180250547 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6921104c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180250547 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180250547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180250547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180250547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180250549 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180250549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180250549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180250549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:02:51.516771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10148): Terminating (SIGTERM) 18:02:51.558633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10151): Terminating (SIGTERM) 18:02:51.600609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10154): Terminating (SIGTERM) 18:02:51.642719 --- ParallelTerminationStrategy: PID 10148 died... 18:02:51.662870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10148): Terminated: ok {rc=0} 18:02:51.709189 --- ParallelTerminationStrategy: PID 10151 died... 18:02:51.728529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10151): Terminated: ok {rc=0} 18:02:51.774701 --- ParallelTerminationStrategy: PID 10154 died... 18:02:51.794450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10154): Terminated: ok {rc=0} 18:02:51.883927 bus /sierra_3: Setting Powered False 18:02:52.985179 bus /sierra_3: Setting Powered False 18:02:54.104643 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 18:02:55.255776 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:02:55.268045 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 18:02:55.320795 tst mo_mt_call_osmux.py: using LAC 30540 18:02:55.448010 tst mo_mt_call_osmux.py: using RAC 195 18:02:55.576306 tst mo_mt_call_osmux.py: using CellId 30540 18:02:55.703692 tst mo_mt_call_osmux.py: using BVCI 30541 18:02:55.822701 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:02:55.834506 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:02:55.845960 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:02:55.857495 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:02:55.868877 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 18:02:55.880120 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 18:02:56.001926 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 18:02:56.122815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:02:56.625872 run create_hlr_db(pid=10157): Launched 18:02:56.759722 bus /sierra_2: Setting Powered False 18:02:57.824642 run create_hlr_db(pid=10157): Terminated: ok {rc=0} 18:02:58.259240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10159): Launched 18:02:58.563217 run osmo-hlr_10.42.42.2(pid=10160): Launched 18:02:58.679027 run osmo-stp_10.42.42.5: Starting osmo-stp 18:02:59.200396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10162): Launched 18:02:59.505038 run osmo-stp_10.42.42.5(pid=10163): Launched 18:02:59.620751 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:00.168265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10165): Launched 18:03:00.471807 run osmo-msc_10.42.42.6(pid=10166): Launched 18:03:00.642171 run osmo-stp_10.42.42.5(pid=10163): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10163)] 18:03:00.770017 run osmo-stp_10.42.42.5(pid=10163): stdout: | (launched: 2022-12-12_18:02:59.448460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:00.916856 run osmo-stp_10.42.42.5(pid=10163): stderr: | [0;m[38;5;43m20221212180259618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180259618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180259618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180259619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180259619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180259619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180259619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:01.056161 run osmo-stp_10.42.42.5(pid=10163): stdout: | (launched: 2022-12-12_18:02:59.448460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:01.190764 run osmo-stp_10.42.42.5(pid=10163): stderr: | [0;m[38;5;43m20221212180259618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180259618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180259618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180259619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180259619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180259619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180259619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:01.351081 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10163): Process ended prematurely: osmo-stp_10.42.42.5(pid=10163) [trial-2380↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10163)] [trial-2380↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 18:03:01.361287 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:03:01.391441 run osmo-hlr_10.42.42.2(pid=10160): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10160)] 18:03:01.444142 run osmo-hlr_10.42.42.2(pid=10160): stdout: | (launched: 2022-12-12_18:02:58.507370) 18:03:01.498131 run osmo-hlr_10.42.42.2(pid=10160): stderr: | [0;m[1;31m20221212180258680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180258681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180258681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180258681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180258681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180258681 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180258692 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180258701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180258701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180258701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:01.572877 run osmo-msc_10.42.42.6(pid=10166): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10166)] 18:03:01.626073 run osmo-msc_10.42.42.6(pid=10166): stdout: | (launched: 2022-12-12_18:03:00.415966) 18:03:01.679727 run osmo-msc_10.42.42.6(pid=10166): stderr: | [0;m[38;5;43m20221212180300685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180300686 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fedcb2ebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180300686 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180300686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180300686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180300686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180300688 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180300688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180300688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180300689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:01.733765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10159): Terminating (SIGTERM) 18:03:01.777830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10162): Terminating (SIGTERM) 18:03:01.824509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10165): Terminating (SIGTERM) 18:03:01.870796 --- ParallelTerminationStrategy: PID 10159 died... 18:03:01.891654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10159): Terminated: ok {rc=0} 18:03:01.941361 --- ParallelTerminationStrategy: PID 10162 died... 18:03:01.961798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10162): Terminated: ok {rc=0} 18:03:02.010036 --- ParallelTerminationStrategy: PID 10165 died... 18:03:02.031156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10165): Terminated: ok {rc=0} 18:03:02.120831 bus /sierra_3: Setting Powered False 18:03:03.217573 bus /sierra_3: Setting Powered False 18:03:04.334677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 18:03:05.582401 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:05.590131 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 18:03:05.624693 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 18:03:05.652716 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 18:03:05.706196 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 18:03:05.740462 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 18:03:05.768094 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 18:03:06.324331 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 18:03:06.377086 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:03:06.388927 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:03:06.441144 tst mo_mt_call.py: using LAC 30541 18:03:06.568179 tst mo_mt_call.py: using RAC 196 18:03:06.693040 tst mo_mt_call.py: using CellId 30541 18:03:06.822189 tst mo_mt_call.py: using BVCI 30542 18:03:06.942011 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:03:06.953755 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:03:06.965251 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:03:06.976736 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:03:06.988470 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:03:07.000021 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:03:07.116836 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:03:07.233133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:07.702792 run create_hlr_db(pid=10172): Launched 18:03:07.821761 bus /sierra_2: Setting Powered False 18:03:08.882220 run create_hlr_db(pid=10172): Terminated: ok {rc=0} 18:03:09.327367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10174): Launched 18:03:09.654833 run osmo-hlr_10.42.42.2(pid=10175): Launched 18:03:09.780126 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:10.337205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10177): Launched 18:03:10.662977 run osmo-stp_10.42.42.5(pid=10178): Launched 18:03:10.787222 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:11.373547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10180): Launched 18:03:11.699328 run osmo-msc_10.42.42.6(pid=10181): Launched 18:03:11.879866 run osmo-stp_10.42.42.5(pid=10178): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10178)] 18:03:12.016709 run osmo-stp_10.42.42.5(pid=10178): stdout: | (launched: 2022-12-12_18:03:10.602658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:12.154043 run osmo-stp_10.42.42.5(pid=10178): stderr: | [0;m[38;5;43m20221212180310791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180310791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180310791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180310792 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180310792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180310792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180310792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:12.289390 run osmo-stp_10.42.42.5(pid=10178): stdout: | (launched: 2022-12-12_18:03:10.602658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:12.418263 run osmo-stp_10.42.42.5(pid=10178): stderr: | [0;m[38;5;43m20221212180310791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180310791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180310791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180310792 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180310792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180310792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180310792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:12.572566 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10178): Process ended prematurely: osmo-stp_10.42.42.5(pid=10178) [trial-2380↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10178)] [trial-2380↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 18:03:12.582302 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:03:12.610209 run osmo-hlr_10.42.42.2(pid=10175): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10175)] 18:03:12.660181 run osmo-hlr_10.42.42.2(pid=10175): stdout: | (launched: 2022-12-12_18:03:09.595555) 18:03:12.711906 run osmo-hlr_10.42.42.2(pid=10175): stderr: | [0;m[1;31m20221212180309789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180309789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180309789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180309789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180309789 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180309790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180309802 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180309811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180309811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180309811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:12.784337 run osmo-msc_10.42.42.6(pid=10181): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10181)] 18:03:12.834565 run osmo-msc_10.42.42.6(pid=10181): stdout: | (launched: 2022-12-12_18:03:11.639276) 18:03:12.886033 run osmo-msc_10.42.42.6(pid=10181): stderr: | [0;m[38;5;43m20221212180311957 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180311957 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0836296c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180311957 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180311958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180311958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180311958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180311959 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180311960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180311960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180311960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:12.938029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10174): Terminating (SIGTERM) 18:03:12.979806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10177): Terminating (SIGTERM) 18:03:13.021729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10180): Terminating (SIGTERM) 18:03:13.063894 --- ParallelTerminationStrategy: PID 10174 died... 18:03:13.083866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10174): Terminated: ok {rc=0} 18:03:13.129976 --- ParallelTerminationStrategy: PID 10177 died... 18:03:13.149493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10177): Terminated: ok {rc=0} 18:03:13.195817 --- ParallelTerminationStrategy: PID 10180 died... 18:03:13.215306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10180): Terminated: ok {rc=0} 18:03:13.303190 bus /sierra_3: Setting Powered False 18:03:14.403227 bus /sierra_3: Setting Powered False 18:03:15.521743 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 18:03:16.674755 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:03:16.688011 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:03:16.746803 tst mo_mt_call_osmux.py: using LAC 30542 18:03:16.867986 tst mo_mt_call_osmux.py: using RAC 197 18:03:17.038262 tst mo_mt_call_osmux.py: using CellId 30542 18:03:17.165255 tst mo_mt_call_osmux.py: using BVCI 30543 18:03:17.278181 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:03:17.290208 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:03:17.302201 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:03:17.314836 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:03:17.327077 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:03:17.339282 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:03:17.462397 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:03:17.584786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:18.090916 run create_hlr_db(pid=10183): Launched 18:03:18.224589 bus /sierra_2: Setting Powered False 18:03:19.289141 run create_hlr_db(pid=10183): Terminated: ok {rc=0} 18:03:19.722541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10185): Launched 18:03:20.028103 run osmo-hlr_10.42.42.2(pid=10186): Launched 18:03:20.144560 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:20.666700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10188): Launched 18:03:20.971201 run osmo-stp_10.42.42.5(pid=10189): Launched 18:03:21.086489 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:21.634482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10191): Launched 18:03:21.938693 run osmo-msc_10.42.42.6(pid=10192): Launched 18:03:22.111949 run osmo-stp_10.42.42.5(pid=10189): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10189)] 18:03:22.240210 run osmo-stp_10.42.42.5(pid=10189): stdout: | (launched: 2022-12-12_18:03:20.915314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:22.368287 run osmo-stp_10.42.42.5(pid=10189): stderr: | [0;m[38;5;43m20221212180321084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180321084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180321084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180321085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180321085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180321085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180321085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:22.493879 run osmo-stp_10.42.42.5(pid=10189): stdout: | (launched: 2022-12-12_18:03:20.915314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:22.614440 run osmo-stp_10.42.42.5(pid=10189): stderr: | [0;m[38;5;43m20221212180321084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180321084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180321084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180321085 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180321085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180321085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180321085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:22.758644 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10189): Process ended prematurely: osmo-stp_10.42.42.5(pid=10189) [trial-2380↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10189)] [trial-2380↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 18:03:22.767624 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:03:22.794511 run osmo-hlr_10.42.42.2(pid=10186): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10186)] 18:03:22.842281 run osmo-hlr_10.42.42.2(pid=10186): stdout: | (launched: 2022-12-12_18:03:19.971915) 18:03:22.891649 run osmo-hlr_10.42.42.2(pid=10186): stderr: | [0;m[1;31m20221212180320146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180320146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180320146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180320146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180320146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180320146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180320158 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180320167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180320167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180320167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:22.960879 run osmo-msc_10.42.42.6(pid=10192): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10192)] 18:03:23.008667 run osmo-msc_10.42.42.6(pid=10192): stdout: | (launched: 2022-12-12_18:03:21.882575) 18:03:23.058001 run osmo-msc_10.42.42.6(pid=10192): stderr: | [0;m[38;5;43m20221212180322150 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180322151 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f15a7df6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180322151 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180322151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180322151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180322151 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180322153 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180322153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180322153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180322154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:23.107888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10185): Terminating (SIGTERM) 18:03:23.147526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10188): Terminating (SIGTERM) 18:03:23.187236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10191): Terminating (SIGTERM) 18:03:23.227057 --- ParallelTerminationStrategy: PID 10185 died... 18:03:23.246071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10185): Terminated: ok {rc=0} 18:03:23.290128 --- ParallelTerminationStrategy: PID 10188 died... 18:03:23.308361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10188): Terminated: ok {rc=0} 18:03:23.352149 --- ParallelTerminationStrategy: PID 10191 died... 18:03:23.370546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10191): Terminated: ok {rc=0} 18:03:23.456629 bus /sierra_3: Setting Powered False 18:03:24.557240 bus /sierra_3: Setting Powered False 18:03:25.673025 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 emergency:trx-b200 --------------------------------------------------------------------- 18:03:26.923856 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:26.928488 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 18:03:26.961929 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 18:03:26.988244 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 18:03:27.073497 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 18:03:27.106520 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 18:03:27.133130 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 18:03:27.715660 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2380 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 18:03:27.720720 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:03:27.731377 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 18:03:27.780217 tst emergency_mo_mt_call.py: using LAC 30543 18:03:27.899127 tst emergency_mo_mt_call.py: using RAC 198 18:03:28.017770 tst emergency_mo_mt_call.py: using CellId 30543 18:03:28.137391 tst emergency_mo_mt_call.py: using BVCI 30544 18:03:28.255560 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:03:28.266808 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:03:28.277924 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:03:28.288874 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:03:28.299949 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:03:28.311120 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 18:03:28.428797 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 18:03:28.547981 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:29.011947 run create_hlr_db(pid=10197): Launched 18:03:29.127909 bus /sierra_2: Setting Powered False 18:03:30.188601 run create_hlr_db(pid=10197): Terminated: ok {rc=0} 18:03:30.606262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10199): Launched 18:03:30.914956 run osmo-hlr_10.42.42.2(pid=10200): Launched 18:03:31.030086 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:31.645770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10202): Launched 18:03:31.974413 run osmo-stp_10.42.42.5(pid=10203): Launched 18:03:32.235402 tst emergency_mo_mt_call.py: using MSISDN 7899 18:03:32.464321 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:33.041317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10205): Launched 18:03:33.360556 run osmo-msc_10.42.42.6(pid=10206): Launched 18:03:33.538501 run osmo-stp_10.42.42.5(pid=10203): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10203)] 18:03:33.672212 run osmo-stp_10.42.42.5(pid=10203): stdout: | (launched: 2022-12-12_18:03:31.915441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:33.806144 run osmo-stp_10.42.42.5(pid=10203): stderr: | [0;m[38;5;43m20221212180332214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180332214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180332214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180332215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180332215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180332215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180332215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:33.939031 run osmo-stp_10.42.42.5(pid=10203): stdout: | (launched: 2022-12-12_18:03:31.915441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:34.065620 run osmo-stp_10.42.42.5(pid=10203): stderr: | [0;m[38;5;43m20221212180332214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180332214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180332214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180332215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180332215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180332215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180332215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:34.217920 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10203): Process ended prematurely: osmo-stp_10.42.42.5(pid=10203) [trial-2380↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10203)] [trial-2380↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 18:03:34.227124 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 18:03:34.254896 run osmo-hlr_10.42.42.2(pid=10200): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10200)] 18:03:34.304896 run osmo-hlr_10.42.42.2(pid=10200): stdout: | (launched: 2022-12-12_18:03:30.855288) 18:03:34.356636 run osmo-hlr_10.42.42.2(pid=10200): stderr: | [0;m[1;31m20221212180331228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180331228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180331228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180331228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180331228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180331228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180331253 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180331274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180331274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180331274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:34.428780 run osmo-msc_10.42.42.6(pid=10206): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10206)] 18:03:34.479254 run osmo-msc_10.42.42.6(pid=10206): stdout: | (launched: 2022-12-12_18:03:33.301940) 18:03:34.530688 run osmo-msc_10.42.42.6(pid=10206): stderr: | [0;m[38;5;43m20221212180333622 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180333622 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fce1c6a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180333622 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180333622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180333623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180333623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180333625 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180333625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180333625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180333625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:34.582458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10199): Terminating (SIGTERM) 18:03:34.624122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10202): Terminating (SIGTERM) 18:03:34.665892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10205): Terminating (SIGTERM) 18:03:34.707821 --- ParallelTerminationStrategy: PID 10199 died... 18:03:34.727875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10199): Terminated: ok {rc=0} 18:03:34.774263 --- ParallelTerminationStrategy: PID 10202 died... 18:03:34.793720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10202): Terminated: ok {rc=0} 18:03:34.839865 --- ParallelTerminationStrategy: PID 10205 died... 18:03:34.859441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10205): Terminated: ok {rc=0} 18:03:34.947353 bus /sierra_3: Setting Powered False 18:03:36.045613 bus /sierra_3: Setting Powered False 18:03:37.161729 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 18:03:38.250790 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:03:38.263333 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 18:03:38.316586 tst emergency_preemptive_call.py: using LAC 30544 18:03:38.443586 tst emergency_preemptive_call.py: using RAC 199 18:03:38.568607 tst emergency_preemptive_call.py: using CellId 30544 18:03:38.694768 tst emergency_preemptive_call.py: using BVCI 30545 18:03:38.811050 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:03:38.822550 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:03:38.833665 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:03:38.844698 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:03:38.855853 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 18:03:38.866874 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 18:03:38.982306 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 18:03:39.100328 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 18:03:39.219594 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 18:03:39.337665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:39.802052 run create_hlr_db(pid=10208): Launched 18:03:39.918928 bus /sierra_2: Setting Powered False 18:03:40.978797 run create_hlr_db(pid=10208): Terminated: ok {rc=0} 18:03:41.416625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10210): Launched 18:03:41.737145 run osmo-hlr_10.42.42.2(pid=10211): Launched 18:03:41.859767 run osmo-stp_10.42.42.5: Starting osmo-stp 18:03:42.408285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10213): Launched 18:03:42.726992 run osmo-stp_10.42.42.5(pid=10214): Launched 18:03:42.862648 tst emergency_preemptive_call.py: using MSISDN 7900 18:03:43.025826 run osmo-msc_10.42.42.6: Starting osmo-msc 18:03:43.598732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10216): Launched 18:03:43.918208 run osmo-msc_10.42.42.6(pid=10217): Launched 18:03:44.097578 run osmo-stp_10.42.42.5(pid=10214): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10214)] 18:03:44.231838 run osmo-stp_10.42.42.5(pid=10214): stdout: | (launched: 2022-12-12_18:03:42.668275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:44.366991 run osmo-stp_10.42.42.5(pid=10214): stderr: | [0;m[38;5;43m20221212180342856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180342857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180342857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180342857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180342858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180342858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180342858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:44.499967 run osmo-stp_10.42.42.5(pid=10214): stdout: | (launched: 2022-12-12_18:03:42.668275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:03:44.626636 run osmo-stp_10.42.42.5(pid=10214): stderr: | [0;m[38;5;43m20221212180342856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180342857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180342857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180342857 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180342858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180342858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180342858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:03:44.778280 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10214): Process ended prematurely: osmo-stp_10.42.42.5(pid=10214) [trial-2380↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10214)] [trial-2380↪emergency:trx-b200↪emergency_preemptive_call.py:32] 18:03:44.787568 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 18:03:44.815711 run osmo-hlr_10.42.42.2(pid=10211): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10211)] 18:03:44.866543 run osmo-hlr_10.42.42.2(pid=10211): stdout: | (launched: 2022-12-12_18:03:41.678269) 18:03:44.918797 run osmo-hlr_10.42.42.2(pid=10211): stderr: | [0;m[1;31m20221212180341873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180341873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180341873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180341873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180341873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180341873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180341886 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180341894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180341895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180341895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:03:44.991954 run osmo-msc_10.42.42.6(pid=10217): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10217)] 18:03:45.042464 run osmo-msc_10.42.42.6(pid=10217): stdout: | (launched: 2022-12-12_18:03:43.859401) 18:03:45.094566 run osmo-msc_10.42.42.6(pid=10217): stderr: | [0;m[38;5;43m20221212180344176 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180344176 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb2cda67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180344176 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180344176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180344176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180344176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180344178 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180344179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180344179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180344179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:03:45.147605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10210): Terminating (SIGTERM) 18:03:45.189835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10213): Terminating (SIGTERM) 18:03:45.232571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10216): Terminating (SIGTERM) 18:03:45.275512 --- ParallelTerminationStrategy: PID 10210 died... 18:03:45.295873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10210): Terminated: ok {rc=0} 18:03:45.343248 --- ParallelTerminationStrategy: PID 10213 died... 18:03:45.362909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10213): Terminated: ok {rc=0} 18:03:45.408801 --- ParallelTerminationStrategy: PID 10216 died... 18:03:45.428764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10216): Terminated: ok {rc=0} 18:03:45.516566 bus /sierra_9: Setting Powered False 18:03:46.615941 bus /sierra_9: Setting Powered False 18:03:47.735040 bus /sierra_8: Setting Powered False 18:03:48.833806 bus /sierra_8: Setting Powered False 18:03:49.949489 bus /sierra_3: Setting Powered False 18:03:51.046714 bus /sierra_3: Setting Powered False 18:03:52.165702 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-b200 --------------------------------------------------------------------- 18:03:53.449125 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:03:53.453478 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 18:03:53.487026 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 18:03:53.525265 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 18:03:53.611753 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 18:03:53.644707 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 18:03:53.682860 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 18:03:54.272455 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 18:03:54.322505 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:03:54.333305 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 18:03:54.383162 tst cs_paging_gprs_active.py: using LAC 30545 18:03:54.502977 tst cs_paging_gprs_active.py: using RAC 200 18:03:54.623941 tst cs_paging_gprs_active.py: using CellId 30545 18:03:54.744315 tst cs_paging_gprs_active.py: using BVCI 30546 18:03:54.855676 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:03:54.866409 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:03:54.876818 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:03:54.887647 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:03:54.898020 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:03:54.908729 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:03:54.919532 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:03:54.930291 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:03:54.940929 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:03:55.062671 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:03:55.178075 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:03:55.383587 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:03:55.689587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10222): Launched 18:03:55.958081 run iperf3-srv_10.42.42.10(pid=10223): Launched 18:03:56.075021 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:03:56.279693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:03:56.586080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10224): Launched 18:03:56.853363 run iperf3-srv_10.42.42.10(pid=10225): Launched 18:03:56.968296 tst cs_paging_gprs_active.py:38: start network... 18:03:57.172387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:03:57.645789 run create_hlr_db(pid=10226): Launched 18:03:57.763007 bus /sierra_2: Setting Powered False 18:03:58.823712 run create_hlr_db(pid=10226): Terminated: ok {rc=0} 18:03:59.249658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10228): Launched 18:03:59.554451 run osmo-hlr_10.42.42.2(pid=10229): Launched 18:03:59.673073 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:00.209970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10231): Launched 18:04:00.516854 run osmo-stp_10.42.42.5(pid=10232): Launched 18:04:00.633565 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:04:01.200159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10234): Launched 18:04:01.338064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:04:01.629948 run patchelf(pid=10235): Launched 18:04:01.825672 run osmo-stp_10.42.42.5(pid=10232): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10232)] 18:04:01.966784 run osmo-stp_10.42.42.5(pid=10232): stdout: | (launched: 2022-12-12_18:04:00.460190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:02.110110 run osmo-stp_10.42.42.5(pid=10232): stderr: | [0;m[38;5;43m20221212180400630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180400631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180400631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180400631 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180400632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180400632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180400632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:02.253287 run osmo-stp_10.42.42.5(pid=10232): stdout: | (launched: 2022-12-12_18:04:00.460190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:02.387065 run osmo-stp_10.42.42.5(pid=10232): stderr: | [0;m[38;5;43m20221212180400630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180400631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180400631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180400631 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180400632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180400632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180400632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:02.545373 run patchelf(pid=10235): Terminating (SIGINT) 18:04:02.726889 run patchelf(pid=10235): Terminated: ok {rc=0} 18:04:02.857752 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10232): Process ended prematurely: osmo-stp_10.42.42.5(pid=10232) [trial-2380↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10232)] [trial-2380↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 18:04:02.868404 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 18:04:02.897451 run osmo-hlr_10.42.42.2(pid=10229): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10229)] 18:04:02.948009 run osmo-hlr_10.42.42.2(pid=10229): stdout: | (launched: 2022-12-12_18:03:59.498057) 18:04:03.000098 run osmo-hlr_10.42.42.2(pid=10229): stderr: | [0;m[1;31m20221212180359671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180359671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180359671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180359671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180359671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180359671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180359683 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180359692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180359692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180359692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:03.052490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10222): Terminating (SIGTERM) 18:04:03.094824 run iperf3-srv_10.42.42.10(pid=10223): Terminating (SIGTERM) 18:04:03.138527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10224): Terminating (SIGTERM) 18:04:03.180805 run iperf3-srv_10.42.42.10(pid=10225): Terminating (SIGTERM) 18:04:03.223162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10228): Terminating (SIGTERM) 18:04:03.265973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10231): Terminating (SIGTERM) 18:04:03.307816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10234): Terminating (SIGTERM) 18:04:03.350075 --- ParallelTerminationStrategy: PID 10222 died... 18:04:03.370243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10222): Terminated: ok {rc=0} 18:04:03.417019 --- ParallelTerminationStrategy: PID 10223 died... 18:04:03.436698 run iperf3-srv_10.42.42.10(pid=10223): Terminated {rc=256} 18:04:03.482750 --- ParallelTerminationStrategy: PID 10224 died... 18:04:03.502534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10224): Terminated: ok {rc=0} 18:04:03.548767 --- ParallelTerminationStrategy: PID 10225 died... 18:04:03.568450 run iperf3-srv_10.42.42.10(pid=10225): Terminated {rc=256} 18:04:03.614582 --- ParallelTerminationStrategy: PID 10228 died... 18:04:03.634292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10228): Terminated: ok {rc=0} 18:04:03.680699 --- ParallelTerminationStrategy: PID 10231 died... 18:04:03.700342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10231): Terminated: ok {rc=0} 18:04:03.746822 --- ParallelTerminationStrategy: PID 10234 died... 18:04:03.766531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10234): Terminated: ok {rc=0} 18:04:03.854737 bus /gobi_0: Setting Powered False 18:04:04.953583 bus /gobi_0: Setting Powered False 18:04:06.069935 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200 iperf3.py ---------------------------------------------- 18:04:07.221790 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:07.233965 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 18:04:07.287684 tst iperf3.py: using LAC 30546 18:04:07.416607 tst iperf3.py: using RAC 201 18:04:07.548264 tst iperf3.py: using CellId 30546 18:04:07.679373 tst iperf3.py: using BVCI 30547 18:04:07.797916 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:07.809171 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:07.820105 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:07.831081 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:07.841914 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:07.852689 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:07.863794 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:07.874633 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:07.885698 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:04:07.999576 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:04:08.203400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:04:08.509459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10236): Launched 18:04:08.775502 run iperf3-srv_10.42.42.10(pid=10237): Launched 18:04:08.889840 tst iperf3.py:8: start network... 18:04:09.092871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:09.562526 run create_hlr_db(pid=10238): Launched 18:04:09.681427 bus /gobi_6: Setting Powered False 18:04:10.741794 run create_hlr_db(pid=10238): Terminated: ok {rc=0} 18:04:11.184331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10240): Launched 18:04:11.508832 run osmo-hlr_10.42.42.2(pid=10241): Launched 18:04:11.632701 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:12.193595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10243): Launched 18:04:12.519486 run osmo-stp_10.42.42.5(pid=10244): Launched 18:04:12.644285 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:04:13.203604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10246): Launched 18:04:13.328138 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:04:13.604063 run patchelf(pid=10247): Launched 18:04:13.785236 run osmo-stp_10.42.42.5(pid=10244): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10244)] 18:04:13.922058 run osmo-stp_10.42.42.5(pid=10244): stdout: | (launched: 2022-12-12_18:04:12.459310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:14.060645 run osmo-stp_10.42.42.5(pid=10244): stderr: | [0;m[38;5;43m20221212180412649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180412649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180412649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180412650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180412650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180412650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180412650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:14.199458 run osmo-stp_10.42.42.5(pid=10244): stdout: | (launched: 2022-12-12_18:04:12.459310) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:14.332922 run osmo-stp_10.42.42.5(pid=10244): stderr: | [0;m[38;5;43m20221212180412649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180412649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180412649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180412650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180412650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180412650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180412650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:14.490744 run patchelf(pid=10247): Terminating (SIGINT) 18:04:14.672899 run patchelf(pid=10247): Terminated: ok {rc=0} 18:04:14.803799 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10244): Process ended prematurely: osmo-stp_10.42.42.5(pid=10244) [trial-2380↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10244)] [trial-2380↪gprs:trx-b200↪iperf3.py:8] 18:04:14.814218 tst iperf3.py:8: Test FAILED (7.6 sec) 18:04:14.842699 run osmo-hlr_10.42.42.2(pid=10241): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10241)] 18:04:14.892398 run osmo-hlr_10.42.42.2(pid=10241): stdout: | (launched: 2022-12-12_18:04:11.449283) 18:04:14.943611 run osmo-hlr_10.42.42.2(pid=10241): stderr: | [0;m[1;31m20221212180411644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180411644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180411644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180411644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180411644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180411644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180411656 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180411666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180411666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180411666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:14.995285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10236): Terminating (SIGTERM) 18:04:15.036983 run iperf3-srv_10.42.42.10(pid=10237): Terminating (SIGTERM) 18:04:15.078500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10240): Terminating (SIGTERM) 18:04:15.120186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10243): Terminating (SIGTERM) 18:04:15.161903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10246): Terminating (SIGTERM) 18:04:15.203805 --- ParallelTerminationStrategy: PID 10236 died... 18:04:15.224126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10236): Terminated: ok {rc=0} 18:04:15.270566 --- ParallelTerminationStrategy: PID 10237 died... 18:04:15.290103 run iperf3-srv_10.42.42.10(pid=10237): Terminated {rc=256} 18:04:15.336078 --- ParallelTerminationStrategy: PID 10240 died... 18:04:15.355500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10240): Terminated: ok {rc=0} 18:04:15.401327 --- ParallelTerminationStrategy: PID 10243 died... 18:04:15.420841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10243): Terminated: ok {rc=0} 18:04:15.466905 --- ParallelTerminationStrategy: PID 10246 died... 18:04:15.486539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10246): Terminated: ok {rc=0} 18:04:15.573969 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 18:04:16.756616 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:16.773547 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 18:04:16.834117 tst iperf3m4.py: using LAC 30547 18:04:16.996306 tst iperf3m4.py: using RAC 202 18:04:17.132865 tst iperf3m4.py: using CellId 30547 18:04:17.260175 tst iperf3m4.py: using BVCI 30548 18:04:17.378947 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:17.390254 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:17.401428 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:17.412403 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:17.423284 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:17.434115 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:17.445179 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:17.456063 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:17.467089 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:04:17.585705 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:04:17.705924 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:04:17.826417 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:04:17.943630 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:04:18.149689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:04:18.456782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10248): Launched 18:04:18.724474 run iperf3-srv_10.42.42.10(pid=10249): Launched 18:04:18.839492 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:04:19.043662 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:04:19.350735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10250): Launched 18:04:19.618985 run iperf3-srv_10.42.42.10(pid=10251): Launched 18:04:19.735225 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:04:19.938991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:04:20.246162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10252): Launched 18:04:20.514400 run iperf3-srv_10.42.42.10(pid=10253): Launched 18:04:20.632150 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:04:20.835935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:04:21.141460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10254): Launched 18:04:21.407650 run iperf3-srv_10.42.42.10(pid=10255): Launched 18:04:21.522785 tst iperf3m4.py:8: start network... 18:04:21.726548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:22.200152 run create_hlr_db(pid=10256): Launched 18:04:22.334300 bus /gobi_6: Setting Powered False 18:04:23.399144 run create_hlr_db(pid=10256): Terminated: ok {rc=0} 18:04:23.855230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10258): Launched 18:04:24.183562 run osmo-hlr_10.42.42.2(pid=10259): Launched 18:04:24.307661 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:24.875961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10261): Launched 18:04:25.206292 run osmo-stp_10.42.42.5(pid=10262): Launched 18:04:25.331963 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:04:25.895083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10264): Launched 18:04:26.019975 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:04:26.298653 run patchelf(pid=10265): Launched 18:04:26.482707 run osmo-stp_10.42.42.5(pid=10262): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10262)] 18:04:26.622077 run osmo-stp_10.42.42.5(pid=10262): stdout: | (launched: 2022-12-12_18:04:25.145188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:26.762401 run osmo-stp_10.42.42.5(pid=10262): stderr: | [0;m[38;5;43m20221212180425334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180425334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180425334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180425334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180425335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180425335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180425335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:26.902473 run osmo-stp_10.42.42.5(pid=10262): stdout: | (launched: 2022-12-12_18:04:25.145188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:27.036385 run osmo-stp_10.42.42.5(pid=10262): stderr: | [0;m[38;5;43m20221212180425334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180425334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180425334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180425334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180425335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180425335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180425335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:27.195818 run patchelf(pid=10265): Terminating (SIGINT) 18:04:27.379794 run patchelf(pid=10265): Terminated: ok {rc=0} 18:04:27.512180 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10262): Process ended prematurely: osmo-stp_10.42.42.5(pid=10262) [trial-2380↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10262)] [trial-2380↪gprs:trx-b200↪iperf3m4.py:8] 18:04:27.522498 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:04:27.551372 run osmo-hlr_10.42.42.2(pid=10259): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10259)] 18:04:27.601058 run osmo-hlr_10.42.42.2(pid=10259): stdout: | (launched: 2022-12-12_18:04:24.122485) 18:04:27.652285 run osmo-hlr_10.42.42.2(pid=10259): stderr: | [0;m[1;31m20221212180424318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180424318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180424318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180424318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180424318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180424319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180424331 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180424340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180424341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180424341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:27.703915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10248): Terminating (SIGTERM) 18:04:27.745348 run iperf3-srv_10.42.42.10(pid=10249): Terminating (SIGTERM) 18:04:27.786620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10250): Terminating (SIGTERM) 18:04:27.829047 run iperf3-srv_10.42.42.10(pid=10251): Terminating (SIGTERM) 18:04:27.870661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10252): Terminating (SIGTERM) 18:04:27.912136 run iperf3-srv_10.42.42.10(pid=10253): Terminating (SIGTERM) 18:04:27.953529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10254): Terminating (SIGTERM) 18:04:27.995545 run iperf3-srv_10.42.42.10(pid=10255): Terminating (SIGTERM) 18:04:28.037017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10258): Terminating (SIGTERM) 18:04:28.078644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10261): Terminating (SIGTERM) 18:04:28.120411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10264): Terminating (SIGTERM) 18:04:28.162591 --- ParallelTerminationStrategy: PID 10248 died... 18:04:28.182838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10248): Terminated: ok {rc=0} 18:04:28.230006 --- ParallelTerminationStrategy: PID 10249 died... 18:04:28.249689 run iperf3-srv_10.42.42.10(pid=10249): Terminated {rc=256} 18:04:28.296110 --- ParallelTerminationStrategy: PID 10250 died... 18:04:28.315773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10250): Terminated: ok {rc=0} 18:04:28.362246 --- ParallelTerminationStrategy: PID 10251 died... 18:04:28.381952 run iperf3-srv_10.42.42.10(pid=10251): Terminated {rc=256} 18:04:28.428199 --- ParallelTerminationStrategy: PID 10252 died... 18:04:28.447901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10252): Terminated: ok {rc=0} 18:04:28.494560 --- ParallelTerminationStrategy: PID 10253 died... 18:04:28.514192 run iperf3-srv_10.42.42.10(pid=10253): Terminated {rc=256} 18:04:28.560376 --- ParallelTerminationStrategy: PID 10254 died... 18:04:28.580122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10254): Terminated: ok {rc=0} 18:04:28.626835 --- ParallelTerminationStrategy: PID 10255 died... 18:04:28.646661 run iperf3-srv_10.42.42.10(pid=10255): Terminated {rc=256} 18:04:28.693076 --- ParallelTerminationStrategy: PID 10258 died... 18:04:28.712744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10258): Terminated: ok {rc=0} 18:04:28.759121 --- ParallelTerminationStrategy: PID 10261 died... 18:04:28.778917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10261): Terminated: ok {rc=0} 18:04:28.825540 --- ParallelTerminationStrategy: PID 10264 died... 18:04:28.845683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10264): Terminated: ok {rc=0} 18:04:28.933854 bus /gobi_4: Setting Powered False 18:04:30.034090 bus /gobi_4: Setting Powered False 18:04:31.150038 bus /gobi_1: Setting Powered False 18:04:32.251640 bus /gobi_1: Setting Powered False 18:04:33.366809 bus /gobi_0: Setting Powered False 18:04:34.463892 bus /gobi_0: Setting Powered False 18:04:35.579245 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200 ping.py ---------------------------------------------- 18:04:36.684154 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:36.696268 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 18:04:36.747189 tst ping.py: using LAC 30548 18:04:36.874260 tst ping.py: using RAC 203 18:04:37.001124 tst ping.py: using CellId 30548 18:04:37.127420 tst ping.py: using BVCI 30549 18:04:37.246381 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:37.257616 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:37.268693 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:37.279880 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:37.290809 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:37.301786 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:37.312791 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:37.324016 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:04:37.443340 tst ping.py:19: start network... 18:04:37.660191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:38.159930 run create_hlr_db(pid=10266): Launched 18:04:38.293421 bus /gobi_6: Setting Powered False 18:04:39.357571 run create_hlr_db(pid=10266): Terminated: ok {rc=0} 18:04:39.789155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10268): Launched 18:04:40.092043 run osmo-hlr_10.42.42.2(pid=10269): Launched 18:04:40.208470 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:40.733363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10271): Launched 18:04:41.038169 run osmo-stp_10.42.42.5(pid=10272): Launched 18:04:41.155341 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:04:41.675431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10274): Launched 18:04:41.792577 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:04:42.048343 run patchelf(pid=10275): Launched 18:04:42.218360 run osmo-stp_10.42.42.5(pid=10272): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10272)] 18:04:42.346446 run osmo-stp_10.42.42.5(pid=10272): stdout: | (launched: 2022-12-12_18:04:40.981303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:42.475482 run osmo-stp_10.42.42.5(pid=10272): stderr: | [0;m[38;5;43m20221212180441148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180441148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180441149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180441149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180441149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180441149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180441150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:42.604821 run osmo-stp_10.42.42.5(pid=10272): stdout: | (launched: 2022-12-12_18:04:40.981303) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:42.729272 run osmo-stp_10.42.42.5(pid=10272): stderr: | [0;m[38;5;43m20221212180441148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180441148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180441149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180441149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180441149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180441149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180441150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:42.876089 run patchelf(pid=10275): Terminating (SIGINT) 18:04:43.044397 run patchelf(pid=10275): Terminated: ok {rc=0} 18:04:43.165629 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10272): Process ended prematurely: osmo-stp_10.42.42.5(pid=10272) [trial-2380↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10272)] [trial-2380↪gprs:trx-b200↪ping.py:22] 18:04:43.174651 tst ping.py:22: Test FAILED (6.5 sec) 18:04:43.202972 run osmo-hlr_10.42.42.2(pid=10269): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10269)] 18:04:43.251937 run osmo-hlr_10.42.42.2(pid=10269): stdout: | (launched: 2022-12-12_18:04:40.035325) 18:04:43.301984 run osmo-hlr_10.42.42.2(pid=10269): stderr: | [0;m[1;31m20221212180440210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180440210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180440210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180440210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180440210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180440210 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180440222 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180440231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180440232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180440232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:43.352711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10268): Terminating (SIGTERM) 18:04:43.393430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10271): Terminating (SIGTERM) 18:04:43.434339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10274): Terminating (SIGTERM) 18:04:43.475429 --- ParallelTerminationStrategy: PID 10268 died... 18:04:43.494455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10268): Terminated: ok {rc=0} 18:04:43.539609 --- ParallelTerminationStrategy: PID 10271 died... 18:04:43.558689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10271): Terminated: ok {rc=0} 18:04:43.603786 --- ParallelTerminationStrategy: PID 10274 died... 18:04:43.622645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10274): Terminated: ok {rc=0} 18:04:43.710774 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 18:04:44.800178 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:44.812248 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 18:04:44.863032 tst ping_idle_ping.py: using LAC 30549 18:04:44.982794 tst ping_idle_ping.py: using RAC 204 18:04:45.102438 tst ping_idle_ping.py: using CellId 30549 18:04:45.232315 tst ping_idle_ping.py: using BVCI 30550 18:04:45.350154 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:45.361548 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:45.372550 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:45.384455 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:45.395956 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:45.407496 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:45.419256 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 18:04:45.431040 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 18:04:45.548527 tst ping_idle_ping.py:24: start network... 18:04:45.750339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:46.269154 run create_hlr_db(pid=10276): Launched 18:04:46.426026 bus /gobi_6: Setting Powered False 18:04:47.486684 run create_hlr_db(pid=10276): Terminated: ok {rc=0} 18:04:47.929729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10278): Launched 18:04:48.256154 run osmo-hlr_10.42.42.2(pid=10279): Launched 18:04:48.381327 run osmo-stp_10.42.42.5: Starting osmo-stp 18:04:48.937085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10281): Launched 18:04:49.263200 run osmo-stp_10.42.42.5(pid=10282): Launched 18:04:49.390768 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:04:49.947337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10284): Launched 18:04:50.071674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:04:50.346104 run patchelf(pid=10285): Launched 18:04:50.526013 run osmo-stp_10.42.42.5(pid=10282): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10282)] 18:04:50.662174 run osmo-stp_10.42.42.5(pid=10282): stdout: | (launched: 2022-12-12_18:04:49.202351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:50.800220 run osmo-stp_10.42.42.5(pid=10282): stderr: | [0;m[38;5;43m20221212180449393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180449393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180449394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180449394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180449395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180449396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180449396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:50.938481 run osmo-stp_10.42.42.5(pid=10282): stdout: | (launched: 2022-12-12_18:04:49.202351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:04:51.070627 run osmo-stp_10.42.42.5(pid=10282): stderr: | [0;m[38;5;43m20221212180449393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180449393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180449394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180449394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180449395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180449396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180449396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:04:51.227026 run patchelf(pid=10285): Terminating (SIGINT) 18:04:51.407765 run patchelf(pid=10285): Terminated: ok {rc=0} 18:04:51.537133 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10282): Process ended prematurely: osmo-stp_10.42.42.5(pid=10282) [trial-2380↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10282)] [trial-2380↪gprs:trx-b200↪ping_idle_ping.py:27] 18:04:51.546808 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:04:51.574872 run osmo-hlr_10.42.42.2(pid=10279): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10279)] 18:04:51.624559 run osmo-hlr_10.42.42.2(pid=10279): stdout: | (launched: 2022-12-12_18:04:48.195489) 18:04:51.675886 run osmo-hlr_10.42.42.2(pid=10279): stderr: | [0;m[1;31m20221212180448392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180448392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180448392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180448392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180448392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180448392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180448406 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180448414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180448414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180448415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:04:51.727673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10278): Terminating (SIGTERM) 18:04:51.769133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10281): Terminating (SIGTERM) 18:04:51.810885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10284): Terminating (SIGTERM) 18:04:51.853327 --- ParallelTerminationStrategy: PID 10278 died... 18:04:51.873637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10278): Terminated: ok {rc=0} 18:04:51.920920 --- ParallelTerminationStrategy: PID 10281 died... 18:04:51.940800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10281): Terminated: ok {rc=0} 18:04:51.987223 --- ParallelTerminationStrategy: PID 10284 died... 18:04:52.006908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10284): Terminated: ok {rc=0} 18:04:52.095731 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 18:04:53.408283 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:04:53.414128 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:04:53.448218 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:04:53.488243 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:04:53.576940 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:04:53.610561 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:04:53.649605 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:04:54.246738 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:04:54.299622 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:04:54.310943 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:04:54.362918 tst cs_paging_gprs_active.py: using LAC 30550 18:04:54.493675 tst cs_paging_gprs_active.py: using RAC 205 18:04:54.621480 tst cs_paging_gprs_active.py: using CellId 30550 18:04:54.750820 tst cs_paging_gprs_active.py: using BVCI 30551 18:04:54.871470 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:04:54.882956 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:04:54.894098 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:04:54.905244 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:04:54.916222 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:04:54.927332 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:04:54.938651 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:04:54.949774 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:04:54.961040 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:04:55.079765 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:04:55.197675 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:04:55.406367 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:04:55.717202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10289): Launched 18:04:55.986253 run iperf3-srv_10.42.42.10(pid=10290): Launched 18:04:56.102247 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:04:56.308232 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:04:56.617588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10291): Launched 18:04:56.887675 run iperf3-srv_10.42.42.10(pid=10292): Launched 18:04:57.005473 tst cs_paging_gprs_active.py:38: start network... 18:04:57.211141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:04:57.686835 run create_hlr_db(pid=10293): Launched 18:04:57.806896 bus /gobi_6: Setting Powered False 18:04:58.871568 run create_hlr_db(pid=10293): Terminated: ok {rc=0} 18:04:59.310947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10295): Launched 18:04:59.621959 run osmo-hlr_10.42.42.2(pid=10296): Launched 18:04:59.740937 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:00.281615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10298): Launched 18:05:00.591367 run osmo-stp_10.42.42.5(pid=10299): Launched 18:05:00.710717 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:05:01.281785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10301): Launched 18:05:01.417515 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:05:01.703204 run patchelf(pid=10302): Launched 18:05:01.916906 run osmo-stp_10.42.42.5(pid=10299): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10299)] 18:05:02.059465 run osmo-stp_10.42.42.5(pid=10299): stdout: | (launched: 2022-12-12_18:05:00.534113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:02.202967 run osmo-stp_10.42.42.5(pid=10299): stderr: | [0;m[38;5;43m20221212180500703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180500703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180500704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180500704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180500705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180500705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180500705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:02.344510 run osmo-stp_10.42.42.5(pid=10299): stdout: | (launched: 2022-12-12_18:05:00.534113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:02.479297 run osmo-stp_10.42.42.5(pid=10299): stderr: | [0;m[38;5;43m20221212180500703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180500703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180500704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180500704 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180500705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180500705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180500705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:02.638165 run patchelf(pid=10302): Terminating (SIGINT) 18:05:02.821266 run patchelf(pid=10302): Terminated: ok {rc=0} 18:05:02.953782 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10299): Process ended prematurely: osmo-stp_10.42.42.5(pid=10299) [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10299)] [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:05:02.964247 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:05:02.993046 run osmo-hlr_10.42.42.2(pid=10296): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10296)] 18:05:03.043245 run osmo-hlr_10.42.42.2(pid=10296): stdout: | (launched: 2022-12-12_18:04:59.564014) 18:05:03.095223 run osmo-hlr_10.42.42.2(pid=10296): stderr: | [0;m[1;31m20221212180459739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180459739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180459739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180459739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180459740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180459740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180459752 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180459760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180459760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180459760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:03.147352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10289): Terminating (SIGTERM) 18:05:03.189405 run iperf3-srv_10.42.42.10(pid=10290): Terminating (SIGTERM) 18:05:03.230986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10291): Terminating (SIGTERM) 18:05:03.273050 run iperf3-srv_10.42.42.10(pid=10292): Terminating (SIGTERM) 18:05:03.314980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10295): Terminating (SIGTERM) 18:05:03.356604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10298): Terminating (SIGTERM) 18:05:03.398346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10301): Terminating (SIGTERM) 18:05:03.440204 --- ParallelTerminationStrategy: PID 10289 died... 18:05:03.459859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10289): Terminated: ok {rc=0} 18:05:03.505847 --- ParallelTerminationStrategy: PID 10290 died... 18:05:03.525177 run iperf3-srv_10.42.42.10(pid=10290): Terminated {rc=256} 18:05:03.570863 --- ParallelTerminationStrategy: PID 10291 died... 18:05:03.590327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10291): Terminated: ok {rc=0} 18:05:03.636140 --- ParallelTerminationStrategy: PID 10292 died... 18:05:03.655581 run iperf3-srv_10.42.42.10(pid=10292): Terminated {rc=256} 18:05:03.701429 --- ParallelTerminationStrategy: PID 10295 died... 18:05:03.720794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10295): Terminated: ok {rc=0} 18:05:03.766756 --- ParallelTerminationStrategy: PID 10298 died... 18:05:03.786358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10298): Terminated: ok {rc=0} 18:05:03.832296 --- ParallelTerminationStrategy: PID 10301 died... 18:05:03.851849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10301): Terminated: ok {rc=0} 18:05:03.939032 bus /gobi_0: Setting Powered False 18:05:05.039866 bus /gobi_0: Setting Powered False 18:05:06.156628 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:05:07.302858 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:07.314502 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:05:07.368029 tst iperf3.py: using LAC 30551 18:05:07.490332 tst iperf3.py: using RAC 206 18:05:07.616141 tst iperf3.py: using CellId 30551 18:05:07.738183 tst iperf3.py: using BVCI 30552 18:05:07.851254 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:07.862177 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:07.872787 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:07.883784 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:07.894758 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:07.905690 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:07.916852 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:07.927754 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:07.938894 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:05:08.054725 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:05:08.260061 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:05:08.568530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10306): Launched 18:05:08.837244 run iperf3-srv_10.42.42.10(pid=10307): Launched 18:05:08.953396 tst iperf3.py:8: start network... 18:05:09.158531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:09.633645 run create_hlr_db(pid=10308): Launched 18:05:09.752035 bus /gobi_6: Setting Powered False 18:05:10.812386 run create_hlr_db(pid=10308): Terminated: ok {rc=0} 18:05:11.261195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10310): Launched 18:05:11.590924 run osmo-hlr_10.42.42.2(pid=10311): Launched 18:05:11.716026 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:12.279118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10313): Launched 18:05:12.607082 run osmo-stp_10.42.42.5(pid=10314): Launched 18:05:12.733653 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:05:13.300047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10316): Launched 18:05:13.426677 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:05:13.703909 run patchelf(pid=10317): Launched 18:05:13.887563 run osmo-stp_10.42.42.5(pid=10314): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10314)] 18:05:14.025183 run osmo-stp_10.42.42.5(pid=10314): stdout: | (launched: 2022-12-12_18:05:12.546124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:14.164446 run osmo-stp_10.42.42.5(pid=10314): stderr: | [0;m[38;5;43m20221212180512737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180512737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180512737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180512738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180512738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180512738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180512738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:14.304146 run osmo-stp_10.42.42.5(pid=10314): stdout: | (launched: 2022-12-12_18:05:12.546124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:14.437683 run osmo-stp_10.42.42.5(pid=10314): stderr: | [0;m[38;5;43m20221212180512737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180512737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180512737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180512738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180512738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180512738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180512738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:14.595837 run patchelf(pid=10317): Terminating (SIGINT) 18:05:14.778372 run patchelf(pid=10317): Terminated: ok {rc=0} 18:05:14.909905 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10314): Process ended prematurely: osmo-stp_10.42.42.5(pid=10314) [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10314)] [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 18:05:14.920182 tst iperf3.py:8: Test FAILED (7.7 sec) 18:05:14.949784 run osmo-hlr_10.42.42.2(pid=10311): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10311)] 18:05:14.999606 run osmo-hlr_10.42.42.2(pid=10311): stdout: | (launched: 2022-12-12_18:05:11.529931) 18:05:15.051339 run osmo-hlr_10.42.42.2(pid=10311): stderr: | [0;m[1;31m20221212180511728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180511728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180511728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180511728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180511728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180511728 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180511744 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180511753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180511753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180511753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:15.103278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10306): Terminating (SIGTERM) 18:05:15.144741 run iperf3-srv_10.42.42.10(pid=10307): Terminating (SIGTERM) 18:05:15.186226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10310): Terminating (SIGTERM) 18:05:15.227812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10313): Terminating (SIGTERM) 18:05:15.269732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10316): Terminating (SIGTERM) 18:05:15.311638 --- ParallelTerminationStrategy: PID 10306 died... 18:05:15.331402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10306): Terminated: ok {rc=0} 18:05:15.377950 --- ParallelTerminationStrategy: PID 10307 died... 18:05:15.397521 run iperf3-srv_10.42.42.10(pid=10307): Terminated {rc=256} 18:05:15.443930 --- ParallelTerminationStrategy: PID 10310 died... 18:05:15.463410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10310): Terminated: ok {rc=0} 18:05:15.512253 --- ParallelTerminationStrategy: PID 10313 died... 18:05:15.531077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10313): Terminated: ok {rc=0} 18:05:15.577176 --- ParallelTerminationStrategy: PID 10316 died... 18:05:15.596041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10316): Terminated: ok {rc=0} 18:05:15.684478 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:05:16.857140 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:16.873695 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:05:16.933777 tst iperf3m4.py: using LAC 30552 18:05:17.085208 tst iperf3m4.py: using RAC 207 18:05:17.239707 tst iperf3m4.py: using CellId 30552 18:05:17.362431 tst iperf3m4.py: using BVCI 30553 18:05:17.474151 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:17.485730 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:17.496607 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:17.508270 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:17.519832 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:17.531538 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:17.543245 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:17.554648 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:17.566435 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:05:17.691161 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:05:17.813039 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:05:17.932638 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:05:18.049677 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:05:18.256077 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:05:18.564794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10319): Launched 18:05:18.835152 run iperf3-srv_10.42.42.10(pid=10320): Launched 18:05:18.952870 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:05:19.158752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:05:19.467690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10321): Launched 18:05:19.735613 run iperf3-srv_10.42.42.10(pid=10322): Launched 18:05:19.852696 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:05:20.057641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:05:20.365712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10323): Launched 18:05:20.633754 run iperf3-srv_10.42.42.10(pid=10324): Launched 18:05:20.750667 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:05:20.955227 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:05:21.263164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10325): Launched 18:05:21.533149 run iperf3-srv_10.42.42.10(pid=10326): Launched 18:05:21.650293 tst iperf3m4.py:8: start network... 18:05:21.854425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:22.328367 run create_hlr_db(pid=10327): Launched 18:05:22.446975 bus /gobi_6: Setting Powered False 18:05:23.507554 run create_hlr_db(pid=10327): Terminated: ok {rc=0} 18:05:23.955905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10329): Launched 18:05:24.288241 run osmo-hlr_10.42.42.2(pid=10330): Launched 18:05:24.415388 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:24.982978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10332): Launched 18:05:25.317033 run osmo-stp_10.42.42.5(pid=10333): Launched 18:05:25.443035 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:05:26.009423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10335): Launched 18:05:26.135980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:05:26.415220 run patchelf(pid=10336): Launched 18:05:26.599211 run osmo-stp_10.42.42.5(pid=10333): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10333)] 18:05:26.737542 run osmo-stp_10.42.42.5(pid=10333): stdout: | (launched: 2022-12-12_18:05:25.255483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:26.877300 run osmo-stp_10.42.42.5(pid=10333): stderr: | [0;m[38;5;43m20221212180525446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180525446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180525446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180525447 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180525447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180525447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180525447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:27.017187 run osmo-stp_10.42.42.5(pid=10333): stdout: | (launched: 2022-12-12_18:05:25.255483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:27.151878 run osmo-stp_10.42.42.5(pid=10333): stderr: | [0;m[38;5;43m20221212180525446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180525446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180525446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180525447 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180525447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180525447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180525447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:27.311519 run patchelf(pid=10336): Terminating (SIGINT) 18:05:27.495142 run patchelf(pid=10336): Terminated: ok {rc=0} 18:05:27.627062 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10333): Process ended prematurely: osmo-stp_10.42.42.5(pid=10333) [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10333)] [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 18:05:27.637430 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:05:27.666910 run osmo-hlr_10.42.42.2(pid=10330): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10330)] 18:05:27.717464 run osmo-hlr_10.42.42.2(pid=10330): stdout: | (launched: 2022-12-12_18:05:24.226720) 18:05:27.769403 run osmo-hlr_10.42.42.2(pid=10330): stderr: | [0;m[1;31m20221212180524422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180524422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180524422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180524422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180524422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180524423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180524435 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180524446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180524446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180524446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:27.821847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10319): Terminating (SIGTERM) 18:05:27.864136 run iperf3-srv_10.42.42.10(pid=10320): Terminating (SIGTERM) 18:05:27.906353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10321): Terminating (SIGTERM) 18:05:27.948497 run iperf3-srv_10.42.42.10(pid=10322): Terminating (SIGTERM) 18:05:27.990739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10323): Terminating (SIGTERM) 18:05:28.032803 run iperf3-srv_10.42.42.10(pid=10324): Terminating (SIGTERM) 18:05:28.075071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10325): Terminating (SIGTERM) 18:05:28.117220 run iperf3-srv_10.42.42.10(pid=10326): Terminating (SIGTERM) 18:05:28.159197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10329): Terminating (SIGTERM) 18:05:28.201482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10332): Terminating (SIGTERM) 18:05:28.243585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10335): Terminating (SIGTERM) 18:05:28.286413 --- ParallelTerminationStrategy: PID 10319 died... 18:05:28.306787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10319): Terminated: ok {rc=0} 18:05:28.353719 --- ParallelTerminationStrategy: PID 10320 died... 18:05:28.373479 run iperf3-srv_10.42.42.10(pid=10320): Terminated {rc=256} 18:05:28.420018 --- ParallelTerminationStrategy: PID 10321 died... 18:05:28.439867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10321): Terminated: ok {rc=0} 18:05:28.486411 --- ParallelTerminationStrategy: PID 10322 died... 18:05:28.506302 run iperf3-srv_10.42.42.10(pid=10322): Terminated {rc=256} 18:05:28.552588 --- ParallelTerminationStrategy: PID 10323 died... 18:05:28.572345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10323): Terminated: ok {rc=0} 18:05:28.618534 --- ParallelTerminationStrategy: PID 10324 died... 18:05:28.638134 run iperf3-srv_10.42.42.10(pid=10324): Terminated {rc=256} 18:05:28.684217 --- ParallelTerminationStrategy: PID 10325 died... 18:05:28.703980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10325): Terminated: ok {rc=0} 18:05:28.750102 --- ParallelTerminationStrategy: PID 10326 died... 18:05:28.770004 run iperf3-srv_10.42.42.10(pid=10326): Terminated {rc=256} 18:05:28.816019 --- ParallelTerminationStrategy: PID 10329 died... 18:05:28.835891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10329): Terminated: ok {rc=0} 18:05:28.882197 --- ParallelTerminationStrategy: PID 10332 died... 18:05:28.902133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10332): Terminated: ok {rc=0} 18:05:28.948356 --- ParallelTerminationStrategy: PID 10335 died... 18:05:28.968219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10335): Terminated: ok {rc=0} 18:05:29.056535 bus /gobi_4: Setting Powered False 18:05:30.156423 bus /gobi_4: Setting Powered False 18:05:31.289970 bus /gobi_1: Setting Powered False 18:05:32.394935 bus /gobi_1: Setting Powered False 18:05:33.512227 bus /gobi_0: Setting Powered False 18:05:34.611968 bus /gobi_0: Setting Powered False 18:05:35.729035 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 18:05:36.832874 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:36.844618 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:05:36.896847 tst ping.py: using LAC 30553 18:05:37.014529 tst ping.py: using RAC 208 18:05:37.133661 tst ping.py: using CellId 30553 18:05:37.261998 tst ping.py: using BVCI 30554 18:05:37.378840 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:37.390600 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:37.402165 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:37.413667 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:37.425046 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:37.436310 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:37.447882 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:37.459290 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:05:37.575085 tst ping.py:19: start network... 18:05:37.774915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:38.239565 run create_hlr_db(pid=10337): Launched 18:05:38.355554 bus /gobi_6: Setting Powered False 18:05:39.419891 run create_hlr_db(pid=10337): Terminated: ok {rc=0} 18:05:39.869717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10339): Launched 18:05:40.194575 run osmo-hlr_10.42.42.2(pid=10340): Launched 18:05:40.320068 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:40.877943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10342): Launched 18:05:41.203184 run osmo-stp_10.42.42.5(pid=10343): Launched 18:05:41.328580 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:05:41.886380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10345): Launched 18:05:42.011297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:05:42.286121 run patchelf(pid=10346): Launched 18:05:42.465563 run osmo-stp_10.42.42.5(pid=10343): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10343)] 18:05:42.601630 run osmo-stp_10.42.42.5(pid=10343): stdout: | (launched: 2022-12-12_18:05:41.142959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:42.739368 run osmo-stp_10.42.42.5(pid=10343): stderr: | [0;m[38;5;43m20221212180541334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180541334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180541334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180541334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180541335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180541335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180541335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:42.877177 run osmo-stp_10.42.42.5(pid=10343): stdout: | (launched: 2022-12-12_18:05:41.142959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:43.009242 run osmo-stp_10.42.42.5(pid=10343): stderr: | [0;m[38;5;43m20221212180541334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180541334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180541334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180541334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180541335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180541335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180541335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:43.165843 run patchelf(pid=10346): Terminating (SIGINT) 18:05:43.347035 run patchelf(pid=10346): Terminated: ok {rc=0} 18:05:43.476638 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10343): Process ended prematurely: osmo-stp_10.42.42.5(pid=10343) [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10343)] [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 18:05:43.486493 tst ping.py:22: Test FAILED (6.6 sec) 18:05:43.515169 run osmo-hlr_10.42.42.2(pid=10340): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10340)] 18:05:43.565927 run osmo-hlr_10.42.42.2(pid=10340): stdout: | (launched: 2022-12-12_18:05:40.134512) 18:05:43.618380 run osmo-hlr_10.42.42.2(pid=10340): stderr: | [0;m[1;31m20221212180540332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180540333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180540333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180540333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180540333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180540333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180540345 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180540354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180540354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180540354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:43.671213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10339): Terminating (SIGTERM) 18:05:43.713945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10342): Terminating (SIGTERM) 18:05:43.756579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10345): Terminating (SIGTERM) 18:05:43.799939 --- ParallelTerminationStrategy: PID 10339 died... 18:05:43.820453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10339): Terminated: ok {rc=0} 18:05:43.867577 --- ParallelTerminationStrategy: PID 10342 died... 18:05:43.887423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10342): Terminated: ok {rc=0} 18:05:43.934219 --- ParallelTerminationStrategy: PID 10345 died... 18:05:43.954347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10345): Terminated: ok {rc=0} 18:05:44.042999 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:05:45.131349 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:45.143163 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:05:45.195320 tst ping_idle_ping.py: using LAC 30554 18:05:45.315240 tst ping_idle_ping.py: using RAC 209 18:05:45.434264 tst ping_idle_ping.py: using CellId 30554 18:05:45.554292 tst ping_idle_ping.py: using BVCI 30555 18:05:45.663248 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:45.674302 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:45.685274 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:45.696343 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:45.707347 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:45.718465 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:45.729725 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:05:45.740596 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:05:45.876838 tst ping_idle_ping.py:24: start network... 18:05:46.104576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:46.652472 run create_hlr_db(pid=10347): Launched 18:05:46.821620 bus /gobi_6: Setting Powered False 18:05:47.886527 run create_hlr_db(pid=10347): Terminated: ok {rc=0} 18:05:48.323817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10349): Launched 18:05:48.629997 run osmo-hlr_10.42.42.2(pid=10350): Launched 18:05:48.746884 run osmo-stp_10.42.42.5: Starting osmo-stp 18:05:49.272702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10352): Launched 18:05:49.576193 run osmo-stp_10.42.42.5(pid=10353): Launched 18:05:49.693799 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:05:50.214814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10355): Launched 18:05:50.332132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:05:50.588206 run patchelf(pid=10356): Launched 18:05:50.757964 run osmo-stp_10.42.42.5(pid=10353): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10353)] 18:05:50.885327 run osmo-stp_10.42.42.5(pid=10353): stdout: | (launched: 2022-12-12_18:05:49.519326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:51.014063 run osmo-stp_10.42.42.5(pid=10353): stderr: | [0;m[38;5;43m20221212180549689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180549689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180549689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180549690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180549690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180549690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180549690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:51.143186 run osmo-stp_10.42.42.5(pid=10353): stdout: | (launched: 2022-12-12_18:05:49.519326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:05:51.266426 run osmo-stp_10.42.42.5(pid=10353): stderr: | [0;m[38;5;43m20221212180549689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180549689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180549689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180549690 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180549690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180549690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180549690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:05:51.413555 run patchelf(pid=10356): Terminating (SIGINT) 18:05:51.582377 run patchelf(pid=10356): Terminated: ok {rc=0} 18:05:51.704281 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10353): Process ended prematurely: osmo-stp_10.42.42.5(pid=10353) [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10353)] [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 18:05:51.713455 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:05:51.740924 run osmo-hlr_10.42.42.2(pid=10350): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10350)] 18:05:51.789029 run osmo-hlr_10.42.42.2(pid=10350): stdout: | (launched: 2022-12-12_18:05:48.572891) 18:05:51.838753 run osmo-hlr_10.42.42.2(pid=10350): stderr: | [0;m[1;31m20221212180548748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180548748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180548748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180548748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180548748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180548748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180548760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180548769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180548769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180548769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:05:51.888857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10349): Terminating (SIGTERM) 18:05:51.929065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10352): Terminating (SIGTERM) 18:05:51.969524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10355): Terminating (SIGTERM) 18:05:52.010070 --- ParallelTerminationStrategy: PID 10349 died... 18:05:52.029386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10349): Terminated: ok {rc=0} 18:05:52.074305 --- ParallelTerminationStrategy: PID 10352 died... 18:05:52.092863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10352): Terminated: ok {rc=0} 18:05:52.137835 --- ParallelTerminationStrategy: PID 10355 died... 18:05:52.156539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10355): Terminated: ok {rc=0} 18:05:52.242024 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:05:53.546905 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:05:53.552885 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:05:53.586659 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:05:53.625348 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:05:53.714378 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:05:53.748433 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:05:53.786647 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:05:54.378248 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:05:54.427772 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:05:54.438712 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:05:54.508099 tst cs_paging_gprs_active.py: using LAC 30555 18:05:54.627964 tst cs_paging_gprs_active.py: using RAC 210 18:05:54.757259 tst cs_paging_gprs_active.py: using CellId 30555 18:05:54.885059 tst cs_paging_gprs_active.py: using BVCI 30556 18:05:55.003692 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:05:55.015058 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:05:55.026382 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:05:55.037620 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:05:55.048701 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:05:55.059886 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:05:55.071149 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:05:55.082320 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:05:55.093643 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:05:55.211917 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:05:55.329460 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:05:55.535779 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:05:55.844313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10362): Launched 18:05:56.112926 run iperf3-srv_10.42.42.10(pid=10363): Launched 18:05:56.229732 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:05:56.434928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:05:56.743630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10364): Launched 18:05:57.014876 run iperf3-srv_10.42.42.10(pid=10365): Launched 18:05:57.132182 tst cs_paging_gprs_active.py:38: start network... 18:05:57.338054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:05:57.813205 run create_hlr_db(pid=10366): Launched 18:05:57.931724 bus /gobi_6: Setting Powered False 18:05:58.992528 run create_hlr_db(pid=10366): Terminated: ok {rc=0} 18:05:59.440796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10368): Launched 18:05:59.771610 run osmo-hlr_10.42.42.2(pid=10369): Launched 18:05:59.898988 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:00.462595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10371): Launched 18:06:00.792072 run osmo-stp_10.42.42.5(pid=10372): Launched 18:06:00.945275 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:06:01.731753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10374): Launched 18:06:01.877300 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:06:02.162353 run patchelf(pid=10375): Launched 18:06:02.355835 run osmo-stp_10.42.42.5(pid=10372): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10372)] 18:06:02.489356 run osmo-stp_10.42.42.5(pid=10372): stdout: | (launched: 2022-12-12_18:06:00.731103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:02.621736 run osmo-stp_10.42.42.5(pid=10372): stderr: | [0;m[38;5;43m20221212180601081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180601081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180601081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180601081 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180601082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180601082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180601082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:02.753077 run osmo-stp_10.42.42.5(pid=10372): stdout: | (launched: 2022-12-12_18:06:00.731103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:02.879162 run osmo-stp_10.42.42.5(pid=10372): stderr: | [0;m[38;5;43m20221212180601081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180601081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180601081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180601081 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180601082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180601082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180601082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:03.028506 run patchelf(pid=10375): Terminating (SIGINT) 18:06:03.201457 run patchelf(pid=10375): Terminated: ok {rc=0} 18:06:03.326018 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10372): Process ended prematurely: osmo-stp_10.42.42.5(pid=10372) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10372)] [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:06:03.335760 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 18:06:03.363837 run osmo-hlr_10.42.42.2(pid=10369): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10369)] 18:06:03.412341 run osmo-hlr_10.42.42.2(pid=10369): stdout: | (launched: 2022-12-12_18:05:59.710819) 18:06:03.462645 run osmo-hlr_10.42.42.2(pid=10369): stderr: | [0;m[1;31m20221212180559909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180559909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180559909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180559910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180559910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180559910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180559927 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180559935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180559935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180559935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:03.513071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10362): Terminating (SIGTERM) 18:06:03.554192 run iperf3-srv_10.42.42.10(pid=10363): Terminating (SIGTERM) 18:06:03.594568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10364): Terminating (SIGTERM) 18:06:03.634977 run iperf3-srv_10.42.42.10(pid=10365): Terminating (SIGTERM) 18:06:03.675315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10368): Terminating (SIGTERM) 18:06:03.715617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10371): Terminating (SIGTERM) 18:06:03.755956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10374): Terminating (SIGTERM) 18:06:03.796501 --- ParallelTerminationStrategy: PID 10362 died... 18:06:03.816153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10362): Terminated: ok {rc=0} 18:06:03.861660 --- ParallelTerminationStrategy: PID 10363 died... 18:06:03.880350 run iperf3-srv_10.42.42.10(pid=10363): Terminated {rc=256} 18:06:03.924773 --- ParallelTerminationStrategy: PID 10364 died... 18:06:03.943713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10364): Terminated: ok {rc=0} 18:06:03.988165 --- ParallelTerminationStrategy: PID 10365 died... 18:06:04.006923 run iperf3-srv_10.42.42.10(pid=10365): Terminated {rc=256} 18:06:04.051413 --- ParallelTerminationStrategy: PID 10368 died... 18:06:04.070391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10368): Terminated: ok {rc=0} 18:06:04.114870 --- ParallelTerminationStrategy: PID 10371 died... 18:06:04.133700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10371): Terminated: ok {rc=0} 18:06:04.178260 --- ParallelTerminationStrategy: PID 10374 died... 18:06:04.197191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10374): Terminated: ok {rc=0} 18:06:04.284456 bus /gobi_0: Setting Powered False 18:06:05.385882 bus /gobi_0: Setting Powered False 18:06:06.502370 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:06:07.650655 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:07.662742 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:06:07.737213 tst iperf3.py: using LAC 30556 18:06:07.858465 tst iperf3.py: using RAC 211 18:06:07.978317 tst iperf3.py: using CellId 30556 18:06:08.105267 tst iperf3.py: using BVCI 30557 18:06:08.217337 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:08.228308 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:08.239322 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:08.251287 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:08.263011 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:08.274804 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:08.286630 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:08.298246 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:08.310052 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:06:08.433631 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:06:08.654619 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:08.983252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10376): Launched 18:06:09.270838 run iperf3-srv_10.42.42.10(pid=10377): Launched 18:06:09.395767 tst iperf3.py:8: start network... 18:06:09.617150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:10.125831 run create_hlr_db(pid=10378): Launched 18:06:10.259042 bus /gobi_6: Setting Powered False 18:06:11.323820 run create_hlr_db(pid=10378): Terminated: ok {rc=0} 18:06:11.780360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10380): Launched 18:06:12.109989 run osmo-hlr_10.42.42.2(pid=10383): Launched 18:06:12.234250 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:12.803228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10385): Launched 18:06:13.133024 run osmo-stp_10.42.42.5(pid=10386): Launched 18:06:13.259442 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:06:13.826100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10388): Launched 18:06:13.952341 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:06:14.230096 run patchelf(pid=10389): Launched 18:06:14.412885 run osmo-stp_10.42.42.5(pid=10386): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10386)] 18:06:14.551193 run osmo-stp_10.42.42.5(pid=10386): stdout: | (launched: 2022-12-12_18:06:13.071892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:14.691317 run osmo-stp_10.42.42.5(pid=10386): stderr: | [0;m[38;5;43m20221212180613265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180613265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180613266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180613266 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180613266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180613266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180613267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:14.831258 run osmo-stp_10.42.42.5(pid=10386): stdout: | (launched: 2022-12-12_18:06:13.071892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:14.965117 run osmo-stp_10.42.42.5(pid=10386): stderr: | [0;m[38;5;43m20221212180613265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180613265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180613266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180613266 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180613266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180613266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180613267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:15.123713 run patchelf(pid=10389): Terminating (SIGINT) 18:06:15.307321 run patchelf(pid=10389): Terminated: ok {rc=0} 18:06:15.439487 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10386): Process ended prematurely: osmo-stp_10.42.42.5(pid=10386) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10386)] [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 18:06:15.449789 tst iperf3.py:8: Test FAILED (7.8 sec) 18:06:15.478859 run osmo-hlr_10.42.42.2(pid=10383): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10383)] 18:06:15.529247 run osmo-hlr_10.42.42.2(pid=10383): stdout: | (launched: 2022-12-12_18:06:12.049238) 18:06:15.581352 run osmo-hlr_10.42.42.2(pid=10383): stderr: | [0;m[1;31m20221212180612247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180612247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180612247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180612247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180612247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180612247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180612260 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180612268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180612268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180612268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:15.633806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10376): Terminating (SIGTERM) 18:06:15.676252 run iperf3-srv_10.42.42.10(pid=10377): Terminating (SIGTERM) 18:06:15.718754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10380): Terminating (SIGTERM) 18:06:15.761342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10385): Terminating (SIGTERM) 18:06:15.803823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10388): Terminating (SIGTERM) 18:06:15.869982 --- ParallelTerminationStrategy: PID 10376 died... 18:06:15.891167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10376): Terminated: ok {rc=0} 18:06:15.945408 --- ParallelTerminationStrategy: PID 10377 died... 18:06:15.966050 run iperf3-srv_10.42.42.10(pid=10377): Terminated {rc=256} 18:06:16.014635 --- ParallelTerminationStrategy: PID 10380 died... 18:06:16.035631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10380): Terminated: ok {rc=0} 18:06:16.083891 --- ParallelTerminationStrategy: PID 10385 died... 18:06:16.104797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10385): Terminated: ok {rc=0} 18:06:16.154523 --- ParallelTerminationStrategy: PID 10388 died... 18:06:16.175403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10388): Terminated: ok {rc=0} 18:06:16.270773 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:06:17.427480 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:17.439541 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:06:17.508895 tst iperf3m4.py: using LAC 30557 18:06:17.626606 tst iperf3m4.py: using RAC 212 18:06:17.745369 tst iperf3m4.py: using CellId 30557 18:06:17.863408 tst iperf3m4.py: using BVCI 30558 18:06:17.974446 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:17.985457 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:17.996274 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:18.007396 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:18.018418 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:18.029464 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:18.040518 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:18.051617 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:18.062772 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:06:18.181429 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:06:18.303102 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:06:18.424432 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:06:18.547473 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:06:18.769115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:19.099157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10390): Launched 18:06:19.387614 run iperf3-srv_10.42.42.10(pid=10391): Launched 18:06:19.511660 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:06:19.732933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:20.063352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10392): Launched 18:06:20.352004 run iperf3-srv_10.42.42.10(pid=10393): Launched 18:06:20.477053 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:06:20.697362 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:21.027565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10394): Launched 18:06:21.314459 run iperf3-srv_10.42.42.10(pid=10395): Launched 18:06:21.438121 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:06:21.659242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:21.989307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10396): Launched 18:06:22.278002 run iperf3-srv_10.42.42.10(pid=10397): Launched 18:06:22.403439 tst iperf3m4.py:8: start network... 18:06:22.623121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:23.131974 run create_hlr_db(pid=10398): Launched 18:06:23.267128 bus /gobi_6: Setting Powered False 18:06:24.332708 run create_hlr_db(pid=10398): Terminated: ok {rc=0} 18:06:24.772002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10400): Launched 18:06:25.081981 run osmo-hlr_10.42.42.2(pid=10401): Launched 18:06:25.201309 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:25.742078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10403): Launched 18:06:26.051188 run osmo-stp_10.42.42.5(pid=10404): Launched 18:06:26.170113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:06:26.698198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10406): Launched 18:06:26.815384 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:06:27.075439 run patchelf(pid=10407): Launched 18:06:27.247760 run osmo-stp_10.42.42.5(pid=10404): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10404)] 18:06:27.378035 run osmo-stp_10.42.42.5(pid=10404): stdout: | (launched: 2022-12-12_18:06:25.993131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:27.509925 run osmo-stp_10.42.42.5(pid=10404): stderr: | [0;m[38;5;43m20221212180626162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180626162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180626162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180626162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180626163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180626163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180626163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:27.641216 run osmo-stp_10.42.42.5(pid=10404): stdout: | (launched: 2022-12-12_18:06:25.993131) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:27.766910 run osmo-stp_10.42.42.5(pid=10404): stderr: | [0;m[38;5;43m20221212180626162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180626162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180626162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180626162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180626163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180626163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180626163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:27.915354 run patchelf(pid=10407): Terminating (SIGINT) 18:06:28.087843 run patchelf(pid=10407): Terminated: ok {rc=0} 18:06:28.212327 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10404): Process ended prematurely: osmo-stp_10.42.42.5(pid=10404) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10404)] [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:06:28.221947 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:06:28.250563 run osmo-hlr_10.42.42.2(pid=10401): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10401)] 18:06:28.299144 run osmo-hlr_10.42.42.2(pid=10401): stdout: | (launched: 2022-12-12_18:06:25.024045) 18:06:28.348824 run osmo-hlr_10.42.42.2(pid=10401): stderr: | [0;m[1;31m20221212180625198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180625198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180625198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180625198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180625198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180625198 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180625210 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180625218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180625218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180625218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:28.399025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10390): Terminating (SIGTERM) 18:06:28.439426 run iperf3-srv_10.42.42.10(pid=10391): Terminating (SIGTERM) 18:06:28.479789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10392): Terminating (SIGTERM) 18:06:28.520084 run iperf3-srv_10.42.42.10(pid=10393): Terminating (SIGTERM) 18:06:28.560150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10394): Terminating (SIGTERM) 18:06:28.600416 run iperf3-srv_10.42.42.10(pid=10395): Terminating (SIGTERM) 18:06:28.640875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10396): Terminating (SIGTERM) 18:06:28.681677 run iperf3-srv_10.42.42.10(pid=10397): Terminating (SIGTERM) 18:06:28.722213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10400): Terminating (SIGTERM) 18:06:28.762002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10403): Terminating (SIGTERM) 18:06:28.802466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10406): Terminating (SIGTERM) 18:06:28.843099 --- ParallelTerminationStrategy: PID 10390 died... 18:06:28.862458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10390): Terminated: ok {rc=0} 18:06:28.907462 --- ParallelTerminationStrategy: PID 10391 died... 18:06:28.926092 run iperf3-srv_10.42.42.10(pid=10391): Terminated {rc=256} 18:06:28.970468 --- ParallelTerminationStrategy: PID 10392 died... 18:06:28.989143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10392): Terminated: ok {rc=0} 18:06:29.033700 --- ParallelTerminationStrategy: PID 10393 died... 18:06:29.052371 run iperf3-srv_10.42.42.10(pid=10393): Terminated {rc=256} 18:06:29.096668 --- ParallelTerminationStrategy: PID 10394 died... 18:06:29.115535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10394): Terminated: ok {rc=0} 18:06:29.160167 --- ParallelTerminationStrategy: PID 10395 died... 18:06:29.178765 run iperf3-srv_10.42.42.10(pid=10395): Terminated {rc=256} 18:06:29.223174 --- ParallelTerminationStrategy: PID 10396 died... 18:06:29.241800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10396): Terminated: ok {rc=0} 18:06:29.286400 --- ParallelTerminationStrategy: PID 10397 died... 18:06:29.304895 run iperf3-srv_10.42.42.10(pid=10397): Terminated {rc=256} 18:06:29.349574 --- ParallelTerminationStrategy: PID 10400 died... 18:06:29.368273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10400): Terminated: ok {rc=0} 18:06:29.413071 --- ParallelTerminationStrategy: PID 10403 died... 18:06:29.431943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10403): Terminated: ok {rc=0} 18:06:29.476538 --- ParallelTerminationStrategy: PID 10406 died... 18:06:29.495428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10406): Terminated: ok {rc=0} 18:06:29.583664 bus /gobi_4: Setting Powered False 18:06:30.685074 bus /gobi_4: Setting Powered False 18:06:31.811011 bus /gobi_1: Setting Powered False 18:06:32.917143 bus /gobi_1: Setting Powered False 18:06:34.033433 bus /gobi_0: Setting Powered False 18:06:35.132048 bus /gobi_0: Setting Powered False 18:06:36.251825 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:06:37.358056 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:37.370325 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:06:37.441737 tst ping.py: using LAC 30558 18:06:37.572108 tst ping.py: using RAC 213 18:06:37.698375 tst ping.py: using CellId 30558 18:06:37.822681 tst ping.py: using BVCI 30559 18:06:37.939246 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:37.950934 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:37.962225 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:37.973534 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:37.984686 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:37.995970 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:38.007312 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:38.018715 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:06:38.135464 tst ping.py:19: start network... 18:06:38.337930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:38.805726 run create_hlr_db(pid=10408): Launched 18:06:38.922859 bus /gobi_6: Setting Powered False 18:06:39.982945 run create_hlr_db(pid=10408): Terminated: ok {rc=0} 18:06:40.405317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10410): Launched 18:06:40.708661 run osmo-hlr_10.42.42.2(pid=10411): Launched 18:06:40.825871 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:41.360721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10413): Launched 18:06:41.664226 run osmo-stp_10.42.42.5(pid=10414): Launched 18:06:41.781178 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:06:42.302075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10416): Launched 18:06:42.419247 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:06:42.675020 run patchelf(pid=10417): Launched 18:06:42.842925 run osmo-stp_10.42.42.5(pid=10414): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10414)] 18:06:42.969906 run osmo-stp_10.42.42.5(pid=10414): stdout: | (launched: 2022-12-12_18:06:41.607446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:43.098663 run osmo-stp_10.42.42.5(pid=10414): stderr: | [0;m[38;5;43m20221212180641777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180641777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180641777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180641778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180641778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180641778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180641778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:43.227736 run osmo-stp_10.42.42.5(pid=10414): stdout: | (launched: 2022-12-12_18:06:41.607446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:43.350926 run osmo-stp_10.42.42.5(pid=10414): stderr: | [0;m[38;5;43m20221212180641777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180641777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180641777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180641778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180641778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180641778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180641778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:43.497281 run patchelf(pid=10417): Terminating (SIGINT) 18:06:43.666042 run patchelf(pid=10417): Terminated: ok {rc=0} 18:06:43.787844 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10414): Process ended prematurely: osmo-stp_10.42.42.5(pid=10414) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10414)] [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 18:06:43.797193 tst ping.py:22: Test FAILED (6.4 sec) 18:06:43.825066 run osmo-hlr_10.42.42.2(pid=10411): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10411)] 18:06:43.874115 run osmo-hlr_10.42.42.2(pid=10411): stdout: | (launched: 2022-12-12_18:06:40.651945) 18:06:43.924552 run osmo-hlr_10.42.42.2(pid=10411): stderr: | [0;m[1;31m20221212180640828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180640828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180640829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180640829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180640829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180640829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180640841 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180640851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180640851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180640851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:43.975091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10410): Terminating (SIGTERM) 18:06:44.015955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10413): Terminating (SIGTERM) 18:06:44.056719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10416): Terminating (SIGTERM) 18:06:44.097541 --- ParallelTerminationStrategy: PID 10410 died... 18:06:44.117284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10410): Terminated: ok {rc=0} 18:06:44.162494 --- ParallelTerminationStrategy: PID 10413 died... 18:06:44.181464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10413): Terminated: ok {rc=0} 18:06:44.226431 --- ParallelTerminationStrategy: PID 10416 died... 18:06:44.245368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10416): Terminated: ok {rc=0} 18:06:44.332633 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:06:45.422351 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:45.434763 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:06:45.506714 tst ping_idle_ping.py: using LAC 30559 18:06:45.625240 tst ping_idle_ping.py: using RAC 214 18:06:45.744890 tst ping_idle_ping.py: using CellId 30559 18:06:45.893396 tst ping_idle_ping.py: using BVCI 30560 18:06:46.030790 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:46.043688 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:46.057524 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:46.071284 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:46.083858 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:46.097805 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:46.111954 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:06:46.125695 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:06:46.250399 tst ping_idle_ping.py:24: start network... 18:06:46.475638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:46.998405 run create_hlr_db(pid=10418): Launched 18:06:47.163008 bus /gobi_6: Setting Powered False 18:06:48.227097 run create_hlr_db(pid=10418): Terminated: ok {rc=0} 18:06:48.660346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10420): Launched 18:06:48.963895 run osmo-hlr_10.42.42.2(pid=10421): Launched 18:06:49.079709 run osmo-stp_10.42.42.5: Starting osmo-stp 18:06:49.617325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10423): Launched 18:06:49.921687 run osmo-stp_10.42.42.5(pid=10424): Launched 18:06:50.036849 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:06:50.557146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10426): Launched 18:06:50.672792 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:06:50.929084 run patchelf(pid=10427): Launched 18:06:51.098794 run osmo-stp_10.42.42.5(pid=10424): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10424)] 18:06:51.226708 run osmo-stp_10.42.42.5(pid=10424): stdout: | (launched: 2022-12-12_18:06:49.865267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:51.356156 run osmo-stp_10.42.42.5(pid=10424): stderr: | [0;m[38;5;43m20221212180650034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180650034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180650035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180650035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180650036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180650036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180650036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:51.486130 run osmo-stp_10.42.42.5(pid=10424): stdout: | (launched: 2022-12-12_18:06:49.865267) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:06:51.610165 run osmo-stp_10.42.42.5(pid=10424): stderr: | [0;m[38;5;43m20221212180650034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180650034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180650035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180650035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180650036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180650036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180650036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:06:51.757521 run patchelf(pid=10427): Terminating (SIGINT) 18:06:51.927500 run patchelf(pid=10427): Terminated: ok {rc=0} 18:06:52.049454 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10424): Process ended prematurely: osmo-stp_10.42.42.5(pid=10424) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10424)] [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:06:52.058596 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:06:52.085775 run osmo-hlr_10.42.42.2(pid=10421): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10421)] 18:06:52.134403 run osmo-hlr_10.42.42.2(pid=10421): stdout: | (launched: 2022-12-12_18:06:48.907396) 18:06:52.183801 run osmo-hlr_10.42.42.2(pid=10421): stderr: | [0;m[1;31m20221212180649083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180649083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180649083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180649083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180649083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180649083 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180649095 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180649106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180649106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180649106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:06:52.233896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10420): Terminating (SIGTERM) 18:06:52.273644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10423): Terminating (SIGTERM) 18:06:52.313983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10426): Terminating (SIGTERM) 18:06:52.353842 --- ParallelTerminationStrategy: PID 10420 died... 18:06:52.373343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10420): Terminated: ok {rc=0} 18:06:52.417621 --- ParallelTerminationStrategy: PID 10423 died... 18:06:52.436551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10423): Terminated: ok {rc=0} 18:06:52.480616 --- ParallelTerminationStrategy: PID 10426 died... 18:06:52.499221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10426): Terminated: ok {rc=0} 18:06:52.585569 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:06:53.892922 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:06:53.899594 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:06:53.934013 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:06:53.973130 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:06:54.060084 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:06:54.093127 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:06:54.131511 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:06:54.730946 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:06:54.785746 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:06:54.797486 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:06:54.871719 tst cs_paging_gprs_active.py: using LAC 30560 18:06:55.000440 tst cs_paging_gprs_active.py: using RAC 215 18:06:55.122673 tst cs_paging_gprs_active.py: using CellId 30560 18:06:55.252441 tst cs_paging_gprs_active.py: using BVCI 30561 18:06:55.371689 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:06:55.383210 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:06:55.394583 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:06:55.406249 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:06:55.417418 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:06:55.429133 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:06:55.440601 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:06:55.451993 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:06:55.463398 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:06:55.581195 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:06:55.703342 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:06:55.927039 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:56.256924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10432): Launched 18:06:56.547109 run iperf3-srv_10.42.42.10(pid=10433): Launched 18:06:56.673319 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:06:56.895323 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:06:57.226754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10434): Launched 18:06:57.514686 run iperf3-srv_10.42.42.10(pid=10435): Launched 18:06:57.637763 tst cs_paging_gprs_active.py:38: start network... 18:06:57.859572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:06:58.369754 run create_hlr_db(pid=10436): Launched 18:06:58.503973 bus /gobi_6: Setting Powered False 18:06:59.569181 run create_hlr_db(pid=10436): Terminated: ok {rc=0} 18:07:00.025563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10438): Launched 18:07:00.356318 run osmo-hlr_10.42.42.2(pid=10439): Launched 18:07:00.483090 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:01.085554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10441): Launched 18:07:01.431121 run osmo-stp_10.42.42.5(pid=10442): Launched 18:07:01.693330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:02.281627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10444): Launched 18:07:02.400444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:02.662226 run patchelf(pid=10445): Launched 18:07:02.836843 run osmo-stp_10.42.42.5(pid=10442): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10442)] 18:07:02.966870 run osmo-stp_10.42.42.5(pid=10442): stdout: | (launched: 2022-12-12_18:07:01.370035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:03.098388 run osmo-stp_10.42.42.5(pid=10442): stderr: | [0;m[38;5;43m20221212180701657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180701657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180701657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180701658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180701658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180701658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180701659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:03.230313 run osmo-stp_10.42.42.5(pid=10442): stdout: | (launched: 2022-12-12_18:07:01.370035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:03.356070 run osmo-stp_10.42.42.5(pid=10442): stderr: | [0;m[38;5;43m20221212180701657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180701657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180701657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180701658 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180701658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180701658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180701659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:03.504693 run patchelf(pid=10445): Terminating (SIGINT) 18:07:03.677258 run patchelf(pid=10445): Terminated: ok {rc=0} 18:07:03.801668 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10442): Process ended prematurely: osmo-stp_10.42.42.5(pid=10442) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10442)] [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:07:03.811379 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 18:07:03.839696 run osmo-hlr_10.42.42.2(pid=10439): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10439)] 18:07:03.888373 run osmo-hlr_10.42.42.2(pid=10439): stdout: | (launched: 2022-12-12_18:07:00.295199) 18:07:03.938389 run osmo-hlr_10.42.42.2(pid=10439): stderr: | [0;m[1;31m20221212180700493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180700493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180700493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180700493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180700493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180700493 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180700509 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180700517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180700517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180700517 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:03.989316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10432): Terminating (SIGTERM) 18:07:04.029354 run iperf3-srv_10.42.42.10(pid=10433): Terminating (SIGTERM) 18:07:04.069966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10434): Terminating (SIGTERM) 18:07:04.110593 run iperf3-srv_10.42.42.10(pid=10435): Terminating (SIGTERM) 18:07:04.150348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10438): Terminating (SIGTERM) 18:07:04.190959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10441): Terminating (SIGTERM) 18:07:04.231414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10444): Terminating (SIGTERM) 18:07:04.272105 --- ParallelTerminationStrategy: PID 10432 died... 18:07:04.291382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10432): Terminated: ok {rc=0} 18:07:04.335932 --- ParallelTerminationStrategy: PID 10433 died... 18:07:04.355099 run iperf3-srv_10.42.42.10(pid=10433): Terminated {rc=256} 18:07:04.399268 --- ParallelTerminationStrategy: PID 10434 died... 18:07:04.418739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10434): Terminated: ok {rc=0} 18:07:04.463008 --- ParallelTerminationStrategy: PID 10435 died... 18:07:04.482041 run iperf3-srv_10.42.42.10(pid=10435): Terminated {rc=256} 18:07:04.526485 --- ParallelTerminationStrategy: PID 10438 died... 18:07:04.545229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10438): Terminated: ok {rc=0} 18:07:04.589854 --- ParallelTerminationStrategy: PID 10441 died... 18:07:04.608749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10441): Terminated: ok {rc=0} 18:07:04.653559 --- ParallelTerminationStrategy: PID 10444 died... 18:07:04.672351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10444): Terminated: ok {rc=0} 18:07:04.759290 bus /gobi_0: Setting Powered False 18:07:05.858912 bus /gobi_0: Setting Powered False 18:07:06.975420 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:07:08.122653 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:08.134719 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:07:08.209607 tst iperf3.py: using LAC 30561 18:07:08.339129 tst iperf3.py: using RAC 216 18:07:08.468839 tst iperf3.py: using CellId 30561 18:07:08.597378 tst iperf3.py: using BVCI 30562 18:07:08.715980 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:08.727428 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:08.738635 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:08.749864 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:08.760887 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:08.772143 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:08.783438 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:08.794549 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:08.805919 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:07:08.926975 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:07:09.132073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:09.439138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10446): Launched 18:07:09.708711 run iperf3-srv_10.42.42.10(pid=10447): Launched 18:07:09.825596 tst iperf3.py:8: start network... 18:07:10.030828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:10.506000 run create_hlr_db(pid=10448): Launched 18:07:10.626708 bus /gobi_6: Setting Powered False 18:07:11.687869 run create_hlr_db(pid=10448): Terminated: ok {rc=0} 18:07:12.138548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10450): Launched 18:07:12.469578 run osmo-hlr_10.42.42.2(pid=10451): Launched 18:07:12.597592 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:13.165190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10453): Launched 18:07:13.496156 run osmo-stp_10.42.42.5(pid=10454): Launched 18:07:13.623400 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:14.189147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10456): Launched 18:07:14.316126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:14.593328 run patchelf(pid=10457): Launched 18:07:14.775501 run osmo-stp_10.42.42.5(pid=10454): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10454)] 18:07:14.914048 run osmo-stp_10.42.42.5(pid=10454): stdout: | (launched: 2022-12-12_18:07:13.435384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:15.053872 run osmo-stp_10.42.42.5(pid=10454): stderr: | [0;m[38;5;43m20221212180713627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180713627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180713627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180713628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180713628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180713628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180713628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:15.193595 run osmo-stp_10.42.42.5(pid=10454): stdout: | (launched: 2022-12-12_18:07:13.435384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:15.327996 run osmo-stp_10.42.42.5(pid=10454): stderr: | [0;m[38;5;43m20221212180713627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180713627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180713627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180713628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180713628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180713628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180713628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:15.486979 run patchelf(pid=10457): Terminating (SIGINT) 18:07:15.669894 run patchelf(pid=10457): Terminated: ok {rc=0} 18:07:15.802067 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10454): Process ended prematurely: osmo-stp_10.42.42.5(pid=10454) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10454)] [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 18:07:15.812550 tst iperf3.py:8: Test FAILED (7.7 sec) 18:07:15.849274 run osmo-hlr_10.42.42.2(pid=10451): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10451)] 18:07:15.900538 run osmo-hlr_10.42.42.2(pid=10451): stdout: | (launched: 2022-12-12_18:07:12.408550) 18:07:15.956610 run osmo-hlr_10.42.42.2(pid=10451): stderr: | [0;m[1;31m20221212180712608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180712608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180712608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180712608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180712608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180712609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180712621 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180712631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180712631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180712631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:16.010673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10446): Terminating (SIGTERM) 18:07:16.054616 run iperf3-srv_10.42.42.10(pid=10447): Terminating (SIGTERM) 18:07:16.100799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10450): Terminating (SIGTERM) 18:07:16.144820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10453): Terminating (SIGTERM) 18:07:16.190481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10456): Terminating (SIGTERM) 18:07:16.236870 --- ParallelTerminationStrategy: PID 10446 died... 18:07:16.257220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10446): Terminated: ok {rc=0} 18:07:16.307090 --- ParallelTerminationStrategy: PID 10447 died... 18:07:16.327041 run iperf3-srv_10.42.42.10(pid=10447): Terminated {rc=256} 18:07:16.374937 --- ParallelTerminationStrategy: PID 10450 died... 18:07:16.394805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10450): Terminated: ok {rc=0} 18:07:16.444194 --- ParallelTerminationStrategy: PID 10453 died... 18:07:16.464138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10453): Terminated: ok {rc=0} 18:07:16.512183 --- ParallelTerminationStrategy: PID 10456 died... 18:07:16.532677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10456): Terminated: ok {rc=0} 18:07:16.623751 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:07:17.773489 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:17.785573 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:07:17.856493 tst iperf3m4.py: using LAC 30562 18:07:17.977168 tst iperf3m4.py: using RAC 217 18:07:18.101089 tst iperf3m4.py: using CellId 30562 18:07:18.230585 tst iperf3m4.py: using BVCI 30563 18:07:18.352103 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:18.363966 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:18.375409 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:18.386917 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:18.398415 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:18.409725 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:18.420941 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:18.432118 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:18.443624 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:07:18.561800 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:07:18.685989 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:07:18.805620 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:07:18.927201 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:07:19.149663 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:19.480784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10458): Launched 18:07:19.770110 run iperf3-srv_10.42.42.10(pid=10459): Launched 18:07:19.895637 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:07:20.117606 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:20.448232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10460): Launched 18:07:20.736709 run iperf3-srv_10.42.42.10(pid=10461): Launched 18:07:20.861742 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:07:21.082906 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:21.414249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10462): Launched 18:07:21.703320 run iperf3-srv_10.42.42.10(pid=10463): Launched 18:07:21.828565 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:07:22.051022 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:22.382011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10464): Launched 18:07:22.668455 run iperf3-srv_10.42.42.10(pid=10465): Launched 18:07:22.793469 tst iperf3m4.py:8: start network... 18:07:23.014492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:23.523906 run create_hlr_db(pid=10466): Launched 18:07:23.659253 bus /gobi_6: Setting Powered False 18:07:24.723255 run create_hlr_db(pid=10466): Terminated: ok {rc=0} 18:07:25.162309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10468): Launched 18:07:25.470353 run osmo-hlr_10.42.42.2(pid=10469): Launched 18:07:25.589270 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:26.117245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10471): Launched 18:07:26.425690 run osmo-stp_10.42.42.5(pid=10472): Launched 18:07:26.544342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:27.073078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10474): Launched 18:07:27.191669 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:27.450961 run patchelf(pid=10475): Launched 18:07:27.623131 run osmo-stp_10.42.42.5(pid=10472): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10472)] 18:07:27.752126 run osmo-stp_10.42.42.5(pid=10472): stdout: | (launched: 2022-12-12_18:07:26.368160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:27.882813 run osmo-stp_10.42.42.5(pid=10472): stderr: | [0;m[38;5;43m20221212180726537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180726537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180726538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180726538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180726538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180726539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180726539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:28.013712 run osmo-stp_10.42.42.5(pid=10472): stdout: | (launched: 2022-12-12_18:07:26.368160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:28.139555 run osmo-stp_10.42.42.5(pid=10472): stderr: | [0;m[38;5;43m20221212180726537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180726537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180726538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180726538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180726538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180726539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180726539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:28.287653 run patchelf(pid=10475): Terminating (SIGINT) 18:07:28.458591 run patchelf(pid=10475): Terminated: ok {rc=0} 18:07:28.581654 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10472): Process ended prematurely: osmo-stp_10.42.42.5(pid=10472) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10472)] [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:07:28.591232 tst iperf3m4.py:8: Test FAILED (10.9 sec) 18:07:28.619670 run osmo-hlr_10.42.42.2(pid=10469): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10469)] 18:07:28.667877 run osmo-hlr_10.42.42.2(pid=10469): stdout: | (launched: 2022-12-12_18:07:25.412748) 18:07:28.717258 run osmo-hlr_10.42.42.2(pid=10469): stderr: | [0;m[1;31m20221212180725585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180725585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180725585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180725585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180725585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180725585 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180725598 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180725607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180725607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180725607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:28.767161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10458): Terminating (SIGTERM) 18:07:28.806977 run iperf3-srv_10.42.42.10(pid=10459): Terminating (SIGTERM) 18:07:28.846649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10460): Terminating (SIGTERM) 18:07:28.886670 run iperf3-srv_10.42.42.10(pid=10461): Terminating (SIGTERM) 18:07:28.926456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10462): Terminating (SIGTERM) 18:07:28.966231 run iperf3-srv_10.42.42.10(pid=10463): Terminating (SIGTERM) 18:07:29.006051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10464): Terminating (SIGTERM) 18:07:29.045908 run iperf3-srv_10.42.42.10(pid=10465): Terminating (SIGTERM) 18:07:29.085740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10468): Terminating (SIGTERM) 18:07:29.125733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10471): Terminating (SIGTERM) 18:07:29.165659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10474): Terminating (SIGTERM) 18:07:29.205762 --- ParallelTerminationStrategy: PID 10458 died... 18:07:29.224901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10458): Terminated: ok {rc=0} 18:07:29.269400 --- ParallelTerminationStrategy: PID 10459 died... 18:07:29.287964 run iperf3-srv_10.42.42.10(pid=10459): Terminated {rc=256} 18:07:29.331938 --- ParallelTerminationStrategy: PID 10460 died... 18:07:29.350543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10460): Terminated: ok {rc=0} 18:07:29.394810 --- ParallelTerminationStrategy: PID 10461 died... 18:07:29.413415 run iperf3-srv_10.42.42.10(pid=10461): Terminated {rc=256} 18:07:29.457395 --- ParallelTerminationStrategy: PID 10462 died... 18:07:29.475934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10462): Terminated: ok {rc=0} 18:07:29.520263 --- ParallelTerminationStrategy: PID 10463 died... 18:07:29.538834 run iperf3-srv_10.42.42.10(pid=10463): Terminated {rc=256} 18:07:29.582995 --- ParallelTerminationStrategy: PID 10464 died... 18:07:29.601519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10464): Terminated: ok {rc=0} 18:07:29.645718 --- ParallelTerminationStrategy: PID 10465 died... 18:07:29.664012 run iperf3-srv_10.42.42.10(pid=10465): Terminated {rc=256} 18:07:29.708362 --- ParallelTerminationStrategy: PID 10468 died... 18:07:29.726957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10468): Terminated: ok {rc=0} 18:07:29.771748 --- ParallelTerminationStrategy: PID 10471 died... 18:07:29.790417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10471): Terminated: ok {rc=0} 18:07:29.834299 --- ParallelTerminationStrategy: PID 10474 died... 18:07:29.853212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10474): Terminated: ok {rc=0} 18:07:29.940235 bus /gobi_4: Setting Powered False 18:07:31.047311 bus /gobi_4: Setting Powered False 18:07:32.171653 bus /gobi_1: Setting Powered False 18:07:33.271781 bus /gobi_1: Setting Powered False 18:07:34.387779 bus /gobi_0: Setting Powered False 18:07:35.484648 bus /gobi_0: Setting Powered False 18:07:36.597417 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:07:37.701558 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:37.713853 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:07:37.786855 tst ping.py: using LAC 30563 18:07:37.913157 tst ping.py: using RAC 218 18:07:38.038738 tst ping.py: using CellId 30563 18:07:38.166998 tst ping.py: using BVCI 30564 18:07:38.283954 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:38.297374 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:38.308629 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:38.320403 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:38.331737 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:38.343145 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:38.354853 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:38.366159 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:07:38.487910 tst ping.py:19: start network... 18:07:38.704559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:39.202089 run create_hlr_db(pid=10476): Launched 18:07:39.335307 bus /gobi_6: Setting Powered False 18:07:40.400054 run create_hlr_db(pid=10476): Terminated: ok {rc=0} 18:07:40.832699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10478): Launched 18:07:41.137463 run osmo-hlr_10.42.42.2(pid=10479): Launched 18:07:41.254602 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:41.783121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10481): Launched 18:07:42.087117 run osmo-stp_10.42.42.5(pid=10482): Launched 18:07:42.204919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:42.725197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10484): Launched 18:07:42.842580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:43.097512 run patchelf(pid=10485): Launched 18:07:43.265533 run osmo-stp_10.42.42.5(pid=10482): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10482)] 18:07:43.392755 run osmo-stp_10.42.42.5(pid=10482): stdout: | (launched: 2022-12-12_18:07:42.030519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:43.522205 run osmo-stp_10.42.42.5(pid=10482): stderr: | [0;m[38;5;43m20221212180742198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180742199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180742199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180742199 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180742200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180742200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180742200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:43.651408 run osmo-stp_10.42.42.5(pid=10482): stdout: | (launched: 2022-12-12_18:07:42.030519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:43.774509 run osmo-stp_10.42.42.5(pid=10482): stderr: | [0;m[38;5;43m20221212180742198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180742199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180742199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180742199 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180742200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180742200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180742200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:43.920413 run patchelf(pid=10485): Terminating (SIGINT) 18:07:44.088654 run patchelf(pid=10485): Terminated: ok {rc=0} 18:07:44.210651 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10482): Process ended prematurely: osmo-stp_10.42.42.5(pid=10482) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10482)] [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 18:07:44.219658 tst ping.py:22: Test FAILED (6.5 sec) 18:07:44.246837 run osmo-hlr_10.42.42.2(pid=10479): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10479)] 18:07:44.294944 run osmo-hlr_10.42.42.2(pid=10479): stdout: | (launched: 2022-12-12_18:07:41.080556) 18:07:44.344392 run osmo-hlr_10.42.42.2(pid=10479): stderr: | [0;m[1;31m20221212180741256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180741256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180741256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180741256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180741256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180741256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180741268 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180741276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180741276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180741276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:44.394226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10478): Terminating (SIGTERM) 18:07:44.434294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10481): Terminating (SIGTERM) 18:07:44.474231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10484): Terminating (SIGTERM) 18:07:44.514538 --- ParallelTerminationStrategy: PID 10478 died... 18:07:44.533372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10478): Terminated: ok {rc=0} 18:07:44.578188 --- ParallelTerminationStrategy: PID 10481 died... 18:07:44.597268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10481): Terminated: ok {rc=0} 18:07:44.641623 --- ParallelTerminationStrategy: PID 10484 died... 18:07:44.660340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10484): Terminated: ok {rc=0} 18:07:44.744061 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:07:45.829609 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:45.856799 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:07:45.944428 tst ping_idle_ping.py: using LAC 30564 18:07:46.080610 tst ping_idle_ping.py: using RAC 219 18:07:46.202609 tst ping_idle_ping.py: using CellId 30564 18:07:46.360392 tst ping_idle_ping.py: using BVCI 30565 18:07:46.480428 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:46.492353 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:46.504073 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:46.515784 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:46.527742 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:46.539373 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:46.551188 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:07:46.563083 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:07:46.684305 tst ping_idle_ping.py:24: start network... 18:07:46.943530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:47.449681 run create_hlr_db(pid=10486): Launched 18:07:47.580777 bus /gobi_6: Setting Powered False 18:07:48.644396 run create_hlr_db(pid=10486): Terminated: ok {rc=0} 18:07:49.093486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10488): Launched 18:07:49.418983 run osmo-hlr_10.42.42.2(pid=10489): Launched 18:07:49.543004 run osmo-stp_10.42.42.5: Starting osmo-stp 18:07:50.099942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10491): Launched 18:07:50.426045 run osmo-stp_10.42.42.5(pid=10492): Launched 18:07:50.550092 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:07:51.106409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10494): Launched 18:07:51.230747 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:07:51.504286 run patchelf(pid=10495): Launched 18:07:51.684420 run osmo-stp_10.42.42.5(pid=10492): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10492)] 18:07:51.819601 run osmo-stp_10.42.42.5(pid=10492): stdout: | (launched: 2022-12-12_18:07:50.365788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:51.956564 run osmo-stp_10.42.42.5(pid=10492): stderr: | [0;m[38;5;43m20221212180750556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180750557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180750557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180750558 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180750558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180750558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180750558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:52.093816 run osmo-stp_10.42.42.5(pid=10492): stdout: | (launched: 2022-12-12_18:07:50.365788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:07:52.225431 run osmo-stp_10.42.42.5(pid=10492): stderr: | [0;m[38;5;43m20221212180750556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180750557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180750557 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180750558 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180750558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180750558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180750558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:07:52.382114 run patchelf(pid=10495): Terminating (SIGINT) 18:07:52.561558 run patchelf(pid=10495): Terminated: ok {rc=0} 18:07:52.690621 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10492): Process ended prematurely: osmo-stp_10.42.42.5(pid=10492) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10492)] [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:07:52.700401 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 18:07:52.728675 run osmo-hlr_10.42.42.2(pid=10489): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10489)] 18:07:52.778276 run osmo-hlr_10.42.42.2(pid=10489): stdout: | (launched: 2022-12-12_18:07:49.358611) 18:07:52.829657 run osmo-hlr_10.42.42.2(pid=10489): stderr: | [0;m[1;31m20221212180749555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180749555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180749555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180749555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180749555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180749555 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180749568 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180749577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180749577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180749577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:07:52.881410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10488): Terminating (SIGTERM) 18:07:52.922894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10491): Terminating (SIGTERM) 18:07:52.964626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10494): Terminating (SIGTERM) 18:07:53.006621 --- ParallelTerminationStrategy: PID 10488 died... 18:07:53.026225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10488): Terminated: ok {rc=0} 18:07:53.072074 --- ParallelTerminationStrategy: PID 10491 died... 18:07:53.091417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10491): Terminated: ok {rc=0} 18:07:53.137530 --- ParallelTerminationStrategy: PID 10494 died... 18:07:53.157147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10494): Terminated: ok {rc=0} 18:07:53.244894 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 18:07:54.556639 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:07:54.563837 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 18:07:54.598037 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 18:07:54.638231 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 18:07:54.728016 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 18:07:54.762047 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 18:07:54.801453 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 18:07:55.404626 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 18:07:55.457535 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:07:55.469491 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:07:55.523537 tst cs_paging_gprs_active.py: using LAC 30565 18:07:55.653844 tst cs_paging_gprs_active.py: using RAC 220 18:07:55.781957 tst cs_paging_gprs_active.py: using CellId 30565 18:07:55.912044 tst cs_paging_gprs_active.py: using BVCI 30566 18:07:56.031361 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:07:56.043350 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:07:56.055097 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:07:56.066876 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:07:56.078727 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:07:56.090394 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:07:56.102291 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:07:56.113893 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:07:56.125792 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:07:56.246946 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:07:56.369643 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:07:56.593624 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:56.925132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10500): Launched 18:07:57.214345 run iperf3-srv_10.42.42.10(pid=10501): Launched 18:07:57.338576 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:07:57.561070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:07:57.892139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10502): Launched 18:07:58.179855 run iperf3-srv_10.42.42.10(pid=10503): Launched 18:07:58.306251 tst cs_paging_gprs_active.py:38: start network... 18:07:58.528916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:07:59.039982 run create_hlr_db(pid=10504): Launched 18:07:59.174769 bus /gobi_6: Setting Powered False 18:08:00.240122 run create_hlr_db(pid=10504): Terminated: ok {rc=0} 18:08:00.681535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10506): Launched 18:08:01.015290 run osmo-hlr_10.42.42.2(pid=10507): Launched 18:08:01.302474 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:02.010022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10509): Launched 18:08:02.360666 run osmo-stp_10.42.42.5(pid=10510): Launched 18:08:02.487925 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:03.056842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10512): Launched 18:08:03.184408 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:03.464424 run patchelf(pid=10513): Launched 18:08:03.649353 run osmo-stp_10.42.42.5(pid=10510): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10510)] 18:08:03.787942 run osmo-stp_10.42.42.5(pid=10510): stdout: | (launched: 2022-12-12_18:08:02.298076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:03.928523 run osmo-stp_10.42.42.5(pid=10510): stderr: | [0;m[38;5;43m20221212180802488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180802488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180802489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180802489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180802490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180802490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180802490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:04.068510 run osmo-stp_10.42.42.5(pid=10510): stdout: | (launched: 2022-12-12_18:08:02.298076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:04.202759 run osmo-stp_10.42.42.5(pid=10510): stderr: | [0;m[38;5;43m20221212180802488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180802488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180802489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180802489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180802490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180802490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180802490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:04.363147 run patchelf(pid=10513): Terminating (SIGINT) 18:08:04.546851 run patchelf(pid=10513): Terminated: ok {rc=0} 18:08:04.679022 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10510): Process ended prematurely: osmo-stp_10.42.42.5(pid=10510) [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10510)] [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 18:08:04.689496 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 18:08:04.718625 run osmo-hlr_10.42.42.2(pid=10507): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10507)] 18:08:04.769180 run osmo-hlr_10.42.42.2(pid=10507): stdout: | (launched: 2022-12-12_18:08:00.951252) 18:08:04.821291 run osmo-hlr_10.42.42.2(pid=10507): stderr: | [0;m[1;31m20221212180801342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180801342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180801342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180801342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180801342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180801342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180801369 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180801388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180801390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180801391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:04.873798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10500): Terminating (SIGTERM) 18:08:04.916136 run iperf3-srv_10.42.42.10(pid=10501): Terminating (SIGTERM) 18:08:04.958430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10502): Terminating (SIGTERM) 18:08:05.001076 run iperf3-srv_10.42.42.10(pid=10503): Terminating (SIGTERM) 18:08:05.043305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10506): Terminating (SIGTERM) 18:08:05.086257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10509): Terminating (SIGTERM) 18:08:05.128611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10512): Terminating (SIGTERM) 18:08:05.171666 --- ParallelTerminationStrategy: PID 10500 died... 18:08:05.191828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10500): Terminated: ok {rc=0} 18:08:05.238416 --- ParallelTerminationStrategy: PID 10501 died... 18:08:05.258139 run iperf3-srv_10.42.42.10(pid=10501): Terminated {rc=256} 18:08:05.304437 --- ParallelTerminationStrategy: PID 10502 died... 18:08:05.324096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10502): Terminated: ok {rc=0} 18:08:05.370910 --- ParallelTerminationStrategy: PID 10503 died... 18:08:05.391015 run iperf3-srv_10.42.42.10(pid=10503): Terminated {rc=256} 18:08:05.437323 --- ParallelTerminationStrategy: PID 10506 died... 18:08:05.457156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10506): Terminated: ok {rc=0} 18:08:05.503467 --- ParallelTerminationStrategy: PID 10509 died... 18:08:05.523418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10509): Terminated: ok {rc=0} 18:08:05.569753 --- ParallelTerminationStrategy: PID 10512 died... 18:08:05.589647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10512): Terminated: ok {rc=0} 18:08:05.678616 bus /gobi_0: Setting Powered False 18:08:06.780031 bus /gobi_0: Setting Powered False 18:08:07.900356 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 18:08:09.052520 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:09.065338 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:08:09.122836 tst iperf3.py: using LAC 30566 18:08:09.256401 tst iperf3.py: using RAC 221 18:08:09.385214 tst iperf3.py: using CellId 30566 18:08:09.511379 tst iperf3.py: using BVCI 30567 18:08:09.630375 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:09.642249 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:09.653922 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:09.665731 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:09.677242 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:09.688812 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:09.700555 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:09.712061 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:09.723785 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:08:09.844831 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:08:10.066969 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:10.398446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10514): Launched 18:08:10.688248 run iperf3-srv_10.42.42.10(pid=10515): Launched 18:08:10.813946 tst iperf3.py:8: start network... 18:08:11.035732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:11.547291 run create_hlr_db(pid=10516): Launched 18:08:11.674193 bus /gobi_6: Setting Powered False 18:08:12.736484 run create_hlr_db(pid=10516): Terminated: ok {rc=0} 18:08:13.165740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10518): Launched 18:08:13.474671 run osmo-hlr_10.42.42.2(pid=10519): Launched 18:08:13.595465 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:14.141231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10521): Launched 18:08:14.452432 run osmo-stp_10.42.42.5(pid=10522): Launched 18:08:14.571327 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:15.099653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10524): Launched 18:08:15.219013 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:15.478817 run patchelf(pid=10525): Launched 18:08:15.651534 run osmo-stp_10.42.42.5(pid=10522): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10522)] 18:08:15.780602 run osmo-stp_10.42.42.5(pid=10522): stdout: | (launched: 2022-12-12_18:08:14.394395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:15.934632 run osmo-stp_10.42.42.5(pid=10522): stderr: | [0;m[38;5;43m20221212180814563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180814563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180814563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180814564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180814564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180814564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180814564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:16.097007 run osmo-stp_10.42.42.5(pid=10522): stdout: | (launched: 2022-12-12_18:08:14.394395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:16.265990 run osmo-stp_10.42.42.5(pid=10522): stderr: | [0;m[38;5;43m20221212180814563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180814563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180814563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180814564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180814564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180814564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180814564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:16.442362 run patchelf(pid=10525): Terminating (SIGINT) 18:08:16.651129 run patchelf(pid=10525): Terminated: ok {rc=0} 18:08:16.782610 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10522): Process ended prematurely: osmo-stp_10.42.42.5(pid=10522) [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10522)] [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 18:08:16.793452 tst iperf3.py:8: Test FAILED (7.8 sec) 18:08:16.824716 run osmo-hlr_10.42.42.2(pid=10519): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10519)] 18:08:16.875618 run osmo-hlr_10.42.42.2(pid=10519): stdout: | (launched: 2022-12-12_18:08:13.417138) 18:08:16.928010 run osmo-hlr_10.42.42.2(pid=10519): stderr: | [0;m[1;31m20221212180813592 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180813593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180813593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180813593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180813593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180813593 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180813605 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180813614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180813614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180813614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:16.981322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10514): Terminating (SIGTERM) 18:08:17.024531 run iperf3-srv_10.42.42.10(pid=10515): Terminating (SIGTERM) 18:08:17.070411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10518): Terminating (SIGTERM) 18:08:17.113560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10521): Terminating (SIGTERM) 18:08:17.156509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10524): Terminating (SIGTERM) 18:08:17.199593 --- ParallelTerminationStrategy: PID 10514 died... 18:08:17.219480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10514): Terminated: ok {rc=0} 18:08:17.266691 --- ParallelTerminationStrategy: PID 10515 died... 18:08:17.286468 run iperf3-srv_10.42.42.10(pid=10515): Terminated {rc=256} 18:08:17.333758 --- ParallelTerminationStrategy: PID 10518 died... 18:08:17.352686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10518): Terminated: ok {rc=0} 18:08:17.397181 --- ParallelTerminationStrategy: PID 10521 died... 18:08:17.415861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10521): Terminated: ok {rc=0} 18:08:17.459953 --- ParallelTerminationStrategy: PID 10524 died... 18:08:17.479027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10524): Terminated: ok {rc=0} 18:08:17.565669 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 18:08:18.714442 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:18.726906 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:08:18.780634 tst iperf3m4.py: using LAC 30567 18:08:18.902416 tst iperf3m4.py: using RAC 222 18:08:19.023962 tst iperf3m4.py: using CellId 30567 18:08:19.153171 tst iperf3m4.py: using BVCI 30568 18:08:19.273689 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:19.285699 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:19.297428 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:19.309131 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:19.320820 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:19.332571 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:19.344816 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:19.356483 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:19.368541 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:08:19.490689 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:08:19.611682 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:08:19.732445 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:08:19.855203 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:08:20.076940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:20.408654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10526): Launched 18:08:20.698265 run iperf3-srv_10.42.42.10(pid=10527): Launched 18:08:20.821982 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:08:21.043394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:21.374714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10528): Launched 18:08:21.662610 run iperf3-srv_10.42.42.10(pid=10529): Launched 18:08:21.785674 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:08:22.007037 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:22.338430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10530): Launched 18:08:22.625400 run iperf3-srv_10.42.42.10(pid=10531): Launched 18:08:22.749743 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:08:22.969719 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:08:23.299245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10532): Launched 18:08:23.586621 run iperf3-srv_10.42.42.10(pid=10533): Launched 18:08:23.709518 tst iperf3m4.py:8: start network... 18:08:23.929865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:24.438982 run create_hlr_db(pid=10534): Launched 18:08:24.572026 bus /gobi_6: Setting Powered False 18:08:25.636206 run create_hlr_db(pid=10534): Terminated: ok {rc=0} 18:08:26.073268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10536): Launched 18:08:26.383277 run osmo-hlr_10.42.42.2(pid=10537): Launched 18:08:26.502127 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:27.048794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10539): Launched 18:08:27.356527 run osmo-stp_10.42.42.5(pid=10540): Launched 18:08:27.474324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:28.000649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10542): Launched 18:08:28.119183 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:28.378234 run patchelf(pid=10543): Launched 18:08:28.549134 run osmo-stp_10.42.42.5(pid=10540): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10540)] 18:08:28.677857 run osmo-stp_10.42.42.5(pid=10540): stdout: | (launched: 2022-12-12_18:08:27.298909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:28.808424 run osmo-stp_10.42.42.5(pid=10540): stderr: | [0;m[38;5;43m20221212180827471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180827471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180827471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180827471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180827472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180827472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180827472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:28.939123 run osmo-stp_10.42.42.5(pid=10540): stdout: | (launched: 2022-12-12_18:08:27.298909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:29.063987 run osmo-stp_10.42.42.5(pid=10540): stderr: | [0;m[38;5;43m20221212180827471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180827471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180827471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180827471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180827472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180827472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180827472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:29.211854 run patchelf(pid=10543): Terminating (SIGINT) 18:08:29.383158 run patchelf(pid=10543): Terminated: ok {rc=0} 18:08:29.507120 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10540): Process ended prematurely: osmo-stp_10.42.42.5(pid=10540) [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10540)] [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 18:08:29.517183 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:08:29.545697 run osmo-hlr_10.42.42.2(pid=10537): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10537)] 18:08:29.593934 run osmo-hlr_10.42.42.2(pid=10537): stdout: | (launched: 2022-12-12_18:08:26.325823) 18:08:29.643882 run osmo-hlr_10.42.42.2(pid=10537): stderr: | [0;m[1;31m20221212180826499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180826499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180826499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180826499 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180826500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180826500 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180826512 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180826520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180826520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180826520 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:29.694351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10526): Terminating (SIGTERM) 18:08:29.734248 run iperf3-srv_10.42.42.10(pid=10527): Terminating (SIGTERM) 18:08:29.774174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10528): Terminating (SIGTERM) 18:08:29.814239 run iperf3-srv_10.42.42.10(pid=10529): Terminating (SIGTERM) 18:08:29.854175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10530): Terminating (SIGTERM) 18:08:29.894247 run iperf3-srv_10.42.42.10(pid=10531): Terminating (SIGTERM) 18:08:29.935694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10532): Terminating (SIGTERM) 18:08:29.976346 run iperf3-srv_10.42.42.10(pid=10533): Terminating (SIGTERM) 18:08:30.016740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10536): Terminating (SIGTERM) 18:08:30.057101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10539): Terminating (SIGTERM) 18:08:30.097178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10542): Terminating (SIGTERM) 18:08:30.137484 --- ParallelTerminationStrategy: PID 10526 died... 18:08:30.156671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10526): Terminated: ok {rc=0} 18:08:30.201419 --- ParallelTerminationStrategy: PID 10527 died... 18:08:30.219866 run iperf3-srv_10.42.42.10(pid=10527): Terminated {rc=256} 18:08:30.264153 --- ParallelTerminationStrategy: PID 10528 died... 18:08:30.282797 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10528): Terminated: ok {rc=0} 18:08:30.327734 --- ParallelTerminationStrategy: PID 10529 died... 18:08:30.346333 run iperf3-srv_10.42.42.10(pid=10529): Terminated {rc=256} 18:08:30.390898 --- ParallelTerminationStrategy: PID 10530 died... 18:08:30.409671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10530): Terminated: ok {rc=0} 18:08:30.453916 --- ParallelTerminationStrategy: PID 10531 died... 18:08:30.472415 run iperf3-srv_10.42.42.10(pid=10531): Terminated {rc=256} 18:08:30.516203 --- ParallelTerminationStrategy: PID 10532 died... 18:08:30.534819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10532): Terminated: ok {rc=0} 18:08:30.579081 --- ParallelTerminationStrategy: PID 10533 died... 18:08:30.597620 run iperf3-srv_10.42.42.10(pid=10533): Terminated {rc=256} 18:08:30.641555 --- ParallelTerminationStrategy: PID 10536 died... 18:08:30.660053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10536): Terminated: ok {rc=0} 18:08:30.704327 --- ParallelTerminationStrategy: PID 10539 died... 18:08:30.722966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10539): Terminated: ok {rc=0} 18:08:30.767183 --- ParallelTerminationStrategy: PID 10542 died... 18:08:30.785846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10542): Terminated: ok {rc=0} 18:08:30.876430 bus /gobi_4: Setting Powered False 18:08:31.976902 bus /gobi_4: Setting Powered False 18:08:33.093131 bus /gobi_1: Setting Powered False 18:08:34.192443 bus /gobi_1: Setting Powered False 18:08:35.308537 bus /gobi_0: Setting Powered False 18:08:36.406579 bus /gobi_0: Setting Powered False 18:08:37.522681 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 18:08:38.627007 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:38.639553 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:08:38.694710 tst ping.py: using LAC 30568 18:08:38.815526 tst ping.py: using RAC 223 18:08:38.941735 tst ping.py: using CellId 30568 18:08:39.067532 tst ping.py: using BVCI 30569 18:08:39.183810 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:39.195829 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:39.207563 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:39.219296 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:39.230875 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:39.242546 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:39.254296 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:39.265975 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:08:39.387251 tst ping.py:19: start network... 18:08:39.605367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:40.106115 run create_hlr_db(pid=10544): Launched 18:08:40.238969 bus /gobi_6: Setting Powered False 18:08:41.302542 run create_hlr_db(pid=10544): Terminated: ok {rc=0} 18:08:41.735757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10546): Launched 18:08:42.039655 run osmo-hlr_10.42.42.2(pid=10547): Launched 18:08:42.156246 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:42.694347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10549): Launched 18:08:42.999147 run osmo-stp_10.42.42.5(pid=10550): Launched 18:08:43.116140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:43.637167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10552): Launched 18:08:43.754491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:44.010475 run patchelf(pid=10553): Launched 18:08:44.181160 run osmo-stp_10.42.42.5(pid=10550): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10550)] 18:08:44.317382 run osmo-stp_10.42.42.5(pid=10550): stdout: | (launched: 2022-12-12_18:08:42.942486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:44.455850 run osmo-stp_10.42.42.5(pid=10550): stderr: | [0;m[38;5;43m20221212180843110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180843110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180843111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180843111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180843112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180843112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180843112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:44.593851 run osmo-stp_10.42.42.5(pid=10550): stdout: | (launched: 2022-12-12_18:08:42.942486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:44.726830 run osmo-stp_10.42.42.5(pid=10550): stderr: | [0;m[38;5;43m20221212180843110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180843110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180843111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180843111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180843112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180843112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180843112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:44.883281 run patchelf(pid=10553): Terminating (SIGINT) 18:08:45.064097 run patchelf(pid=10553): Terminated: ok {rc=0} 18:08:45.194095 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10550): Process ended prematurely: osmo-stp_10.42.42.5(pid=10550) [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10550)] [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 18:08:45.204018 tst ping.py:22: Test FAILED (6.6 sec) 18:08:45.232757 run osmo-hlr_10.42.42.2(pid=10547): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10547)] 18:08:45.283245 run osmo-hlr_10.42.42.2(pid=10547): stdout: | (launched: 2022-12-12_18:08:41.982988) 18:08:45.335524 run osmo-hlr_10.42.42.2(pid=10547): stderr: | [0;m[1;31m20221212180842155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180842155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180842155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180842155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180842155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180842155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180842168 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180842178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180842178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180842178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:45.388586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10546): Terminating (SIGTERM) 18:08:45.431152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10549): Terminating (SIGTERM) 18:08:45.473659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10552): Terminating (SIGTERM) 18:08:45.516017 --- ParallelTerminationStrategy: PID 10546 died... 18:08:45.536402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10546): Terminated: ok {rc=0} 18:08:45.583081 --- ParallelTerminationStrategy: PID 10549 died... 18:08:45.603024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10549): Terminated: ok {rc=0} 18:08:45.649848 --- ParallelTerminationStrategy: PID 10552 died... 18:08:45.670181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10552): Terminated: ok {rc=0} 18:08:45.758670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 18:08:46.860112 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:46.886068 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:08:46.961312 tst ping_idle_ping.py: using LAC 30569 18:08:47.126638 tst ping_idle_ping.py: using RAC 224 18:08:47.309580 tst ping_idle_ping.py: using CellId 30569 18:08:47.485309 tst ping_idle_ping.py: using BVCI 30570 18:08:47.640679 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:47.656713 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:47.670811 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:47.684511 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:47.696858 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:47.716553 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:47.729457 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:08:47.744021 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:08:47.880400 tst ping_idle_ping.py:24: start network... 18:08:48.133290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:48.712667 run create_hlr_db(pid=10772): Launched 18:08:48.901195 bus /gobi_6: Setting Powered False 18:08:49.957617 run create_hlr_db(pid=10772): Terminated: ok {rc=0} 18:08:50.428188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10826): Launched 18:08:50.757753 run osmo-hlr_10.42.42.2(pid=10828): Launched 18:08:51.000933 run osmo-stp_10.42.42.5: Starting osmo-stp 18:08:51.660789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10831): Launched 18:08:51.998094 run osmo-stp_10.42.42.5(pid=10832): Launched 18:08:52.266929 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:08:52.908351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10834): Launched 18:08:53.038382 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:08:53.299119 run patchelf(pid=10835): Launched 18:08:53.486123 run osmo-stp_10.42.42.5(pid=10832): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10832)] 18:08:53.619212 run osmo-stp_10.42.42.5(pid=10832): stdout: | (launched: 2022-12-12_18:08:51.938031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:53.752169 run osmo-stp_10.42.42.5(pid=10832): stderr: | [0;m[38;5;43m20221212180852251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180852252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180852252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180852252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180852253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180852253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180852253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:53.887183 run osmo-stp_10.42.42.5(pid=10832): stdout: | (launched: 2022-12-12_18:08:51.938031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:08:54.015910 run osmo-stp_10.42.42.5(pid=10832): stderr: | [0;m[38;5;43m20221212180852251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180852252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180852252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180852252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180852253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180852253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180852253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:08:54.166312 run patchelf(pid=10835): Terminating (SIGINT) 18:08:54.339551 run patchelf(pid=10835): Terminated: ok {rc=0} 18:08:54.466985 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10832): Process ended prematurely: osmo-stp_10.42.42.5(pid=10832) [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10832)] [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 18:08:54.477544 tst ping_idle_ping.py:27: Test FAILED (7.6 sec) 18:08:54.507295 run osmo-hlr_10.42.42.2(pid=10828): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10828)] 18:08:54.560308 run osmo-hlr_10.42.42.2(pid=10828): stdout: | (launched: 2022-12-12_18:08:50.696658) 18:08:54.615478 run osmo-hlr_10.42.42.2(pid=10828): stderr: | [0;m[1;31m20221212180850989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180850989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180850989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180850989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180850989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180850989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180851010 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180851026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180851027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180851027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:08:54.669246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10826): Terminating (SIGTERM) 18:08:54.712414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10831): Terminating (SIGTERM) 18:08:54.757845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10834): Terminating (SIGTERM) 18:08:54.803392 --- ParallelTerminationStrategy: PID 10826 died... 18:08:54.824639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10826): Terminated: ok {rc=0} 18:08:54.874404 --- ParallelTerminationStrategy: PID 10831 died... 18:08:54.894390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10831): Terminated: ok {rc=0} 18:08:54.942215 --- ParallelTerminationStrategy: PID 10834 died... 18:08:54.962791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10834): Terminated: ok {rc=0} 18:08:55.053747 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:08:56.366344 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:08:56.374092 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:08:56.413522 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:08:56.450945 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:08:56.505659 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:08:56.541565 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:08:56.579005 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:08:57.135715 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:08:57.142153 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:08:57.155838 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:08:57.229452 tst switch_tch_pdch.py: using LAC 30570 18:08:57.357637 tst switch_tch_pdch.py: using RAC 225 18:08:57.482780 tst switch_tch_pdch.py: using CellId 30570 18:08:57.608042 tst switch_tch_pdch.py: using BVCI 30571 18:08:57.726679 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:08:57.739650 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:08:57.752654 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:08:57.765413 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:08:57.778148 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:08:57.791050 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:08:57.804316 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:08:57.816937 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:08:57.943459 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:08:58.066951 tst switch_tch_pdch.py:51: start network... 18:08:58.287203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:08:58.795479 run create_hlr_db(pid=10841): Launched 18:08:58.962522 bus /gobi_6: Setting Powered False 18:09:00.028021 run create_hlr_db(pid=10841): Terminated: ok {rc=0} 18:09:00.490457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10843): Launched 18:09:00.842763 run osmo-hlr_10.42.42.2(pid=10844): Launched 18:09:01.140110 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:01.929395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10846): Launched 18:09:02.277684 run osmo-stp_10.42.42.5(pid=10847): Launched 18:09:02.515109 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:03.224213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10849): Launched 18:09:03.355250 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:03.618912 run patchelf(pid=10850): Launched 18:09:03.806014 run osmo-stp_10.42.42.5(pid=10847): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10847)] 18:09:03.936468 run osmo-stp_10.42.42.5(pid=10847): stdout: | (launched: 2022-12-12_18:09:02.211844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:04.069513 run osmo-stp_10.42.42.5(pid=10847): stderr: | [0;m[38;5;43m20221212180902515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180902515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180902515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180902515 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180902516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180902516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180902516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:04.201772 run osmo-stp_10.42.42.5(pid=10847): stdout: | (launched: 2022-12-12_18:09:02.211844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:04.328270 run osmo-stp_10.42.42.5(pid=10847): stderr: | [0;m[38;5;43m20221212180902515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180902515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180902515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180902515 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180902516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180902516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180902516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:04.478194 run patchelf(pid=10850): Terminating (SIGINT) 18:09:04.650888 run patchelf(pid=10850): Terminated: ok {rc=0} 18:09:04.776731 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10847): Process ended prematurely: osmo-stp_10.42.42.5(pid=10847) [trial-2380↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10847)] [trial-2380↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:09:04.787125 tst switch_tch_pdch.py:54: Test FAILED (7.6 sec) 18:09:04.818129 run osmo-hlr_10.42.42.2(pid=10844): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10844)] 18:09:04.868869 run osmo-hlr_10.42.42.2(pid=10844): stdout: | (launched: 2022-12-12_18:09:00.773698) 18:09:04.921520 run osmo-hlr_10.42.42.2(pid=10844): stderr: | [0;m[1;31m20221212180901142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180901142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180901142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180901142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180901142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180901142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180901159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180901176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180901176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180901176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:04.974916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10843): Terminating (SIGTERM) 18:09:05.018318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10846): Terminating (SIGTERM) 18:09:05.063455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10849): Terminating (SIGTERM) 18:09:05.108817 --- ParallelTerminationStrategy: PID 10843 died... 18:09:05.129350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10843): Terminated: ok {rc=0} 18:09:05.178702 --- ParallelTerminationStrategy: PID 10846 died... 18:09:05.198732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10846): Terminated: ok {rc=0} 18:09:05.246509 --- ParallelTerminationStrategy: PID 10849 died... 18:09:05.266526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10849): Terminated: ok {rc=0} 18:09:05.356423 bus /gobi_0: Setting Powered False 18:09:06.458389 bus /gobi_0: Setting Powered False 18:09:07.576545 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:09:08.840019 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:09:08.847149 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:09:08.885488 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:09:08.923780 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:09:08.979210 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:09:09.015272 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:09:09.053602 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:09:09.603260 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:09:09.610511 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:09:09.622694 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:09:09.698797 tst switch_tch_pdch.py: using LAC 30571 18:09:09.821362 tst switch_tch_pdch.py: using RAC 226 18:09:09.944516 tst switch_tch_pdch.py: using CellId 30571 18:09:10.068495 tst switch_tch_pdch.py: using BVCI 30572 18:09:10.183601 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:09:10.195786 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:09:10.208707 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:09:10.222994 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:09:10.236099 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:09:10.249133 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:09:10.263705 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:09:10.277027 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:09:10.399994 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:09:10.525030 tst switch_tch_pdch.py:51: start network... 18:09:10.737285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:11.212602 run create_hlr_db(pid=10855): Launched 18:09:11.344645 bus /gobi_6: Setting Powered False 18:09:12.408876 run create_hlr_db(pid=10855): Terminated: ok {rc=0} 18:09:12.814764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10857): Launched 18:09:13.118466 run osmo-hlr_10.42.42.2(pid=10858): Launched 18:09:13.235611 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:13.741352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10860): Launched 18:09:14.045623 run osmo-stp_10.42.42.5(pid=10861): Launched 18:09:14.162440 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:09:14.656505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10863): Launched 18:09:14.772794 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:09:15.028650 run patchelf(pid=10864): Launched 18:09:15.196691 run osmo-stp_10.42.42.5(pid=10861): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10861)] 18:09:15.324148 run osmo-stp_10.42.42.5(pid=10861): stdout: | (launched: 2022-12-12_18:09:13.988684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:15.453225 run osmo-stp_10.42.42.5(pid=10861): stderr: | [0;m[38;5;43m20221212180914157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180914157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180914158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180914158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180914158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180914159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180914159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:15.582165 run osmo-stp_10.42.42.5(pid=10861): stdout: | (launched: 2022-12-12_18:09:13.988684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:15.705732 run osmo-stp_10.42.42.5(pid=10861): stderr: | [0;m[38;5;43m20221212180914157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180914157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180914158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180914158 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180914158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180914159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180914159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:15.856232 run patchelf(pid=10864): Terminating (SIGINT) 18:09:16.056394 run patchelf(pid=10864): Terminated: ok {rc=0} 18:09:16.188805 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10861): Process ended prematurely: osmo-stp_10.42.42.5(pid=10861) [trial-2380↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10861)] [trial-2380↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:09:16.198986 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 18:09:16.228840 run osmo-hlr_10.42.42.2(pid=10858): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10858)] 18:09:16.282722 run osmo-hlr_10.42.42.2(pid=10858): stdout: | (launched: 2022-12-12_18:09:13.061895) 18:09:16.336313 run osmo-hlr_10.42.42.2(pid=10858): stderr: | [0;m[1;31m20221212180913235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180913235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180913235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180913235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180913235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180913235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180913246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180913256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180913257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180913257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:16.390921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10857): Terminating (SIGTERM) 18:09:16.435331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10860): Terminating (SIGTERM) 18:09:16.480447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10863): Terminating (SIGTERM) 18:09:16.525910 --- ParallelTerminationStrategy: PID 10857 died... 18:09:16.546438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10857): Terminated: ok {rc=0} 18:09:16.596722 --- ParallelTerminationStrategy: PID 10860 died... 18:09:16.617628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10860): Terminated: ok {rc=0} 18:09:16.667260 --- ParallelTerminationStrategy: PID 10863 died... 18:09:16.687680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10863): Terminated: ok {rc=0} 18:09:16.784678 bus /gobi_0: Setting Powered False 18:09:17.898955 bus /gobi_0: Setting Powered False 18:09:19.013671 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 18:09:20.271921 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:09:20.276244 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 18:09:20.311085 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 18:09:20.318134 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 18:09:20.372012 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 18:09:20.406843 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 18:09:20.413966 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 18:09:20.954170 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 18:09:20.959383 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 18:09:20.970946 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 18:09:21.020319 tst mo_mt_sms.py: using LAC 30572 18:09:21.145403 tst mo_mt_sms.py: using RAC 227 18:09:21.271071 tst mo_mt_sms.py: using CellId 30572 18:09:21.396928 tst mo_mt_sms.py: using BVCI 30573 18:09:21.513776 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:09:21.627976 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:09:21.743280 tst mo_mt_sms.py:9: start nitb and bts... 18:09:21.946399 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:09:22.561660 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10869): Launched 18:09:22.864111 run osmo-nitb_10.42.42.2(pid=10870): Launched 18:09:23.033929 run osmo-nitb_10.42.42.2(pid=10870): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10870)] 18:09:23.168915 run osmo-nitb_10.42.42.2(pid=10870): stdout: | (launched: 2022-12-12_18:09:22.807502) 18:09:23.305126 run osmo-nitb_10.42.42.2(pid=10870): stderr: | (launched: 2022-12-12_18:09:22.852121) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:09:23.441467 run osmo-nitb_10.42.42.2(pid=10870): stdout: | (launched: 2022-12-12_18:09:22.807502) 18:09:23.572425 run osmo-nitb_10.42.42.2(pid=10870): stderr: | (launched: 2022-12-12_18:09:22.852121) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10870): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10870) [trial-2380↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10870)] 18:09:23.980214 tst osmo-nitb_10.42.42.2(pid=10870): stdout: | (launched: 2022-12-12_18:09:22.807502) 18:09:24.102143 tst osmo-nitb_10.42.42.2(pid=10870): stderr: | (launched: 2022-12-12_18:09:22.852121) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:09:24.246338 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=10870): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10870) [trial-2380↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10870)] [trial-2380↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 18:09:24.254812 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 18:09:24.261539 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10869): Terminating (SIGTERM) 18:09:24.473172 --- ParallelTerminationStrategy: PID 10869 died... 18:09:24.493765 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10869): Terminated: ok {rc=0} 18:09:24.580735 bus /sierra_3: Setting Powered False 18:09:25.681677 bus /sierra_3: Setting Powered False 18:09:26.801444 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 sms:trx-sysmocell5000 --------------------------------------------------------------------- 18:09:28.004704 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:09:28.009325 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 18:09:28.044073 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:09:28.071686 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 18:09:28.125270 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 18:09:28.159626 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:09:28.186822 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 18:09:28.736176 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 18:09:28.741430 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:09:28.752680 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 18:09:28.802248 tst mo_mt_sms.py: using LAC 30573 18:09:28.927820 tst mo_mt_sms.py: using RAC 228 18:09:29.053955 tst mo_mt_sms.py: using CellId 30573 18:09:29.179617 tst mo_mt_sms.py: using BVCI 30574 18:09:29.295921 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:09:29.307209 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:09:29.318412 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:09:29.329529 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:09:29.340566 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:09:29.352078 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:09:29.470340 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 18:09:29.584092 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:30.052561 run create_hlr_db(pid=10874): Launched 18:09:30.169277 bus /sierra_2: Setting Powered False 18:09:31.228032 run create_hlr_db(pid=10874): Terminated: ok {rc=0} 18:09:31.659905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10876): Launched 18:09:31.981709 run osmo-hlr_10.42.42.2(pid=10877): Launched 18:09:32.183985 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:32.718057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10879): Launched 18:09:33.020136 run osmo-stp_10.42.42.5(pid=10880): Launched 18:09:33.137707 run osmo-msc_10.42.42.6: Starting osmo-msc 18:09:33.680412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10882): Launched 18:09:33.985561 run osmo-msc_10.42.42.6(pid=10883): Launched 18:09:34.156370 run osmo-stp_10.42.42.5(pid=10880): ERR: Terminated: ERROR {rc=1} [trial-2380↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10880)] 18:09:34.283344 run osmo-stp_10.42.42.5(pid=10880): stdout: | (launched: 2022-12-12_18:09:32.963507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:34.422206 run osmo-stp_10.42.42.5(pid=10880): stderr: | [0;m[38;5;43m20221212180933132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180933132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180933133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180933133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180933134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180933134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180933134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:34.556209 run osmo-stp_10.42.42.5(pid=10880): stdout: | (launched: 2022-12-12_18:09:32.963507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:34.684333 run osmo-stp_10.42.42.5(pid=10880): stderr: | [0;m[38;5;43m20221212180933132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180933132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180933133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180933133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180933134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180933134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180933134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:34.837727 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10880): Process ended prematurely: osmo-stp_10.42.42.5(pid=10880) [trial-2380↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10880)] [trial-2380↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 18:09:34.846796 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 18:09:34.874448 run osmo-hlr_10.42.42.2(pid=10877): ERR: Terminated: ERROR {rc=237} [trial-2380↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10877)] 18:09:34.924801 run osmo-hlr_10.42.42.2(pid=10877): stdout: | (launched: 2022-12-12_18:09:31.923521) 18:09:34.976788 run osmo-hlr_10.42.42.2(pid=10877): stderr: | [0;m[1;31m20221212180932169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180932169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180932169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180932169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180932169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180932170 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180932184 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180932205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180932205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180932205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:35.049571 run osmo-msc_10.42.42.6(pid=10883): ERR: Terminated: ERROR {rc=2} [trial-2380↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10883)] 18:09:35.100199 run osmo-msc_10.42.42.6(pid=10883): stdout: | (launched: 2022-12-12_18:09:33.928521) 18:09:35.152054 run osmo-msc_10.42.42.6(pid=10883): stderr: | [0;m[38;5;43m20221212180934196 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180934196 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8d479ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180934196 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180934197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180934197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180934197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180934199 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180934199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180934199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180934199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:09:35.204541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10876): Terminating (SIGTERM) 18:09:35.246527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10879): Terminating (SIGTERM) 18:09:35.288423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10882): Terminating (SIGTERM) 18:09:35.330853 --- ParallelTerminationStrategy: PID 10876 died... 18:09:35.351072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10876): Terminated: ok {rc=0} 18:09:35.398253 --- ParallelTerminationStrategy: PID 10879 died... 18:09:35.417921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10879): Terminated: ok {rc=0} 18:09:35.464150 --- ParallelTerminationStrategy: PID 10882 died... 18:09:35.483872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10882): Terminated: ok {rc=0} 18:09:35.572874 bus /sierra_3: Setting Powered False 18:09:36.672613 bus /sierra_3: Setting Powered False 18:09:37.789610 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 18:09:39.024198 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:09:39.028680 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 18:09:39.063452 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 18:09:39.070517 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 18:09:39.107845 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 18:09:39.142735 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 18:09:39.149797 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 18:09:39.668862 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2380 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 18:09:39.674364 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 18:09:39.686015 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 18:09:39.735410 tst assert_extension.py: using LAC 30574 18:09:39.860804 tst assert_extension.py: using RAC 229 18:09:39.987376 tst assert_extension.py: using CellId 30574 18:09:40.106670 tst assert_extension.py: using BVCI 30575 18:09:40.217357 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 18:09:40.336404 tst assert_extension.py:10: start nitb and bts... 18:09:40.553308 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:09:41.211192 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10889): Launched 18:09:41.537028 run osmo-nitb_10.42.42.2(pid=10890): Launched 18:09:41.717313 run osmo-nitb_10.42.42.2(pid=10890): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10890)] 18:09:41.860709 run osmo-nitb_10.42.42.2(pid=10890): stdout: | (launched: 2022-12-12_18:09:41.476667) 18:09:42.005591 run osmo-nitb_10.42.42.2(pid=10890): stderr: | (launched: 2022-12-12_18:09:41.524613) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:09:42.150562 run osmo-nitb_10.42.42.2(pid=10890): stdout: | (launched: 2022-12-12_18:09:41.476667) 18:09:42.289960 run osmo-nitb_10.42.42.2(pid=10890): stderr: | (launched: 2022-12-12_18:09:41.524613) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10890): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10890) [trial-2380↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10890)] 18:09:42.660163 tst osmo-nitb_10.42.42.2(pid=10890): stdout: | (launched: 2022-12-12_18:09:41.476667) 18:09:42.789996 tst osmo-nitb_10.42.42.2(pid=10890): stderr: | (launched: 2022-12-12_18:09:41.524613) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:09:42.943676 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10890): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10890) [trial-2380↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10890)] [trial-2380↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 18:09:42.952836 tst assert_extension.py:12: Test FAILED (3.3 sec) 18:09:42.960256 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10889): Terminating (SIGTERM) 18:09:43.171249 --- ParallelTerminationStrategy: PID 10889 died... 18:09:43.193132 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10889): Terminated: ok {rc=0} 18:09:43.282137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 18:09:44.466839 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:09:44.471555 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 18:09:44.506458 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:09:44.533964 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 18:09:44.571584 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 18:09:44.605595 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:09:44.632532 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 18:09:45.167119 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2380 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 18:09:45.172321 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:09:45.183595 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 18:09:45.233495 tst assert_extension.py: using LAC 30575 18:09:45.354565 tst assert_extension.py: using RAC 230 18:09:45.474309 tst assert_extension.py: using CellId 30575 18:09:45.592124 tst assert_extension.py: using BVCI 30576 18:09:45.702967 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:09:45.713981 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:09:45.724475 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:09:45.735378 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:09:45.746248 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:09:45.757025 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 18:09:45.898963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:46.378413 run create_hlr_db(pid=10894): Launched 18:09:46.507410 bus /sierra_2: Setting Powered False 18:09:47.568250 run create_hlr_db(pid=10894): Terminated: ok {rc=0} 18:09:47.988431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10896): Launched 18:09:48.292045 run osmo-hlr_10.42.42.2(pid=10897): Launched 18:09:48.407680 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:49.044706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10899): Launched 18:09:49.344756 run osmo-stp_10.42.42.5(pid=10900): Launched 18:09:49.460282 run osmo-msc_10.42.42.6: Starting osmo-msc 18:09:49.999010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10902): Launched 18:09:50.298761 run osmo-msc_10.42.42.6(pid=10903): Launched 18:09:50.465593 run osmo-stp_10.42.42.5(pid=10900): ERR: Terminated: ERROR {rc=1} [trial-2380↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10900)] 18:09:50.591532 run osmo-stp_10.42.42.5(pid=10900): stdout: | (launched: 2022-12-12_18:09:49.288832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:50.717321 run osmo-stp_10.42.42.5(pid=10900): stderr: | [0;m[38;5;43m20221212180949458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180949458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180949458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180949459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180949459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180949459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180949459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:50.841169 run osmo-stp_10.42.42.5(pid=10900): stdout: | (launched: 2022-12-12_18:09:49.288832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:50.959465 run osmo-stp_10.42.42.5(pid=10900): stderr: | [0;m[38;5;43m20221212180949458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180949458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180949458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180949459 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180949459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180949459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180949459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:51.101195 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10900): Process ended prematurely: osmo-stp_10.42.42.5(pid=10900) [trial-2380↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10900)] [trial-2380↪ussd:trx-sysmocell5000↪assert_extension.py:17] 18:09:51.109583 tst assert_extension.py:17: Test FAILED (5.9 sec) 18:09:51.136053 run osmo-hlr_10.42.42.2(pid=10897): ERR: Terminated: ERROR {rc=237} [trial-2380↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10897)] 18:09:51.184402 run osmo-hlr_10.42.42.2(pid=10897): stdout: | (launched: 2022-12-12_18:09:48.235449) 18:09:51.234128 run osmo-hlr_10.42.42.2(pid=10897): stderr: | [0;m[1;31m20221212180948409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180948409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180948409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180948409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180948409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180948409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180948421 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180948429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180948430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180948430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:09:51.303081 run osmo-msc_10.42.42.6(pid=10903): ERR: Terminated: ERROR {rc=2} [trial-2380↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10903)] 18:09:51.351017 run osmo-msc_10.42.42.6(pid=10903): stdout: | (launched: 2022-12-12_18:09:50.242178) 18:09:51.400498 run osmo-msc_10.42.42.6(pid=10903): stderr: | [0;m[38;5;43m20221212180950511 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180950511 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe2e355dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180950511 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180950511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180950511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180950512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180950513 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180950514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180950514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180950514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:09:51.450587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10896): Terminating (SIGTERM) 18:09:51.490571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10899): Terminating (SIGTERM) 18:09:51.530518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10902): Terminating (SIGTERM) 18:09:51.571176 --- ParallelTerminationStrategy: PID 10896 died... 18:09:51.590475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10896): Terminated: ok {rc=0} 18:09:51.635039 --- ParallelTerminationStrategy: PID 10899 died... 18:09:51.653665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10899): Terminated: ok {rc=0} 18:09:51.698510 --- ParallelTerminationStrategy: PID 10902 died... 18:09:51.716941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10902): Terminated: ok {rc=0} 18:09:51.801187 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:09:53.015514 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:09:53.022920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:09:53.058242 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:09:53.086092 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:09:53.140090 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:09:53.174778 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:09:53.202505 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:09:53.755469 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:09:53.808514 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:09:53.820789 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:09:53.893414 tst mo_mt_call.py: using LAC 30576 18:09:54.021742 tst mo_mt_call.py: using RAC 231 18:09:54.144216 tst mo_mt_call.py: using CellId 30576 18:09:54.273780 tst mo_mt_call.py: using BVCI 30577 18:09:54.391657 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:09:54.403664 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:09:54.415501 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:09:54.427476 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:09:54.439635 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:09:54.451774 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:09:54.566944 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:09:54.687146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:09:55.189228 run create_hlr_db(pid=10920): Launched 18:09:55.321899 bus /sierra_2: Setting Powered False 18:09:56.386088 run create_hlr_db(pid=10920): Terminated: ok {rc=0} 18:09:56.819539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10922): Launched 18:09:57.124352 run osmo-hlr_10.42.42.2(pid=10923): Launched 18:09:57.241625 run osmo-stp_10.42.42.5: Starting osmo-stp 18:09:57.767256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10925): Launched 18:09:58.071899 run osmo-stp_10.42.42.5(pid=10926): Launched 18:09:58.188350 run osmo-msc_10.42.42.6: Starting osmo-msc 18:09:58.735376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10928): Launched 18:09:59.040578 run osmo-msc_10.42.42.6(pid=10929): Launched 18:09:59.211243 run osmo-stp_10.42.42.5(pid=10926): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10926)] 18:09:59.339538 run osmo-stp_10.42.42.5(pid=10926): stdout: | (launched: 2022-12-12_18:09:58.015401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:59.467495 run osmo-stp_10.42.42.5(pid=10926): stderr: | [0;m[38;5;43m20221212180958184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180958184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180958185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180958185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180958186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180958186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180958186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:59.592604 run osmo-stp_10.42.42.5(pid=10926): stdout: | (launched: 2022-12-12_18:09:58.015401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:09:59.712666 run osmo-stp_10.42.42.5(pid=10926): stderr: | [0;m[38;5;43m20221212180958184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212180958184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212180958185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212180958185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212180958186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212180958186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212180958186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:09:59.856432 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10926): Process ended prematurely: osmo-stp_10.42.42.5(pid=10926) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10926)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:09:59.865662 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:09:59.892515 run osmo-hlr_10.42.42.2(pid=10923): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10923)] 18:09:59.940751 run osmo-hlr_10.42.42.2(pid=10923): stdout: | (launched: 2022-12-12_18:09:57.067613) 18:09:59.990376 run osmo-hlr_10.42.42.2(pid=10923): stderr: | [0;m[1;31m20221212180957243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212180957243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212180957243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212180957243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212180957243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212180957243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212180957256 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212180957266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212180957266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212180957266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:00.059868 run osmo-msc_10.42.42.6(pid=10929): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10929)] 18:10:00.108017 run osmo-msc_10.42.42.6(pid=10929): stdout: | (launched: 2022-12-12_18:09:58.983208) 18:10:00.157671 run osmo-msc_10.42.42.6(pid=10929): stderr: | [0;m[38;5;43m20221212180959254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212180959254 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1a5b8e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212180959254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212180959254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212180959255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212180959255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212180959257 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212180959257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212180959257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212180959257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:10:00.207529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10922): Terminating (SIGTERM) 18:10:00.247420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10925): Terminating (SIGTERM) 18:10:00.287722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10928): Terminating (SIGTERM) 18:10:00.328036 --- ParallelTerminationStrategy: PID 10922 died... 18:10:00.347084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10922): Terminated: ok {rc=0} 18:10:00.391509 --- ParallelTerminationStrategy: PID 10925 died... 18:10:00.410022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10925): Terminated: ok {rc=0} 18:10:00.454202 --- ParallelTerminationStrategy: PID 10928 died... 18:10:00.472614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10928): Terminated: ok {rc=0} 18:10:00.559378 bus /sierra_3: Setting Powered False 18:10:01.662934 bus /sierra_3: Setting Powered False 18:10:02.783189 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:10:03.931913 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:10:03.944817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:10:04.018012 tst mo_mt_call_osmux.py: using LAC 30577 18:10:04.139308 tst mo_mt_call_osmux.py: using RAC 232 18:10:04.259565 tst mo_mt_call_osmux.py: using CellId 30577 18:10:04.379343 tst mo_mt_call_osmux.py: using BVCI 30578 18:10:04.490199 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:10:04.501486 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:10:04.512472 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:10:04.523895 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:10:04.535329 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:10:04.546663 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:10:04.663315 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:10:04.784318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:05.287858 run create_hlr_db(pid=10934): Launched 18:10:05.424819 bus /sierra_2: Setting Powered False 18:10:06.484243 run create_hlr_db(pid=10934): Terminated: ok {rc=0} 18:10:06.916669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10936): Launched 18:10:07.222293 run osmo-hlr_10.42.42.2(pid=10938): Launched 18:10:07.338855 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:07.873555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10940): Launched 18:10:08.178411 run osmo-stp_10.42.42.5(pid=10941): Launched 18:10:08.294219 run osmo-msc_10.42.42.6: Starting osmo-msc 18:10:08.843342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10943): Launched 18:10:09.149344 run osmo-msc_10.42.42.6(pid=10944): Launched 18:10:09.318905 run osmo-stp_10.42.42.5(pid=10941): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10941)] 18:10:09.456676 run osmo-stp_10.42.42.5(pid=10941): stdout: | (launched: 2022-12-12_18:10:08.121428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:09.593980 run osmo-stp_10.42.42.5(pid=10941): stderr: | [0;m[38;5;43m20221212181008289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181008290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181008290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181008290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181008291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181008291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181008291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:09.728706 run osmo-stp_10.42.42.5(pid=10941): stdout: | (launched: 2022-12-12_18:10:08.121428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:09.858296 run osmo-stp_10.42.42.5(pid=10941): stderr: | [0;m[38;5;43m20221212181008289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181008290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181008290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181008290 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181008291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181008291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181008291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:10.013201 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10941): Process ended prematurely: osmo-stp_10.42.42.5(pid=10941) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10941)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:10:10.023176 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:10:10.051205 run osmo-hlr_10.42.42.2(pid=10938): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10938)] 18:10:10.102119 run osmo-hlr_10.42.42.2(pid=10938): stdout: | (launched: 2022-12-12_18:10:07.165445) 18:10:10.154000 run osmo-hlr_10.42.42.2(pid=10938): stderr: | [0;m[1;31m20221212181007341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181007341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181007341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181007341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181007341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181007341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181007354 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181007363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181007363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181007363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:10.226110 run osmo-msc_10.42.42.6(pid=10944): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10944)] 18:10:10.276382 run osmo-msc_10.42.42.6(pid=10944): stdout: | (launched: 2022-12-12_18:10:09.092326) 18:10:10.328208 run osmo-msc_10.42.42.6(pid=10944): stderr: | [0;m[38;5;43m20221212181009362 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181009362 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fac46f72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181009362 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181009362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181009362 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181009363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181009364 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181009365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181009365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181009365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:10:10.380410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10936): Terminating (SIGTERM) 18:10:10.423326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10940): Terminating (SIGTERM) 18:10:10.465644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10943): Terminating (SIGTERM) 18:10:10.508273 --- ParallelTerminationStrategy: PID 10936 died... 18:10:10.528307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10936): Terminated: ok {rc=0} 18:10:10.575944 --- ParallelTerminationStrategy: PID 10940 died... 18:10:10.595525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10940): Terminated: ok {rc=0} 18:10:10.642829 --- ParallelTerminationStrategy: PID 10943 died... 18:10:10.662353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10943): Terminated: ok {rc=0} 18:10:10.751343 bus /sierra_3: Setting Powered False 18:10:11.850623 bus /sierra_3: Setting Powered False 18:10:12.967753 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:10:14.224567 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:10:14.232232 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:10:14.267615 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:10:14.294953 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:10:14.349690 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:10:14.385254 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:10:14.413410 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:10:14.963983 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:10:15.015602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:10:15.027613 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:10:15.101062 tst mo_mt_call.py: using LAC 30578 18:10:15.229024 tst mo_mt_call.py: using RAC 233 18:10:15.355835 tst mo_mt_call.py: using CellId 30578 18:10:15.483222 tst mo_mt_call.py: using BVCI 30579 18:10:15.602274 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:10:15.614147 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:10:15.625766 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:10:15.637502 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:10:15.649241 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:10:15.660843 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:10:15.779011 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:10:15.899241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:16.408577 run create_hlr_db(pid=10949): Launched 18:10:16.575926 bus /sierra_2: Setting Powered False 18:10:17.639451 run create_hlr_db(pid=10949): Terminated: ok {rc=0} 18:10:18.090183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10951): Launched 18:10:18.417023 run osmo-hlr_10.42.42.2(pid=10952): Launched 18:10:18.542104 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:19.104265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10954): Launched 18:10:19.432374 run osmo-stp_10.42.42.5(pid=10955): Launched 18:10:19.557426 run osmo-msc_10.42.42.6: Starting osmo-msc 18:10:20.149253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10957): Launched 18:10:20.478230 run osmo-msc_10.42.42.6(pid=10958): Launched 18:10:20.660741 run osmo-stp_10.42.42.5(pid=10955): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10955)] 18:10:20.796715 run osmo-stp_10.42.42.5(pid=10955): stdout: | (launched: 2022-12-12_18:10:19.371227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:20.933099 run osmo-stp_10.42.42.5(pid=10955): stderr: | [0;m[38;5;43m20221212181019563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181019563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181019563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181019564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181019564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181019564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181019565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:21.067821 run osmo-stp_10.42.42.5(pid=10955): stdout: | (launched: 2022-12-12_18:10:19.371227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:21.197063 run osmo-stp_10.42.42.5(pid=10955): stderr: | [0;m[38;5;43m20221212181019563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181019563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181019563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181019564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181019564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181019564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181019565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:21.351894 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10955): Process ended prematurely: osmo-stp_10.42.42.5(pid=10955) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10955)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:10:21.361562 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:10:21.389279 run osmo-hlr_10.42.42.2(pid=10952): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10952)] 18:10:21.440426 run osmo-hlr_10.42.42.2(pid=10952): stdout: | (launched: 2022-12-12_18:10:18.356130) 18:10:21.492279 run osmo-hlr_10.42.42.2(pid=10952): stderr: | [0;m[1;31m20221212181018553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181018553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181018553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181018553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181018553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181018553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181018565 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181018574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181018574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181018574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:21.564292 run osmo-msc_10.42.42.6(pid=10958): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10958)] 18:10:21.614161 run osmo-msc_10.42.42.6(pid=10958): stdout: | (launched: 2022-12-12_18:10:20.417525) 18:10:21.665826 run osmo-msc_10.42.42.6(pid=10958): stderr: | [0;m[38;5;43m20221212181020739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181020739 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff4c5d96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181020739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181020740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181020740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181020740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181020742 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181020742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181020742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181020742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:10:21.717643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10951): Terminating (SIGTERM) 18:10:21.759308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10954): Terminating (SIGTERM) 18:10:21.801058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10957): Terminating (SIGTERM) 18:10:21.843040 --- ParallelTerminationStrategy: PID 10951 died... 18:10:21.863056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10951): Terminated: ok {rc=0} 18:10:21.909444 --- ParallelTerminationStrategy: PID 10954 died... 18:10:21.929324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10954): Terminated: ok {rc=0} 18:10:21.975604 --- ParallelTerminationStrategy: PID 10957 died... 18:10:21.994935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10957): Terminated: ok {rc=0} 18:10:22.082858 bus /sierra_3: Setting Powered False 18:10:23.183211 bus /sierra_3: Setting Powered False 18:10:24.298635 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:10:25.448751 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:10:25.461849 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:10:25.535716 tst mo_mt_call_osmux.py: using LAC 30579 18:10:25.663357 tst mo_mt_call_osmux.py: using RAC 234 18:10:25.785186 tst mo_mt_call_osmux.py: using CellId 30579 18:10:25.906746 tst mo_mt_call_osmux.py: using BVCI 30580 18:10:26.018250 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:10:26.029850 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:10:26.041207 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:10:26.052504 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:10:26.063980 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:10:26.075366 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:10:26.194161 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:10:26.311039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:26.779878 run create_hlr_db(pid=10960): Launched 18:10:26.897623 bus /sierra_2: Setting Powered False 18:10:27.958127 run create_hlr_db(pid=10960): Terminated: ok {rc=0} 18:10:28.403147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10962): Launched 18:10:28.730678 run osmo-hlr_10.42.42.2(pid=10963): Launched 18:10:28.856508 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:29.413854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10965): Launched 18:10:29.742048 run osmo-stp_10.42.42.5(pid=10966): Launched 18:10:29.867324 run osmo-msc_10.42.42.6: Starting osmo-msc 18:10:30.456289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10968): Launched 18:10:30.784252 run osmo-msc_10.42.42.6(pid=10969): Launched 18:10:31.158913 run osmo-stp_10.42.42.5(pid=10966): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10966)] 18:10:31.538672 run osmo-stp_10.42.42.5(pid=10966): stdout: | (launched: 2022-12-12_18:10:29.681459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:31.674160 run osmo-stp_10.42.42.5(pid=10966): stderr: | [0;m[38;5;43m20221212181029872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181029872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181029873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181029873 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181029874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181029874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181029874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:31.804477 run osmo-stp_10.42.42.5(pid=10966): stdout: | (launched: 2022-12-12_18:10:29.681459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:31.932604 run osmo-stp_10.42.42.5(pid=10966): stderr: | [0;m[38;5;43m20221212181029872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181029872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181029873 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181029873 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181029874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181029874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181029874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:32.085109 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10966): Process ended prematurely: osmo-stp_10.42.42.5(pid=10966) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10966)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:10:32.095434 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 18:10:32.125840 run osmo-hlr_10.42.42.2(pid=10963): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10963)] 18:10:32.177155 run osmo-hlr_10.42.42.2(pid=10963): stdout: | (launched: 2022-12-12_18:10:28.670333) 18:10:32.243673 run osmo-hlr_10.42.42.2(pid=10963): stderr: | [0;m[1;31m20221212181028867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181028867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181028867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181028867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181028867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181028867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181028880 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181028889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181028889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181028889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:32.333842 run osmo-msc_10.42.42.6(pid=10969): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10969)] 18:10:32.387837 run osmo-msc_10.42.42.6(pid=10969): stdout: | (launched: 2022-12-12_18:10:30.723663) 18:10:32.440599 run osmo-msc_10.42.42.6(pid=10969): stderr: | [0;m[38;5;43m20221212181031141 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181031141 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4d5217cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181031141 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181031141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181031141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181031141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181031143 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181031143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181031144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181031144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:10:32.492827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10962): Terminating (SIGTERM) 18:10:32.534664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10965): Terminating (SIGTERM) 18:10:32.576695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10968): Terminating (SIGTERM) 18:10:32.619513 --- ParallelTerminationStrategy: PID 10962 died... 18:10:32.639779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10962): Terminated: ok {rc=0} 18:10:32.685983 --- ParallelTerminationStrategy: PID 10965 died... 18:10:32.705422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10965): Terminated: ok {rc=0} 18:10:32.751227 --- ParallelTerminationStrategy: PID 10968 died... 18:10:32.770596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10968): Terminated: ok {rc=0} 18:10:32.857352 bus /sierra_3: Setting Powered False 18:10:33.956526 bus /sierra_3: Setting Powered False 18:10:35.073469 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:10:36.328870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:10:36.335560 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:10:36.369305 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:10:36.396625 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:10:36.447510 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:10:36.481546 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:10:36.508157 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:10:37.060840 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:10:37.110270 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:10:37.121603 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:10:37.193224 tst mo_mt_call.py: using LAC 30580 18:10:37.311490 tst mo_mt_call.py: using RAC 235 18:10:37.428565 tst mo_mt_call.py: using CellId 30580 18:10:37.545793 tst mo_mt_call.py: using BVCI 30581 18:10:37.658000 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:10:37.669390 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:10:37.680461 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:10:37.691808 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:10:37.703220 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:10:37.714647 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:10:37.835765 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:10:37.957976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:38.462807 run create_hlr_db(pid=10974): Launched 18:10:38.595043 bus /sierra_2: Setting Powered False 18:10:39.658855 run create_hlr_db(pid=10974): Terminated: ok {rc=0} 18:10:40.094142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10976): Launched 18:10:40.401087 run osmo-hlr_10.42.42.2(pid=10977): Launched 18:10:40.517414 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:41.049752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10979): Launched 18:10:41.355186 run osmo-stp_10.42.42.5(pid=10980): Launched 18:10:41.471299 run osmo-msc_10.42.42.6: Starting osmo-msc 18:10:42.020722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10982): Launched 18:10:42.327238 run osmo-msc_10.42.42.6(pid=10983): Launched 18:10:42.499305 run osmo-stp_10.42.42.5(pid=10980): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10980)] 18:10:42.627817 run osmo-stp_10.42.42.5(pid=10980): stdout: | (launched: 2022-12-12_18:10:41.298442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:42.755776 run osmo-stp_10.42.42.5(pid=10980): stderr: | [0;m[38;5;43m20221212181041467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181041468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181041468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181041468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181041469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181041469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181041469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:42.881910 run osmo-stp_10.42.42.5(pid=10980): stdout: | (launched: 2022-12-12_18:10:41.298442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:43.003021 run osmo-stp_10.42.42.5(pid=10980): stderr: | [0;m[38;5;43m20221212181041467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181041468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181041468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181041468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181041469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181041469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181041469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:43.148356 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10980): Process ended prematurely: osmo-stp_10.42.42.5(pid=10980) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10980)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:10:43.157468 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:10:43.184213 run osmo-hlr_10.42.42.2(pid=10977): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10977)] 18:10:43.232119 run osmo-hlr_10.42.42.2(pid=10977): stdout: | (launched: 2022-12-12_18:10:40.344156) 18:10:43.281728 run osmo-hlr_10.42.42.2(pid=10977): stderr: | [0;m[1;31m20221212181040521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181040521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181040521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181040521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181040521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181040521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181040533 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181040542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181040542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181040542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:43.350594 run osmo-msc_10.42.42.6(pid=10983): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10983)] 18:10:43.398458 run osmo-msc_10.42.42.6(pid=10983): stdout: | (launched: 2022-12-12_18:10:42.270361) 18:10:43.448186 run osmo-msc_10.42.42.6(pid=10983): stderr: | [0;m[38;5;43m20221212181042542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181042542 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe25da83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181042542 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181042542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181042542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181042543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181042544 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181042545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181042545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181042545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:10:43.497932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10976): Terminating (SIGTERM) 18:10:43.537718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10979): Terminating (SIGTERM) 18:10:43.577524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10982): Terminating (SIGTERM) 18:10:43.617618 --- ParallelTerminationStrategy: PID 10976 died... 18:10:43.636687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10976): Terminated: ok {rc=0} 18:10:43.681038 --- ParallelTerminationStrategy: PID 10979 died... 18:10:43.699506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10979): Terminated: ok {rc=0} 18:10:43.744127 --- ParallelTerminationStrategy: PID 10982 died... 18:10:43.762530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10982): Terminated: ok {rc=0} 18:10:43.848632 bus /sierra_3: Setting Powered False 18:10:44.947794 bus /sierra_3: Setting Powered False 18:10:46.075729 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:10:47.240299 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:10:47.253516 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:10:47.327132 tst mo_mt_call_osmux.py: using LAC 30581 18:10:47.448408 tst mo_mt_call_osmux.py: using RAC 236 18:10:47.567135 tst mo_mt_call_osmux.py: using CellId 30581 18:10:47.689409 tst mo_mt_call_osmux.py: using BVCI 30582 18:10:47.801323 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:10:47.812764 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:10:47.824175 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:10:47.835836 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:10:47.847572 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:10:47.859936 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:10:47.981577 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:10:48.102224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:48.608081 run create_hlr_db(pid=10985): Launched 18:10:48.743146 bus /sierra_2: Setting Powered False 18:10:49.807443 run create_hlr_db(pid=10985): Terminated: ok {rc=0} 18:10:50.243202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10987): Launched 18:10:50.550153 run osmo-hlr_10.42.42.2(pid=10988): Launched 18:10:50.666555 run osmo-stp_10.42.42.5: Starting osmo-stp 18:10:51.202184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10990): Launched 18:10:51.509165 run osmo-stp_10.42.42.5(pid=10991): Launched 18:10:51.626079 run osmo-msc_10.42.42.6: Starting osmo-msc 18:10:52.178898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10993): Launched 18:10:52.486356 run osmo-msc_10.42.42.6(pid=10994): Launched 18:10:52.658406 run osmo-stp_10.42.42.5(pid=10991): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10991)] 18:10:52.787644 run osmo-stp_10.42.42.5(pid=10991): stdout: | (launched: 2022-12-12_18:10:51.451940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:52.916220 run osmo-stp_10.42.42.5(pid=10991): stderr: | [0;m[38;5;43m20221212181051621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181051621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181051622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181051622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181051622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181051623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181051623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:53.042420 run osmo-stp_10.42.42.5(pid=10991): stdout: | (launched: 2022-12-12_18:10:51.451940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:10:53.163814 run osmo-stp_10.42.42.5(pid=10991): stderr: | [0;m[38;5;43m20221212181051621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181051621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181051622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181051622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181051622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181051623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181051623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:10:53.308800 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10991): Process ended prematurely: osmo-stp_10.42.42.5(pid=10991) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10991)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:10:53.318526 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:10:53.345376 run osmo-hlr_10.42.42.2(pid=10988): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10988)] 18:10:53.393528 run osmo-hlr_10.42.42.2(pid=10988): stdout: | (launched: 2022-12-12_18:10:50.492778) 18:10:53.443235 run osmo-hlr_10.42.42.2(pid=10988): stderr: | [0;m[1;31m20221212181050669 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181050670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181050670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181050670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181050670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181050670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181050682 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181050693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181050693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181050693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:10:53.512999 run osmo-msc_10.42.42.6(pid=10994): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10994)] 18:10:53.561052 run osmo-msc_10.42.42.6(pid=10994): stdout: | (launched: 2022-12-12_18:10:52.429106) 18:10:53.610571 run osmo-msc_10.42.42.6(pid=10994): stderr: | [0;m[38;5;43m20221212181052699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181052699 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f39aabd3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181052699 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181052699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181052699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181052699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181052701 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181052702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181052702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181052702 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:10:53.660656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10987): Terminating (SIGTERM) 18:10:53.701136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10990): Terminating (SIGTERM) 18:10:53.741201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10993): Terminating (SIGTERM) 18:10:53.781630 --- ParallelTerminationStrategy: PID 10987 died... 18:10:53.800588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10987): Terminated: ok {rc=0} 18:10:53.845130 --- ParallelTerminationStrategy: PID 10990 died... 18:10:53.863648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10990): Terminated: ok {rc=0} 18:10:53.907811 --- ParallelTerminationStrategy: PID 10993 died... 18:10:53.926436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10993): Terminated: ok {rc=0} 18:10:54.010830 bus /sierra_3: Setting Powered False 18:10:55.111015 bus /sierra_3: Setting Powered False 18:10:56.228015 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:10:57.484223 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:10:57.492164 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:10:57.526060 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:10:57.552306 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:10:57.606400 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:10:57.641316 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:10:57.667957 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:10:58.222760 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:10:58.271976 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:10:58.283327 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:10:58.353409 tst mo_mt_call.py: using LAC 30582 18:10:58.474848 tst mo_mt_call.py: using RAC 237 18:10:58.595773 tst mo_mt_call.py: using CellId 30582 18:10:58.715530 tst mo_mt_call.py: using BVCI 30583 18:10:58.827358 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:10:58.838747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:10:58.849830 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:10:58.861209 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:10:58.872620 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:10:58.884042 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:10:59.003973 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:10:59.120030 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:10:59.592089 run create_hlr_db(pid=10999): Launched 18:10:59.709706 bus /sierra_2: Setting Powered False 18:11:00.770195 run create_hlr_db(pid=10999): Terminated: ok {rc=0} 18:11:01.255252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11001): Launched 18:11:01.600711 run osmo-hlr_10.42.42.2(pid=11002): Launched 18:11:01.793152 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:02.493701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11004): Launched 18:11:02.798582 run osmo-stp_10.42.42.5(pid=11005): Launched 18:11:02.915279 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:03.466505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11007): Launched 18:11:03.775386 run osmo-msc_10.42.42.6(pid=11008): Launched 18:11:03.948719 run osmo-stp_10.42.42.5(pid=11005): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11005)] 18:11:04.078184 run osmo-stp_10.42.42.5(pid=11005): stdout: | (launched: 2022-12-12_18:11:02.741791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:04.206648 run osmo-stp_10.42.42.5(pid=11005): stderr: | [0;m[38;5;43m20221212181102911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181102911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181102912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181102912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181102913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181102913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181102913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:04.333102 run osmo-stp_10.42.42.5(pid=11005): stdout: | (launched: 2022-12-12_18:11:02.741791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:04.454912 run osmo-stp_10.42.42.5(pid=11005): stderr: | [0;m[38;5;43m20221212181102911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181102911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181102912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181102912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181102913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181102913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181102913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:04.600306 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11005): Process ended prematurely: osmo-stp_10.42.42.5(pid=11005) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11005)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:11:04.609710 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:11:04.637018 run osmo-hlr_10.42.42.2(pid=11002): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11002)] 18:11:04.685180 run osmo-hlr_10.42.42.2(pid=11002): stdout: | (launched: 2022-12-12_18:11:01.539034) 18:11:04.735016 run osmo-hlr_10.42.42.2(pid=11002): stderr: | [0;m[1;31m20221212181101883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181101883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181101883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181101883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181101883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181101883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181101904 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181101932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181101933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181101933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:04.804315 run osmo-msc_10.42.42.6(pid=11008): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11008)] 18:11:04.852478 run osmo-msc_10.42.42.6(pid=11008): stdout: | (launched: 2022-12-12_18:11:03.717610) 18:11:04.902510 run osmo-msc_10.42.42.6(pid=11008): stderr: | [0;m[38;5;43m20221212181103989 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181103990 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbd56abcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181103990 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181103990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181103990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181103990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181103992 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181103992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181103992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181103992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:04.952727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11001): Terminating (SIGTERM) 18:11:04.993018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11004): Terminating (SIGTERM) 18:11:05.033267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11007): Terminating (SIGTERM) 18:11:05.074181 --- ParallelTerminationStrategy: PID 11001 died... 18:11:05.093525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11001): Terminated: ok {rc=0} 18:11:05.138278 --- ParallelTerminationStrategy: PID 11004 died... 18:11:05.156781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11004): Terminated: ok {rc=0} 18:11:05.201137 --- ParallelTerminationStrategy: PID 11007 died... 18:11:05.219718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11007): Terminated: ok {rc=0} 18:11:05.304398 bus /sierra_3: Setting Powered False 18:11:06.403472 bus /sierra_3: Setting Powered False 18:11:07.520169 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:11:08.670444 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:11:08.682892 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:11:08.755710 tst mo_mt_call_osmux.py: using LAC 30583 18:11:08.883667 tst mo_mt_call_osmux.py: using RAC 238 18:11:09.010645 tst mo_mt_call_osmux.py: using CellId 30583 18:11:09.139455 tst mo_mt_call_osmux.py: using BVCI 30584 18:11:09.257385 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:11:09.269226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:11:09.280702 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:11:09.292434 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:11:09.304172 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:11:09.315699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:11:09.432858 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:11:09.554448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:10.060389 run create_hlr_db(pid=11010): Launched 18:11:10.193520 bus /sierra_2: Setting Powered False 18:11:11.258019 run create_hlr_db(pid=11010): Terminated: ok {rc=0} 18:11:11.694984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11012): Launched 18:11:12.003698 run osmo-hlr_10.42.42.2(pid=11013): Launched 18:11:12.120354 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:12.660298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11015): Launched 18:11:12.967907 run osmo-stp_10.42.42.5(pid=11016): Launched 18:11:13.084832 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:13.636827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11019): Launched 18:11:13.945468 run osmo-msc_10.42.42.6(pid=11020): Launched 18:11:14.117771 run osmo-stp_10.42.42.5(pid=11016): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11016)] 18:11:14.246991 run osmo-stp_10.42.42.5(pid=11016): stdout: | (launched: 2022-12-12_18:11:12.910807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:14.375654 run osmo-stp_10.42.42.5(pid=11016): stderr: | [0;m[38;5;43m20221212181113079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181113080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181113080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181113080 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181113081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181113081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181113081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:14.502257 run osmo-stp_10.42.42.5(pid=11016): stdout: | (launched: 2022-12-12_18:11:12.910807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:14.623654 run osmo-stp_10.42.42.5(pid=11016): stderr: | [0;m[38;5;43m20221212181113079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181113080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181113080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181113080 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181113081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181113081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181113081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:14.769234 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11016): Process ended prematurely: osmo-stp_10.42.42.5(pid=11016) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11016)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:11:14.778582 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:11:14.805643 run osmo-hlr_10.42.42.2(pid=11013): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11013)] 18:11:14.854179 run osmo-hlr_10.42.42.2(pid=11013): stdout: | (launched: 2022-12-12_18:11:11.945902) 18:11:14.903897 run osmo-hlr_10.42.42.2(pid=11013): stderr: | [0;m[1;31m20221212181112122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181112122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181112122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181112122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181112122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181112122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181112134 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181112144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181112145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181112145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:14.972815 run osmo-msc_10.42.42.6(pid=11020): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11020)] 18:11:15.020360 run osmo-msc_10.42.42.6(pid=11020): stdout: | (launched: 2022-12-12_18:11:13.887934) 18:11:15.069729 run osmo-msc_10.42.42.6(pid=11020): stderr: | [0;m[38;5;43m20221212181114158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181114158 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8636ea1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181114158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181114158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181114158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181114159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181114160 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181114161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181114161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181114161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:15.119658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11012): Terminating (SIGTERM) 18:11:15.159601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11015): Terminating (SIGTERM) 18:11:15.199561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11019): Terminating (SIGTERM) 18:11:15.239844 --- ParallelTerminationStrategy: PID 11012 died... 18:11:15.258984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11012): Terminated: ok {rc=0} 18:11:15.303838 --- ParallelTerminationStrategy: PID 11015 died... 18:11:15.322379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11015): Terminated: ok {rc=0} 18:11:15.366464 --- ParallelTerminationStrategy: PID 11019 died... 18:11:15.385041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11019): Terminated: ok {rc=0} 18:11:15.471344 bus /sierra_3: Setting Powered False 18:11:16.579818 bus /sierra_3: Setting Powered False 18:11:17.703906 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:11:18.964070 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:18.971839 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:11:19.006827 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:11:19.033570 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:11:19.087827 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:11:19.121782 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:11:19.148158 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:11:19.698373 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:11:19.748178 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:11:19.759465 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:11:19.829095 tst mo_mt_call.py: using LAC 30584 18:11:19.950243 tst mo_mt_call.py: using RAC 239 18:11:20.069120 tst mo_mt_call.py: using CellId 30584 18:11:20.187747 tst mo_mt_call.py: using BVCI 30585 18:11:20.299872 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:11:20.311154 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:11:20.322235 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:11:20.333634 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:11:20.345264 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:11:20.356533 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:11:20.474929 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:11:20.594226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:21.100696 run create_hlr_db(pid=11025): Launched 18:11:21.234244 bus /sierra_2: Setting Powered False 18:11:22.298949 run create_hlr_db(pid=11025): Terminated: ok {rc=0} 18:11:22.736692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11027): Launched 18:11:23.043134 run osmo-hlr_10.42.42.2(pid=11028): Launched 18:11:23.159656 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:23.683482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11030): Launched 18:11:23.991836 run osmo-stp_10.42.42.5(pid=11031): Launched 18:11:24.110653 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:24.662659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11033): Launched 18:11:24.971546 run osmo-msc_10.42.42.6(pid=11034): Launched 18:11:25.144525 run osmo-stp_10.42.42.5(pid=11031): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11031)] 18:11:25.273725 run osmo-stp_10.42.42.5(pid=11031): stdout: | (launched: 2022-12-12_18:11:23.934598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:25.402283 run osmo-stp_10.42.42.5(pid=11031): stderr: | [0;m[38;5;43m20221212181124103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181124103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181124103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181124104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181124104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181124104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181124104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:25.528940 run osmo-stp_10.42.42.5(pid=11031): stdout: | (launched: 2022-12-12_18:11:23.934598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:25.650569 run osmo-stp_10.42.42.5(pid=11031): stderr: | [0;m[38;5;43m20221212181124103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181124103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181124103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181124104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181124104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181124104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181124104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:25.796123 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11031): Process ended prematurely: osmo-stp_10.42.42.5(pid=11031) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11031)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:11:25.805537 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:11:25.832522 run osmo-hlr_10.42.42.2(pid=11028): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11028)] 18:11:25.881103 run osmo-hlr_10.42.42.2(pid=11028): stdout: | (launched: 2022-12-12_18:11:22.986303) 18:11:25.930723 run osmo-hlr_10.42.42.2(pid=11028): stderr: | [0;m[1;31m20221212181123160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181123160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181123160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181123160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181123160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181123160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181123215 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181123225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181123225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181123225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:26.000256 run osmo-msc_10.42.42.6(pid=11034): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11034)] 18:11:26.048022 run osmo-msc_10.42.42.6(pid=11034): stdout: | (launched: 2022-12-12_18:11:24.913965) 18:11:26.097604 run osmo-msc_10.42.42.6(pid=11034): stderr: | [0;m[38;5;43m20221212181125184 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181125184 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4668276c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181125185 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181125185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181125185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181125185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181125187 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181125187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181125187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181125187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:26.147682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11027): Terminating (SIGTERM) 18:11:26.187544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11030): Terminating (SIGTERM) 18:11:26.227576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11033): Terminating (SIGTERM) 18:11:26.268821 --- ParallelTerminationStrategy: PID 11027 died... 18:11:26.287858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11027): Terminated: ok {rc=0} 18:11:26.332602 --- ParallelTerminationStrategy: PID 11030 died... 18:11:26.351295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11030): Terminated: ok {rc=0} 18:11:26.395697 --- ParallelTerminationStrategy: PID 11033 died... 18:11:26.414722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11033): Terminated: ok {rc=0} 18:11:26.501486 bus /sierra_3: Setting Powered False 18:11:27.600816 bus /sierra_3: Setting Powered False 18:11:28.717682 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:11:29.864006 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:11:29.876174 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:11:29.948247 tst mo_mt_call_osmux.py: using LAC 30585 18:11:30.069324 tst mo_mt_call_osmux.py: using RAC 240 18:11:30.189362 tst mo_mt_call_osmux.py: using CellId 30585 18:11:30.311975 tst mo_mt_call_osmux.py: using BVCI 30586 18:11:30.423625 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:11:30.435015 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:11:30.446769 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:11:30.458444 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:11:30.470179 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:11:30.481586 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:11:30.598184 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:11:30.713432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:31.204002 run create_hlr_db(pid=11036): Launched 18:11:31.358919 bus /sierra_2: Setting Powered False 18:11:32.421134 run create_hlr_db(pid=11036): Terminated: ok {rc=0} 18:11:32.869058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11038): Launched 18:11:33.198881 run osmo-hlr_10.42.42.2(pid=11039): Launched 18:11:33.324639 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:33.892142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11041): Launched 18:11:34.222649 run osmo-stp_10.42.42.5(pid=11042): Launched 18:11:34.349006 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:34.940228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11044): Launched 18:11:35.269995 run osmo-msc_10.42.42.6(pid=11045): Launched 18:11:35.452327 run osmo-stp_10.42.42.5(pid=11042): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11042)] 18:11:35.589212 run osmo-stp_10.42.42.5(pid=11042): stdout: | (launched: 2022-12-12_18:11:34.161820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:35.726543 run osmo-stp_10.42.42.5(pid=11042): stderr: | [0;m[38;5;43m20221212181134353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181134353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181134353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181134353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181134354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181134354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181134354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:35.862168 run osmo-stp_10.42.42.5(pid=11042): stdout: | (launched: 2022-12-12_18:11:34.161820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:35.992461 run osmo-stp_10.42.42.5(pid=11042): stderr: | [0;m[38;5;43m20221212181134353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181134353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181134353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181134353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181134354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181134354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181134354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:36.148724 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11042): Process ended prematurely: osmo-stp_10.42.42.5(pid=11042) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11042)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:11:36.158786 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:11:36.186856 run osmo-hlr_10.42.42.2(pid=11039): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11039)] 18:11:36.237200 run osmo-hlr_10.42.42.2(pid=11039): stdout: | (launched: 2022-12-12_18:11:33.137991) 18:11:36.288879 run osmo-hlr_10.42.42.2(pid=11039): stderr: | [0;m[1;31m20221212181133335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181133335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181133335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181133335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181133335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181133335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181133348 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181133359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181133359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181133359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:36.361222 run osmo-msc_10.42.42.6(pid=11045): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11045)] 18:11:36.411328 run osmo-msc_10.42.42.6(pid=11045): stdout: | (launched: 2022-12-12_18:11:35.208457) 18:11:36.463327 run osmo-msc_10.42.42.6(pid=11045): stderr: | [0;m[38;5;43m20221212181135529 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181135529 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f04ad063c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181135529 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181135530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181135530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181135530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181135532 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181135532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181135532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181135532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:36.515423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11038): Terminating (SIGTERM) 18:11:36.557000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11041): Terminating (SIGTERM) 18:11:36.598779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11044): Terminating (SIGTERM) 18:11:36.640714 --- ParallelTerminationStrategy: PID 11038 died... 18:11:36.660854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11038): Terminated: ok {rc=0} 18:11:36.707218 --- ParallelTerminationStrategy: PID 11041 died... 18:11:36.726976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11041): Terminated: ok {rc=0} 18:11:36.772871 --- ParallelTerminationStrategy: PID 11044 died... 18:11:36.792832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11044): Terminated: ok {rc=0} 18:11:36.881979 bus /sierra_3: Setting Powered False 18:11:37.983927 bus /sierra_3: Setting Powered False 18:11:39.100642 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:11:40.364035 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:11:40.371516 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:11:40.406180 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:11:40.433720 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:11:40.488471 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:11:40.523353 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:11:40.550871 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:11:41.104832 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:11:41.158118 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:11:41.169973 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:11:41.242901 tst mo_mt_call.py: using LAC 30586 18:11:41.370805 tst mo_mt_call.py: using RAC 241 18:11:41.498986 tst mo_mt_call.py: using CellId 30586 18:11:41.626336 tst mo_mt_call.py: using BVCI 30587 18:11:41.745387 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:11:41.757206 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:11:41.768805 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:11:41.780432 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:11:41.792177 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:11:41.803746 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:11:41.921951 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:11:42.037947 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:42.509424 run create_hlr_db(pid=11050): Launched 18:11:42.627967 bus /sierra_2: Setting Powered False 18:11:43.688269 run create_hlr_db(pid=11050): Terminated: ok {rc=0} 18:11:44.114802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11052): Launched 18:11:44.423061 run osmo-hlr_10.42.42.2(pid=11053): Launched 18:11:44.539955 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:45.078267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11055): Launched 18:11:45.386247 run osmo-stp_10.42.42.5(pid=11056): Launched 18:11:45.503600 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:46.105842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11058): Launched 18:11:46.433123 run osmo-msc_10.42.42.6(pid=11059): Launched 18:11:46.918229 run osmo-stp_10.42.42.5(pid=11056): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11056)] 18:11:47.126361 run osmo-stp_10.42.42.5(pid=11056): stdout: | (launched: 2022-12-12_18:11:45.329372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:47.264073 run osmo-stp_10.42.42.5(pid=11056): stderr: | [0;m[38;5;43m20221212181145499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181145499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181145499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181145500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181145500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181145500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181145500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:47.401810 run osmo-stp_10.42.42.5(pid=11056): stdout: | (launched: 2022-12-12_18:11:45.329372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:47.533794 run osmo-stp_10.42.42.5(pid=11056): stderr: | [0;m[38;5;43m20221212181145499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181145499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181145499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181145500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181145500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181145500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181145500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:47.689884 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11056): Process ended prematurely: osmo-stp_10.42.42.5(pid=11056) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11056)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:11:47.699871 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 18:11:47.728115 run osmo-hlr_10.42.42.2(pid=11053): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11053)] 18:11:47.778735 run osmo-hlr_10.42.42.2(pid=11053): stdout: | (launched: 2022-12-12_18:11:44.366044) 18:11:47.831485 run osmo-hlr_10.42.42.2(pid=11053): stderr: | [0;m[1;31m20221212181144540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181144540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181144540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181144540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181144540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181144540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181144551 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181144559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181144559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181144559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:47.904696 run osmo-msc_10.42.42.6(pid=11059): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11059)] 18:11:47.955385 run osmo-msc_10.42.42.6(pid=11059): stdout: | (launched: 2022-12-12_18:11:46.370649) 18:11:48.007591 run osmo-msc_10.42.42.6(pid=11059): stderr: | [0;m[38;5;43m20221212181146727 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181146727 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4d4e24cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181146727 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181146727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181146727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181146727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181146729 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181146730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181146730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181146730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:48.059983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11052): Terminating (SIGTERM) 18:11:48.102301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11055): Terminating (SIGTERM) 18:11:48.145156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11058): Terminating (SIGTERM) 18:11:48.187558 --- ParallelTerminationStrategy: PID 11052 died... 18:11:48.208050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11052): Terminated: ok {rc=0} 18:11:48.254738 --- ParallelTerminationStrategy: PID 11055 died... 18:11:48.274641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11055): Terminated: ok {rc=0} 18:11:48.321204 --- ParallelTerminationStrategy: PID 11058 died... 18:11:48.340828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11058): Terminated: ok {rc=0} 18:11:48.430142 bus /sierra_3: Setting Powered False 18:11:49.529899 bus /sierra_3: Setting Powered False 18:11:50.646802 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:11:51.797678 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:11:51.810536 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:11:51.885286 tst mo_mt_call_osmux.py: using LAC 30587 18:11:52.014609 tst mo_mt_call_osmux.py: using RAC 242 18:11:52.143507 tst mo_mt_call_osmux.py: using CellId 30587 18:11:52.264267 tst mo_mt_call_osmux.py: using BVCI 30588 18:11:52.375436 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:11:52.386834 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:11:52.398092 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:11:52.410063 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:11:52.422187 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:11:52.434295 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:11:52.556577 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:11:52.679504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:11:53.186985 run create_hlr_db(pid=11061): Launched 18:11:53.322719 bus /sierra_2: Setting Powered False 18:11:54.387414 run create_hlr_db(pid=11061): Terminated: ok {rc=0} 18:11:54.845135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11063): Launched 18:11:55.173572 run osmo-hlr_10.42.42.2(pid=11064): Launched 18:11:55.299469 run osmo-stp_10.42.42.5: Starting osmo-stp 18:11:55.860886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11066): Launched 18:11:56.190527 run osmo-stp_10.42.42.5(pid=11067): Launched 18:11:56.316066 run osmo-msc_10.42.42.6: Starting osmo-msc 18:11:56.907829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11069): Launched 18:11:57.237780 run osmo-msc_10.42.42.6(pid=11070): Launched 18:11:57.419771 run osmo-stp_10.42.42.5(pid=11067): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11067)] 18:11:57.556793 run osmo-stp_10.42.42.5(pid=11067): stdout: | (launched: 2022-12-12_18:11:56.129556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:57.695456 run osmo-stp_10.42.42.5(pid=11067): stderr: | [0;m[38;5;43m20221212181156321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181156321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181156321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181156322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181156322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181156322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181156322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:57.831812 run osmo-stp_10.42.42.5(pid=11067): stdout: | (launched: 2022-12-12_18:11:56.129556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:11:57.962728 run osmo-stp_10.42.42.5(pid=11067): stderr: | [0;m[38;5;43m20221212181156321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181156321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181156321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181156322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181156322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181156322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181156322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:11:58.118726 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11067): Process ended prematurely: osmo-stp_10.42.42.5(pid=11067) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11067)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:11:58.128542 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:11:58.157277 run osmo-hlr_10.42.42.2(pid=11064): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11064)] 18:11:58.208018 run osmo-hlr_10.42.42.2(pid=11064): stdout: | (launched: 2022-12-12_18:11:55.112390) 18:11:58.259969 run osmo-hlr_10.42.42.2(pid=11064): stderr: | [0;m[1;31m20221212181155311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181155311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181155311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181155311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181155311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181155311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181155325 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181155333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181155333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181155333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:11:58.332086 run osmo-msc_10.42.42.6(pid=11070): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11070)] 18:11:58.382160 run osmo-msc_10.42.42.6(pid=11070): stdout: | (launched: 2022-12-12_18:11:57.176896) 18:11:58.434007 run osmo-msc_10.42.42.6(pid=11070): stderr: | [0;m[38;5;43m20221212181157499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181157499 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa976745c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181157499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181157499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181157500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181157500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181157501 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181157502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181157502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181157502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:11:58.486459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11063): Terminating (SIGTERM) 18:11:58.528244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11066): Terminating (SIGTERM) 18:11:58.570212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11069): Terminating (SIGTERM) 18:11:58.612418 --- ParallelTerminationStrategy: PID 11063 died... 18:11:58.632547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11063): Terminated: ok {rc=0} 18:11:58.679789 --- ParallelTerminationStrategy: PID 11066 died... 18:11:58.699369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11066): Terminated: ok {rc=0} 18:11:58.745762 --- ParallelTerminationStrategy: PID 11069 died... 18:11:58.765473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11069): Terminated: ok {rc=0} 18:11:58.854490 bus /sierra_3: Setting Powered False 18:11:59.953446 bus /sierra_3: Setting Powered False 18:12:01.070524 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:12:02.335510 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:12:02.341414 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:12:02.375860 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:12:02.402644 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:12:02.458963 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:12:02.492712 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:12:02.519609 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:12:03.069437 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:12:03.122972 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:12:03.134815 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:12:03.210527 tst mo_mt_call.py: using LAC 30588 18:12:03.338288 tst mo_mt_call.py: using RAC 243 18:12:03.464446 tst mo_mt_call.py: using CellId 30588 18:12:03.592681 tst mo_mt_call.py: using BVCI 30589 18:12:03.710465 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:12:03.722045 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:12:03.733337 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:12:03.744642 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:12:03.756151 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:12:03.767488 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:12:03.883836 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:12:04.003096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:04.476892 run create_hlr_db(pid=11075): Launched 18:12:04.596821 bus /sierra_2: Setting Powered False 18:12:05.657854 run create_hlr_db(pid=11075): Terminated: ok {rc=0} 18:12:06.104159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11077): Launched 18:12:06.433728 run osmo-hlr_10.42.42.2(pid=11078): Launched 18:12:06.560822 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:07.130008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11080): Launched 18:12:07.459647 run osmo-stp_10.42.42.5(pid=11081): Launched 18:12:07.587060 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:08.179194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11083): Launched 18:12:08.510515 run osmo-msc_10.42.42.6(pid=11084): Launched 18:12:08.695151 run osmo-stp_10.42.42.5(pid=11081): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11081)] 18:12:08.835018 run osmo-stp_10.42.42.5(pid=11081): stdout: | (launched: 2022-12-12_18:12:07.398435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:08.974634 run osmo-stp_10.42.42.5(pid=11081): stderr: | [0;m[38;5;43m20221212181207589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181207589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181207590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181207590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181207590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181207591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181207591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:09.109896 run osmo-stp_10.42.42.5(pid=11081): stdout: | (launched: 2022-12-12_18:12:07.398435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:09.239924 run osmo-stp_10.42.42.5(pid=11081): stderr: | [0;m[38;5;43m20221212181207589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181207589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181207590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181207590 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181207590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181207591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181207591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:09.395867 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11081): Process ended prematurely: osmo-stp_10.42.42.5(pid=11081) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11081)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:12:09.405824 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:12:09.433772 run osmo-hlr_10.42.42.2(pid=11078): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11078)] 18:12:09.484081 run osmo-hlr_10.42.42.2(pid=11078): stdout: | (launched: 2022-12-12_18:12:06.373152) 18:12:09.535804 run osmo-hlr_10.42.42.2(pid=11078): stderr: | [0;m[1;31m20221212181206569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181206569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181206570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181206570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181206570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181206570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181206582 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181206593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181206593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181206593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:09.607826 run osmo-msc_10.42.42.6(pid=11084): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11084)] 18:12:09.659111 run osmo-msc_10.42.42.6(pid=11084): stdout: | (launched: 2022-12-12_18:12:08.449499) 18:12:09.710701 run osmo-msc_10.42.42.6(pid=11084): stderr: | [0;m[38;5;43m20221212181208770 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181208770 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f896275fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181208770 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181208770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181208771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181208771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181208772 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181208773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181208773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181208773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:09.762790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11077): Terminating (SIGTERM) 18:12:09.804280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11080): Terminating (SIGTERM) 18:12:09.845912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11083): Terminating (SIGTERM) 18:12:09.887725 --- ParallelTerminationStrategy: PID 11077 died... 18:12:09.907791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11077): Terminated: ok {rc=0} 18:12:09.954370 --- ParallelTerminationStrategy: PID 11080 died... 18:12:09.974092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11080): Terminated: ok {rc=0} 18:12:10.020590 --- ParallelTerminationStrategy: PID 11083 died... 18:12:10.040622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11083): Terminated: ok {rc=0} 18:12:10.129300 bus /sierra_3: Setting Powered False 18:12:11.228936 bus /sierra_3: Setting Powered False 18:12:12.346168 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:12:13.493997 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:12:13.506499 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:12:13.581880 tst mo_mt_call_osmux.py: using LAC 30589 18:12:13.705129 tst mo_mt_call_osmux.py: using RAC 244 18:12:13.826351 tst mo_mt_call_osmux.py: using CellId 30589 18:12:13.946330 tst mo_mt_call_osmux.py: using BVCI 30590 18:12:14.059370 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:12:14.070682 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:12:14.081759 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:12:14.093128 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:12:14.104370 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:12:14.115758 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:12:14.232352 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:12:14.358724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:14.865974 run create_hlr_db(pid=11086): Launched 18:12:14.987124 bus /sierra_2: Setting Powered False 18:12:16.046655 run create_hlr_db(pid=11086): Terminated: ok {rc=0} 18:12:16.482130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11088): Launched 18:12:16.808755 run osmo-hlr_10.42.42.2(pid=11089): Launched 18:12:17.050280 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:17.676263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11091): Launched 18:12:18.004528 run osmo-stp_10.42.42.5(pid=11092): Launched 18:12:18.129642 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:18.720072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11094): Launched 18:12:19.049507 run osmo-msc_10.42.42.6(pid=11095): Launched 18:12:19.231113 run osmo-stp_10.42.42.5(pid=11092): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11092)] 18:12:19.369628 run osmo-stp_10.42.42.5(pid=11092): stdout: | (launched: 2022-12-12_18:12:17.943992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:19.507922 run osmo-stp_10.42.42.5(pid=11092): stderr: | [0;m[38;5;43m20221212181218134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181218134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181218134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181218135 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181218135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181218135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181218135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:19.643406 run osmo-stp_10.42.42.5(pid=11092): stdout: | (launched: 2022-12-12_18:12:17.943992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:19.772931 run osmo-stp_10.42.42.5(pid=11092): stderr: | [0;m[38;5;43m20221212181218134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181218134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181218134 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181218135 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181218135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181218135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181218135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:19.928745 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11092): Process ended prematurely: osmo-stp_10.42.42.5(pid=11092) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11092)] [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:12:19.938549 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:12:19.966629 run osmo-hlr_10.42.42.2(pid=11089): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11089)] 18:12:20.016527 run osmo-hlr_10.42.42.2(pid=11089): stdout: | (launched: 2022-12-12_18:12:16.750198) 18:12:20.068033 run osmo-hlr_10.42.42.2(pid=11089): stderr: | [0;m[1;31m20221212181217085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181217085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181217085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181217085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181217085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181217085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181217103 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181217119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181217119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181217120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:20.140015 run osmo-msc_10.42.42.6(pid=11095): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11095)] 18:12:20.190160 run osmo-msc_10.42.42.6(pid=11095): stdout: | (launched: 2022-12-12_18:12:18.988771) 18:12:20.241802 run osmo-msc_10.42.42.6(pid=11095): stderr: | [0;m[38;5;43m20221212181219307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181219308 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa05cb00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181219308 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181219308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181219308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181219308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181219310 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181219310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181219310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181219310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:20.293794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11088): Terminating (SIGTERM) 18:12:20.335601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11091): Terminating (SIGTERM) 18:12:20.377651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11094): Terminating (SIGTERM) 18:12:20.419777 --- ParallelTerminationStrategy: PID 11088 died... 18:12:20.439639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11088): Terminated: ok {rc=0} 18:12:20.486322 --- ParallelTerminationStrategy: PID 11091 died... 18:12:20.505860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11091): Terminated: ok {rc=0} 18:12:20.551994 --- ParallelTerminationStrategy: PID 11094 died... 18:12:20.571416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11094): Terminated: ok {rc=0} 18:12:20.659363 bus /sierra_3: Setting Powered False 18:12:21.759951 bus /sierra_3: Setting Powered False 18:12:22.878175 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 18:12:24.134003 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:12:24.138858 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 18:12:24.173472 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 18:12:24.201161 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 18:12:24.288843 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 18:12:24.323925 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 18:12:24.351625 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 18:12:24.937828 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2380 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 18:12:24.943025 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:12:24.954424 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 18:12:25.006379 tst emergency_mo_mt_call.py: using LAC 30590 18:12:25.130627 tst emergency_mo_mt_call.py: using RAC 245 18:12:25.255704 tst emergency_mo_mt_call.py: using CellId 30590 18:12:25.380395 tst emergency_mo_mt_call.py: using BVCI 30591 18:12:25.495834 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:12:25.507389 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:12:25.518586 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:12:25.529688 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:12:25.540773 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:12:25.551860 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:12:25.669502 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:12:25.788541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:26.259528 run create_hlr_db(pid=11102): Launched 18:12:26.375349 bus /sierra_2: Setting Powered False 18:12:27.434599 run create_hlr_db(pid=11102): Terminated: ok {rc=0} 18:12:27.874444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11104): Launched 18:12:28.196241 run osmo-hlr_10.42.42.2(pid=11105): Launched 18:12:28.320295 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:28.877515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11107): Launched 18:12:29.200793 run osmo-stp_10.42.42.5(pid=11108): Launched 18:12:29.334754 tst emergency_mo_mt_call.py: using MSISDN 7901 18:12:29.498591 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:30.077424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11110): Launched 18:12:30.400805 run osmo-msc_10.42.42.6(pid=11111): Launched 18:12:30.582406 run osmo-stp_10.42.42.5(pid=11108): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11108)] 18:12:30.716419 run osmo-stp_10.42.42.5(pid=11108): stdout: | (launched: 2022-12-12_18:12:29.140911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:30.911032 run osmo-stp_10.42.42.5(pid=11108): stderr: | [0;m[38;5;43m20221212181229333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181229333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181229333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181229334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181229334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181229334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181229334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:31.048502 run osmo-stp_10.42.42.5(pid=11108): stdout: | (launched: 2022-12-12_18:12:29.140911) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:31.217555 run osmo-stp_10.42.42.5(pid=11108): stderr: | [0;m[38;5;43m20221212181229333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181229333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181229333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181229334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181229334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181229334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181229334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:31.424789 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=11108): Process ended prematurely: osmo-stp_10.42.42.5(pid=11108) [trial-2380↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11108)] [trial-2380↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 18:12:31.434649 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 18:12:31.466263 run osmo-hlr_10.42.42.2(pid=11105): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11105)] 18:12:31.518582 run osmo-hlr_10.42.42.2(pid=11105): stdout: | (launched: 2022-12-12_18:12:28.136442) 18:12:31.572777 run osmo-hlr_10.42.42.2(pid=11105): stderr: | [0;m[1;31m20221212181228332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181228332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181228332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181228333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181228333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181228333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181228345 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181228354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181228354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181228354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:31.649273 run osmo-msc_10.42.42.6(pid=11111): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11111)] 18:12:31.702307 run osmo-msc_10.42.42.6(pid=11111): stdout: | (launched: 2022-12-12_18:12:30.340805) 18:12:31.755717 run osmo-msc_10.42.42.6(pid=11111): stderr: | [0;m[38;5;43m20221212181230664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181230664 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fad41295c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181230665 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181230665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181230665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181230665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181230667 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181230667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181230667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181230667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:31.810136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11104): Terminating (SIGTERM) 18:12:31.856232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11107): Terminating (SIGTERM) 18:12:31.917904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11110): Terminating (SIGTERM) 18:12:31.969948 --- ParallelTerminationStrategy: PID 11104 died... 18:12:31.991148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11104): Terminated: ok {rc=0} 18:12:32.041493 --- ParallelTerminationStrategy: PID 11107 died... 18:12:32.062821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11107): Terminated: ok {rc=0} 18:12:32.112838 --- ParallelTerminationStrategy: PID 11110 died... 18:12:32.133493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11110): Terminated: ok {rc=0} 18:12:32.223764 bus /sierra_3: Setting Powered False 18:12:33.325787 bus /sierra_3: Setting Powered False 18:12:34.442743 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 18:12:35.530611 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:12:35.543088 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 18:12:35.597348 tst emergency_preemptive_call.py: using LAC 30591 18:12:35.725240 tst emergency_preemptive_call.py: using RAC 246 18:12:35.850211 tst emergency_preemptive_call.py: using CellId 30591 18:12:35.975574 tst emergency_preemptive_call.py: using BVCI 30592 18:12:36.091272 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:12:36.102734 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:12:36.113972 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:12:36.125150 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:12:36.136325 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 18:12:36.147596 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:12:36.267082 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:12:36.383534 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:12:36.504885 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:12:36.624663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:37.126994 run create_hlr_db(pid=11113): Launched 18:12:37.259666 bus /sierra_2: Setting Powered False 18:12:38.323500 run create_hlr_db(pid=11113): Terminated: ok {rc=0} 18:12:38.757239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11115): Launched 18:12:39.061085 run osmo-hlr_10.42.42.2(pid=11116): Launched 18:12:39.176850 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:39.739197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11118): Launched 18:12:40.064299 run osmo-stp_10.42.42.5(pid=11119): Launched 18:12:40.197599 tst emergency_preemptive_call.py: using MSISDN 7902 18:12:40.362684 run osmo-msc_10.42.42.6: Starting osmo-msc 18:12:40.944343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11121): Launched 18:12:41.269552 run osmo-msc_10.42.42.6(pid=11122): Launched 18:12:41.449481 run osmo-stp_10.42.42.5(pid=11119): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11119)] 18:12:41.585231 run osmo-stp_10.42.42.5(pid=11119): stdout: | (launched: 2022-12-12_18:12:40.003960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:41.720581 run osmo-stp_10.42.42.5(pid=11119): stderr: | [0;m[38;5;43m20221212181240193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181240193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181240193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181240194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181240194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181240194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181240194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:41.854978 run osmo-stp_10.42.42.5(pid=11119): stdout: | (launched: 2022-12-12_18:12:40.003960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:41.983190 run osmo-stp_10.42.42.5(pid=11119): stderr: | [0;m[38;5;43m20221212181240193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181240193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181240193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181240194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181240194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181240194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181240194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:42.136562 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=11119): Process ended prematurely: osmo-stp_10.42.42.5(pid=11119) [trial-2380↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11119)] [trial-2380↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 18:12:42.145776 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 18:12:42.173756 run osmo-hlr_10.42.42.2(pid=11116): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11116)] 18:12:42.224614 run osmo-hlr_10.42.42.2(pid=11116): stdout: | (launched: 2022-12-12_18:12:39.004370) 18:12:42.276931 run osmo-hlr_10.42.42.2(pid=11116): stderr: | [0;m[1;31m20221212181239179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181239179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181239179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181239179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181239179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181239179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181239191 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181239200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181239200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181239200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:12:42.349880 run osmo-msc_10.42.42.6(pid=11122): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11122)] 18:12:42.400907 run osmo-msc_10.42.42.6(pid=11122): stdout: | (launched: 2022-12-12_18:12:41.209263) 18:12:42.453108 run osmo-msc_10.42.42.6(pid=11122): stderr: | [0;m[38;5;43m20221212181241530 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181241531 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa61582ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181241531 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181241531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181241531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181241531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181241533 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181241533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181241534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181241534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:12:42.505849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11115): Terminating (SIGTERM) 18:12:42.548300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11118): Terminating (SIGTERM) 18:12:42.590673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11121): Terminating (SIGTERM) 18:12:42.632845 --- ParallelTerminationStrategy: PID 11115 died... 18:12:42.652880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11115): Terminated: ok {rc=0} 18:12:42.699103 --- ParallelTerminationStrategy: PID 11118 died... 18:12:42.718732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11118): Terminated: ok {rc=0} 18:12:42.764844 --- ParallelTerminationStrategy: PID 11121 died... 18:12:42.784793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11121): Terminated: ok {rc=0} 18:12:42.872820 bus /sierra_9: Setting Powered False 18:12:43.971520 bus /sierra_9: Setting Powered False 18:12:45.088933 bus /sierra_8: Setting Powered False 18:12:46.197077 bus /sierra_8: Setting Powered False 18:12:47.330297 bus /sierra_3: Setting Powered False 18:12:48.429854 bus /sierra_3: Setting Powered False 18:12:49.547222 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 18:12:50.837361 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:12:50.842102 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 18:12:50.876806 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 18:12:50.916360 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 18:12:51.007442 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 18:12:51.041909 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 18:12:51.081090 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 18:12:51.673836 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 18:12:51.726997 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:12:51.738261 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 18:12:51.789211 tst cs_paging_gprs_active.py: using LAC 30592 18:12:51.918600 tst cs_paging_gprs_active.py: using RAC 247 18:12:52.046738 tst cs_paging_gprs_active.py: using CellId 30592 18:12:52.169135 tst cs_paging_gprs_active.py: using BVCI 30593 18:12:52.280542 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:12:52.291618 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:12:52.302466 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:12:52.313964 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:12:52.325280 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:12:52.336367 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:12:52.347755 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:12:52.358851 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:12:52.370260 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:12:52.493390 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:12:52.611921 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:12:52.819548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:12:53.129071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11128): Launched 18:12:53.398065 run iperf3-srv_10.42.42.10(pid=11129): Launched 18:12:53.516366 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:12:53.721958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:12:54.031655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11130): Launched 18:12:54.301359 run iperf3-srv_10.42.42.10(pid=11131): Launched 18:12:54.418578 tst cs_paging_gprs_active.py:38: start network... 18:12:54.623690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:12:55.100566 run create_hlr_db(pid=11132): Launched 18:12:55.221240 bus /sierra_2: Setting Powered False 18:12:56.282234 run create_hlr_db(pid=11132): Terminated: ok {rc=0} 18:12:56.711897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11134): Launched 18:12:57.022265 run osmo-hlr_10.42.42.2(pid=11135): Launched 18:12:57.140056 run osmo-stp_10.42.42.5: Starting osmo-stp 18:12:57.681751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11137): Launched 18:12:57.992025 run osmo-stp_10.42.42.5(pid=11138): Launched 18:12:58.111693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:12:58.641892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11140): Launched 18:12:58.760882 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:12:59.022425 run patchelf(pid=11141): Launched 18:12:59.196164 run osmo-stp_10.42.42.5(pid=11138): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11138)] 18:12:59.326504 run osmo-stp_10.42.42.5(pid=11138): stdout: | (launched: 2022-12-12_18:12:57.934145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:59.458221 run osmo-stp_10.42.42.5(pid=11138): stderr: | [0;m[38;5;43m20221212181258103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181258103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181258103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181258104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181258104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181258104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181258104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:59.590428 run osmo-stp_10.42.42.5(pid=11138): stdout: | (launched: 2022-12-12_18:12:57.934145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:12:59.716568 run osmo-stp_10.42.42.5(pid=11138): stderr: | [0;m[38;5;43m20221212181258103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181258103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181258103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181258104 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181258104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181258104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181258104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:12:59.865733 run patchelf(pid=11141): Terminating (SIGINT) 18:13:00.038939 run patchelf(pid=11141): Terminated: ok {rc=0} 18:13:00.163380 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11138): Process ended prematurely: osmo-stp_10.42.42.5(pid=11138) [trial-2380↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11138)] [trial-2380↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 18:13:00.173346 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:13:00.201529 run osmo-hlr_10.42.42.2(pid=11135): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11135)] 18:13:00.250874 run osmo-hlr_10.42.42.2(pid=11135): stdout: | (launched: 2022-12-12_18:12:56.964046) 18:13:00.301424 run osmo-hlr_10.42.42.2(pid=11135): stderr: | [0;m[1;31m20221212181257140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181257140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181257140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181257140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181257140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181257140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181257152 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181257160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181257160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181257160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:00.353074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11128): Terminating (SIGTERM) 18:13:00.394558 run iperf3-srv_10.42.42.10(pid=11129): Terminating (SIGTERM) 18:13:00.434818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11130): Terminating (SIGTERM) 18:13:00.476118 run iperf3-srv_10.42.42.10(pid=11131): Terminating (SIGTERM) 18:13:00.517203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11134): Terminating (SIGTERM) 18:13:00.558104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11137): Terminating (SIGTERM) 18:13:00.599045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11140): Terminating (SIGTERM) 18:13:00.640302 --- ParallelTerminationStrategy: PID 11128 died... 18:13:00.659807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11128): Terminated: ok {rc=0} 18:13:00.705632 --- ParallelTerminationStrategy: PID 11129 died... 18:13:00.724387 run iperf3-srv_10.42.42.10(pid=11129): Terminated {rc=256} 18:13:00.769569 --- ParallelTerminationStrategy: PID 11130 died... 18:13:00.788537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11130): Terminated: ok {rc=0} 18:13:00.838049 --- ParallelTerminationStrategy: PID 11131 died... 18:13:00.860189 run iperf3-srv_10.42.42.10(pid=11131): Terminated {rc=256} 18:13:00.918247 --- ParallelTerminationStrategy: PID 11134 died... 18:13:00.939317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11134): Terminated: ok {rc=0} 18:13:00.989789 --- ParallelTerminationStrategy: PID 11137 died... 18:13:01.010844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11137): Terminated: ok {rc=0} 18:13:01.061333 --- ParallelTerminationStrategy: PID 11140 died... 18:13:01.082179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11140): Terminated: ok {rc=0} 18:13:01.174300 bus /gobi_0: Setting Powered False 18:13:02.283485 bus /gobi_0: Setting Powered False 18:13:03.401336 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 18:13:04.549971 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:04.561846 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 18:13:04.615275 tst iperf3.py: using LAC 30593 18:13:04.734173 tst iperf3.py: using RAC 248 18:13:04.855643 tst iperf3.py: using CellId 30593 18:13:04.976833 tst iperf3.py: using BVCI 30594 18:13:05.096700 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:05.108232 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:05.119333 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:05.130618 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:05.141802 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:05.152805 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:05.164030 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:05.174967 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:05.186091 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:13:05.305577 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:13:05.527581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:13:05.857772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11142): Launched 18:13:06.145537 run iperf3-srv_10.42.42.10(pid=11143): Launched 18:13:06.269917 tst iperf3.py:8: start network... 18:13:06.491417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:07.002468 run create_hlr_db(pid=11144): Launched 18:13:07.137452 bus /gobi_6: Setting Powered False 18:13:08.201883 run create_hlr_db(pid=11144): Terminated: ok {rc=0} 18:13:08.641415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11146): Launched 18:13:08.950375 run osmo-hlr_10.42.42.2(pid=11147): Launched 18:13:09.067203 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:09.607171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11149): Launched 18:13:09.916306 run osmo-stp_10.42.42.5(pid=11150): Launched 18:13:10.035812 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:13:10.565977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11152): Launched 18:13:10.685727 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:13:10.946049 run patchelf(pid=11153): Launched 18:13:11.117257 run osmo-stp_10.42.42.5(pid=11150): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11150)] 18:13:11.246565 run osmo-stp_10.42.42.5(pid=11150): stdout: | (launched: 2022-12-12_18:13:09.858718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:11.377662 run osmo-stp_10.42.42.5(pid=11150): stderr: | [0;m[38;5;43m20221212181310026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181310027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181310027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181310027 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181310028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181310028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181310028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:11.509275 run osmo-stp_10.42.42.5(pid=11150): stdout: | (launched: 2022-12-12_18:13:09.858718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:11.634884 run osmo-stp_10.42.42.5(pid=11150): stderr: | [0;m[38;5;43m20221212181310026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181310027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181310027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181310027 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181310028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181310028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181310028 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:11.783589 run patchelf(pid=11153): Terminating (SIGINT) 18:13:11.955768 run patchelf(pid=11153): Terminated: ok {rc=0} 18:13:12.079717 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11150): Process ended prematurely: osmo-stp_10.42.42.5(pid=11150) [trial-2380↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11150)] [trial-2380↪gprs:trx-sysmocell5000↪iperf3.py:8] 18:13:12.089470 tst iperf3.py:8: Test FAILED (7.6 sec) 18:13:12.117545 run osmo-hlr_10.42.42.2(pid=11147): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11147)] 18:13:12.166231 run osmo-hlr_10.42.42.2(pid=11147): stdout: | (launched: 2022-12-12_18:13:08.893159) 18:13:12.216440 run osmo-hlr_10.42.42.2(pid=11147): stderr: | [0;m[1;31m20221212181309071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181309071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181309071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181309071 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181309072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181309072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181309088 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181309098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181309098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181309098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:12.267167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11142): Terminating (SIGTERM) 18:13:12.308087 run iperf3-srv_10.42.42.10(pid=11143): Terminating (SIGTERM) 18:13:12.348715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11146): Terminating (SIGTERM) 18:13:12.389545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11149): Terminating (SIGTERM) 18:13:12.430445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11152): Terminating (SIGTERM) 18:13:12.471637 --- ParallelTerminationStrategy: PID 11142 died... 18:13:12.491149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11142): Terminated: ok {rc=0} 18:13:12.537097 --- ParallelTerminationStrategy: PID 11143 died... 18:13:12.556054 run iperf3-srv_10.42.42.10(pid=11143): Terminated {rc=256} 18:13:12.601394 --- ParallelTerminationStrategy: PID 11146 died... 18:13:12.620352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11146): Terminated: ok {rc=0} 18:13:12.665768 --- ParallelTerminationStrategy: PID 11149 died... 18:13:12.684805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11149): Terminated: ok {rc=0} 18:13:12.730376 --- ParallelTerminationStrategy: PID 11152 died... 18:13:12.749461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11152): Terminated: ok {rc=0} 18:13:12.837804 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 18:13:13.993405 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:14.005592 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 18:13:14.065844 tst iperf3m4.py: using LAC 30594 18:13:14.194809 tst iperf3m4.py: using RAC 249 18:13:14.324296 tst iperf3m4.py: using CellId 30594 18:13:14.453097 tst iperf3m4.py: using BVCI 30595 18:13:14.572050 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:14.583616 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:14.594813 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:14.606161 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:14.617288 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:14.628343 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:14.639690 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:14.650838 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:14.662182 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:13:14.783464 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:13:14.904856 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:13:15.021453 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:13:15.137789 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:13:15.343960 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:13:15.652606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11154): Launched 18:13:15.937717 run iperf3-srv_10.42.42.10(pid=11155): Launched 18:13:16.079078 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:13:16.290977 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:13:16.607354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11156): Launched 18:13:16.897758 run iperf3-srv_10.42.42.10(pid=11157): Launched 18:13:17.036402 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:13:17.261481 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:13:17.593112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11158): Launched 18:13:17.880905 run iperf3-srv_10.42.42.10(pid=11159): Launched 18:13:18.005527 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:13:18.226337 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:13:18.556669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11160): Launched 18:13:18.844516 run iperf3-srv_10.42.42.10(pid=11161): Launched 18:13:18.969377 tst iperf3m4.py:8: start network... 18:13:19.189620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:19.698606 run create_hlr_db(pid=11162): Launched 18:13:19.832843 bus /gobi_6: Setting Powered False 18:13:20.898034 run create_hlr_db(pid=11162): Terminated: ok {rc=0} 18:13:21.354642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11164): Launched 18:13:21.684791 run osmo-hlr_10.42.42.2(pid=11165): Launched 18:13:21.811292 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:22.377388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11167): Launched 18:13:22.709330 run osmo-stp_10.42.42.5(pid=11168): Launched 18:13:22.836206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:13:23.403237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11170): Launched 18:13:23.528784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:13:23.806932 run patchelf(pid=11171): Launched 18:13:23.988915 run osmo-stp_10.42.42.5(pid=11168): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11168)] 18:13:24.127174 run osmo-stp_10.42.42.5(pid=11168): stdout: | (launched: 2022-12-12_18:13:22.648016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:24.267240 run osmo-stp_10.42.42.5(pid=11168): stderr: | [0;m[38;5;43m20221212181322835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181322835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181322835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181322836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181322836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181322836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181322837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:24.407632 run osmo-stp_10.42.42.5(pid=11168): stdout: | (launched: 2022-12-12_18:13:22.648016) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:24.542327 run osmo-stp_10.42.42.5(pid=11168): stderr: | [0;m[38;5;43m20221212181322835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181322835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181322835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181322836 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181322836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181322836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181322837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:24.701673 run patchelf(pid=11171): Terminating (SIGINT) 18:13:24.885407 run patchelf(pid=11171): Terminated: ok {rc=0} 18:13:25.017431 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11168): Process ended prematurely: osmo-stp_10.42.42.5(pid=11168) [trial-2380↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11168)] [trial-2380↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 18:13:25.027828 tst iperf3m4.py:8: Test FAILED (11.1 sec) 18:13:25.056878 run osmo-hlr_10.42.42.2(pid=11165): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11165)] 18:13:25.106711 run osmo-hlr_10.42.42.2(pid=11165): stdout: | (launched: 2022-12-12_18:13:21.623443) 18:13:25.158014 run osmo-hlr_10.42.42.2(pid=11165): stderr: | [0;m[1;31m20221212181321819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181321819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181321819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181321819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181321819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181321819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181321841 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181321851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181321851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181321851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:25.209829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11154): Terminating (SIGTERM) 18:13:25.251485 run iperf3-srv_10.42.42.10(pid=11155): Terminating (SIGTERM) 18:13:25.292938 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11156): Terminating (SIGTERM) 18:13:25.334490 run iperf3-srv_10.42.42.10(pid=11157): Terminating (SIGTERM) 18:13:25.375744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11158): Terminating (SIGTERM) 18:13:25.417310 run iperf3-srv_10.42.42.10(pid=11159): Terminating (SIGTERM) 18:13:25.458356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11160): Terminating (SIGTERM) 18:13:25.499966 run iperf3-srv_10.42.42.10(pid=11161): Terminating (SIGTERM) 18:13:25.541291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11164): Terminating (SIGTERM) 18:13:25.582681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11167): Terminating (SIGTERM) 18:13:25.624158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11170): Terminating (SIGTERM) 18:13:25.666005 --- ParallelTerminationStrategy: PID 11154 died... 18:13:25.686083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11154): Terminated: ok {rc=0} 18:13:25.732436 --- ParallelTerminationStrategy: PID 11155 died... 18:13:25.752027 run iperf3-srv_10.42.42.10(pid=11155): Terminated {rc=256} 18:13:25.797965 --- ParallelTerminationStrategy: PID 11156 died... 18:13:25.817400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11156): Terminated: ok {rc=0} 18:13:25.863979 --- ParallelTerminationStrategy: PID 11157 died... 18:13:25.883550 run iperf3-srv_10.42.42.10(pid=11157): Terminated {rc=256} 18:13:25.929424 --- ParallelTerminationStrategy: PID 11158 died... 18:13:25.948728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11158): Terminated: ok {rc=0} 18:13:25.995381 --- ParallelTerminationStrategy: PID 11159 died... 18:13:26.014957 run iperf3-srv_10.42.42.10(pid=11159): Terminated {rc=256} 18:13:26.060844 --- ParallelTerminationStrategy: PID 11160 died... 18:13:26.080756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11160): Terminated: ok {rc=0} 18:13:26.127623 --- ParallelTerminationStrategy: PID 11161 died... 18:13:26.147253 run iperf3-srv_10.42.42.10(pid=11161): Terminated {rc=256} 18:13:26.193146 --- ParallelTerminationStrategy: PID 11164 died... 18:13:26.212633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11164): Terminated: ok {rc=0} 18:13:26.258499 --- ParallelTerminationStrategy: PID 11167 died... 18:13:26.278006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11167): Terminated: ok {rc=0} 18:13:26.324019 --- ParallelTerminationStrategy: PID 11170 died... 18:13:26.343679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11170): Terminated: ok {rc=0} 18:13:26.432058 bus /gobi_4: Setting Powered False 18:13:27.532692 bus /gobi_4: Setting Powered False 18:13:28.649257 bus /gobi_1: Setting Powered False 18:13:29.747579 bus /gobi_1: Setting Powered False 18:13:30.866983 bus /gobi_0: Setting Powered False 18:13:31.990323 bus /gobi_0: Setting Powered False 18:13:33.120723 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 18:13:34.225384 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:34.237449 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 18:13:34.289229 tst ping.py: using LAC 30595 18:13:34.416678 tst ping.py: using RAC 250 18:13:34.544439 tst ping.py: using CellId 30595 18:13:34.672273 tst ping.py: using BVCI 30596 18:13:34.788503 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:34.799798 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:34.810922 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:34.821979 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:34.832923 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:34.843933 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:34.855074 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:34.866158 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:13:34.987673 tst ping.py:19: start network... 18:13:35.203914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:35.703648 run create_hlr_db(pid=11172): Launched 18:13:35.835327 bus /gobi_6: Setting Powered False 18:13:36.898316 run create_hlr_db(pid=11172): Terminated: ok {rc=0} 18:13:37.347597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11174): Launched 18:13:37.671875 run osmo-hlr_10.42.42.2(pid=11175): Launched 18:13:37.794942 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:38.351720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11177): Launched 18:13:38.676048 run osmo-stp_10.42.42.5(pid=11178): Launched 18:13:38.800890 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:13:39.358564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11180): Launched 18:13:39.483132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:13:39.756784 run patchelf(pid=11181): Launched 18:13:39.937917 run osmo-stp_10.42.42.5(pid=11178): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11178)] 18:13:40.073895 run osmo-stp_10.42.42.5(pid=11178): stdout: | (launched: 2022-12-12_18:13:38.615691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:40.211351 run osmo-stp_10.42.42.5(pid=11178): stderr: | [0;m[38;5;43m20221212181338803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181338803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181338804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181338804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181338805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181338805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181338805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:40.349111 run osmo-stp_10.42.42.5(pid=11178): stdout: | (launched: 2022-12-12_18:13:38.615691) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:40.481146 run osmo-stp_10.42.42.5(pid=11178): stderr: | [0;m[38;5;43m20221212181338803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181338803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181338804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181338804 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181338805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181338805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181338805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:40.637892 run patchelf(pid=11181): Terminating (SIGINT) 18:13:40.817919 run patchelf(pid=11181): Terminated: ok {rc=0} 18:13:40.947617 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11178): Process ended prematurely: osmo-stp_10.42.42.5(pid=11178) [trial-2380↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11178)] [trial-2380↪gprs:trx-sysmocell5000↪ping.py:22] 18:13:40.957356 tst ping.py:22: Test FAILED (6.7 sec) 18:13:40.985874 run osmo-hlr_10.42.42.2(pid=11175): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11175)] 18:13:41.036744 run osmo-hlr_10.42.42.2(pid=11175): stdout: | (launched: 2022-12-12_18:13:37.611870) 18:13:41.089165 run osmo-hlr_10.42.42.2(pid=11175): stderr: | [0;m[1;31m20221212181337807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181337807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181337807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181337807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181337807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181337807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181337826 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181337836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181337836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181337836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:41.141906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11174): Terminating (SIGTERM) 18:13:41.184411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11177): Terminating (SIGTERM) 18:13:41.227044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11180): Terminating (SIGTERM) 18:13:41.269725 --- ParallelTerminationStrategy: PID 11174 died... 18:13:41.289967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11174): Terminated: ok {rc=0} 18:13:41.337358 --- ParallelTerminationStrategy: PID 11177 died... 18:13:41.357403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11177): Terminated: ok {rc=0} 18:13:41.404067 --- ParallelTerminationStrategy: PID 11180 died... 18:13:41.423838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11180): Terminated: ok {rc=0} 18:13:41.513690 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 18:13:42.600874 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:42.612774 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 18:13:42.664768 tst ping_idle_ping.py: using LAC 30596 18:13:42.783406 tst ping_idle_ping.py: using RAC 251 18:13:42.901155 tst ping_idle_ping.py: using CellId 30596 18:13:43.021298 tst ping_idle_ping.py: using BVCI 30597 18:13:43.130935 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:43.142013 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:43.152752 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:43.163994 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:43.175100 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:43.186358 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:43.197888 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 18:13:43.209124 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 18:13:43.329290 tst ping_idle_ping.py:24: start network... 18:13:43.547729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:44.052740 run create_hlr_db(pid=11182): Launched 18:13:44.184486 bus /gobi_6: Setting Powered False 18:13:45.248922 run create_hlr_db(pid=11182): Terminated: ok {rc=0} 18:13:45.682660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11184): Launched 18:13:46.034612 run osmo-hlr_10.42.42.2(pid=11185): Launched 18:13:46.268872 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:46.982216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11187): Launched 18:13:47.322375 run osmo-stp_10.42.42.5(pid=11188): Launched 18:13:47.445192 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:13:48.003220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11190): Launched 18:13:48.119591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:13:48.376112 run patchelf(pid=11191): Launched 18:13:48.547008 run osmo-stp_10.42.42.5(pid=11188): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11188)] 18:13:48.675081 run osmo-stp_10.42.42.5(pid=11188): stdout: | (launched: 2022-12-12_18:13:47.261354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:48.804371 run osmo-stp_10.42.42.5(pid=11188): stderr: | [0;m[38;5;43m20221212181347453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181347453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181347454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181347454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181347454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181347455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181347455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:48.933882 run osmo-stp_10.42.42.5(pid=11188): stdout: | (launched: 2022-12-12_18:13:47.261354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:13:49.058403 run osmo-stp_10.42.42.5(pid=11188): stderr: | [0;m[38;5;43m20221212181347453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181347453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181347454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181347454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181347454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181347455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181347455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:13:49.205861 run patchelf(pid=11191): Terminating (SIGINT) 18:13:49.375647 run patchelf(pid=11191): Terminated: ok {rc=0} 18:13:49.497879 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11188): Process ended prematurely: osmo-stp_10.42.42.5(pid=11188) [trial-2380↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11188)] [trial-2380↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 18:13:49.506918 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 18:13:49.534616 run osmo-hlr_10.42.42.2(pid=11185): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11185)] 18:13:49.582640 run osmo-hlr_10.42.42.2(pid=11185): stdout: | (launched: 2022-12-12_18:13:45.968713) 18:13:49.632432 run osmo-hlr_10.42.42.2(pid=11185): stderr: | [0;m[1;31m20221212181346317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181346318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181346318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181346318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181346318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181346318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181346331 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181346340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181346341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181346341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:13:49.682944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11184): Terminating (SIGTERM) 18:13:49.723523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11187): Terminating (SIGTERM) 18:13:49.764635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11190): Terminating (SIGTERM) 18:13:49.805257 --- ParallelTerminationStrategy: PID 11184 died... 18:13:49.824291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11184): Terminated: ok {rc=0} 18:13:49.868922 --- ParallelTerminationStrategy: PID 11187 died... 18:13:49.887741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11187): Terminated: ok {rc=0} 18:13:49.931899 --- ParallelTerminationStrategy: PID 11190 died... 18:13:49.950601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11190): Terminated: ok {rc=0} 18:13:50.037104 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 18:13:51.348299 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:13:51.354083 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:13:51.388736 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:13:51.427155 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:13:51.517712 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:13:51.552095 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:13:51.590374 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:13:52.182081 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:13:52.231596 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:13:52.242596 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:13:52.291804 tst cs_paging_gprs_active.py: using LAC 30597 18:13:52.410597 tst cs_paging_gprs_active.py: using RAC 252 18:13:52.530035 tst cs_paging_gprs_active.py: using CellId 30597 18:13:52.649992 tst cs_paging_gprs_active.py: using BVCI 30598 18:13:52.762900 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:13:52.774167 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:13:52.785031 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:13:52.796673 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:13:52.807662 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:13:52.818905 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:13:52.830121 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:13:52.841112 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:13:52.852423 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:13:52.969522 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:13:53.086221 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:13:53.292324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:13:53.599439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11195): Launched 18:13:53.868918 run iperf3-srv_10.42.42.10(pid=11196): Launched 18:13:53.984503 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:13:54.189713 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:13:54.498137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11197): Launched 18:13:54.768108 run iperf3-srv_10.42.42.10(pid=11198): Launched 18:13:54.883572 tst cs_paging_gprs_active.py:38: start network... 18:13:55.088511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:13:55.563606 run create_hlr_db(pid=11199): Launched 18:13:55.682238 bus /gobi_6: Setting Powered False 18:13:56.743085 run create_hlr_db(pid=11199): Terminated: ok {rc=0} 18:13:57.192595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11201): Launched 18:13:57.524138 run osmo-hlr_10.42.42.2(pid=11202): Launched 18:13:57.649833 run osmo-stp_10.42.42.5: Starting osmo-stp 18:13:58.212396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11204): Launched 18:13:58.544655 run osmo-stp_10.42.42.5(pid=11205): Launched 18:13:58.671658 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:13:59.239685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11207): Launched 18:13:59.367823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:13:59.647238 run patchelf(pid=11208): Launched 18:13:59.831989 run osmo-stp_10.42.42.5(pid=11205): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11205)] 18:13:59.970075 run osmo-stp_10.42.42.5(pid=11205): stdout: | (launched: 2022-12-12_18:13:58.483190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:00.109878 run osmo-stp_10.42.42.5(pid=11205): stderr: | [0;m[38;5;43m20221212181358674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181358674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181358674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181358675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181358675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181358675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181358675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:00.249834 run osmo-stp_10.42.42.5(pid=11205): stdout: | (launched: 2022-12-12_18:13:58.483190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:00.383692 run osmo-stp_10.42.42.5(pid=11205): stderr: | [0;m[38;5;43m20221212181358674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181358674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181358674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181358675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181358675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181358675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181358675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:00.542883 run patchelf(pid=11208): Terminating (SIGINT) 18:14:00.726307 run patchelf(pid=11208): Terminated: ok {rc=0} 18:14:00.859703 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11205): Process ended prematurely: osmo-stp_10.42.42.5(pid=11205) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11205)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:14:00.870710 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:14:00.901467 run osmo-hlr_10.42.42.2(pid=11202): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11202)] 18:14:00.952611 run osmo-hlr_10.42.42.2(pid=11202): stdout: | (launched: 2022-12-12_18:13:57.462793) 18:14:01.005660 run osmo-hlr_10.42.42.2(pid=11202): stderr: | [0;m[1;31m20221212181357659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181357659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181357659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181357659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181357659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181357659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181357672 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181357683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181357683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181357684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:01.058723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11195): Terminating (SIGTERM) 18:14:01.102304 run iperf3-srv_10.42.42.10(pid=11196): Terminating (SIGTERM) 18:14:01.147954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11197): Terminating (SIGTERM) 18:14:01.192037 run iperf3-srv_10.42.42.10(pid=11198): Terminating (SIGTERM) 18:14:01.237835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11201): Terminating (SIGTERM) 18:14:01.281208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11204): Terminating (SIGTERM) 18:14:01.325864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11207): Terminating (SIGTERM) 18:14:01.368773 --- ParallelTerminationStrategy: PID 11195 died... 18:14:01.389228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11195): Terminated: ok {rc=0} 18:14:01.436005 --- ParallelTerminationStrategy: PID 11196 died... 18:14:01.456229 run iperf3-srv_10.42.42.10(pid=11196): Terminated {rc=256} 18:14:01.503260 --- ParallelTerminationStrategy: PID 11197 died... 18:14:01.523850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11197): Terminated: ok {rc=0} 18:14:01.570686 --- ParallelTerminationStrategy: PID 11198 died... 18:14:01.591224 run iperf3-srv_10.42.42.10(pid=11198): Terminated {rc=256} 18:14:01.637981 --- ParallelTerminationStrategy: PID 11201 died... 18:14:01.657962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11201): Terminated: ok {rc=0} 18:14:01.704526 --- ParallelTerminationStrategy: PID 11204 died... 18:14:01.724696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11204): Terminated: ok {rc=0} 18:14:01.771503 --- ParallelTerminationStrategy: PID 11207 died... 18:14:01.791593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11207): Terminated: ok {rc=0} 18:14:01.880795 bus /gobi_0: Setting Powered False 18:14:02.980624 bus /gobi_0: Setting Powered False 18:14:04.096355 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:14:05.247917 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:05.260353 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:14:05.319436 tst iperf3.py: using LAC 30598 18:14:05.447488 tst iperf3.py: using RAC 253 18:14:05.575215 tst iperf3.py: using CellId 30598 18:14:05.701092 tst iperf3.py: using BVCI 30599 18:14:05.819235 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:05.830927 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:05.842261 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:05.853555 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:05.864637 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:05.875951 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:05.887262 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:05.898400 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:05.909761 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:14:06.026213 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:14:06.230590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:06.537826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11211): Launched 18:14:06.804877 run iperf3-srv_10.42.42.10(pid=11212): Launched 18:14:06.919885 tst iperf3.py:8: start network... 18:14:07.123232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:07.595609 run create_hlr_db(pid=11213): Launched 18:14:07.715176 bus /gobi_6: Setting Powered False 18:14:08.775844 run create_hlr_db(pid=11213): Terminated: ok {rc=0} 18:14:09.222982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11215): Launched 18:14:09.554263 run osmo-hlr_10.42.42.2(pid=11216): Launched 18:14:09.681366 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:10.250279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11218): Launched 18:14:10.579848 run osmo-stp_10.42.42.5(pid=11219): Launched 18:14:10.707263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:11.271710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11221): Launched 18:14:11.398207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:14:11.676485 run patchelf(pid=11222): Launched 18:14:11.859844 run osmo-stp_10.42.42.5(pid=11219): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11219)] 18:14:11.997878 run osmo-stp_10.42.42.5(pid=11219): stdout: | (launched: 2022-12-12_18:14:10.518304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:12.137812 run osmo-stp_10.42.42.5(pid=11219): stderr: | [0;m[38;5;43m20221212181410709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181410709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181410710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181410710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181410710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181410710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181410711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:12.277641 run osmo-stp_10.42.42.5(pid=11219): stdout: | (launched: 2022-12-12_18:14:10.518304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:12.411334 run osmo-stp_10.42.42.5(pid=11219): stderr: | [0;m[38;5;43m20221212181410709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181410709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181410710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181410710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181410710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181410710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181410711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:12.570550 run patchelf(pid=11222): Terminating (SIGINT) 18:14:12.752931 run patchelf(pid=11222): Terminated: ok {rc=0} 18:14:12.884481 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11219): Process ended prematurely: osmo-stp_10.42.42.5(pid=11219) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11219)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 18:14:12.894966 tst iperf3.py:8: Test FAILED (7.7 sec) 18:14:12.923712 run osmo-hlr_10.42.42.2(pid=11216): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11216)] 18:14:12.973932 run osmo-hlr_10.42.42.2(pid=11216): stdout: | (launched: 2022-12-12_18:14:09.493262) 18:14:13.026142 run osmo-hlr_10.42.42.2(pid=11216): stderr: | [0;m[1;31m20221212181409691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181409691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181409691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181409691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181409691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181409691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181409704 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181409714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181409714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181409714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:13.078696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11211): Terminating (SIGTERM) 18:14:13.121197 run iperf3-srv_10.42.42.10(pid=11212): Terminating (SIGTERM) 18:14:13.163483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11215): Terminating (SIGTERM) 18:14:13.205798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11218): Terminating (SIGTERM) 18:14:13.248005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11221): Terminating (SIGTERM) 18:14:13.290710 --- ParallelTerminationStrategy: PID 11211 died... 18:14:13.310956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11211): Terminated: ok {rc=0} 18:14:13.358478 --- ParallelTerminationStrategy: PID 11212 died... 18:14:13.377354 run iperf3-srv_10.42.42.10(pid=11212): Terminated {rc=256} 18:14:13.422036 --- ParallelTerminationStrategy: PID 11215 died... 18:14:13.440759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11215): Terminated: ok {rc=0} 18:14:13.489964 --- ParallelTerminationStrategy: PID 11218 died... 18:14:13.509735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11218): Terminated: ok {rc=0} 18:14:13.556229 --- ParallelTerminationStrategy: PID 11221 died... 18:14:13.576260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11221): Terminated: ok {rc=0} 18:14:13.665656 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:14:14.816767 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:14.829429 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:14:14.883455 tst iperf3m4.py: using LAC 30599 18:14:15.012600 tst iperf3m4.py: using RAC 254 18:14:15.141066 tst iperf3m4.py: using CellId 30599 18:14:15.270506 tst iperf3m4.py: using BVCI 30600 18:14:15.391460 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:15.403225 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:15.414630 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:15.426029 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:15.437461 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:15.448796 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:15.460326 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:15.471711 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:15.483276 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:14:15.608232 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:14:15.732204 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:14:15.851447 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:14:15.983431 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:14:16.211957 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:16.547615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11224): Launched 18:14:16.850677 run iperf3-srv_10.42.42.10(pid=11225): Launched 18:14:17.016886 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:14:17.254859 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:17.589381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11226): Launched 18:14:17.877406 run iperf3-srv_10.42.42.10(pid=11227): Launched 18:14:18.002302 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:14:18.223913 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:18.555568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11228): Launched 18:14:18.842813 run iperf3-srv_10.42.42.10(pid=11229): Launched 18:14:18.967671 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:14:19.189297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:19.520445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11230): Launched 18:14:19.809739 run iperf3-srv_10.42.42.10(pid=11231): Launched 18:14:19.933445 tst iperf3m4.py:8: start network... 18:14:20.155120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:20.666585 run create_hlr_db(pid=11232): Launched 18:14:20.800180 bus /gobi_6: Setting Powered False 18:14:21.864488 run create_hlr_db(pid=11232): Terminated: ok {rc=0} 18:14:22.320659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11235): Launched 18:14:22.652721 run osmo-hlr_10.42.42.2(pid=11236): Launched 18:14:22.779618 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:23.345928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11238): Launched 18:14:23.655180 run osmo-stp_10.42.42.5(pid=11239): Launched 18:14:23.774386 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:24.303896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11241): Launched 18:14:24.422286 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:14:24.681784 run patchelf(pid=11242): Launched 18:14:24.852562 run osmo-stp_10.42.42.5(pid=11239): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11239)] 18:14:24.981659 run osmo-stp_10.42.42.5(pid=11239): stdout: | (launched: 2022-12-12_18:14:23.597647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:25.112495 run osmo-stp_10.42.42.5(pid=11239): stderr: | [0;m[38;5;43m20221212181423767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181423767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181423768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181423768 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181423769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181423769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181423769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:25.243054 run osmo-stp_10.42.42.5(pid=11239): stdout: | (launched: 2022-12-12_18:14:23.597647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:25.368247 run osmo-stp_10.42.42.5(pid=11239): stderr: | [0;m[38;5;43m20221212181423767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181423767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181423768 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181423768 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181423769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181423769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181423769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:25.516395 run patchelf(pid=11242): Terminating (SIGINT) 18:14:25.687770 run patchelf(pid=11242): Terminated: ok {rc=0} 18:14:25.811501 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11239): Process ended prematurely: osmo-stp_10.42.42.5(pid=11239) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11239)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 18:14:25.821216 tst iperf3m4.py:8: Test FAILED (11.0 sec) 18:14:25.849643 run osmo-hlr_10.42.42.2(pid=11236): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11236)] 18:14:25.897792 run osmo-hlr_10.42.42.2(pid=11236): stdout: | (launched: 2022-12-12_18:14:22.591292) 18:14:25.947845 run osmo-hlr_10.42.42.2(pid=11236): stderr: | [0;m[1;31m20221212181422788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181422788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181422788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181422788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181422788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181422788 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181422799 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181422808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181422808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181422808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:25.998159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11224): Terminating (SIGTERM) 18:14:26.038194 run iperf3-srv_10.42.42.10(pid=11225): Terminating (SIGTERM) 18:14:26.077979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11226): Terminating (SIGTERM) 18:14:26.118027 run iperf3-srv_10.42.42.10(pid=11227): Terminating (SIGTERM) 18:14:26.157930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11228): Terminating (SIGTERM) 18:14:26.197907 run iperf3-srv_10.42.42.10(pid=11229): Terminating (SIGTERM) 18:14:26.237458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11230): Terminating (SIGTERM) 18:14:26.277974 run iperf3-srv_10.42.42.10(pid=11231): Terminating (SIGTERM) 18:14:26.317928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11235): Terminating (SIGTERM) 18:14:26.358393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11238): Terminating (SIGTERM) 18:14:26.398166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11241): Terminating (SIGTERM) 18:14:26.438869 --- ParallelTerminationStrategy: PID 11224 died... 18:14:26.458053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11224): Terminated: ok {rc=0} 18:14:26.502639 --- ParallelTerminationStrategy: PID 11225 died... 18:14:26.521182 run iperf3-srv_10.42.42.10(pid=11225): Terminated {rc=256} 18:14:26.565543 --- ParallelTerminationStrategy: PID 11226 died... 18:14:26.584239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11226): Terminated: ok {rc=0} 18:14:26.628686 --- ParallelTerminationStrategy: PID 11227 died... 18:14:26.647303 run iperf3-srv_10.42.42.10(pid=11227): Terminated {rc=256} 18:14:26.692325 --- ParallelTerminationStrategy: PID 11228 died... 18:14:26.711014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11228): Terminated: ok {rc=0} 18:14:26.755419 --- ParallelTerminationStrategy: PID 11229 died... 18:14:26.774101 run iperf3-srv_10.42.42.10(pid=11229): Terminated {rc=256} 18:14:26.818485 --- ParallelTerminationStrategy: PID 11230 died... 18:14:26.837219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11230): Terminated: ok {rc=0} 18:14:26.881746 --- ParallelTerminationStrategy: PID 11231 died... 18:14:26.900242 run iperf3-srv_10.42.42.10(pid=11231): Terminated {rc=256} 18:14:26.944760 --- ParallelTerminationStrategy: PID 11235 died... 18:14:26.963459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11235): Terminated: ok {rc=0} 18:14:27.008007 --- ParallelTerminationStrategy: PID 11238 died... 18:14:27.026773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11238): Terminated: ok {rc=0} 18:14:27.071880 --- ParallelTerminationStrategy: PID 11241 died... 18:14:27.090745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11241): Terminated: ok {rc=0} 18:14:27.176393 bus /gobi_4: Setting Powered False 18:14:28.276070 bus /gobi_4: Setting Powered False 18:14:29.393877 bus /gobi_1: Setting Powered False 18:14:30.492123 bus /gobi_1: Setting Powered False 18:14:31.608066 bus /gobi_0: Setting Powered False 18:14:32.708740 bus /gobi_0: Setting Powered False 18:14:33.825973 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 18:14:34.930518 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:34.942625 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:14:34.994646 tst ping.py: using LAC 30600 18:14:35.114329 tst ping.py: using RAC 255 18:14:35.231867 tst ping.py: using CellId 30600 18:14:35.352216 tst ping.py: using BVCI 30601 18:14:35.471270 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:35.483091 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:35.494604 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:35.506084 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:35.517598 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:35.529313 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:35.541043 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:35.552362 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:14:35.671981 tst ping.py:19: start network... 18:14:35.888680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:36.388364 run create_hlr_db(pid=11244): Launched 18:14:36.520773 bus /gobi_6: Setting Powered False 18:14:37.584590 run create_hlr_db(pid=11244): Terminated: ok {rc=0} 18:14:38.015452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11246): Launched 18:14:38.319637 run osmo-hlr_10.42.42.2(pid=11247): Launched 18:14:38.436508 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:38.969470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Launched 18:14:39.272788 run osmo-stp_10.42.42.5(pid=11250): Launched 18:14:39.389547 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:39.910049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11252): Launched 18:14:40.028258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:14:40.283810 run patchelf(pid=11253): Launched 18:14:40.453462 run osmo-stp_10.42.42.5(pid=11250): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] 18:14:40.580373 run osmo-stp_10.42.42.5(pid=11250): stdout: | (launched: 2022-12-12_18:14:39.215863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:40.709113 run osmo-stp_10.42.42.5(pid=11250): stderr: | [0;m[38;5;43m20221212181439385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181439385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181439385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181439386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181439386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181439386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181439386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:40.837638 run osmo-stp_10.42.42.5(pid=11250): stdout: | (launched: 2022-12-12_18:14:39.215863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:40.960490 run osmo-stp_10.42.42.5(pid=11250): stderr: | [0;m[38;5;43m20221212181439385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181439385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181439385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181439386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181439386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181439386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181439386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:41.106137 run patchelf(pid=11253): Terminating (SIGINT) 18:14:41.274498 run patchelf(pid=11253): Terminated: ok {rc=0} 18:14:41.395864 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11250): Process ended prematurely: osmo-stp_10.42.42.5(pid=11250) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 18:14:41.404888 tst ping.py:22: Test FAILED (6.5 sec) 18:14:41.432321 run osmo-hlr_10.42.42.2(pid=11247): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11247)] 18:14:41.480604 run osmo-hlr_10.42.42.2(pid=11247): stdout: | (launched: 2022-12-12_18:14:38.262880) 18:14:41.530421 run osmo-hlr_10.42.42.2(pid=11247): stderr: | [0;m[1;31m20221212181438436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181438436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181438436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181438436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181438436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181438436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181438448 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181438460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181438460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181438460 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:41.580304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11246): Terminating (SIGTERM) 18:14:41.620358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Terminating (SIGTERM) 18:14:41.660532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11252): Terminating (SIGTERM) 18:14:41.701132 --- ParallelTerminationStrategy: PID 11246 died... 18:14:41.720314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11246): Terminated: ok {rc=0} 18:14:41.765679 --- ParallelTerminationStrategy: PID 11249 died... 18:14:41.784391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11249): Terminated: ok {rc=0} 18:14:41.828930 --- ParallelTerminationStrategy: PID 11252 died... 18:14:41.847625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11252): Terminated: ok {rc=0} 18:14:41.933950 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:14:43.022546 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:43.035657 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:14:43.091446 tst ping_idle_ping.py: using LAC 30601 18:14:43.219766 tst ping_idle_ping.py: using RAC 1 18:14:43.346840 tst ping_idle_ping.py: using CellId 30601 18:14:43.474686 tst ping_idle_ping.py: using BVCI 30602 18:14:43.594592 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:43.606329 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:43.617811 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:43.629358 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:43.640601 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:43.651895 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:43.663478 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:14:43.674812 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:14:43.791914 tst ping_idle_ping.py:24: start network... 18:14:44.010447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:44.516208 run create_hlr_db(pid=11254): Launched 18:14:44.650319 bus /gobi_6: Setting Powered False 18:14:45.714660 run create_hlr_db(pid=11254): Terminated: ok {rc=0} 18:14:46.201522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11256): Launched 18:14:46.533693 run osmo-hlr_10.42.42.2(pid=11257): Launched 18:14:46.805246 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:47.410289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11259): Launched 18:14:47.715588 run osmo-stp_10.42.42.5(pid=11260): Launched 18:14:47.831528 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:48.353356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11262): Launched 18:14:48.479720 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:14:48.754799 run patchelf(pid=11263): Launched 18:14:48.936768 run osmo-stp_10.42.42.5(pid=11260): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11260)] 18:14:49.073285 run osmo-stp_10.42.42.5(pid=11260): stdout: | (launched: 2022-12-12_18:14:47.658550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:49.211553 run osmo-stp_10.42.42.5(pid=11260): stderr: | [0;m[38;5;43m20221212181447827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181447827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181447827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181447828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181447828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181447828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181447828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:49.349768 run osmo-stp_10.42.42.5(pid=11260): stdout: | (launched: 2022-12-12_18:14:47.658550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:14:49.482021 run osmo-stp_10.42.42.5(pid=11260): stderr: | [0;m[38;5;43m20221212181447827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181447827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181447827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181447828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181447828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181447828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181447828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:14:49.639881 run patchelf(pid=11263): Terminating (SIGINT) 18:14:49.820329 run patchelf(pid=11263): Terminated: ok {rc=0} 18:14:49.950228 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11260): Process ended prematurely: osmo-stp_10.42.42.5(pid=11260) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11260)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 18:14:49.959951 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 18:14:49.989010 run osmo-hlr_10.42.42.2(pid=11257): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11257)] 18:14:50.038777 run osmo-hlr_10.42.42.2(pid=11257): stdout: | (launched: 2022-12-12_18:14:46.470294) 18:14:50.090829 run osmo-hlr_10.42.42.2(pid=11257): stderr: | [0;m[1;31m20221212181446696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181446696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181446696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181446696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181446696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181446696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181446712 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181446728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181446729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181446730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:14:50.143266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11256): Terminating (SIGTERM) 18:14:50.184892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11259): Terminating (SIGTERM) 18:14:50.226830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11262): Terminating (SIGTERM) 18:14:50.268921 --- ParallelTerminationStrategy: PID 11256 died... 18:14:50.289195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11256): Terminated: ok {rc=0} 18:14:50.335338 --- ParallelTerminationStrategy: PID 11259 died... 18:14:50.354954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11259): Terminated: ok {rc=0} 18:14:50.401400 --- ParallelTerminationStrategy: PID 11262 died... 18:14:50.421294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11262): Terminated: ok {rc=0} 18:14:50.510020 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:14:51.823317 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:14:51.829763 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:14:51.868125 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:14:51.908113 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:14:51.996649 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:14:52.031236 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:14:52.070866 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:14:52.670729 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:14:52.723558 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:14:52.735367 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:14:52.808185 tst cs_paging_gprs_active.py: using LAC 30602 18:14:52.937128 tst cs_paging_gprs_active.py: using RAC 2 18:14:53.064484 tst cs_paging_gprs_active.py: using CellId 30602 18:14:53.191612 tst cs_paging_gprs_active.py: using BVCI 30603 18:14:53.310067 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:14:53.321746 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:14:53.333052 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:14:53.344379 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:14:53.355742 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:14:53.367649 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:14:53.379258 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:14:53.390554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:14:53.402236 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:14:53.520788 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:14:53.638860 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:14:53.844555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:54.153366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11267): Launched 18:14:54.422083 run iperf3-srv_10.42.42.10(pid=11268): Launched 18:14:54.538014 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:14:54.743263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:14:55.051952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11269): Launched 18:14:55.321203 run iperf3-srv_10.42.42.10(pid=11270): Launched 18:14:55.436415 tst cs_paging_gprs_active.py:38: start network... 18:14:55.642149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:14:56.118005 run create_hlr_db(pid=11271): Launched 18:14:56.236775 bus /gobi_6: Setting Powered False 18:14:57.298425 run create_hlr_db(pid=11271): Terminated: ok {rc=0} 18:14:57.727517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11273): Launched 18:14:58.036613 run osmo-hlr_10.42.42.2(pid=11274): Launched 18:14:58.155691 run osmo-stp_10.42.42.5: Starting osmo-stp 18:14:58.697149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11276): Launched 18:14:59.006715 run osmo-stp_10.42.42.5(pid=11277): Launched 18:14:59.128270 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:14:59.658464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11279): Launched 18:14:59.777237 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:00.037646 run patchelf(pid=11280): Launched 18:15:00.210364 run osmo-stp_10.42.42.5(pid=11277): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11277)] 18:15:00.339692 run osmo-stp_10.42.42.5(pid=11277): stdout: | (launched: 2022-12-12_18:14:58.948748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:00.471037 run osmo-stp_10.42.42.5(pid=11277): stderr: | [0;m[38;5;43m20221212181459116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181459116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181459117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181459117 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181459118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181459118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181459118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:00.602718 run osmo-stp_10.42.42.5(pid=11277): stdout: | (launched: 2022-12-12_18:14:58.948748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:00.727765 run osmo-stp_10.42.42.5(pid=11277): stderr: | [0;m[38;5;43m20221212181459116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181459116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181459117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181459117 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181459118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181459118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181459118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:00.890709 run patchelf(pid=11280): Terminating (SIGINT) 18:15:01.066144 run patchelf(pid=11280): Terminated: ok {rc=0} 18:15:01.192734 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11277): Process ended prematurely: osmo-stp_10.42.42.5(pid=11277) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11277)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:15:01.203729 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:15:01.233425 run osmo-hlr_10.42.42.2(pid=11274): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11274)] 18:15:01.285377 run osmo-hlr_10.42.42.2(pid=11274): stdout: | (launched: 2022-12-12_18:14:57.978804) 18:15:01.337947 run osmo-hlr_10.42.42.2(pid=11274): stderr: | [0;m[1;31m20221212181458155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181458155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181458155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181458155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181458155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181458155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181458166 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181458175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181458175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181458175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:01.391008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11267): Terminating (SIGTERM) 18:15:01.434090 run iperf3-srv_10.42.42.10(pid=11268): Terminating (SIGTERM) 18:15:01.477970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11269): Terminating (SIGTERM) 18:15:01.521055 run iperf3-srv_10.42.42.10(pid=11270): Terminating (SIGTERM) 18:15:01.565043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11273): Terminating (SIGTERM) 18:15:01.607530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11276): Terminating (SIGTERM) 18:15:01.650536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11279): Terminating (SIGTERM) 18:15:01.693453 --- ParallelTerminationStrategy: PID 11267 died... 18:15:01.713305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11267): Terminated: ok {rc=0} 18:15:01.761257 --- ParallelTerminationStrategy: PID 11268 died... 18:15:01.781092 run iperf3-srv_10.42.42.10(pid=11268): Terminated {rc=256} 18:15:01.828677 --- ParallelTerminationStrategy: PID 11269 died... 18:15:01.848929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11269): Terminated: ok {rc=0} 18:15:01.896893 --- ParallelTerminationStrategy: PID 11270 died... 18:15:01.916710 run iperf3-srv_10.42.42.10(pid=11270): Terminated {rc=256} 18:15:01.963714 --- ParallelTerminationStrategy: PID 11273 died... 18:15:01.983592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11273): Terminated: ok {rc=0} 18:15:02.042118 --- ParallelTerminationStrategy: PID 11276 died... 18:15:02.062129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11276): Terminated: ok {rc=0} 18:15:02.112392 --- ParallelTerminationStrategy: PID 11279 died... 18:15:02.132481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11279): Terminated: ok {rc=0} 18:15:02.233138 bus /gobi_0: Setting Powered False 18:15:03.333663 bus /gobi_0: Setting Powered False 18:15:04.449733 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:15:05.600386 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:05.612852 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:15:05.689070 tst iperf3.py: using LAC 30603 18:15:05.816726 tst iperf3.py: using RAC 3 18:15:05.944731 tst iperf3.py: using CellId 30603 18:15:06.074294 tst iperf3.py: using BVCI 30604 18:15:06.193794 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:06.205585 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:06.216894 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:06.228824 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:06.240349 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:06.251917 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:06.263693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:06.275222 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:06.286902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:15:06.408218 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:15:06.631366 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:06.961592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11286): Launched 18:15:07.250362 run iperf3-srv_10.42.42.10(pid=11287): Launched 18:15:07.375360 tst iperf3.py:8: start network... 18:15:07.597132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:08.107866 run create_hlr_db(pid=11288): Launched 18:15:08.243369 bus /gobi_6: Setting Powered False 18:15:09.308678 run create_hlr_db(pid=11288): Terminated: ok {rc=0} 18:15:09.749409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11290): Launched 18:15:10.059755 run osmo-hlr_10.42.42.2(pid=11291): Launched 18:15:10.177370 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:10.721093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11293): Launched 18:15:11.029989 run osmo-stp_10.42.42.5(pid=11294): Launched 18:15:11.148587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:11.680903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11296): Launched 18:15:11.799090 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:12.060069 run patchelf(pid=11297): Launched 18:15:12.244452 run osmo-stp_10.42.42.5(pid=11294): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11294)] 18:15:12.383857 run osmo-stp_10.42.42.5(pid=11294): stdout: | (launched: 2022-12-12_18:15:10.972232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:12.538730 run osmo-stp_10.42.42.5(pid=11294): stderr: | [0;m[38;5;43m20221212181511144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181511145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181511145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181511146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181511146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181511146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181511146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:12.676726 run osmo-stp_10.42.42.5(pid=11294): stdout: | (launched: 2022-12-12_18:15:10.972232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:12.808453 run osmo-stp_10.42.42.5(pid=11294): stderr: | [0;m[38;5;43m20221212181511144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181511145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181511145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181511146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181511146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181511146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181511146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:12.964451 run patchelf(pid=11297): Terminating (SIGINT) 18:15:13.144507 run patchelf(pid=11297): Terminated: ok {rc=0} 18:15:13.274624 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11294): Process ended prematurely: osmo-stp_10.42.42.5(pid=11294) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11294)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 18:15:13.284702 tst iperf3.py:8: Test FAILED (7.7 sec) 18:15:13.314009 run osmo-hlr_10.42.42.2(pid=11291): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11291)] 18:15:13.364267 run osmo-hlr_10.42.42.2(pid=11291): stdout: | (launched: 2022-12-12_18:15:10.001340) 18:15:13.415889 run osmo-hlr_10.42.42.2(pid=11291): stderr: | [0;m[1;31m20221212181510175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181510175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181510176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181510176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181510176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181510176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181510187 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181510196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181510196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181510196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:13.468537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11286): Terminating (SIGTERM) 18:15:13.510507 run iperf3-srv_10.42.42.10(pid=11287): Terminating (SIGTERM) 18:15:13.552732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11290): Terminating (SIGTERM) 18:15:13.595453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11293): Terminating (SIGTERM) 18:15:13.637639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11296): Terminating (SIGTERM) 18:15:13.679877 --- ParallelTerminationStrategy: PID 11286 died... 18:15:13.699853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11286): Terminated: ok {rc=0} 18:15:13.747179 --- ParallelTerminationStrategy: PID 11287 died... 18:15:13.766766 run iperf3-srv_10.42.42.10(pid=11287): Terminated {rc=256} 18:15:13.813513 --- ParallelTerminationStrategy: PID 11290 died... 18:15:13.832819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11290): Terminated: ok {rc=0} 18:15:13.879432 --- ParallelTerminationStrategy: PID 11293 died... 18:15:13.898751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11293): Terminated: ok {rc=0} 18:15:13.945406 --- ParallelTerminationStrategy: PID 11296 died... 18:15:13.965210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11296): Terminated: ok {rc=0} 18:15:14.053977 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:15:15.207107 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:15.219501 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:15:15.292612 tst iperf3m4.py: using LAC 30604 18:15:15.417378 tst iperf3m4.py: using RAC 4 18:15:15.542738 tst iperf3m4.py: using CellId 30604 18:15:15.669034 tst iperf3m4.py: using BVCI 30605 18:15:15.786083 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:15.797735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:15.808870 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:15.820921 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:15.845197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:15.865297 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:15.878893 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:15.898115 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:15.912256 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:15:16.052575 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:15:16.180374 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:15:16.333268 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:15:16.485896 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:15:16.694224 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:17.012841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11298): Launched 18:15:17.292196 run iperf3-srv_10.42.42.10(pid=11299): Launched 18:15:17.405727 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:15:17.607049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:17.910790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11300): Launched 18:15:18.173708 run iperf3-srv_10.42.42.10(pid=11301): Launched 18:15:18.286989 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:15:18.486915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:18.789206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11302): Launched 18:15:19.052619 run iperf3-srv_10.42.42.10(pid=11303): Launched 18:15:19.166207 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:15:19.366750 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:19.669337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11304): Launched 18:15:19.932477 run iperf3-srv_10.42.42.10(pid=11305): Launched 18:15:20.045195 tst iperf3m4.py:8: start network... 18:15:20.244908 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:20.707946 run create_hlr_db(pid=11306): Launched 18:15:20.824577 bus /gobi_6: Setting Powered False 18:15:21.884730 run create_hlr_db(pid=11306): Terminated: ok {rc=0} 18:15:22.325064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11308): Launched 18:15:22.649632 run osmo-hlr_10.42.42.2(pid=11309): Launched 18:15:22.773909 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:23.337278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11311): Launched 18:15:23.666260 run osmo-stp_10.42.42.5(pid=11312): Launched 18:15:23.792382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:24.355949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11314): Launched 18:15:24.480266 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:24.756885 run patchelf(pid=11315): Launched 18:15:24.939272 run osmo-stp_10.42.42.5(pid=11312): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11312)] 18:15:25.076564 run osmo-stp_10.42.42.5(pid=11312): stdout: | (launched: 2022-12-12_18:15:23.605311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:25.215497 run osmo-stp_10.42.42.5(pid=11312): stderr: | [0;m[38;5;43m20221212181523793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181523793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181523793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181523794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181523794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181523794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181523794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:25.354586 run osmo-stp_10.42.42.5(pid=11312): stdout: | (launched: 2022-12-12_18:15:23.605311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:25.487485 run osmo-stp_10.42.42.5(pid=11312): stderr: | [0;m[38;5;43m20221212181523793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181523793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181523793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181523794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181523794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181523794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181523794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:25.645867 run patchelf(pid=11315): Terminating (SIGINT) 18:15:25.828208 run patchelf(pid=11315): Terminated: ok {rc=0} 18:15:25.959962 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11312): Process ended prematurely: osmo-stp_10.42.42.5(pid=11312) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11312)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:15:25.970477 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:15:25.999380 run osmo-hlr_10.42.42.2(pid=11309): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11309)] 18:15:26.049297 run osmo-hlr_10.42.42.2(pid=11309): stdout: | (launched: 2022-12-12_18:15:22.589403) 18:15:26.100748 run osmo-hlr_10.42.42.2(pid=11309): stderr: | [0;m[1;31m20221212181522785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181522785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181522785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181522785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181522785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181522785 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181522797 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181522806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181522806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181522806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:26.152534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11298): Terminating (SIGTERM) 18:15:26.194164 run iperf3-srv_10.42.42.10(pid=11299): Terminating (SIGTERM) 18:15:26.235517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11300): Terminating (SIGTERM) 18:15:26.277087 run iperf3-srv_10.42.42.10(pid=11301): Terminating (SIGTERM) 18:15:26.318383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11302): Terminating (SIGTERM) 18:15:26.359785 run iperf3-srv_10.42.42.10(pid=11303): Terminating (SIGTERM) 18:15:26.401030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11304): Terminating (SIGTERM) 18:15:26.442287 run iperf3-srv_10.42.42.10(pid=11305): Terminating (SIGTERM) 18:15:26.483506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11308): Terminating (SIGTERM) 18:15:26.524829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11311): Terminating (SIGTERM) 18:15:26.566633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11314): Terminating (SIGTERM) 18:15:26.608354 --- ParallelTerminationStrategy: PID 11298 died... 18:15:26.628292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11298): Terminated: ok {rc=0} 18:15:26.674603 --- ParallelTerminationStrategy: PID 11299 died... 18:15:26.694029 run iperf3-srv_10.42.42.10(pid=11299): Terminated {rc=256} 18:15:26.739415 --- ParallelTerminationStrategy: PID 11300 died... 18:15:26.758821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11300): Terminated: ok {rc=0} 18:15:26.804653 --- ParallelTerminationStrategy: PID 11301 died... 18:15:26.824062 run iperf3-srv_10.42.42.10(pid=11301): Terminated {rc=256} 18:15:26.869557 --- ParallelTerminationStrategy: PID 11302 died... 18:15:26.888881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11302): Terminated: ok {rc=0} 18:15:26.934635 --- ParallelTerminationStrategy: PID 11303 died... 18:15:26.953940 run iperf3-srv_10.42.42.10(pid=11303): Terminated {rc=256} 18:15:26.999395 --- ParallelTerminationStrategy: PID 11304 died... 18:15:27.019033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11304): Terminated: ok {rc=0} 18:15:27.064799 --- ParallelTerminationStrategy: PID 11305 died... 18:15:27.084238 run iperf3-srv_10.42.42.10(pid=11305): Terminated {rc=256} 18:15:27.129663 --- ParallelTerminationStrategy: PID 11308 died... 18:15:27.149066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11308): Terminated: ok {rc=0} 18:15:27.194660 --- ParallelTerminationStrategy: PID 11311 died... 18:15:27.214093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11311): Terminated: ok {rc=0} 18:15:27.259690 --- ParallelTerminationStrategy: PID 11314 died... 18:15:27.279057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11314): Terminated: ok {rc=0} 18:15:27.366937 bus /gobi_4: Setting Powered False 18:15:28.466202 bus /gobi_4: Setting Powered False 18:15:29.580375 bus /gobi_1: Setting Powered False 18:15:30.678648 bus /gobi_1: Setting Powered False 18:15:31.790946 bus /gobi_0: Setting Powered False 18:15:32.889962 bus /gobi_0: Setting Powered False 18:15:34.003314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:15:35.106763 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:35.119112 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:15:35.193732 tst ping.py: using LAC 30605 18:15:35.312911 tst ping.py: using RAC 5 18:15:35.439612 tst ping.py: using CellId 30605 18:15:35.566992 tst ping.py: using BVCI 30606 18:15:35.685692 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:35.697211 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:35.708337 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:35.720198 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:35.731969 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:35.743270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:35.755669 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:35.767433 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:15:35.887088 tst ping.py:19: start network... 18:15:36.102121 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:36.596009 run create_hlr_db(pid=11316): Launched 18:15:36.727329 bus /gobi_6: Setting Powered False 18:15:37.790557 run create_hlr_db(pid=11316): Terminated: ok {rc=0} 18:15:38.217125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11318): Launched 18:15:38.515605 run osmo-hlr_10.42.42.2(pid=11319): Launched 18:15:38.630337 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:39.146666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11321): Launched 18:15:39.447508 run osmo-stp_10.42.42.5(pid=11322): Launched 18:15:39.563537 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:40.080751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11324): Launched 18:15:40.194896 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:40.448036 run patchelf(pid=11325): Launched 18:15:40.615784 run osmo-stp_10.42.42.5(pid=11322): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11322)] 18:15:40.741452 run osmo-stp_10.42.42.5(pid=11322): stdout: | (launched: 2022-12-12_18:15:39.391735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:40.869244 run osmo-stp_10.42.42.5(pid=11322): stderr: | [0;m[38;5;43m20221212181539559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181539559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181539560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181539560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181539560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181539560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181539561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:40.996737 run osmo-stp_10.42.42.5(pid=11322): stdout: | (launched: 2022-12-12_18:15:39.391735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:41.119111 run osmo-stp_10.42.42.5(pid=11322): stderr: | [0;m[38;5;43m20221212181539559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181539559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181539560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181539560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181539560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181539560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181539561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:41.263518 run patchelf(pid=11325): Terminating (SIGINT) 18:15:41.430820 run patchelf(pid=11325): Terminated: ok {rc=0} 18:15:41.551304 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11322): Process ended prematurely: osmo-stp_10.42.42.5(pid=11322) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11322)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 18:15:41.560077 tst ping.py:22: Test FAILED (6.4 sec) 18:15:41.587185 run osmo-hlr_10.42.42.2(pid=11319): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11319)] 18:15:41.635205 run osmo-hlr_10.42.42.2(pid=11319): stdout: | (launched: 2022-12-12_18:15:38.459728) 18:15:41.684943 run osmo-hlr_10.42.42.2(pid=11319): stderr: | [0;m[1;31m20221212181538632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181538632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181538632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181538632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181538632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181538632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181538643 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181538653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181538654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181538654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:41.734855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11318): Terminating (SIGTERM) 18:15:41.775078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11321): Terminating (SIGTERM) 18:15:41.815542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11324): Terminating (SIGTERM) 18:15:41.855825 --- ParallelTerminationStrategy: PID 11318 died... 18:15:41.874939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11318): Terminated: ok {rc=0} 18:15:41.919877 --- ParallelTerminationStrategy: PID 11321 died... 18:15:41.938745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11321): Terminated: ok {rc=0} 18:15:41.983079 --- ParallelTerminationStrategy: PID 11324 died... 18:15:42.001727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11324): Terminated: ok {rc=0} 18:15:42.087638 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:15:43.181693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:43.194130 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:15:43.266742 tst ping_idle_ping.py: using LAC 30606 18:15:43.384482 tst ping_idle_ping.py: using RAC 6 18:15:43.501207 tst ping_idle_ping.py: using CellId 30606 18:15:43.618522 tst ping_idle_ping.py: using BVCI 30607 18:15:43.727690 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:43.738749 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:43.749603 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:43.761077 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:43.772298 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:43.783680 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:43.795103 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:15:43.806528 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:15:43.922330 tst ping_idle_ping.py:24: start network... 18:15:44.121070 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:44.589143 run create_hlr_db(pid=11326): Launched 18:15:44.703175 bus /gobi_6: Setting Powered False 18:15:45.763154 run create_hlr_db(pid=11326): Terminated: ok {rc=0} 18:15:46.278571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11328): Launched 18:15:46.620725 run osmo-hlr_10.42.42.2(pid=11329): Launched 18:15:46.859617 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:47.436193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11331): Launched 18:15:47.734588 run osmo-stp_10.42.42.5(pid=11332): Launched 18:15:47.848690 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:48.361685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11334): Launched 18:15:48.476517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:48.729034 run patchelf(pid=11335): Launched 18:15:48.894925 run osmo-stp_10.42.42.5(pid=11332): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11332)] 18:15:49.020531 run osmo-stp_10.42.42.5(pid=11332): stdout: | (launched: 2022-12-12_18:15:47.679488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:49.147861 run osmo-stp_10.42.42.5(pid=11332): stderr: | [0;m[38;5;43m20221212181547845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181547845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181547845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181547846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181547846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181547846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181547846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:49.275563 run osmo-stp_10.42.42.5(pid=11332): stdout: | (launched: 2022-12-12_18:15:47.679488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:15:49.397353 run osmo-stp_10.42.42.5(pid=11332): stderr: | [0;m[38;5;43m20221212181547845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181547845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181547845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181547846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181547846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181547846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181547846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:15:49.541639 run patchelf(pid=11335): Terminating (SIGINT) 18:15:49.708454 run patchelf(pid=11335): Terminated: ok {rc=0} 18:15:49.828607 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11332): Process ended prematurely: osmo-stp_10.42.42.5(pid=11332) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11332)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:15:49.837736 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:15:49.864893 run osmo-hlr_10.42.42.2(pid=11329): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11329)] 18:15:49.913123 run osmo-hlr_10.42.42.2(pid=11329): stdout: | (launched: 2022-12-12_18:15:46.558441) 18:15:49.963153 run osmo-hlr_10.42.42.2(pid=11329): stderr: | [0;m[1;31m20221212181546784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181546784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181546784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181546784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181546784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181546784 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181546836 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181546849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181546849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181546849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:15:50.013179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11328): Terminating (SIGTERM) 18:15:50.053755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11331): Terminating (SIGTERM) 18:15:50.094311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11334): Terminating (SIGTERM) 18:15:50.134519 --- ParallelTerminationStrategy: PID 11328 died... 18:15:50.153645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11328): Terminated: ok {rc=0} 18:15:50.198094 --- ParallelTerminationStrategy: PID 11331 died... 18:15:50.216633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11331): Terminated: ok {rc=0} 18:15:50.261650 --- ParallelTerminationStrategy: PID 11334 died... 18:15:50.280095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11334): Terminated: ok {rc=0} 18:15:50.364556 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:15:51.671206 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:15:51.677722 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:15:51.712073 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:15:51.750727 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:15:51.839870 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:15:51.874472 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:15:51.912897 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:15:52.505260 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:15:52.554916 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:15:52.566140 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:15:52.637350 tst cs_paging_gprs_active.py: using LAC 30607 18:15:52.758266 tst cs_paging_gprs_active.py: using RAC 7 18:15:52.881796 tst cs_paging_gprs_active.py: using CellId 30607 18:15:53.000368 tst cs_paging_gprs_active.py: using BVCI 30608 18:15:53.110069 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:15:53.120934 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:15:53.131874 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:15:53.142997 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:15:53.154178 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:15:53.165222 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:15:53.176337 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:15:53.187349 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:15:53.198545 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:15:53.316311 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:15:53.437972 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:15:53.640164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:53.942224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11339): Launched 18:15:54.207547 run iperf3-srv_10.42.42.10(pid=11340): Launched 18:15:54.322153 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:15:54.525969 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:15:54.831074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11341): Launched 18:15:55.097586 run iperf3-srv_10.42.42.10(pid=11342): Launched 18:15:55.214404 tst cs_paging_gprs_active.py:38: start network... 18:15:55.418166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:15:55.889009 run create_hlr_db(pid=11343): Launched 18:15:56.005477 bus /gobi_6: Setting Powered False 18:15:57.065698 run create_hlr_db(pid=11343): Terminated: ok {rc=0} 18:15:57.488218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11345): Launched 18:15:57.792811 run osmo-hlr_10.42.42.2(pid=11346): Launched 18:15:57.909148 run osmo-stp_10.42.42.5: Starting osmo-stp 18:15:58.429316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11348): Launched 18:15:58.734488 run osmo-stp_10.42.42.5(pid=11349): Launched 18:15:58.852788 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:15:59.373982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11351): Launched 18:15:59.490755 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:15:59.746904 run patchelf(pid=11352): Launched 18:15:59.916203 run osmo-stp_10.42.42.5(pid=11349): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11349)] 18:16:00.044262 run osmo-stp_10.42.42.5(pid=11349): stdout: | (launched: 2022-12-12_18:15:58.678512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:00.174746 run osmo-stp_10.42.42.5(pid=11349): stderr: | [0;m[38;5;43m20221212181558846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181558846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181558846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181558847 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181558847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181558847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181558848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:00.304724 run osmo-stp_10.42.42.5(pid=11349): stdout: | (launched: 2022-12-12_18:15:58.678512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:00.428820 run osmo-stp_10.42.42.5(pid=11349): stderr: | [0;m[38;5;43m20221212181558846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181558846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181558846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181558847 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181558847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181558847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181558848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:00.577089 run patchelf(pid=11352): Terminating (SIGINT) 18:16:00.746922 run patchelf(pid=11352): Terminated: ok {rc=0} 18:16:00.884196 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11349): Process ended prematurely: osmo-stp_10.42.42.5(pid=11349) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11349)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:16:00.894771 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 18:16:00.924219 run osmo-hlr_10.42.42.2(pid=11346): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11346)] 18:16:00.974050 run osmo-hlr_10.42.42.2(pid=11346): stdout: | (launched: 2022-12-12_18:15:57.736848) 18:16:01.025684 run osmo-hlr_10.42.42.2(pid=11346): stderr: | [0;m[1;31m20221212181557912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181557912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181557912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181557912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181557912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181557912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181557929 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181557939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181557939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181557939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:01.078288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11339): Terminating (SIGTERM) 18:16:01.120875 run iperf3-srv_10.42.42.10(pid=11340): Terminating (SIGTERM) 18:16:01.163127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11341): Terminating (SIGTERM) 18:16:01.205758 run iperf3-srv_10.42.42.10(pid=11342): Terminating (SIGTERM) 18:16:01.250815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11345): Terminating (SIGTERM) 18:16:01.293395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11348): Terminating (SIGTERM) 18:16:01.335793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11351): Terminating (SIGTERM) 18:16:01.378180 --- ParallelTerminationStrategy: PID 11339 died... 18:16:01.397888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11339): Terminated: ok {rc=0} 18:16:01.445393 --- ParallelTerminationStrategy: PID 11340 died... 18:16:01.464790 run iperf3-srv_10.42.42.10(pid=11340): Terminated {rc=256} 18:16:01.512242 --- ParallelTerminationStrategy: PID 11341 died... 18:16:01.531831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11341): Terminated: ok {rc=0} 18:16:01.579246 --- ParallelTerminationStrategy: PID 11342 died... 18:16:01.598784 run iperf3-srv_10.42.42.10(pid=11342): Terminated {rc=256} 18:16:01.646065 --- ParallelTerminationStrategy: PID 11345 died... 18:16:01.665823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11345): Terminated: ok {rc=0} 18:16:01.713144 --- ParallelTerminationStrategy: PID 11348 died... 18:16:01.732741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11348): Terminated: ok {rc=0} 18:16:01.780039 --- ParallelTerminationStrategy: PID 11351 died... 18:16:01.799414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11351): Terminated: ok {rc=0} 18:16:01.888357 bus /gobi_0: Setting Powered False 18:16:02.986991 bus /gobi_0: Setting Powered False 18:16:04.102129 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:16:05.248349 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:05.260352 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:16:05.338607 tst iperf3.py: using LAC 30608 18:16:05.456830 tst iperf3.py: using RAC 8 18:16:05.574021 tst iperf3.py: using CellId 30608 18:16:05.694355 tst iperf3.py: using BVCI 30609 18:16:05.806206 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:05.817301 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:05.828137 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:05.839296 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:05.850562 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:05.861649 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:05.872778 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:05.883820 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:05.895056 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:16:06.012145 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:16:06.233251 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:06.558950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11353): Launched 18:16:06.844890 run iperf3-srv_10.42.42.10(pid=11354): Launched 18:16:06.968756 tst iperf3.py:8: start network... 18:16:07.188065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:07.692744 run create_hlr_db(pid=11355): Launched 18:16:07.827151 bus /gobi_6: Setting Powered False 18:16:08.891588 run create_hlr_db(pid=11355): Terminated: ok {rc=0} 18:16:09.325154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11357): Launched 18:16:09.630283 run osmo-hlr_10.42.42.2(pid=11358): Launched 18:16:09.745695 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:10.271934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11360): Launched 18:16:10.577051 run osmo-stp_10.42.42.5(pid=11361): Launched 18:16:10.693989 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:11.215922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11363): Launched 18:16:11.333054 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:11.589800 run patchelf(pid=11364): Launched 18:16:11.760763 run osmo-stp_10.42.42.5(pid=11361): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11361)] 18:16:11.889152 run osmo-stp_10.42.42.5(pid=11361): stdout: | (launched: 2022-12-12_18:16:10.521093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:12.018549 run osmo-stp_10.42.42.5(pid=11361): stderr: | [0;m[38;5;43m20221212181610688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181610689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181610689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181610689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181610690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181610690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181610690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:12.148441 run osmo-stp_10.42.42.5(pid=11361): stdout: | (launched: 2022-12-12_18:16:10.521093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:12.272751 run osmo-stp_10.42.42.5(pid=11361): stderr: | [0;m[38;5;43m20221212181610688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181610689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181610689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181610689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181610690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181610690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181610690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:12.419500 run patchelf(pid=11364): Terminating (SIGINT) 18:16:12.590562 run patchelf(pid=11364): Terminated: ok {rc=0} 18:16:12.713579 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11361): Process ended prematurely: osmo-stp_10.42.42.5(pid=11361) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11361)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 18:16:12.723183 tst iperf3.py:8: Test FAILED (7.5 sec) 18:16:12.751038 run osmo-hlr_10.42.42.2(pid=11358): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11358)] 18:16:12.799138 run osmo-hlr_10.42.42.2(pid=11358): stdout: | (launched: 2022-12-12_18:16:09.574194) 18:16:12.849100 run osmo-hlr_10.42.42.2(pid=11358): stderr: | [0;m[1;31m20221212181609748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181609748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181609748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181609748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181609748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181609748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181609760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181609769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181609769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181609769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:12.899408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11353): Terminating (SIGTERM) 18:16:12.939713 run iperf3-srv_10.42.42.10(pid=11354): Terminating (SIGTERM) 18:16:12.979966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11357): Terminating (SIGTERM) 18:16:13.020277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11360): Terminating (SIGTERM) 18:16:13.060301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11363): Terminating (SIGTERM) 18:16:13.100640 --- ParallelTerminationStrategy: PID 11353 died... 18:16:13.119849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11353): Terminated: ok {rc=0} 18:16:13.164402 --- ParallelTerminationStrategy: PID 11354 died... 18:16:13.182909 run iperf3-srv_10.42.42.10(pid=11354): Terminated {rc=256} 18:16:13.227915 --- ParallelTerminationStrategy: PID 11357 died... 18:16:13.246496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11357): Terminated: ok {rc=0} 18:16:13.290985 --- ParallelTerminationStrategy: PID 11360 died... 18:16:13.309548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11360): Terminated: ok {rc=0} 18:16:13.353752 --- ParallelTerminationStrategy: PID 11363 died... 18:16:13.372324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11363): Terminated: ok {rc=0} 18:16:13.456431 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:16:14.606708 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:14.619322 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:16:14.694286 tst iperf3m4.py: using LAC 30609 18:16:14.822543 tst iperf3m4.py: using RAC 9 18:16:14.950492 tst iperf3m4.py: using CellId 30609 18:16:15.077979 tst iperf3m4.py: using BVCI 30610 18:16:15.188896 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:15.200141 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:15.211267 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:15.222565 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:15.233933 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:15.245228 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:15.256454 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:15.267561 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:15.278999 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:16:15.399780 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:16:15.523660 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:16:15.641403 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:16:15.759870 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:16:15.973710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:16.353627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11365): Launched 18:16:16.685534 run iperf3-srv_10.42.42.10(pid=11366): Launched 18:16:16.823067 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:16:17.047363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:17.381322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11367): Launched 18:16:17.665474 run iperf3-srv_10.42.42.10(pid=11368): Launched 18:16:17.789508 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:16:18.008213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:18.335541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11369): Launched 18:16:18.619219 run iperf3-srv_10.42.42.10(pid=11370): Launched 18:16:18.741772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:16:18.959877 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:16:19.286377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11371): Launched 18:16:19.569448 run iperf3-srv_10.42.42.10(pid=11372): Launched 18:16:19.691715 tst iperf3m4.py:8: start network... 18:16:19.909800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:20.413506 run create_hlr_db(pid=11373): Launched 18:16:20.546580 bus /gobi_6: Setting Powered False 18:16:21.611196 run create_hlr_db(pid=11373): Terminated: ok {rc=0} 18:16:22.063048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11375): Launched 18:16:22.390145 run osmo-hlr_10.42.42.2(pid=11376): Launched 18:16:22.515001 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:23.074145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11378): Launched 18:16:23.400466 run osmo-stp_10.42.42.5(pid=11379): Launched 18:16:23.523320 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:24.082512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11381): Launched 18:16:24.207150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:24.482578 run patchelf(pid=11382): Launched 18:16:24.663389 run osmo-stp_10.42.42.5(pid=11379): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11379)] 18:16:24.800131 run osmo-stp_10.42.42.5(pid=11379): stdout: | (launched: 2022-12-12_18:16:23.340641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:24.938755 run osmo-stp_10.42.42.5(pid=11379): stderr: | [0;m[38;5;43m20221212181623529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181623529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181623529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181623530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181623530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181623530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181623530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:25.077304 run osmo-stp_10.42.42.5(pid=11379): stdout: | (launched: 2022-12-12_18:16:23.340641) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:25.209963 run osmo-stp_10.42.42.5(pid=11379): stderr: | [0;m[38;5;43m20221212181623529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181623529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181623529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181623530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181623530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181623530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181623530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:25.366758 run patchelf(pid=11382): Terminating (SIGINT) 18:16:25.547665 run patchelf(pid=11382): Terminated: ok {rc=0} 18:16:25.678704 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11379): Process ended prematurely: osmo-stp_10.42.42.5(pid=11379) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11379)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:16:25.689102 tst iperf3m4.py:8: Test FAILED (11.1 sec) 18:16:25.718118 run osmo-hlr_10.42.42.2(pid=11376): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11376)] 18:16:25.768052 run osmo-hlr_10.42.42.2(pid=11376): stdout: | (launched: 2022-12-12_18:16:22.330070) 18:16:25.819519 run osmo-hlr_10.42.42.2(pid=11376): stderr: | [0;m[1;31m20221212181622526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181622526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181622526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181622526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181622526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181622526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181622538 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181622547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181622547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181622548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:25.871448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11365): Terminating (SIGTERM) 18:16:25.913369 run iperf3-srv_10.42.42.10(pid=11366): Terminating (SIGTERM) 18:16:25.955216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11367): Terminating (SIGTERM) 18:16:25.997157 run iperf3-srv_10.42.42.10(pid=11368): Terminating (SIGTERM) 18:16:26.038881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11369): Terminating (SIGTERM) 18:16:26.080704 run iperf3-srv_10.42.42.10(pid=11370): Terminating (SIGTERM) 18:16:26.122566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11371): Terminating (SIGTERM) 18:16:26.164282 run iperf3-srv_10.42.42.10(pid=11372): Terminating (SIGTERM) 18:16:26.205993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11375): Terminating (SIGTERM) 18:16:26.247777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11378): Terminating (SIGTERM) 18:16:26.289615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11381): Terminating (SIGTERM) 18:16:26.332026 --- ParallelTerminationStrategy: PID 11365 died... 18:16:26.352182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11365): Terminated: ok {rc=0} 18:16:26.398907 --- ParallelTerminationStrategy: PID 11366 died... 18:16:26.418607 run iperf3-srv_10.42.42.10(pid=11366): Terminated {rc=256} 18:16:26.464499 --- ParallelTerminationStrategy: PID 11367 died... 18:16:26.484204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11367): Terminated: ok {rc=0} 18:16:26.530282 --- ParallelTerminationStrategy: PID 11368 died... 18:16:26.549864 run iperf3-srv_10.42.42.10(pid=11368): Terminated {rc=256} 18:16:26.596044 --- ParallelTerminationStrategy: PID 11369 died... 18:16:26.615697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11369): Terminated: ok {rc=0} 18:16:26.661709 --- ParallelTerminationStrategy: PID 11370 died... 18:16:26.681308 run iperf3-srv_10.42.42.10(pid=11370): Terminated {rc=256} 18:16:26.727277 --- ParallelTerminationStrategy: PID 11371 died... 18:16:26.746951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11371): Terminated: ok {rc=0} 18:16:26.792832 --- ParallelTerminationStrategy: PID 11372 died... 18:16:26.812798 run iperf3-srv_10.42.42.10(pid=11372): Terminated {rc=256} 18:16:26.859195 --- ParallelTerminationStrategy: PID 11375 died... 18:16:26.878884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11375): Terminated: ok {rc=0} 18:16:26.925197 --- ParallelTerminationStrategy: PID 11378 died... 18:16:26.944718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11378): Terminated: ok {rc=0} 18:16:26.990777 --- ParallelTerminationStrategy: PID 11381 died... 18:16:27.010318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11381): Terminated: ok {rc=0} 18:16:27.098377 bus /gobi_4: Setting Powered False 18:16:28.198291 bus /gobi_4: Setting Powered False 18:16:29.314249 bus /gobi_1: Setting Powered False 18:16:30.413888 bus /gobi_1: Setting Powered False 18:16:31.531382 bus /gobi_0: Setting Powered False 18:16:32.630074 bus /gobi_0: Setting Powered False 18:16:33.746060 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:16:34.848918 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:34.861802 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:16:34.935091 tst ping.py: using LAC 30610 18:16:35.053403 tst ping.py: using RAC 10 18:16:35.179083 tst ping.py: using CellId 30610 18:16:35.305235 tst ping.py: using BVCI 30611 18:16:35.420806 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:35.432622 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:35.444126 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:35.455723 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:35.467035 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:35.478442 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:35.490025 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:35.501478 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:16:35.615286 tst ping.py:19: start network... 18:16:35.814970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:36.277645 run create_hlr_db(pid=11383): Launched 18:16:36.393762 bus /gobi_6: Setting Powered False 18:16:37.453443 run create_hlr_db(pid=11383): Terminated: ok {rc=0} 18:16:37.891185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11385): Launched 18:16:38.213273 run osmo-hlr_10.42.42.2(pid=11386): Launched 18:16:38.335092 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:38.898882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11388): Launched 18:16:39.220353 run osmo-stp_10.42.42.5(pid=11389): Launched 18:16:39.342372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:39.894113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11391): Launched 18:16:40.018049 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:40.288185 run patchelf(pid=11392): Launched 18:16:40.468069 run osmo-stp_10.42.42.5(pid=11389): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11389)] 18:16:40.603260 run osmo-stp_10.42.42.5(pid=11389): stdout: | (launched: 2022-12-12_18:16:39.161168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:40.739813 run osmo-stp_10.42.42.5(pid=11389): stderr: | [0;m[38;5;43m20221212181639351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181639351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181639351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181639352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181639352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181639352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181639352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:40.876017 run osmo-stp_10.42.42.5(pid=11389): stdout: | (launched: 2022-12-12_18:16:39.161168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:41.007659 run osmo-stp_10.42.42.5(pid=11389): stderr: | [0;m[38;5;43m20221212181639351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181639351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181639351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181639352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181639352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181639352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181639352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:41.162493 run patchelf(pid=11392): Terminating (SIGINT) 18:16:41.341132 run patchelf(pid=11392): Terminated: ok {rc=0} 18:16:41.469298 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11389): Process ended prematurely: osmo-stp_10.42.42.5(pid=11389) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11389)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 18:16:41.479000 tst ping.py:22: Test FAILED (6.6 sec) 18:16:41.507302 run osmo-hlr_10.42.42.2(pid=11386): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11386)] 18:16:41.557079 run osmo-hlr_10.42.42.2(pid=11386): stdout: | (launched: 2022-12-12_18:16:38.154187) 18:16:41.609150 run osmo-hlr_10.42.42.2(pid=11386): stderr: | [0;m[1;31m20221212181638348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181638348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181638348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181638348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181638348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181638348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181638361 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181638369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181638370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181638370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:41.661284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11385): Terminating (SIGTERM) 18:16:41.703033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11388): Terminating (SIGTERM) 18:16:41.744912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11391): Terminating (SIGTERM) 18:16:41.787053 --- ParallelTerminationStrategy: PID 11385 died... 18:16:41.807142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11385): Terminated: ok {rc=0} 18:16:41.853646 --- ParallelTerminationStrategy: PID 11388 died... 18:16:41.873174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11388): Terminated: ok {rc=0} 18:16:41.919336 --- ParallelTerminationStrategy: PID 11391 died... 18:16:41.939052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11391): Terminated: ok {rc=0} 18:16:42.027256 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:16:43.115917 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:43.129072 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:16:43.205045 tst ping_idle_ping.py: using LAC 30611 18:16:43.331194 tst ping_idle_ping.py: using RAC 11 18:16:43.456097 tst ping_idle_ping.py: using CellId 30611 18:16:43.582409 tst ping_idle_ping.py: using BVCI 30612 18:16:43.698650 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:43.710304 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:43.721781 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:43.733211 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:43.744535 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:43.756010 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:43.767526 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:16:43.778883 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:16:43.895569 tst ping_idle_ping.py:24: start network... 18:16:44.095650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:44.562484 run create_hlr_db(pid=11393): Launched 18:16:44.678572 bus /gobi_6: Setting Powered False 18:16:45.737921 run create_hlr_db(pid=11393): Terminated: ok {rc=0} 18:16:46.217829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11395): Launched 18:16:46.531485 run osmo-hlr_10.42.42.2(pid=11396): Launched 18:16:46.737818 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:47.469807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11398): Launched 18:16:47.791656 run osmo-stp_10.42.42.5(pid=11399): Launched 18:16:47.915468 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:48.467352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11401): Launched 18:16:48.590485 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:48.861742 run patchelf(pid=11402): Launched 18:16:49.040224 run osmo-stp_10.42.42.5(pid=11399): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11399)] 18:16:49.175473 run osmo-stp_10.42.42.5(pid=11399): stdout: | (launched: 2022-12-12_18:16:47.732587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:49.312416 run osmo-stp_10.42.42.5(pid=11399): stderr: | [0;m[38;5;43m20221212181647921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181647921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181647921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181647922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181647922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181647922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181647922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:49.449210 run osmo-stp_10.42.42.5(pid=11399): stdout: | (launched: 2022-12-12_18:16:47.732587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:49.580606 run osmo-stp_10.42.42.5(pid=11399): stderr: | [0;m[38;5;43m20221212181647921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181647921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181647921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181647922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181647922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181647922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181647922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:49.737152 run patchelf(pid=11402): Terminating (SIGINT) 18:16:49.916779 run patchelf(pid=11402): Terminated: ok {rc=0} 18:16:50.046030 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11399): Process ended prematurely: osmo-stp_10.42.42.5(pid=11399) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11399)] [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:16:50.055718 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 18:16:50.083885 run osmo-hlr_10.42.42.2(pid=11396): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11396)] 18:16:50.133633 run osmo-hlr_10.42.42.2(pid=11396): stdout: | (launched: 2022-12-12_18:16:46.475739) 18:16:50.185067 run osmo-hlr_10.42.42.2(pid=11396): stderr: | [0;m[1;31m20221212181646840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181646840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181646840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181646840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181646840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181646840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181646865 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181646882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181646882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181646882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:50.237053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11395): Terminating (SIGTERM) 18:16:50.278858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11398): Terminating (SIGTERM) 18:16:50.320599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11401): Terminating (SIGTERM) 18:16:50.362731 --- ParallelTerminationStrategy: PID 11395 died... 18:16:50.382923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11395): Terminated: ok {rc=0} 18:16:50.429214 --- ParallelTerminationStrategy: PID 11398 died... 18:16:50.448764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11398): Terminated: ok {rc=0} 18:16:50.495095 --- ParallelTerminationStrategy: PID 11401 died... 18:16:50.514961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11401): Terminated: ok {rc=0} 18:16:50.602695 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:16:51.912255 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:16:51.923893 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:16:51.965831 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:16:52.001589 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:16:52.056091 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:16:52.090826 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:16:52.126233 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:16:52.683001 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:16:52.689212 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:52.701227 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:16:52.774127 tst switch_tch_pdch.py: using LAC 30612 18:16:52.893180 tst switch_tch_pdch.py: using RAC 12 18:16:53.009385 tst switch_tch_pdch.py: using CellId 30612 18:16:53.126641 tst switch_tch_pdch.py: using BVCI 30613 18:16:53.234734 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:53.246199 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:53.257421 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:53.269464 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:53.281821 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:53.293613 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:53.305763 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:16:53.317658 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:16:53.440191 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:16:53.556737 tst switch_tch_pdch.py:51: start network... 18:16:53.757327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:16:54.220844 run create_hlr_db(pid=11407): Launched 18:16:54.335823 bus /gobi_6: Setting Powered False 18:16:55.396162 run create_hlr_db(pid=11407): Terminated: ok {rc=0} 18:16:55.835222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11409): Launched 18:16:56.157680 run osmo-hlr_10.42.42.2(pid=11410): Launched 18:16:56.281499 run osmo-stp_10.42.42.5: Starting osmo-stp 18:16:56.836527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11412): Launched 18:16:57.157440 run osmo-stp_10.42.42.5(pid=11413): Launched 18:16:57.281105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:16:57.832565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11415): Launched 18:16:57.954687 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:16:58.224126 run patchelf(pid=11416): Launched 18:16:58.402567 run osmo-stp_10.42.42.5(pid=11413): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11413)] 18:16:58.536570 run osmo-stp_10.42.42.5(pid=11413): stdout: | (launched: 2022-12-12_18:16:57.098752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:58.673622 run osmo-stp_10.42.42.5(pid=11413): stderr: | [0;m[38;5;43m20221212181657287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181657287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181657287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181657288 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181657288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181657288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181657288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:58.809633 run osmo-stp_10.42.42.5(pid=11413): stdout: | (launched: 2022-12-12_18:16:57.098752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:16:58.939912 run osmo-stp_10.42.42.5(pid=11413): stderr: | [0;m[38;5;43m20221212181657287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181657287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181657287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181657288 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181657288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181657288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181657288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:16:59.094464 run patchelf(pid=11416): Terminating (SIGINT) 18:16:59.272109 run patchelf(pid=11416): Terminated: ok {rc=0} 18:16:59.400459 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11413): Process ended prematurely: osmo-stp_10.42.42.5(pid=11413) [trial-2380↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11413)] [trial-2380↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:16:59.410253 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 18:16:59.438153 run osmo-hlr_10.42.42.2(pid=11410): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11410)] 18:16:59.487654 run osmo-hlr_10.42.42.2(pid=11410): stdout: | (launched: 2022-12-12_18:16:56.098760) 18:16:59.538815 run osmo-hlr_10.42.42.2(pid=11410): stderr: | [0;m[1;31m20221212181656295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181656295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181656295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181656295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181656295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181656295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181656307 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181656317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181656318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181656318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:16:59.590664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11409): Terminating (SIGTERM) 18:16:59.632729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11412): Terminating (SIGTERM) 18:16:59.674646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11415): Terminating (SIGTERM) 18:16:59.716655 --- ParallelTerminationStrategy: PID 11409 died... 18:16:59.736718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11409): Terminated: ok {rc=0} 18:16:59.783047 --- ParallelTerminationStrategy: PID 11412 died... 18:16:59.802450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11412): Terminated: ok {rc=0} 18:16:59.848275 --- ParallelTerminationStrategy: PID 11415 died... 18:16:59.867555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11415): Terminated: ok {rc=0} 18:16:59.955689 bus /gobi_0: Setting Powered False 18:17:01.055519 bus /gobi_0: Setting Powered False 18:17:02.185790 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:17:03.441652 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:03.447741 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:17:03.483474 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:17:03.518296 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:17:03.571950 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:17:03.606965 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:17:03.642312 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:17:04.200672 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:17:04.205990 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:17:04.217662 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:17:04.289464 tst switch_tch_pdch.py: using LAC 30613 18:17:04.414125 tst switch_tch_pdch.py: using RAC 13 18:17:04.547424 tst switch_tch_pdch.py: using CellId 30613 18:17:04.673330 tst switch_tch_pdch.py: using BVCI 30614 18:17:04.783540 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:17:04.794916 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:17:04.806155 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:17:04.818356 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:17:04.830322 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:17:04.842269 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:17:04.854489 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:17:04.866233 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:17:04.982794 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:17:05.100499 tst switch_tch_pdch.py:51: start network... 18:17:05.301259 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:05.738558 run create_hlr_db(pid=11424): Launched 18:17:05.852689 bus /gobi_6: Setting Powered False 18:17:06.912431 run create_hlr_db(pid=11424): Terminated: ok {rc=0} 18:17:07.304711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11426): Launched 18:17:07.636121 run osmo-hlr_10.42.42.2(pid=11427): Launched 18:17:07.758843 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:08.279421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11429): Launched 18:17:08.600181 run osmo-stp_10.42.42.5(pid=11430): Launched 18:17:08.722653 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:17:09.244750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11432): Launched 18:17:09.366672 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:17:09.636701 run patchelf(pid=11433): Launched 18:17:09.815806 run osmo-stp_10.42.42.5(pid=11430): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11430)] 18:17:09.950144 run osmo-stp_10.42.42.5(pid=11430): stdout: | (launched: 2022-12-12_18:17:08.541300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:10.085853 run osmo-stp_10.42.42.5(pid=11430): stderr: | [0;m[38;5;43m20221212181708730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181708730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181708730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181708730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181708731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181708731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181708731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:10.221964 run osmo-stp_10.42.42.5(pid=11430): stdout: | (launched: 2022-12-12_18:17:08.541300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:10.352465 run osmo-stp_10.42.42.5(pid=11430): stderr: | [0;m[38;5;43m20221212181708730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181708730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181708730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181708730 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181708731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181708731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181708731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:10.507043 run patchelf(pid=11433): Terminating (SIGINT) 18:17:10.686213 run patchelf(pid=11433): Terminated: ok {rc=0} 18:17:10.814474 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11430): Process ended prematurely: osmo-stp_10.42.42.5(pid=11430) [trial-2380↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11430)] [trial-2380↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:17:10.824015 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 18:17:10.852149 run osmo-hlr_10.42.42.2(pid=11427): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11427)] 18:17:10.902140 run osmo-hlr_10.42.42.2(pid=11427): stdout: | (launched: 2022-12-12_18:17:07.576693) 18:17:10.953548 run osmo-hlr_10.42.42.2(pid=11427): stderr: | [0;m[1;31m20221212181707773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181707773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181707773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181707773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181707773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181707773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181707785 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181707793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181707794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181707794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:11.005394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11426): Terminating (SIGTERM) 18:17:11.047208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11429): Terminating (SIGTERM) 18:17:11.089119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11432): Terminating (SIGTERM) 18:17:11.131133 --- ParallelTerminationStrategy: PID 11426 died... 18:17:11.151293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11426): Terminated: ok {rc=0} 18:17:11.197465 --- ParallelTerminationStrategy: PID 11429 died... 18:17:11.217016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11429): Terminated: ok {rc=0} 18:17:11.263014 --- ParallelTerminationStrategy: PID 11432 died... 18:17:11.282647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11432): Terminated: ok {rc=0} 18:17:11.369955 bus /gobi_0: Setting Powered False 18:17:12.470241 bus /gobi_0: Setting Powered False 18:17:13.585962 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_sms:trx-umtrx --------------------------------------------------------------------- 18:17:14.848265 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:14.852446 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 18:17:14.885626 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 18:17:14.892645 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 18:17:14.946993 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 18:17:14.980780 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 18:17:14.987777 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 18:17:15.524774 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 18:17:15.529911 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 18:17:15.541095 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 18:17:15.589013 tst mo_mt_sms.py: using LAC 30614 18:17:15.712558 tst mo_mt_sms.py: using RAC 14 18:17:15.839285 tst mo_mt_sms.py: using CellId 30614 18:17:15.979552 tst mo_mt_sms.py: using BVCI 30615 18:17:16.108808 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 18:17:16.231111 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 18:17:16.353047 tst mo_mt_sms.py:9: start nitb and bts... 18:17:16.569118 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:17:17.228361 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11438): Launched 18:17:17.529185 run osmo-nitb_10.42.42.2(pid=11439): Launched 18:17:17.695863 run osmo-nitb_10.42.42.2(pid=11439): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11439)] 18:17:17.829908 run osmo-nitb_10.42.42.2(pid=11439): stdout: | (launched: 2022-12-12_18:17:17.473704) 18:17:17.965380 run osmo-nitb_10.42.42.2(pid=11439): stderr: | (launched: 2022-12-12_18:17:17.518153) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:17:18.101154 run osmo-nitb_10.42.42.2(pid=11439): stdout: | (launched: 2022-12-12_18:17:17.473704) 18:17:18.231066 run osmo-nitb_10.42.42.2(pid=11439): stderr: | (launched: 2022-12-12_18:17:17.518153) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11439): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11439) [trial-2380↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11439)] 18:17:18.642881 tst osmo-nitb_10.42.42.2(pid=11439): stdout: | (launched: 2022-12-12_18:17:17.473704) 18:17:18.764226 tst osmo-nitb_10.42.42.2(pid=11439): stderr: | (launched: 2022-12-12_18:17:17.518153) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:17:18.906275 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=11439): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11439) [trial-2380↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11439)] [trial-2380↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 18:17:18.914867 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 18:17:18.921556 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11438): Terminating (SIGTERM) 18:17:19.131184 --- ParallelTerminationStrategy: PID 11438 died... 18:17:19.152006 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11438): Terminated: ok {rc=0} 18:17:19.239000 bus /sierra_3: Setting Powered False 18:17:20.339820 bus /sierra_3: Setting Powered False 18:17:21.455779 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 sms:trx-umtrx --------------------------------------------------------------------- 18:17:22.656070 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:22.660365 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 18:17:22.693907 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:17:22.721321 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 18:17:22.774942 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 18:17:22.808894 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:17:22.836314 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 18:17:23.382486 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 18:17:23.387612 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:17:23.398742 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 18:17:23.446360 tst mo_mt_sms.py: using LAC 30615 18:17:23.572424 tst mo_mt_sms.py: using RAC 15 18:17:23.696704 tst mo_mt_sms.py: using CellId 30615 18:17:23.822257 tst mo_mt_sms.py: using BVCI 30616 18:17:23.937594 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:17:23.948499 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:17:23.959328 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:17:23.970253 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:17:23.981093 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:17:23.991972 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 18:17:24.107320 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 18:17:24.226218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:24.721735 run create_hlr_db(pid=11443): Launched 18:17:24.853633 bus /sierra_2: Setting Powered False 18:17:25.916613 run create_hlr_db(pid=11443): Terminated: ok {rc=0} 18:17:26.360455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11445): Launched 18:17:26.679842 run osmo-hlr_10.42.42.2(pid=11446): Launched 18:17:26.800695 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:27.348333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11448): Launched 18:17:27.670508 run osmo-stp_10.42.42.5(pid=11449): Launched 18:17:27.794502 run osmo-msc_10.42.42.6: Starting osmo-msc 18:17:28.373285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11451): Launched 18:17:28.693271 run osmo-msc_10.42.42.6(pid=11452): Launched 18:17:28.873186 run osmo-stp_10.42.42.5(pid=11449): ERR: Terminated: ERROR {rc=1} [trial-2380↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11449)] 18:17:29.007231 run osmo-stp_10.42.42.5(pid=11449): stdout: | (launched: 2022-12-12_18:17:27.610536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:29.141827 run osmo-stp_10.42.42.5(pid=11449): stderr: | [0;m[38;5;43m20221212181727798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181727798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181727798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181727799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181727799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181727799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181727799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:29.275248 run osmo-stp_10.42.42.5(pid=11449): stdout: | (launched: 2022-12-12_18:17:27.610536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:29.402036 run osmo-stp_10.42.42.5(pid=11449): stderr: | [0;m[38;5;43m20221212181727798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181727798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181727798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181727799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181727799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181727799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181727799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:29.553435 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=11449): Process ended prematurely: osmo-stp_10.42.42.5(pid=11449) [trial-2380↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11449)] [trial-2380↪sms:trx-umtrx↪mo_mt_sms.py:16] 18:17:29.562838 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 18:17:29.590676 run osmo-hlr_10.42.42.2(pid=11446): ERR: Terminated: ERROR {rc=237} [trial-2380↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11446)] 18:17:29.641279 run osmo-hlr_10.42.42.2(pid=11446): stdout: | (launched: 2022-12-12_18:17:26.621065) 18:17:29.693525 run osmo-hlr_10.42.42.2(pid=11446): stderr: | [0;m[1;31m20221212181726814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181726814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181726814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181726814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181726814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181726814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181726827 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181726835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181726835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181726835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:29.765525 run osmo-msc_10.42.42.6(pid=11452): ERR: Terminated: ERROR {rc=2} [trial-2380↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11452)] 18:17:29.815358 run osmo-msc_10.42.42.6(pid=11452): stdout: | (launched: 2022-12-12_18:17:28.634259) 18:17:29.867027 run osmo-msc_10.42.42.6(pid=11452): stderr: | [0;m[38;5;43m20221212181728953 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181728953 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fef79abac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181728953 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181728953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181728953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181728953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181728955 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181728955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181728956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181728956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:17:29.918911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11445): Terminating (SIGTERM) 18:17:29.960540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11448): Terminating (SIGTERM) 18:17:30.002253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11451): Terminating (SIGTERM) 18:17:30.044155 --- ParallelTerminationStrategy: PID 11445 died... 18:17:30.063811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11445): Terminated: ok {rc=0} 18:17:30.109747 --- ParallelTerminationStrategy: PID 11448 died... 18:17:30.129403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11448): Terminated: ok {rc=0} 18:17:30.175041 --- ParallelTerminationStrategy: PID 11451 died... 18:17:30.194597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11451): Terminated: ok {rc=0} 18:17:30.282725 bus /sierra_3: Setting Powered False 18:17:31.379911 bus /sierra_3: Setting Powered False 18:17:32.494581 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 18:17:33.726843 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:33.731075 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 18:17:33.764527 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 18:17:33.771491 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 18:17:33.807944 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 18:17:33.841222 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 18:17:33.848223 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 18:17:34.368358 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2380 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 18:17:34.374211 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 18:17:34.385611 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 18:17:34.434343 tst assert_extension.py: using LAC 30616 18:17:34.558347 tst assert_extension.py: using RAC 16 18:17:34.684549 tst assert_extension.py: using CellId 30616 18:17:34.810511 tst assert_extension.py: using BVCI 30617 18:17:34.927388 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 18:17:35.042493 tst assert_extension.py:10: start nitb and bts... 18:17:35.243154 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:17:35.854068 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11457): Launched 18:17:36.154270 run osmo-nitb_10.42.42.2(pid=11458): Launched 18:17:36.321781 run osmo-nitb_10.42.42.2(pid=11458): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11458)] 18:17:36.455465 run osmo-nitb_10.42.42.2(pid=11458): stdout: | (launched: 2022-12-12_18:17:36.099074) 18:17:36.590647 run osmo-nitb_10.42.42.2(pid=11458): stderr: | (launched: 2022-12-12_18:17:36.143132) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:17:36.725909 run osmo-nitb_10.42.42.2(pid=11458): stdout: | (launched: 2022-12-12_18:17:36.099074) 18:17:36.855344 run osmo-nitb_10.42.42.2(pid=11458): stderr: | (launched: 2022-12-12_18:17:36.143132) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11458): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11458) [trial-2380↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11458)] 18:17:37.269277 tst osmo-nitb_10.42.42.2(pid=11458): stdout: | (launched: 2022-12-12_18:17:36.099074) 18:17:37.389855 tst osmo-nitb_10.42.42.2(pid=11458): stderr: | (launched: 2022-12-12_18:17:36.143132) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:17:37.531935 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=11458): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11458) [trial-2380↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11458)] [trial-2380↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 18:17:37.540589 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:17:37.547435 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11457): Terminating (SIGTERM) 18:17:37.757224 --- ParallelTerminationStrategy: PID 11457 died... 18:17:37.777598 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11457): Terminated: ok {rc=0} 18:17:37.863488 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 ussd:trx-umtrx --------------------------------------------------------------------- 18:17:39.041524 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:39.045494 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 18:17:39.078661 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:17:39.105150 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 18:17:39.141332 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 18:17:39.173751 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:17:39.200057 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 18:17:39.727041 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2380 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 18:17:39.732360 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:17:39.743056 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 18:17:39.791666 tst assert_extension.py: using LAC 30617 18:17:39.910337 tst assert_extension.py: using RAC 17 18:17:40.029389 tst assert_extension.py: using CellId 30617 18:17:40.149251 tst assert_extension.py: using BVCI 30618 18:17:40.258285 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:17:40.269032 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:17:40.279798 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:17:40.290782 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:17:40.301527 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:17:40.312405 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 18:17:40.429698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:40.926686 run create_hlr_db(pid=11462): Launched 18:17:41.059733 bus /sierra_2: Setting Powered False 18:17:42.122463 run create_hlr_db(pid=11462): Terminated: ok {rc=0} 18:17:42.549526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11464): Launched 18:17:42.849285 run osmo-hlr_10.42.42.2(pid=11465): Launched 18:17:42.964537 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:43.487658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11467): Launched 18:17:43.786641 run osmo-stp_10.42.42.5(pid=11468): Launched 18:17:43.900863 run osmo-msc_10.42.42.6: Starting osmo-msc 18:17:44.439771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11470): Launched 18:17:44.738894 run osmo-msc_10.42.42.6(pid=11471): Launched 18:17:44.906241 run osmo-stp_10.42.42.5(pid=11468): ERR: Terminated: ERROR {rc=1} [trial-2380↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11468)] 18:17:45.033203 run osmo-stp_10.42.42.5(pid=11468): stdout: | (launched: 2022-12-12_18:17:43.731350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:45.159049 run osmo-stp_10.42.42.5(pid=11468): stderr: | [0;m[38;5;43m20221212181743897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181743897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181743897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181743898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181743898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181743898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181743898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:45.282796 run osmo-stp_10.42.42.5(pid=11468): stdout: | (launched: 2022-12-12_18:17:43.731350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:45.400642 run osmo-stp_10.42.42.5(pid=11468): stderr: | [0;m[38;5;43m20221212181743897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181743897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181743897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181743898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181743898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181743898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181743898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:45.542084 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=11468): Process ended prematurely: osmo-stp_10.42.42.5(pid=11468) [trial-2380↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11468)] [trial-2380↪ussd:trx-umtrx↪assert_extension.py:17] 18:17:45.550390 tst assert_extension.py:17: Test FAILED (5.8 sec) 18:17:45.576765 run osmo-hlr_10.42.42.2(pid=11465): ERR: Terminated: ERROR {rc=237} [trial-2380↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11465)] 18:17:45.625539 run osmo-hlr_10.42.42.2(pid=11465): stdout: | (launched: 2022-12-12_18:17:42.793612) 18:17:45.674795 run osmo-hlr_10.42.42.2(pid=11465): stderr: | [0;m[1;31m20221212181742967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181742967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181742967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181742967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181742967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181742967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181742980 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181742991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181742991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181742991 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:45.743683 run osmo-msc_10.42.42.6(pid=11471): ERR: Terminated: ERROR {rc=2} [trial-2380↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11471)] 18:17:45.791422 run osmo-msc_10.42.42.6(pid=11471): stdout: | (launched: 2022-12-12_18:17:44.683772) 18:17:45.847297 run osmo-msc_10.42.42.6(pid=11471): stderr: | [0;m[38;5;43m20221212181744952 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181744952 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb7564a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181744952 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181744952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181744952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181744953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181744954 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181744955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181744955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181744955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:17:45.897967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11464): Terminating (SIGTERM) 18:17:45.938826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11467): Terminating (SIGTERM) 18:17:45.979652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11470): Terminating (SIGTERM) 18:17:46.021111 --- ParallelTerminationStrategy: PID 11464 died... 18:17:46.040461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11464): Terminated: ok {rc=0} 18:17:46.089382 --- ParallelTerminationStrategy: PID 11467 died... 18:17:46.110018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11467): Terminated: ok {rc=0} 18:17:46.159846 --- ParallelTerminationStrategy: PID 11470 died... 18:17:46.181431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11470): Terminated: ok {rc=0} 18:17:46.276252 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:17:47.496728 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:17:47.504471 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:17:47.540164 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:17:47.568639 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:17:47.621252 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:17:47.655259 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:17:47.683491 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:17:48.236092 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:17:48.288535 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:48.300902 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:17:48.371626 tst mo_mt_call.py: using LAC 30618 18:17:48.504329 tst mo_mt_call.py: using RAC 18 18:17:48.632052 tst mo_mt_call.py: using CellId 30618 18:17:48.761724 tst mo_mt_call.py: using BVCI 30619 18:17:48.881481 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:48.893185 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:48.904630 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:48.916659 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:48.929049 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:48.941086 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:17:49.059327 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:17:49.175416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:49.646538 run create_hlr_db(pid=11476): Launched 18:17:49.764567 bus /sierra_2: Setting Powered False 18:17:50.825931 run create_hlr_db(pid=11476): Terminated: ok {rc=0} 18:17:51.250164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11478): Launched 18:17:51.554326 run osmo-hlr_10.42.42.2(pid=11479): Launched 18:17:51.671056 run osmo-stp_10.42.42.5: Starting osmo-stp 18:17:52.196845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11481): Launched 18:17:52.501699 run osmo-stp_10.42.42.5(pid=11482): Launched 18:17:52.618649 run osmo-msc_10.42.42.6: Starting osmo-msc 18:17:53.170283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11484): Launched 18:17:53.475195 run osmo-msc_10.42.42.6(pid=11485): Launched 18:17:53.645827 run osmo-stp_10.42.42.5(pid=11482): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11482)] 18:17:53.774377 run osmo-stp_10.42.42.5(pid=11482): stdout: | (launched: 2022-12-12_18:17:52.445296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:53.901799 run osmo-stp_10.42.42.5(pid=11482): stderr: | [0;m[38;5;43m20221212181752614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181752614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181752614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181752614 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181752615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181752615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181752615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:54.027880 run osmo-stp_10.42.42.5(pid=11482): stdout: | (launched: 2022-12-12_18:17:52.445296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:17:54.148285 run osmo-stp_10.42.42.5(pid=11482): stderr: | [0;m[38;5;43m20221212181752614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181752614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181752614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181752614 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181752615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181752615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181752615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:17:54.292373 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11482): Process ended prematurely: osmo-stp_10.42.42.5(pid=11482) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11482)] [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:17:54.301497 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:17:54.328115 run osmo-hlr_10.42.42.2(pid=11479): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11479)] 18:17:54.376352 run osmo-hlr_10.42.42.2(pid=11479): stdout: | (launched: 2022-12-12_18:17:51.498223) 18:17:54.425984 run osmo-hlr_10.42.42.2(pid=11479): stderr: | [0;m[1;31m20221212181751670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181751670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181751670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181751670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181751670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181751670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181751683 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181751691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181751691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181751691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:17:54.494969 run osmo-msc_10.42.42.6(pid=11485): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11485)] 18:17:54.542806 run osmo-msc_10.42.42.6(pid=11485): stdout: | (launched: 2022-12-12_18:17:53.419103) 18:17:54.592144 run osmo-msc_10.42.42.6(pid=11485): stderr: | [0;m[38;5;43m20221212181753687 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181753687 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb7a4710c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181753687 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181753687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181753688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181753688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181753690 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181753690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181753690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181753690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:17:54.641935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11478): Terminating (SIGTERM) 18:17:54.681483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11481): Terminating (SIGTERM) 18:17:54.721288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11484): Terminating (SIGTERM) 18:17:54.761919 --- ParallelTerminationStrategy: PID 11478 died... 18:17:54.781093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11478): Terminated: ok {rc=0} 18:17:54.825449 --- ParallelTerminationStrategy: PID 11481 died... 18:17:54.843828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11481): Terminated: ok {rc=0} 18:17:54.888159 --- ParallelTerminationStrategy: PID 11484 died... 18:17:54.906625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11484): Terminated: ok {rc=0} 18:17:54.991769 bus /sierra_3: Setting Powered False 18:17:56.092598 bus /sierra_3: Setting Powered False 18:17:57.209180 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:17:58.355908 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:58.368114 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:17:58.436427 tst mo_mt_call_osmux.py: using LAC 30619 18:17:58.554027 tst mo_mt_call_osmux.py: using RAC 19 18:17:58.674016 tst mo_mt_call_osmux.py: using CellId 30619 18:17:58.793854 tst mo_mt_call_osmux.py: using BVCI 30620 18:17:58.905811 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:58.917475 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:58.928351 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:58.939347 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:58.950863 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:17:58.962135 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:17:59.083166 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:17:59.198881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:17:59.667599 run create_hlr_db(pid=11487): Launched 18:17:59.783580 bus /sierra_2: Setting Powered False 18:18:00.849567 run create_hlr_db(pid=11487): Terminated: ok {rc=0} 18:18:01.316354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11489): Launched 18:18:01.656126 run osmo-hlr_10.42.42.2(pid=11490): Launched 18:18:01.823686 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:02.552216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11492): Launched 18:18:02.856401 run osmo-stp_10.42.42.5(pid=11493): Launched 18:18:02.971953 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:03.519332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11495): Launched 18:18:03.823141 run osmo-msc_10.42.42.6(pid=11496): Launched 18:18:03.993494 run osmo-stp_10.42.42.5(pid=11493): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11493)] 18:18:04.120764 run osmo-stp_10.42.42.5(pid=11493): stdout: | (launched: 2022-12-12_18:18:02.800300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:04.248013 run osmo-stp_10.42.42.5(pid=11493): stderr: | [0;m[38;5;43m20221212181802969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181802969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181802969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181802970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181802970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181802970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181802970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:04.373646 run osmo-stp_10.42.42.5(pid=11493): stdout: | (launched: 2022-12-12_18:18:02.800300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:04.494180 run osmo-stp_10.42.42.5(pid=11493): stderr: | [0;m[38;5;43m20221212181802969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181802969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181802969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181802970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181802970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181802970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181802970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:04.638168 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11493): Process ended prematurely: osmo-stp_10.42.42.5(pid=11493) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11493)] [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:18:04.647122 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:18:04.674194 run osmo-hlr_10.42.42.2(pid=11490): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11490)] 18:18:04.722058 run osmo-hlr_10.42.42.2(pid=11490): stdout: | (launched: 2022-12-12_18:18:01.590335) 18:18:04.771605 run osmo-hlr_10.42.42.2(pid=11490): stderr: | [0;m[1;31m20221212181801987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181801987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181801987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181801988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181801988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181801989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181802019 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181802035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181802038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181802038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:04.840380 run osmo-msc_10.42.42.6(pid=11496): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11496)] 18:18:04.888077 run osmo-msc_10.42.42.6(pid=11496): stdout: | (launched: 2022-12-12_18:18:03.767206) 18:18:04.937274 run osmo-msc_10.42.42.6(pid=11496): stderr: | [0;m[38;5;43m20221212181804036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181804036 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f414d06ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181804036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181804036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181804036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181804036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181804038 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181804039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181804039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181804039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:04.986899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11489): Terminating (SIGTERM) 18:18:05.026552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11492): Terminating (SIGTERM) 18:18:05.066092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11495): Terminating (SIGTERM) 18:18:05.106321 --- ParallelTerminationStrategy: PID 11489 died... 18:18:05.125624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11489): Terminated: ok {rc=0} 18:18:05.169679 --- ParallelTerminationStrategy: PID 11492 died... 18:18:05.188107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11492): Terminated: ok {rc=0} 18:18:05.231974 --- ParallelTerminationStrategy: PID 11495 died... 18:18:05.250402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11495): Terminated: ok {rc=0} 18:18:05.336709 bus /sierra_3: Setting Powered False 18:18:06.436333 bus /sierra_3: Setting Powered False 18:18:07.552190 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:18:08.799506 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:18:08.806478 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:18:08.840434 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:18:08.866969 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:18:08.919184 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:18:08.951540 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:18:08.977903 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:18:09.530131 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:18:09.579241 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:09.590343 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:18:09.658753 tst mo_mt_call.py: using LAC 30620 18:18:09.778840 tst mo_mt_call.py: using RAC 20 18:18:09.899465 tst mo_mt_call.py: using CellId 30620 18:18:10.019603 tst mo_mt_call.py: using BVCI 30621 18:18:10.130710 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:10.141907 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:10.152700 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:10.164014 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:10.175876 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:10.186974 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:18:10.307714 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:18:10.424490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:10.895106 run create_hlr_db(pid=11501): Launched 18:18:11.011403 bus /sierra_2: Setting Powered False 18:18:12.073237 run create_hlr_db(pid=11501): Terminated: ok {rc=0} 18:18:12.498583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11503): Launched 18:18:12.802939 run osmo-hlr_10.42.42.2(pid=11504): Launched 18:18:12.921420 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:13.484538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11506): Launched 18:18:13.811415 run osmo-stp_10.42.42.5(pid=11507): Launched 18:18:13.936345 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:14.524607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11509): Launched 18:18:14.850744 run osmo-msc_10.42.42.6(pid=11510): Launched 18:18:15.032679 run osmo-stp_10.42.42.5(pid=11507): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11507)] 18:18:15.168642 run osmo-stp_10.42.42.5(pid=11507): stdout: | (launched: 2022-12-12_18:18:13.751937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:15.305850 run osmo-stp_10.42.42.5(pid=11507): stderr: | [0;m[38;5;43m20221212181813941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181813941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181813941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181813941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181813942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181813942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181813942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:15.441402 run osmo-stp_10.42.42.5(pid=11507): stdout: | (launched: 2022-12-12_18:18:13.751937) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:15.570918 run osmo-stp_10.42.42.5(pid=11507): stderr: | [0;m[38;5;43m20221212181813941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181813941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181813941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181813941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181813942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181813942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181813942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:15.726623 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11507): Process ended prematurely: osmo-stp_10.42.42.5(pid=11507) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11507)] [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:18:15.736367 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:18:15.764486 run osmo-hlr_10.42.42.2(pid=11504): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11504)] 18:18:15.814866 run osmo-hlr_10.42.42.2(pid=11504): stdout: | (launched: 2022-12-12_18:18:12.746626) 18:18:15.883249 run osmo-hlr_10.42.42.2(pid=11504): stderr: | [0;m[1;31m20221212181812919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181812919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181812919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181812920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181812920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181812920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181812931 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181812940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181812940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181812940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:15.967779 run osmo-msc_10.42.42.6(pid=11510): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11510)] 18:18:16.019456 run osmo-msc_10.42.42.6(pid=11510): stdout: | (launched: 2022-12-12_18:18:14.791115) 18:18:16.077252 run osmo-msc_10.42.42.6(pid=11510): stderr: | [0;m[38;5;43m20221212181815110 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181815110 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdb5a248c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181815110 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181815110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181815111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181815111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181815112 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181815113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181815113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181815113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:16.130702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11503): Terminating (SIGTERM) 18:18:16.174818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11506): Terminating (SIGTERM) 18:18:16.221903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11509): Terminating (SIGTERM) 18:18:16.268486 --- ParallelTerminationStrategy: PID 11503 died... 18:18:16.289265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11503): Terminated: ok {rc=0} 18:18:16.339399 --- ParallelTerminationStrategy: PID 11506 died... 18:18:16.359636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11506): Terminated: ok {rc=0} 18:18:16.408273 --- ParallelTerminationStrategy: PID 11509 died... 18:18:16.428111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11509): Terminated: ok {rc=0} 18:18:16.523796 bus /sierra_3: Setting Powered False 18:18:17.633408 bus /sierra_3: Setting Powered False 18:18:18.749995 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:18:19.897733 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:19.909812 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:18:19.980239 tst mo_mt_call_osmux.py: using LAC 30621 18:18:20.098959 tst mo_mt_call_osmux.py: using RAC 21 18:18:20.219966 tst mo_mt_call_osmux.py: using CellId 30621 18:18:20.340475 tst mo_mt_call_osmux.py: using BVCI 30622 18:18:20.451830 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:20.463023 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:20.474073 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:20.485434 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:20.496709 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:18:20.507973 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:18:20.629375 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:18:20.755737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:21.260168 run create_hlr_db(pid=11512): Launched 18:18:21.393086 bus /sierra_2: Setting Powered False 18:18:22.457880 run create_hlr_db(pid=11512): Terminated: ok {rc=0} 18:18:22.892819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11514): Launched 18:18:23.197234 run osmo-hlr_10.42.42.2(pid=11515): Launched 18:18:23.312827 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:23.848272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11517): Launched 18:18:24.153440 run osmo-stp_10.42.42.5(pid=11518): Launched 18:18:24.270099 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:24.820579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11520): Launched 18:18:25.125799 run osmo-msc_10.42.42.6(pid=11521): Launched 18:18:25.296640 run osmo-stp_10.42.42.5(pid=11518): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11518)] 18:18:25.425166 run osmo-stp_10.42.42.5(pid=11518): stdout: | (launched: 2022-12-12_18:18:24.097061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:25.552711 run osmo-stp_10.42.42.5(pid=11518): stderr: | [0;m[38;5;43m20221212181824264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181824265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181824265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181824265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181824266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181824266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181824266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:25.678733 run osmo-stp_10.42.42.5(pid=11518): stdout: | (launched: 2022-12-12_18:18:24.097061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:25.799537 run osmo-stp_10.42.42.5(pid=11518): stderr: | [0;m[38;5;43m20221212181824264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181824265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181824265 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181824265 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181824266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181824266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181824266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:25.943900 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11518): Process ended prematurely: osmo-stp_10.42.42.5(pid=11518) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11518)] [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:18:25.952994 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:18:25.979731 run osmo-hlr_10.42.42.2(pid=11515): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11515)] 18:18:26.027681 run osmo-hlr_10.42.42.2(pid=11515): stdout: | (launched: 2022-12-12_18:18:23.141268) 18:18:26.077141 run osmo-hlr_10.42.42.2(pid=11515): stderr: | [0;m[1;31m20221212181823316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181823317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181823317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181823317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181823317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181823317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181823329 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181823338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181823338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181823338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:26.145712 run osmo-msc_10.42.42.6(pid=11521): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11521)] 18:18:26.193450 run osmo-msc_10.42.42.6(pid=11521): stdout: | (launched: 2022-12-12_18:18:25.069490) 18:18:26.242640 run osmo-msc_10.42.42.6(pid=11521): stderr: | [0;m[38;5;43m20221212181825340 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181825341 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9c1faa4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181825341 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181825341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181825341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181825341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181825343 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181825343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181825343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181825344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:26.292207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11514): Terminating (SIGTERM) 18:18:26.332216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11517): Terminating (SIGTERM) 18:18:26.372137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11520): Terminating (SIGTERM) 18:18:26.412148 --- ParallelTerminationStrategy: PID 11514 died... 18:18:26.431423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11514): Terminated: ok {rc=0} 18:18:26.475778 --- ParallelTerminationStrategy: PID 11517 died... 18:18:26.494267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11517): Terminated: ok {rc=0} 18:18:26.538337 --- ParallelTerminationStrategy: PID 11520 died... 18:18:26.556912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11520): Terminated: ok {rc=0} 18:18:26.644102 bus /sierra_3: Setting Powered False 18:18:27.744437 bus /sierra_3: Setting Powered False 18:18:28.860491 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:18:30.115048 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:18:30.122080 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:18:30.155603 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:18:30.183037 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:18:30.237848 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:18:30.271698 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:18:30.299123 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:18:30.864546 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:18:30.923795 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:30.936414 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:18:31.007664 tst mo_mt_call.py: using LAC 30622 18:18:31.133035 tst mo_mt_call.py: using RAC 22 18:18:31.298817 tst mo_mt_call.py: using CellId 30622 18:18:31.421156 tst mo_mt_call.py: using BVCI 30623 18:18:31.541696 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:31.553546 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:31.565314 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:31.577449 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:31.590596 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:31.603347 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:18:31.729529 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:18:31.864341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:32.374456 run create_hlr_db(pid=11526): Launched 18:18:32.508774 bus /sierra_2: Setting Powered False 18:18:33.572864 run create_hlr_db(pid=11526): Terminated: ok {rc=0} 18:18:34.026697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11528): Launched 18:18:34.353225 run osmo-hlr_10.42.42.2(pid=11529): Launched 18:18:34.478469 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:35.036792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11531): Launched 18:18:35.363451 run osmo-stp_10.42.42.5(pid=11532): Launched 18:18:35.487280 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:36.076391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11534): Launched 18:18:36.405506 run osmo-msc_10.42.42.6(pid=11535): Launched 18:18:36.587531 run osmo-stp_10.42.42.5(pid=11532): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11532)] 18:18:36.724818 run osmo-stp_10.42.42.5(pid=11532): stdout: | (launched: 2022-12-12_18:18:35.303392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:36.861696 run osmo-stp_10.42.42.5(pid=11532): stderr: | [0;m[38;5;43m20221212181835493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181835493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181835493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181835494 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181835494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181835494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181835494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:36.997440 run osmo-stp_10.42.42.5(pid=11532): stdout: | (launched: 2022-12-12_18:18:35.303392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:37.127340 run osmo-stp_10.42.42.5(pid=11532): stderr: | [0;m[38;5;43m20221212181835493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181835493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181835493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181835494 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181835494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181835494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181835494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:37.282709 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11532): Process ended prematurely: osmo-stp_10.42.42.5(pid=11532) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11532)] [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:18:37.292573 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:18:37.320771 run osmo-hlr_10.42.42.2(pid=11529): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11529)] 18:18:37.371108 run osmo-hlr_10.42.42.2(pid=11529): stdout: | (launched: 2022-12-12_18:18:34.293628) 18:18:37.423192 run osmo-hlr_10.42.42.2(pid=11529): stderr: | [0;m[1;31m20221212181834488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181834488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181834488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181834488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181834488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181834488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181834500 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181834510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181834510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181834510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:37.495257 run osmo-msc_10.42.42.6(pid=11535): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11535)] 18:18:37.545282 run osmo-msc_10.42.42.6(pid=11535): stdout: | (launched: 2022-12-12_18:18:36.345250) 18:18:37.596942 run osmo-msc_10.42.42.6(pid=11535): stderr: | [0;m[38;5;43m20221212181836665 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181836665 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff4f509ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181836665 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181836665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181836665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181836665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181836667 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181836668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181836668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181836669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:37.649559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11528): Terminating (SIGTERM) 18:18:37.691446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11531): Terminating (SIGTERM) 18:18:37.733437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11534): Terminating (SIGTERM) 18:18:37.775607 --- ParallelTerminationStrategy: PID 11528 died... 18:18:37.795780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11528): Terminated: ok {rc=0} 18:18:37.842839 --- ParallelTerminationStrategy: PID 11531 died... 18:18:37.862557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11531): Terminated: ok {rc=0} 18:18:37.909087 --- ParallelTerminationStrategy: PID 11534 died... 18:18:37.928834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11534): Terminated: ok {rc=0} 18:18:38.018427 bus /sierra_3: Setting Powered False 18:18:39.117870 bus /sierra_3: Setting Powered False 18:18:40.237018 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:18:41.383924 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:41.396094 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:18:41.465603 tst mo_mt_call_osmux.py: using LAC 30623 18:18:41.595091 tst mo_mt_call_osmux.py: using RAC 23 18:18:41.722398 tst mo_mt_call_osmux.py: using CellId 30623 18:18:41.850252 tst mo_mt_call_osmux.py: using BVCI 30624 18:18:41.970064 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:41.982013 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:41.993547 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:42.005046 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:42.016617 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:18:42.028404 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:18:42.147687 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:18:42.269108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:42.774168 run create_hlr_db(pid=11537): Launched 18:18:42.908130 bus /sierra_2: Setting Powered False 18:18:43.971962 run create_hlr_db(pid=11537): Terminated: ok {rc=0} 18:18:44.406774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11539): Launched 18:18:44.711282 run osmo-hlr_10.42.42.2(pid=11540): Launched 18:18:44.827148 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:45.359030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11542): Launched 18:18:45.664100 run osmo-stp_10.42.42.5(pid=11543): Launched 18:18:45.780679 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:46.406583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11545): Launched 18:18:46.724234 run osmo-msc_10.42.42.6(pid=11546): Launched 18:18:47.096890 run osmo-stp_10.42.42.5(pid=11543): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11543)] 18:18:47.298841 run osmo-stp_10.42.42.5(pid=11543): stdout: | (launched: 2022-12-12_18:18:45.607871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:47.425800 run osmo-stp_10.42.42.5(pid=11543): stderr: | [0;m[38;5;43m20221212181845774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181845774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181845774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181845775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181845775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181845775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181845775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:47.552478 run osmo-stp_10.42.42.5(pid=11543): stdout: | (launched: 2022-12-12_18:18:45.607871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:47.673587 run osmo-stp_10.42.42.5(pid=11543): stderr: | [0;m[38;5;43m20221212181845774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181845774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181845774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181845775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181845775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181845775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181845775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:47.818190 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11543): Process ended prematurely: osmo-stp_10.42.42.5(pid=11543) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11543)] [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:18:47.827326 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:18:47.854690 run osmo-hlr_10.42.42.2(pid=11540): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11540)] 18:18:47.903217 run osmo-hlr_10.42.42.2(pid=11540): stdout: | (launched: 2022-12-12_18:18:44.655049) 18:18:47.953132 run osmo-hlr_10.42.42.2(pid=11540): stderr: | [0;m[1;31m20221212181844828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181844828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181844828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181844828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181844828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181844828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181844839 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181844847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181844847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181844847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:48.022671 run osmo-msc_10.42.42.6(pid=11546): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11546)] 18:18:48.070835 run osmo-msc_10.42.42.6(pid=11546): stdout: | (launched: 2022-12-12_18:18:46.667465) 18:18:48.120486 run osmo-msc_10.42.42.6(pid=11546): stderr: | [0;m[38;5;43m20221212181847156 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181847156 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fda06508c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181847156 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181847156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181847156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181847165 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181847167 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181847167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181847167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181847167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:48.170588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11539): Terminating (SIGTERM) 18:18:48.210739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11542): Terminating (SIGTERM) 18:18:48.250774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11545): Terminating (SIGTERM) 18:18:48.291185 --- ParallelTerminationStrategy: PID 11539 died... 18:18:48.310399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11539): Terminated: ok {rc=0} 18:18:48.355271 --- ParallelTerminationStrategy: PID 11542 died... 18:18:48.373908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11542): Terminated: ok {rc=0} 18:18:48.418643 --- ParallelTerminationStrategy: PID 11545 died... 18:18:48.437357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11545): Terminated: ok {rc=0} 18:18:48.524168 bus /sierra_3: Setting Powered False 18:18:49.624270 bus /sierra_3: Setting Powered False 18:18:50.740681 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:18:51.995346 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:18:52.001764 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:18:52.034563 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:18:52.061390 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:18:52.110952 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:18:52.143411 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:18:52.169681 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:18:52.723148 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:18:52.772823 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:18:52.783960 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:18:52.850723 tst mo_mt_call.py: using LAC 30624 18:18:52.968527 tst mo_mt_call.py: using RAC 24 18:18:53.095663 tst mo_mt_call.py: using CellId 30624 18:18:53.214147 tst mo_mt_call.py: using BVCI 30625 18:18:53.326155 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:18:53.337249 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:18:53.348164 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:18:53.359341 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:18:53.370814 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:18:53.382057 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:18:53.502928 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:18:53.622822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:18:54.092284 run create_hlr_db(pid=11551): Launched 18:18:54.209951 bus /sierra_2: Setting Powered False 18:18:55.270211 run create_hlr_db(pid=11551): Terminated: ok {rc=0} 18:18:55.715565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11553): Launched 18:18:56.043058 run osmo-hlr_10.42.42.2(pid=11554): Launched 18:18:56.167516 run osmo-stp_10.42.42.5: Starting osmo-stp 18:18:56.728134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11556): Launched 18:18:57.056138 run osmo-stp_10.42.42.5(pid=11557): Launched 18:18:57.180937 run osmo-msc_10.42.42.6: Starting osmo-msc 18:18:57.770470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11559): Launched 18:18:58.097773 run osmo-msc_10.42.42.6(pid=11560): Launched 18:18:58.279806 run osmo-stp_10.42.42.5(pid=11557): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11557)] 18:18:58.416304 run osmo-stp_10.42.42.5(pid=11557): stdout: | (launched: 2022-12-12_18:18:56.996344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:58.553085 run osmo-stp_10.42.42.5(pid=11557): stderr: | [0;m[38;5;43m20221212181857184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181857185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181857185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181857185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181857186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181857186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181857186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:58.689082 run osmo-stp_10.42.42.5(pid=11557): stdout: | (launched: 2022-12-12_18:18:56.996344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:18:58.819010 run osmo-stp_10.42.42.5(pid=11557): stderr: | [0;m[38;5;43m20221212181857184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181857185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181857185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181857185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181857186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181857186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181857186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:18:58.973510 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11557): Process ended prematurely: osmo-stp_10.42.42.5(pid=11557) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11557)] [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:18:58.983133 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:18:59.011037 run osmo-hlr_10.42.42.2(pid=11554): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11554)] 18:18:59.061161 run osmo-hlr_10.42.42.2(pid=11554): stdout: | (launched: 2022-12-12_18:18:55.982917) 18:18:59.113390 run osmo-hlr_10.42.42.2(pid=11554): stderr: | [0;m[1;31m20221212181856177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181856177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181856178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181856178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181856178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181856178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181856190 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181856198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181856199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181856199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:18:59.185718 run osmo-msc_10.42.42.6(pid=11560): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11560)] 18:18:59.236047 run osmo-msc_10.42.42.6(pid=11560): stdout: | (launched: 2022-12-12_18:18:58.037600) 18:18:59.288193 run osmo-msc_10.42.42.6(pid=11560): stderr: | [0;m[38;5;43m20221212181858357 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181858357 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2b35b1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181858357 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181858357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181858357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181858357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181858359 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181858359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181858360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181858360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:18:59.340397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11553): Terminating (SIGTERM) 18:18:59.382294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11556): Terminating (SIGTERM) 18:18:59.424004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11559): Terminating (SIGTERM) 18:18:59.465910 --- ParallelTerminationStrategy: PID 11553 died... 18:18:59.485654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11553): Terminated: ok {rc=0} 18:18:59.531856 --- ParallelTerminationStrategy: PID 11556 died... 18:18:59.551482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11556): Terminated: ok {rc=0} 18:18:59.597172 --- ParallelTerminationStrategy: PID 11559 died... 18:18:59.616452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11559): Terminated: ok {rc=0} 18:18:59.704223 bus /sierra_3: Setting Powered False 18:19:00.803463 bus /sierra_3: Setting Powered False 18:19:01.935751 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:19:03.080559 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:19:03.092547 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:19:03.165351 tst mo_mt_call_osmux.py: using LAC 30625 18:19:03.283362 tst mo_mt_call_osmux.py: using RAC 25 18:19:03.401940 tst mo_mt_call_osmux.py: using CellId 30625 18:19:03.518220 tst mo_mt_call_osmux.py: using BVCI 30626 18:19:03.629623 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:19:03.640698 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:19:03.651679 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:19:03.663069 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:19:03.674583 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:19:03.685957 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:19:03.805723 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:19:03.922234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:04.391872 run create_hlr_db(pid=11562): Launched 18:19:04.509361 bus /sierra_2: Setting Powered False 18:19:05.569755 run create_hlr_db(pid=11562): Terminated: ok {rc=0} 18:19:06.013113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11564): Launched 18:19:06.339270 run osmo-hlr_10.42.42.2(pid=11565): Launched 18:19:06.465487 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:07.024756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11567): Launched 18:19:07.352024 run osmo-stp_10.42.42.5(pid=11568): Launched 18:19:07.476801 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:08.076006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11570): Launched 18:19:08.401280 run osmo-msc_10.42.42.6(pid=11571): Launched 18:19:08.583401 run osmo-stp_10.42.42.5(pid=11568): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11568)] 18:19:08.720113 run osmo-stp_10.42.42.5(pid=11568): stdout: | (launched: 2022-12-12_18:19:07.291995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:08.856576 run osmo-stp_10.42.42.5(pid=11568): stderr: | [0;m[38;5;43m20221212181907482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181907483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181907483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181907483 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181907484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181907484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181907484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:08.991528 run osmo-stp_10.42.42.5(pid=11568): stdout: | (launched: 2022-12-12_18:19:07.291995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:09.120334 run osmo-stp_10.42.42.5(pid=11568): stderr: | [0;m[38;5;43m20221212181907482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181907483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181907483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181907483 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181907484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181907484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181907484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:09.274791 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11568): Process ended prematurely: osmo-stp_10.42.42.5(pid=11568) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11568)] [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:19:09.284526 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:19:09.312408 run osmo-hlr_10.42.42.2(pid=11565): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11565)] 18:19:09.362434 run osmo-hlr_10.42.42.2(pid=11565): stdout: | (launched: 2022-12-12_18:19:06.279615) 18:19:09.413675 run osmo-hlr_10.42.42.2(pid=11565): stderr: | [0;m[1;31m20221212181906474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181906474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181906474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181906474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181906474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181906474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181906486 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181906495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181906495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181906495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:09.485959 run osmo-msc_10.42.42.6(pid=11571): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11571)] 18:19:09.535648 run osmo-msc_10.42.42.6(pid=11571): stdout: | (launched: 2022-12-12_18:19:08.341292) 18:19:09.587043 run osmo-msc_10.42.42.6(pid=11571): stderr: | [0;m[38;5;43m20221212181908659 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181908659 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f60edbcdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181908659 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181908660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181908660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181908660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181908662 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181908662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181908663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181908663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:09.639394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11564): Terminating (SIGTERM) 18:19:09.681690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11567): Terminating (SIGTERM) 18:19:09.723576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11570): Terminating (SIGTERM) 18:19:09.765617 --- ParallelTerminationStrategy: PID 11564 died... 18:19:09.785912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11564): Terminated: ok {rc=0} 18:19:09.832256 --- ParallelTerminationStrategy: PID 11567 died... 18:19:09.851728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11567): Terminated: ok {rc=0} 18:19:09.898359 --- ParallelTerminationStrategy: PID 11570 died... 18:19:09.918015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11570): Terminated: ok {rc=0} 18:19:10.006355 bus /sierra_3: Setting Powered False 18:19:11.105990 bus /sierra_3: Setting Powered False 18:19:12.222575 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:19:13.477789 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:19:13.484851 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:19:13.518959 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:19:13.546720 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:19:13.600155 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:19:13.633703 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:19:13.661594 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:19:14.210795 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:19:14.260155 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:14.271257 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:19:14.339499 tst mo_mt_call.py: using LAC 30626 18:19:14.458412 tst mo_mt_call.py: using RAC 26 18:19:14.579394 tst mo_mt_call.py: using CellId 30626 18:19:14.700433 tst mo_mt_call.py: using BVCI 30627 18:19:14.821275 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:14.832846 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:14.844385 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:14.855908 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:14.867495 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:14.879046 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:19:14.996507 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:19:15.116447 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:15.620893 run create_hlr_db(pid=11576): Launched 18:19:15.754005 bus /sierra_2: Setting Powered False 18:19:16.816441 run create_hlr_db(pid=11576): Terminated: ok {rc=0} 18:19:17.284207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11578): Launched 18:19:17.600055 run osmo-hlr_10.42.42.2(pid=11579): Launched 18:19:17.716911 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:18.251762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11581): Launched 18:19:18.558881 run osmo-stp_10.42.42.5(pid=11582): Launched 18:19:18.676312 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:19.222079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11584): Launched 18:19:19.527570 run osmo-msc_10.42.42.6(pid=11585): Launched 18:19:19.698095 run osmo-stp_10.42.42.5(pid=11582): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11582)] 18:19:19.834360 run osmo-stp_10.42.42.5(pid=11582): stdout: | (launched: 2022-12-12_18:19:18.502422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:19.972509 run osmo-stp_10.42.42.5(pid=11582): stderr: | [0;m[38;5;43m20221212181918670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181918670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181918670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181918671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181918671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181918671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181918671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:20.107661 run osmo-stp_10.42.42.5(pid=11582): stdout: | (launched: 2022-12-12_18:19:18.502422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:20.236521 run osmo-stp_10.42.42.5(pid=11582): stderr: | [0;m[38;5;43m20221212181918670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181918670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181918670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181918671 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181918671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181918671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181918671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:20.391106 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11582): Process ended prematurely: osmo-stp_10.42.42.5(pid=11582) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11582)] [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:19:20.400482 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:19:20.428122 run osmo-hlr_10.42.42.2(pid=11579): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11579)] 18:19:20.477798 run osmo-hlr_10.42.42.2(pid=11579): stdout: | (launched: 2022-12-12_18:19:17.543882) 18:19:20.529053 run osmo-hlr_10.42.42.2(pid=11579): stderr: | [0;m[1;31m20221212181917718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181917718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181917718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181917718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181917718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181917718 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181917730 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181917738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181917738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181917739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:20.600366 run osmo-msc_10.42.42.6(pid=11585): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11585)] 18:19:20.650084 run osmo-msc_10.42.42.6(pid=11585): stdout: | (launched: 2022-12-12_18:19:19.471547) 18:19:20.701572 run osmo-msc_10.42.42.6(pid=11585): stderr: | [0;m[38;5;43m20221212181919743 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181919744 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8b57964c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181919744 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181919744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181919744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181919744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181919746 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181919746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181919746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181919746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:20.752880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11578): Terminating (SIGTERM) 18:19:20.794189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11581): Terminating (SIGTERM) 18:19:20.835489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11584): Terminating (SIGTERM) 18:19:20.877117 --- ParallelTerminationStrategy: PID 11578 died... 18:19:20.897039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11578): Terminated: ok {rc=0} 18:19:20.942815 --- ParallelTerminationStrategy: PID 11581 died... 18:19:20.962260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11581): Terminated: ok {rc=0} 18:19:21.007765 --- ParallelTerminationStrategy: PID 11584 died... 18:19:21.027128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11584): Terminated: ok {rc=0} 18:19:21.114824 bus /sierra_3: Setting Powered False 18:19:22.214701 bus /sierra_3: Setting Powered False 18:19:23.332227 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:19:24.478780 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:24.490806 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:19:24.560717 tst mo_mt_call_osmux.py: using LAC 30627 18:19:24.679193 tst mo_mt_call_osmux.py: using RAC 27 18:19:24.802808 tst mo_mt_call_osmux.py: using CellId 30627 18:19:24.922087 tst mo_mt_call_osmux.py: using BVCI 30628 18:19:25.033793 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:25.044775 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:25.055815 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:25.067080 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:25.078384 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:19:25.089718 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:19:25.206025 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:19:25.327514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:25.832557 run create_hlr_db(pid=11587): Launched 18:19:25.966764 bus /sierra_2: Setting Powered False 18:19:27.030919 run create_hlr_db(pid=11587): Terminated: ok {rc=0} 18:19:27.465925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11589): Launched 18:19:27.793978 run osmo-hlr_10.42.42.2(pid=11590): Launched 18:19:27.919464 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:28.477140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11592): Launched 18:19:28.803038 run osmo-stp_10.42.42.5(pid=11593): Launched 18:19:28.927290 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:29.513700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11595): Launched 18:19:29.840608 run osmo-msc_10.42.42.6(pid=11596): Launched 18:19:30.024439 run osmo-stp_10.42.42.5(pid=11593): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11593)] 18:19:30.160264 run osmo-stp_10.42.42.5(pid=11593): stdout: | (launched: 2022-12-12_18:19:28.743669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:30.296414 run osmo-stp_10.42.42.5(pid=11593): stderr: | [0;m[38;5;43m20221212181928931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181928932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181928932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181928932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181928933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181928933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181928933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:30.431082 run osmo-stp_10.42.42.5(pid=11593): stdout: | (launched: 2022-12-12_18:19:28.743669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:30.560210 run osmo-stp_10.42.42.5(pid=11593): stderr: | [0;m[38;5;43m20221212181928931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181928932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181928932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181928932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181928933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181928933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181928933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:30.715172 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11593): Process ended prematurely: osmo-stp_10.42.42.5(pid=11593) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11593)] [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:19:30.724820 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:19:30.752883 run osmo-hlr_10.42.42.2(pid=11590): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11590)] 18:19:30.802746 run osmo-hlr_10.42.42.2(pid=11590): stdout: | (launched: 2022-12-12_18:19:27.733678) 18:19:30.877317 run osmo-hlr_10.42.42.2(pid=11590): stderr: | [0;m[1;31m20221212181927930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181927930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181927930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181927931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181927931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181927931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181927943 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181927952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181927952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181927952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:30.957979 run osmo-msc_10.42.42.6(pid=11596): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11596)] 18:19:31.008786 run osmo-msc_10.42.42.6(pid=11596): stdout: | (launched: 2022-12-12_18:19:29.780404) 18:19:31.062892 run osmo-msc_10.42.42.6(pid=11596): stderr: | [0;m[38;5;43m20221212181930102 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181930102 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efca2f1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181930102 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181930102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181930103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181930103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181930104 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181930105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181930105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181930105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:31.116752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11589): Terminating (SIGTERM) 18:19:31.160101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11592): Terminating (SIGTERM) 18:19:31.204893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11595): Terminating (SIGTERM) 18:19:31.250256 --- ParallelTerminationStrategy: PID 11589 died... 18:19:31.271305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11589): Terminated: ok {rc=0} 18:19:31.321985 --- ParallelTerminationStrategy: PID 11592 died... 18:19:31.341885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11592): Terminated: ok {rc=0} 18:19:31.390111 --- ParallelTerminationStrategy: PID 11595 died... 18:19:31.410338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11595): Terminated: ok {rc=0} 18:19:31.501310 bus /sierra_3: Setting Powered False 18:19:32.599848 bus /sierra_3: Setting Powered False 18:19:33.715969 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:19:34.968735 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:19:34.975308 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:19:35.007965 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:19:35.034283 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:19:35.090865 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:19:35.124272 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:19:35.150439 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:19:35.696752 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:19:35.746333 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:35.757634 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:19:35.824833 tst mo_mt_call.py: using LAC 30628 18:19:35.942537 tst mo_mt_call.py: using RAC 28 18:19:36.062360 tst mo_mt_call.py: using CellId 30628 18:19:36.181406 tst mo_mt_call.py: using BVCI 30629 18:19:36.300837 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:36.312777 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:36.324556 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:36.336617 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:36.348754 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:36.360631 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:19:36.475983 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:19:36.595424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:37.102567 run create_hlr_db(pid=11602): Launched 18:19:37.235511 bus /sierra_2: Setting Powered False 18:19:38.299640 run create_hlr_db(pid=11602): Terminated: ok {rc=0} 18:19:38.735197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11604): Launched 18:19:39.039672 run osmo-hlr_10.42.42.2(pid=11605): Launched 18:19:39.156115 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:39.690624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11607): Launched 18:19:39.997178 run osmo-stp_10.42.42.5(pid=11608): Launched 18:19:40.113053 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:40.660623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11610): Launched 18:19:40.965510 run osmo-msc_10.42.42.6(pid=11611): Launched 18:19:41.136733 run osmo-stp_10.42.42.5(pid=11608): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11608)] 18:19:41.265378 run osmo-stp_10.42.42.5(pid=11608): stdout: | (launched: 2022-12-12_18:19:39.940928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:41.393717 run osmo-stp_10.42.42.5(pid=11608): stderr: | [0;m[38;5;43m20221212181940110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181940110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181940111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181940111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181940112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181940112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181940112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:41.520181 run osmo-stp_10.42.42.5(pid=11608): stdout: | (launched: 2022-12-12_18:19:39.940928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:41.641371 run osmo-stp_10.42.42.5(pid=11608): stderr: | [0;m[38;5;43m20221212181940110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181940110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181940111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181940111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181940112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181940112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181940112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:41.786244 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11608): Process ended prematurely: osmo-stp_10.42.42.5(pid=11608) [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11608)] [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:19:41.795267 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:19:41.822327 run osmo-hlr_10.42.42.2(pid=11605): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11605)] 18:19:41.870394 run osmo-hlr_10.42.42.2(pid=11605): stdout: | (launched: 2022-12-12_18:19:38.983653) 18:19:41.920082 run osmo-hlr_10.42.42.2(pid=11605): stderr: | [0;m[1;31m20221212181939155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181939155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181939155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181939155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181939155 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181939156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181939168 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181939176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181939177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181939177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:41.989275 run osmo-msc_10.42.42.6(pid=11611): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11611)] 18:19:42.037146 run osmo-msc_10.42.42.6(pid=11611): stdout: | (launched: 2022-12-12_18:19:40.909321) 18:19:42.086657 run osmo-msc_10.42.42.6(pid=11611): stderr: | [0;m[38;5;43m20221212181941178 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181941178 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa2ed4acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181941178 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181941178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181941178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181941178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181941180 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181941180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181941181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181941181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:42.136648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11604): Terminating (SIGTERM) 18:19:42.176646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11607): Terminating (SIGTERM) 18:19:42.216423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11610): Terminating (SIGTERM) 18:19:42.256605 --- ParallelTerminationStrategy: PID 11604 died... 18:19:42.275803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11604): Terminated: ok {rc=0} 18:19:42.320141 --- ParallelTerminationStrategy: PID 11607 died... 18:19:42.338717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11607): Terminated: ok {rc=0} 18:19:42.383347 --- ParallelTerminationStrategy: PID 11610 died... 18:19:42.401873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11610): Terminated: ok {rc=0} 18:19:42.488141 bus /sierra_3: Setting Powered False 18:19:43.588798 bus /sierra_3: Setting Powered False 18:19:44.705939 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:19:45.884020 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:45.901952 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:19:45.984175 tst mo_mt_call_osmux.py: using LAC 30629 18:19:46.109204 tst mo_mt_call_osmux.py: using RAC 29 18:19:46.274450 tst mo_mt_call_osmux.py: using CellId 30629 18:19:46.434219 tst mo_mt_call_osmux.py: using BVCI 30630 18:19:46.554398 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:46.567103 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:46.579812 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:46.592381 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:46.605166 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:19:46.617917 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:19:46.762077 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:19:46.907307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:47.442794 run create_hlr_db(pid=11613): Launched 18:19:47.574670 bus /sierra_2: Setting Powered False 18:19:48.638644 run create_hlr_db(pid=11613): Terminated: ok {rc=0} 18:19:49.073568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11615): Launched 18:19:49.378458 run osmo-hlr_10.42.42.2(pid=11616): Launched 18:19:49.495021 run osmo-stp_10.42.42.5: Starting osmo-stp 18:19:50.032636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11618): Launched 18:19:50.336936 run osmo-stp_10.42.42.5(pid=11619): Launched 18:19:50.452750 run osmo-msc_10.42.42.6: Starting osmo-msc 18:19:51.013651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11621): Launched 18:19:51.319480 run osmo-msc_10.42.42.6(pid=11622): Launched 18:19:51.491956 run osmo-stp_10.42.42.5(pid=11619): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11619)] 18:19:51.621216 run osmo-stp_10.42.42.5(pid=11619): stdout: | (launched: 2022-12-12_18:19:50.280652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:51.749218 run osmo-stp_10.42.42.5(pid=11619): stderr: | [0;m[38;5;43m20221212181950450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181950450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181950450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181950451 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181950451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181950451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181950451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:51.874996 run osmo-stp_10.42.42.5(pid=11619): stdout: | (launched: 2022-12-12_18:19:50.280652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:19:51.996283 run osmo-stp_10.42.42.5(pid=11619): stderr: | [0;m[38;5;43m20221212181950450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212181950450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212181950450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212181950451 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212181950451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212181950451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212181950451 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:19:52.140808 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11619): Process ended prematurely: osmo-stp_10.42.42.5(pid=11619) [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11619)] [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:19:52.149853 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:19:52.176598 run osmo-hlr_10.42.42.2(pid=11616): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11616)] 18:19:52.224507 run osmo-hlr_10.42.42.2(pid=11616): stdout: | (launched: 2022-12-12_18:19:49.322315) 18:19:52.273946 run osmo-hlr_10.42.42.2(pid=11616): stderr: | [0;m[1;31m20221212181949497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212181949497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212181949497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212181949497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212181949497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212181949497 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212181949509 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212181949518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212181949518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212181949518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:19:52.342618 run osmo-msc_10.42.42.6(pid=11622): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11622)] 18:19:52.390250 run osmo-msc_10.42.42.6(pid=11622): stdout: | (launched: 2022-12-12_18:19:51.262896) 18:19:52.439475 run osmo-msc_10.42.42.6(pid=11622): stderr: | [0;m[38;5;43m20221212181951532 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212181951532 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd6774a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212181951532 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212181951532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212181951533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212181951533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212181951534 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212181951535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212181951535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212181951535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:19:52.489324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11615): Terminating (SIGTERM) 18:19:52.529280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11618): Terminating (SIGTERM) 18:19:52.569203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11621): Terminating (SIGTERM) 18:19:52.609342 --- ParallelTerminationStrategy: PID 11615 died... 18:19:52.628362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11615): Terminated: ok {rc=0} 18:19:52.672653 --- ParallelTerminationStrategy: PID 11618 died... 18:19:52.691192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11618): Terminated: ok {rc=0} 18:19:52.735238 --- ParallelTerminationStrategy: PID 11621 died... 18:19:52.753900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11621): Terminated: ok {rc=0} 18:19:52.839897 bus /sierra_3: Setting Powered False 18:19:53.940452 bus /sierra_3: Setting Powered False 18:19:55.056509 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:19:56.304583 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:19:56.310363 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:19:56.343420 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:19:56.370525 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:19:56.423498 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:19:56.456167 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:19:56.482356 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:19:57.030754 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:19:57.079928 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:19:57.091124 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:19:57.160860 tst mo_mt_call.py: using LAC 30630 18:19:57.280014 tst mo_mt_call.py: using RAC 30 18:19:57.399781 tst mo_mt_call.py: using CellId 30630 18:19:57.519841 tst mo_mt_call.py: using BVCI 30631 18:19:57.630628 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:19:57.641605 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:19:57.652320 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:19:57.663372 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:19:57.674416 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:19:57.685535 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:19:57.805118 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:19:57.921489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:19:58.391034 run create_hlr_db(pid=11627): Launched 18:19:58.508607 bus /sierra_2: Setting Powered False 18:19:59.569451 run create_hlr_db(pid=11627): Terminated: ok {rc=0} 18:19:59.993358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11629): Launched 18:20:00.299200 run osmo-hlr_10.42.42.2(pid=11630): Launched 18:20:00.418169 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:00.980869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11632): Launched 18:20:01.325699 run osmo-stp_10.42.42.5(pid=11636): Launched 18:20:01.468253 run osmo-msc_10.42.42.6: Starting osmo-msc 18:20:02.152636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11638): Launched 18:20:02.475365 run osmo-msc_10.42.42.6(pid=11639): Launched 18:20:02.684028 run osmo-stp_10.42.42.5(pid=11636): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11636)] 18:20:02.821927 run osmo-stp_10.42.42.5(pid=11636): stdout: | (launched: 2022-12-12_18:20:01.263306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:02.960174 run osmo-stp_10.42.42.5(pid=11636): stderr: | [0;m[38;5;43m20221212182001590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182001590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182001591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182001591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182001592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182001592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182001592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:03.095416 run osmo-stp_10.42.42.5(pid=11636): stdout: | (launched: 2022-12-12_18:20:01.263306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:03.225285 run osmo-stp_10.42.42.5(pid=11636): stderr: | [0;m[38;5;43m20221212182001590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182001590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182001591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182001591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182001592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182001592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182001592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:03.380441 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11636): Process ended prematurely: osmo-stp_10.42.42.5(pid=11636) [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11636)] [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:20:03.390516 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:20:03.418802 run osmo-hlr_10.42.42.2(pid=11630): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11630)] 18:20:03.469792 run osmo-hlr_10.42.42.2(pid=11630): stdout: | (launched: 2022-12-12_18:20:00.242827) 18:20:03.522075 run osmo-hlr_10.42.42.2(pid=11630): stderr: | [0;m[1;31m20221212182000414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182000414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182000414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182000414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182000414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182000414 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182000426 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182000434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182000435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182000435 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:03.594924 run osmo-msc_10.42.42.6(pid=11639): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11639)] 18:20:03.645224 run osmo-msc_10.42.42.6(pid=11639): stdout: | (launched: 2022-12-12_18:20:02.418078) 18:20:03.697527 run osmo-msc_10.42.42.6(pid=11639): stderr: | [0;m[38;5;43m20221212182002771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182002772 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f048e291c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182002772 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182002772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182002772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182002772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182002774 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182002774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182002774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182002775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:20:03.750080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11629): Terminating (SIGTERM) 18:20:03.791795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11632): Terminating (SIGTERM) 18:20:03.833802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11638): Terminating (SIGTERM) 18:20:03.876401 --- ParallelTerminationStrategy: PID 11629 died... 18:20:03.896637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11629): Terminated: ok {rc=0} 18:20:03.943708 --- ParallelTerminationStrategy: PID 11632 died... 18:20:03.963746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11632): Terminated: ok {rc=0} 18:20:04.010357 --- ParallelTerminationStrategy: PID 11638 died... 18:20:04.030275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11638): Terminated: ok {rc=0} 18:20:04.119683 bus /sierra_3: Setting Powered False 18:20:05.219532 bus /sierra_3: Setting Powered False 18:20:06.339709 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:20:07.486158 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:20:07.498162 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:20:07.569458 tst mo_mt_call_osmux.py: using LAC 30631 18:20:07.697407 tst mo_mt_call_osmux.py: using RAC 31 18:20:07.817885 tst mo_mt_call_osmux.py: using CellId 30631 18:20:07.939512 tst mo_mt_call_osmux.py: using BVCI 30632 18:20:08.049448 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:20:08.060350 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:20:08.071141 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:20:08.082413 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:20:08.093715 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:20:08.104764 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:20:08.220829 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:20:08.341637 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:08.847129 run create_hlr_db(pid=11641): Launched 18:20:08.981549 bus /sierra_2: Setting Powered False 18:20:10.046237 run create_hlr_db(pid=11641): Terminated: ok {rc=0} 18:20:10.481960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11643): Launched 18:20:10.787231 run osmo-hlr_10.42.42.2(pid=11644): Launched 18:20:10.904708 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:11.441607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11646): Launched 18:20:11.746852 run osmo-stp_10.42.42.5(pid=11647): Launched 18:20:11.862790 run osmo-msc_10.42.42.6: Starting osmo-msc 18:20:12.418534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11649): Launched 18:20:12.724311 run osmo-msc_10.42.42.6(pid=11650): Launched 18:20:12.896266 run osmo-stp_10.42.42.5(pid=11647): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11647)] 18:20:13.025781 run osmo-stp_10.42.42.5(pid=11647): stdout: | (launched: 2022-12-12_18:20:11.690386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:13.154622 run osmo-stp_10.42.42.5(pid=11647): stderr: | [0;m[38;5;43m20221212182011857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182011857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182011858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182011858 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182011859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182011859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182011859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:13.281199 run osmo-stp_10.42.42.5(pid=11647): stdout: | (launched: 2022-12-12_18:20:11.690386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:13.402670 run osmo-stp_10.42.42.5(pid=11647): stderr: | [0;m[38;5;43m20221212182011857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182011857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182011858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182011858 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182011859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182011859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182011859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:13.548308 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11647): Process ended prematurely: osmo-stp_10.42.42.5(pid=11647) [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11647)] [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:20:13.557411 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:20:13.584638 run osmo-hlr_10.42.42.2(pid=11644): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11644)] 18:20:13.633381 run osmo-hlr_10.42.42.2(pid=11644): stdout: | (launched: 2022-12-12_18:20:10.730735) 18:20:13.683612 run osmo-hlr_10.42.42.2(pid=11644): stderr: | [0;m[1;31m20221212182010903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182010904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182010904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182010904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182010904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182010904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182010915 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182010925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182010925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182010925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:13.753537 run osmo-msc_10.42.42.6(pid=11650): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11650)] 18:20:13.801808 run osmo-msc_10.42.42.6(pid=11650): stdout: | (launched: 2022-12-12_18:20:12.667774) 18:20:13.851837 run osmo-msc_10.42.42.6(pid=11650): stderr: | [0;m[38;5;43m20221212182012934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182012935 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f004ce5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182012935 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182012935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182012935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182012935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182012937 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182012937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182012938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182012938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:20:13.902225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11643): Terminating (SIGTERM) 18:20:13.942331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11646): Terminating (SIGTERM) 18:20:13.982406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11649): Terminating (SIGTERM) 18:20:14.023042 --- ParallelTerminationStrategy: PID 11643 died... 18:20:14.042290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11643): Terminated: ok {rc=0} 18:20:14.087058 --- ParallelTerminationStrategy: PID 11646 died... 18:20:14.105862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11646): Terminated: ok {rc=0} 18:20:14.150622 --- ParallelTerminationStrategy: PID 11649 died... 18:20:14.169263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11649): Terminated: ok {rc=0} 18:20:14.255094 bus /sierra_3: Setting Powered False 18:20:15.353315 bus /sierra_3: Setting Powered False 18:20:16.477614 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 18:20:17.738814 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:20:17.745620 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 18:20:17.779583 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 18:20:17.807125 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 18:20:17.864143 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 18:20:17.897964 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 18:20:17.924571 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 18:20:18.472403 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 18:20:18.522043 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:20:18.533574 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:20:18.584491 tst mo_mt_call.py: using LAC 30632 18:20:18.705247 tst mo_mt_call.py: using RAC 32 18:20:18.823708 tst mo_mt_call.py: using CellId 30632 18:20:18.944365 tst mo_mt_call.py: using BVCI 30633 18:20:19.055283 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:20:19.066604 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:20:19.077724 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:20:19.089194 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:20:19.100678 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:20:19.112034 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:20:19.231281 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:20:19.348872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:19.818823 run create_hlr_db(pid=11655): Launched 18:20:19.936799 bus /sierra_2: Setting Powered False 18:20:20.997783 run create_hlr_db(pid=11655): Terminated: ok {rc=0} 18:20:21.441753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11657): Launched 18:20:21.770455 run osmo-hlr_10.42.42.2(pid=11658): Launched 18:20:21.896108 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:22.460798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11660): Launched 18:20:22.789477 run osmo-stp_10.42.42.5(pid=11661): Launched 18:20:22.914451 run osmo-msc_10.42.42.6: Starting osmo-msc 18:20:23.502496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11663): Launched 18:20:23.829689 run osmo-msc_10.42.42.6(pid=11664): Launched 18:20:24.012469 run osmo-stp_10.42.42.5(pid=11661): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11661)] 18:20:24.149458 run osmo-stp_10.42.42.5(pid=11661): stdout: | (launched: 2022-12-12_18:20:22.729440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:24.286794 run osmo-stp_10.42.42.5(pid=11661): stderr: | [0;m[38;5;43m20221212182022919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182022919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182022919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182022920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182022920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182022920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182022920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:24.422565 run osmo-stp_10.42.42.5(pid=11661): stdout: | (launched: 2022-12-12_18:20:22.729440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:24.552552 run osmo-stp_10.42.42.5(pid=11661): stderr: | [0;m[38;5;43m20221212182022919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182022919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182022919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182022920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182022920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182022920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182022920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:24.708641 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11661): Process ended prematurely: osmo-stp_10.42.42.5(pid=11661) [trial-2380↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11661)] [trial-2380↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 18:20:24.718439 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:20:24.746495 run osmo-hlr_10.42.42.2(pid=11658): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11658)] 18:20:24.796716 run osmo-hlr_10.42.42.2(pid=11658): stdout: | (launched: 2022-12-12_18:20:21.710510) 18:20:24.848642 run osmo-hlr_10.42.42.2(pid=11658): stderr: | [0;m[1;31m20221212182021906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182021906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182021906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182021906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182021906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182021906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182021919 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182021930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182021930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182021930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:24.921600 run osmo-msc_10.42.42.6(pid=11664): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11664)] 18:20:24.971609 run osmo-msc_10.42.42.6(pid=11664): stdout: | (launched: 2022-12-12_18:20:23.769565) 18:20:25.023309 run osmo-msc_10.42.42.6(pid=11664): stderr: | [0;m[38;5;43m20221212182024090 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182024090 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb0db939c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182024090 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182024090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182024090 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182024091 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182024092 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182024093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182024093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182024093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:20:25.075269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11657): Terminating (SIGTERM) 18:20:25.117327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11660): Terminating (SIGTERM) 18:20:25.159171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11663): Terminating (SIGTERM) 18:20:25.201668 --- ParallelTerminationStrategy: PID 11657 died... 18:20:25.221675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11657): Terminated: ok {rc=0} 18:20:25.268201 --- ParallelTerminationStrategy: PID 11660 died... 18:20:25.287914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11660): Terminated: ok {rc=0} 18:20:25.334383 --- ParallelTerminationStrategy: PID 11663 died... 18:20:25.354047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11663): Terminated: ok {rc=0} 18:20:25.442635 bus /sierra_3: Setting Powered False 18:20:26.542626 bus /sierra_3: Setting Powered False 18:20:27.659164 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 18:20:28.809390 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:20:28.822024 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:20:28.876181 tst mo_mt_call_osmux.py: using LAC 30633 18:20:29.004513 tst mo_mt_call_osmux.py: using RAC 33 18:20:29.136455 tst mo_mt_call_osmux.py: using CellId 30633 18:20:29.256356 tst mo_mt_call_osmux.py: using BVCI 30634 18:20:29.366716 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:20:29.378148 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:20:29.389427 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:20:29.400719 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:20:29.412272 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:20:29.423615 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:20:29.544003 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:20:29.665357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:30.171488 run create_hlr_db(pid=11666): Launched 18:20:30.296630 bus /sierra_2: Setting Powered False 18:20:31.356710 run create_hlr_db(pid=11666): Terminated: ok {rc=0} 18:20:31.791971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11668): Launched 18:20:32.170696 run osmo-hlr_10.42.42.2(pid=11669): Launched 18:20:32.288143 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:32.828265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11671): Launched 18:20:33.134287 run osmo-stp_10.42.42.5(pid=11672): Launched 18:20:33.251420 run osmo-msc_10.42.42.6: Starting osmo-msc 18:20:33.801796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11674): Launched 18:20:34.110066 run osmo-msc_10.42.42.6(pid=11675): Launched 18:20:34.284249 run osmo-stp_10.42.42.5(pid=11672): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11672)] 18:20:34.414804 run osmo-stp_10.42.42.5(pid=11672): stdout: | (launched: 2022-12-12_18:20:33.077987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:34.543958 run osmo-stp_10.42.42.5(pid=11672): stderr: | [0;m[38;5;43m20221212182033243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182033244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182033244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182033244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182033245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182033245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182033245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:34.671140 run osmo-stp_10.42.42.5(pid=11672): stdout: | (launched: 2022-12-12_18:20:33.077987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:34.792878 run osmo-stp_10.42.42.5(pid=11672): stderr: | [0;m[38;5;43m20221212182033243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182033244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182033244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182033244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182033245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182033245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182033245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:34.939226 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11672): Process ended prematurely: osmo-stp_10.42.42.5(pid=11672) [trial-2380↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11672)] [trial-2380↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 18:20:34.948293 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:20:34.975057 run osmo-hlr_10.42.42.2(pid=11669): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11669)] 18:20:35.023326 run osmo-hlr_10.42.42.2(pid=11669): stdout: | (launched: 2022-12-12_18:20:32.113427) 18:20:35.073403 run osmo-hlr_10.42.42.2(pid=11669): stderr: | [0;m[1;31m20221212182032377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182032377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182032377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182032377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182032377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182032377 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182032390 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182032398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182032398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182032398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:35.142644 run osmo-msc_10.42.42.6(pid=11675): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11675)] 18:20:35.190137 run osmo-msc_10.42.42.6(pid=11675): stdout: | (launched: 2022-12-12_18:20:34.053242) 18:20:35.239503 run osmo-msc_10.42.42.6(pid=11675): stderr: | [0;m[38;5;43m20221212182034322 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182034322 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b31b42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182034322 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182034322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182034322 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182034323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182034324 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182034325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182034325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182034325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:20:35.289308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11668): Terminating (SIGTERM) 18:20:35.329159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11671): Terminating (SIGTERM) 18:20:35.369049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11674): Terminating (SIGTERM) 18:20:35.409092 --- ParallelTerminationStrategy: PID 11668 died... 18:20:35.428248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11668): Terminated: ok {rc=0} 18:20:35.472512 --- ParallelTerminationStrategy: PID 11671 died... 18:20:35.491002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11671): Terminated: ok {rc=0} 18:20:35.535095 --- ParallelTerminationStrategy: PID 11674 died... 18:20:35.553576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11674): Terminated: ok {rc=0} 18:20:35.637550 bus /sierra_3: Setting Powered False 18:20:36.738305 bus /sierra_3: Setting Powered False 18:20:37.854719 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 emergency:trx-umtrx --------------------------------------------------------------------- 18:20:39.108184 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:20:39.113400 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 18:20:39.146645 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 18:20:39.174336 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 18:20:39.261142 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 18:20:39.294310 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 18:20:39.321721 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 18:20:39.907685 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2380 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 18:20:39.913048 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:20:39.924137 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 18:20:39.976408 tst emergency_mo_mt_call.py: using LAC 30634 18:20:40.099335 tst emergency_mo_mt_call.py: using RAC 34 18:20:40.223181 tst emergency_mo_mt_call.py: using CellId 30634 18:20:40.346507 tst emergency_mo_mt_call.py: using BVCI 30635 18:20:40.461840 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:20:40.473019 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:20:40.484144 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:20:40.495093 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:20:40.506047 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:20:40.517039 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 18:20:40.632352 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 18:20:40.755861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:41.253338 run create_hlr_db(pid=11680): Launched 18:20:41.385119 bus /sierra_2: Setting Powered False 18:20:42.448587 run create_hlr_db(pid=11680): Terminated: ok {rc=0} 18:20:42.878650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11682): Launched 18:20:43.179702 run osmo-hlr_10.42.42.2(pid=11683): Launched 18:20:43.295187 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:43.815457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11685): Launched 18:20:44.117342 run osmo-stp_10.42.42.5(pid=11686): Launched 18:20:44.242559 tst emergency_mo_mt_call.py: using MSISDN 7903 18:20:44.407461 run osmo-msc_10.42.42.6: Starting osmo-msc 18:20:44.947544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11688): Launched 18:20:45.249418 run osmo-msc_10.42.42.6(pid=11689): Launched 18:20:45.418921 run osmo-stp_10.42.42.5(pid=11686): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11686)] 18:20:45.546873 run osmo-stp_10.42.42.5(pid=11686): stdout: | (launched: 2022-12-12_18:20:44.061417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:45.674277 run osmo-stp_10.42.42.5(pid=11686): stderr: | [0;m[38;5;43m20221212182044225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182044225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182044226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182044226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182044227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182044227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182044227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:45.799394 run osmo-stp_10.42.42.5(pid=11686): stdout: | (launched: 2022-12-12_18:20:44.061417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:45.939843 run osmo-stp_10.42.42.5(pid=11686): stderr: | [0;m[38;5;43m20221212182044225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182044225 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182044226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182044226 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182044227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182044227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182044227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:46.087164 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=11686): Process ended prematurely: osmo-stp_10.42.42.5(pid=11686) [trial-2380↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11686)] [trial-2380↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 18:20:46.097081 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 18:20:46.126514 run osmo-hlr_10.42.42.2(pid=11683): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11683)] 18:20:46.177471 run osmo-hlr_10.42.42.2(pid=11683): stdout: | (launched: 2022-12-12_18:20:43.124165) 18:20:46.229617 run osmo-hlr_10.42.42.2(pid=11683): stderr: | [0;m[1;31m20221212182043298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182043298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182043298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182043298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182043298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182043298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182043310 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182043319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182043320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182043320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:46.301934 run osmo-msc_10.42.42.6(pid=11689): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11689)] 18:20:46.352474 run osmo-msc_10.42.42.6(pid=11689): stdout: | (launched: 2022-12-12_18:20:45.193293) 18:20:46.405083 run osmo-msc_10.42.42.6(pid=11689): stderr: | [0;m[38;5;43m20221212182045463 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182045463 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f25ae5e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182045464 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182045464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182045464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182045464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182045466 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182045466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182045467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182045467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:20:46.457596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11682): Terminating (SIGTERM) 18:20:46.500672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11685): Terminating (SIGTERM) 18:20:46.544665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11688): Terminating (SIGTERM) 18:20:46.587756 --- ParallelTerminationStrategy: PID 11682 died... 18:20:46.607752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11682): Terminated: ok {rc=0} 18:20:46.655219 --- ParallelTerminationStrategy: PID 11685 died... 18:20:46.675044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11685): Terminated: ok {rc=0} 18:20:46.722624 --- ParallelTerminationStrategy: PID 11688 died... 18:20:46.742365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11688): Terminated: ok {rc=0} 18:20:46.834344 bus /sierra_3: Setting Powered False 18:20:47.935103 bus /sierra_3: Setting Powered False 18:20:49.050195 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 18:20:50.136580 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:20:50.148700 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 18:20:50.200758 tst emergency_preemptive_call.py: using LAC 30635 18:20:50.327700 tst emergency_preemptive_call.py: using RAC 35 18:20:50.453291 tst emergency_preemptive_call.py: using CellId 30635 18:20:50.572508 tst emergency_preemptive_call.py: using BVCI 30636 18:20:50.681421 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:20:50.692502 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:20:50.703212 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:20:50.714331 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:20:50.725317 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 18:20:50.736102 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 18:20:50.854440 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 18:20:50.975790 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 18:20:51.091392 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 18:20:51.211076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:20:51.710404 run create_hlr_db(pid=11691): Launched 18:20:51.842592 bus /sierra_2: Setting Powered False 18:20:52.902958 run create_hlr_db(pid=11691): Terminated: ok {rc=0} 18:20:53.350231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11693): Launched 18:20:53.672047 run osmo-hlr_10.42.42.2(pid=11694): Launched 18:20:53.794621 run osmo-stp_10.42.42.5: Starting osmo-stp 18:20:54.349494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11696): Launched 18:20:54.672233 run osmo-stp_10.42.42.5(pid=11697): Launched 18:20:54.804060 tst emergency_preemptive_call.py: using MSISDN 7904 18:20:54.967631 run osmo-msc_10.42.42.6: Starting osmo-msc 18:20:55.543916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11699): Launched 18:20:55.866664 run osmo-msc_10.42.42.6(pid=11700): Launched 18:20:56.046508 run osmo-stp_10.42.42.5(pid=11697): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11697)] 18:20:56.180408 run osmo-stp_10.42.42.5(pid=11697): stdout: | (launched: 2022-12-12_18:20:54.612789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:56.315703 run osmo-stp_10.42.42.5(pid=11697): stderr: | [0;m[38;5;43m20221212182054801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182054801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182054801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182054802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182054803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182054803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182054803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:56.449926 run osmo-stp_10.42.42.5(pid=11697): stdout: | (launched: 2022-12-12_18:20:54.612789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:20:56.578141 run osmo-stp_10.42.42.5(pid=11697): stderr: | [0;m[38;5;43m20221212182054801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182054801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182054801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182054802 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182054803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182054803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182054803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:20:56.731147 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=11697): Process ended prematurely: osmo-stp_10.42.42.5(pid=11697) [trial-2380↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11697)] [trial-2380↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 18:20:56.740220 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 18:20:56.767994 run osmo-hlr_10.42.42.2(pid=11694): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11694)] 18:20:56.817918 run osmo-hlr_10.42.42.2(pid=11694): stdout: | (launched: 2022-12-12_18:20:53.613443) 18:20:56.869439 run osmo-hlr_10.42.42.2(pid=11694): stderr: | [0;m[1;31m20221212182053807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182053807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182053807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182053807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182053807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182053807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182053820 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182053830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182053830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182053830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:20:56.941477 run osmo-msc_10.42.42.6(pid=11700): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11700)] 18:20:56.991351 run osmo-msc_10.42.42.6(pid=11700): stdout: | (launched: 2022-12-12_18:20:55.807495) 18:20:57.043428 run osmo-msc_10.42.42.6(pid=11700): stderr: | [0;m[38;5;43m20221212182056127 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182056127 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe2309f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182056128 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182056128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182056128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182056128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182056130 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182056130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182056130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182056130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:20:57.095210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11693): Terminating (SIGTERM) 18:20:57.136909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11696): Terminating (SIGTERM) 18:20:57.178421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11699): Terminating (SIGTERM) 18:20:57.220096 --- ParallelTerminationStrategy: PID 11693 died... 18:20:57.240148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11693): Terminated: ok {rc=0} 18:20:57.286257 --- ParallelTerminationStrategy: PID 11696 died... 18:20:57.305818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11696): Terminated: ok {rc=0} 18:20:57.351509 --- ParallelTerminationStrategy: PID 11699 died... 18:20:57.370844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11699): Terminated: ok {rc=0} 18:20:57.459892 bus /sierra_9: Setting Powered False 18:20:58.559588 bus /sierra_9: Setting Powered False 18:20:59.676067 bus /sierra_8: Setting Powered False 18:21:00.771854 bus /sierra_8: Setting Powered False 18:21:01.896675 bus /sierra_3: Setting Powered False 18:21:03.002786 bus /sierra_3: Setting Powered False 18:21:04.119141 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-umtrx --------------------------------------------------------------------- 18:21:05.398534 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:21:05.403326 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 18:21:05.436591 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 18:21:05.476300 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 18:21:05.567697 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 18:21:05.601377 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 18:21:05.641327 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 18:21:06.231020 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 18:21:06.284476 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:06.295753 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 18:21:06.345732 tst cs_paging_gprs_active.py: using LAC 30636 18:21:06.474257 tst cs_paging_gprs_active.py: using RAC 36 18:21:06.602454 tst cs_paging_gprs_active.py: using CellId 30636 18:21:06.732074 tst cs_paging_gprs_active.py: using BVCI 30637 18:21:06.852283 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:06.863600 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:06.874542 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:06.885482 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:06.896316 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:06.907168 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:06.918319 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:06.929090 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:06.940122 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 18:21:07.059038 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 18:21:07.176333 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:21:07.382855 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:07.689860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11705): Launched 18:21:07.955990 run iperf3-srv_10.42.42.10(pid=11706): Launched 18:21:08.070964 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:21:08.275176 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:08.581819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11707): Launched 18:21:08.848504 run iperf3-srv_10.42.42.10(pid=11708): Launched 18:21:08.963288 tst cs_paging_gprs_active.py:38: start network... 18:21:09.167609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:09.639621 run create_hlr_db(pid=11709): Launched 18:21:09.758490 bus /sierra_2: Setting Powered False 18:21:10.819010 run create_hlr_db(pid=11709): Terminated: ok {rc=0} 18:21:11.244493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11711): Launched 18:21:11.549707 run osmo-hlr_10.42.42.2(pid=11712): Launched 18:21:11.666399 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:12.192209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11714): Launched 18:21:12.498747 run osmo-stp_10.42.42.5(pid=11715): Launched 18:21:12.616940 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:13.140884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11717): Launched 18:21:13.258097 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:13.515110 run patchelf(pid=11718): Launched 18:21:13.684555 run osmo-stp_10.42.42.5(pid=11715): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11715)] 18:21:13.812897 run osmo-stp_10.42.42.5(pid=11715): stdout: | (launched: 2022-12-12_18:21:12.442302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:13.943054 run osmo-stp_10.42.42.5(pid=11715): stderr: | [0;m[38;5;43m20221212182112609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182112610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182112610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182112610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182112611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182112611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182112611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:14.073408 run osmo-stp_10.42.42.5(pid=11715): stdout: | (launched: 2022-12-12_18:21:12.442302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:14.197893 run osmo-stp_10.42.42.5(pid=11715): stderr: | [0;m[38;5;43m20221212182112609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182112610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182112610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182112610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182112611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182112611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182112611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:14.345180 run patchelf(pid=11718): Terminating (SIGINT) 18:21:14.515662 run patchelf(pid=11718): Terminated: ok {rc=0} 18:21:14.638810 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11715): Process ended prematurely: osmo-stp_10.42.42.5(pid=11715) [trial-2380↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11715)] [trial-2380↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 18:21:14.648399 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 18:21:14.676229 run osmo-hlr_10.42.42.2(pid=11712): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11712)] 18:21:14.724517 run osmo-hlr_10.42.42.2(pid=11712): stdout: | (launched: 2022-12-12_18:21:11.493184) 18:21:14.773763 run osmo-hlr_10.42.42.2(pid=11712): stderr: | [0;m[1;31m20221212182111666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182111666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182111666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182111666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182111666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182111666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182111681 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182111691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182111691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182111691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:14.823374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11705): Terminating (SIGTERM) 18:21:14.863341 run iperf3-srv_10.42.42.10(pid=11706): Terminating (SIGTERM) 18:21:14.903015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11707): Terminating (SIGTERM) 18:21:14.942752 run iperf3-srv_10.42.42.10(pid=11708): Terminating (SIGTERM) 18:21:14.982283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11711): Terminating (SIGTERM) 18:21:15.022032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11714): Terminating (SIGTERM) 18:21:15.061804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11717): Terminating (SIGTERM) 18:21:15.102213 --- ParallelTerminationStrategy: PID 11705 died... 18:21:15.121360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11705): Terminated: ok {rc=0} 18:21:15.165689 --- ParallelTerminationStrategy: PID 11706 died... 18:21:15.184136 run iperf3-srv_10.42.42.10(pid=11706): Terminated {rc=256} 18:21:15.228653 --- ParallelTerminationStrategy: PID 11707 died... 18:21:15.247281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11707): Terminated: ok {rc=0} 18:21:15.292138 --- ParallelTerminationStrategy: PID 11708 died... 18:21:15.310720 run iperf3-srv_10.42.42.10(pid=11708): Terminated {rc=256} 18:21:15.354925 --- ParallelTerminationStrategy: PID 11711 died... 18:21:15.373599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11711): Terminated: ok {rc=0} 18:21:15.417849 --- ParallelTerminationStrategy: PID 11714 died... 18:21:15.436511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11714): Terminated: ok {rc=0} 18:21:15.480908 --- ParallelTerminationStrategy: PID 11717 died... 18:21:15.500517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11717): Terminated: ok {rc=0} 18:21:15.585811 bus /gobi_0: Setting Powered False 18:21:16.686218 bus /gobi_0: Setting Powered False 18:21:17.810946 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx iperf3.py ---------------------------------------------- 18:21:18.957476 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:18.968811 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 18:21:19.022415 tst iperf3.py: using LAC 30637 18:21:19.143351 tst iperf3.py: using RAC 37 18:21:19.266550 tst iperf3.py: using CellId 30637 18:21:19.386342 tst iperf3.py: using BVCI 30638 18:21:19.498987 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:19.509731 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:19.520161 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:19.530906 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:19.541535 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:19.552190 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:19.563013 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:19.573666 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:19.584424 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 18:21:19.704131 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:21:19.926778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:20.253706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11719): Launched 18:21:20.538951 run iperf3-srv_10.42.42.10(pid=11720): Launched 18:21:20.663695 tst iperf3.py:8: start network... 18:21:20.884727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:21.390510 run create_hlr_db(pid=11721): Launched 18:21:21.525018 bus /gobi_6: Setting Powered False 18:21:22.590021 run create_hlr_db(pid=11721): Terminated: ok {rc=0} 18:21:23.025960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11723): Launched 18:21:23.331731 run osmo-hlr_10.42.42.2(pid=11724): Launched 18:21:23.449682 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:23.978093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11726): Launched 18:21:24.283099 run osmo-stp_10.42.42.5(pid=11727): Launched 18:21:24.399370 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:24.925433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11729): Launched 18:21:25.042327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:25.300083 run patchelf(pid=11730): Launched 18:21:25.470180 run osmo-stp_10.42.42.5(pid=11727): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11727)] 18:21:25.598953 run osmo-stp_10.42.42.5(pid=11727): stdout: | (launched: 2022-12-12_18:21:24.226934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:25.729339 run osmo-stp_10.42.42.5(pid=11727): stderr: | [0;m[38;5;43m20221212182124395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182124395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182124396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182124396 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182124397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182124397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182124397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:25.859558 run osmo-stp_10.42.42.5(pid=11727): stdout: | (launched: 2022-12-12_18:21:24.226934) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:25.983868 run osmo-stp_10.42.42.5(pid=11727): stderr: | [0;m[38;5;43m20221212182124395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182124395 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182124396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182124396 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182124397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182124397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182124397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:26.131358 run patchelf(pid=11730): Terminating (SIGINT) 18:21:26.302187 run patchelf(pid=11730): Terminated: ok {rc=0} 18:21:26.425079 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11727): Process ended prematurely: osmo-stp_10.42.42.5(pid=11727) [trial-2380↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11727)] [trial-2380↪gprs:trx-umtrx↪iperf3.py:8] 18:21:26.434649 tst iperf3.py:8: Test FAILED (7.5 sec) 18:21:26.462065 run osmo-hlr_10.42.42.2(pid=11724): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11724)] 18:21:26.509766 run osmo-hlr_10.42.42.2(pid=11724): stdout: | (launched: 2022-12-12_18:21:23.275259) 18:21:26.558864 run osmo-hlr_10.42.42.2(pid=11724): stderr: | [0;m[1;31m20221212182123449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182123449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182123449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182123449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182123449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182123449 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182123462 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182123470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182123470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182123470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:26.608250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11719): Terminating (SIGTERM) 18:21:26.648266 run iperf3-srv_10.42.42.10(pid=11720): Terminating (SIGTERM) 18:21:26.688012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11723): Terminating (SIGTERM) 18:21:26.728403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11726): Terminating (SIGTERM) 18:21:26.768204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11729): Terminating (SIGTERM) 18:21:26.808449 --- ParallelTerminationStrategy: PID 11719 died... 18:21:26.827411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11719): Terminated: ok {rc=0} 18:21:26.871661 --- ParallelTerminationStrategy: PID 11720 died... 18:21:26.890153 run iperf3-srv_10.42.42.10(pid=11720): Terminated {rc=256} 18:21:26.934196 --- ParallelTerminationStrategy: PID 11723 died... 18:21:26.952716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11723): Terminated: ok {rc=0} 18:21:26.997087 --- ParallelTerminationStrategy: PID 11726 died... 18:21:27.015662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11726): Terminated: ok {rc=0} 18:21:27.059899 --- ParallelTerminationStrategy: PID 11729 died... 18:21:27.078479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11729): Terminated: ok {rc=0} 18:21:27.164833 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 18:21:28.315782 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:28.327707 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 18:21:28.378828 tst iperf3m4.py: using LAC 30638 18:21:28.507158 tst iperf3m4.py: using RAC 38 18:21:28.634454 tst iperf3m4.py: using CellId 30638 18:21:28.764506 tst iperf3m4.py: using BVCI 30639 18:21:28.884169 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:28.895446 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:28.906500 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:28.917562 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:28.928533 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:28.939477 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:28.950674 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:28.961590 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:28.972641 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 18:21:29.095308 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 18:21:29.218436 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 18:21:29.337470 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 18:21:29.458301 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:21:29.678213 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:30.005782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11731): Launched 18:21:30.291070 run iperf3-srv_10.42.42.10(pid=11732): Launched 18:21:30.413674 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:21:30.632618 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:30.974189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11733): Launched 18:21:31.281100 run iperf3-srv_10.42.42.10(pid=11734): Launched 18:21:31.418604 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:21:31.641471 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:31.974635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11735): Launched 18:21:32.272724 run iperf3-srv_10.42.42.10(pid=11736): Launched 18:21:32.397408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:21:32.617217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:21:32.947669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11737): Launched 18:21:33.232410 run iperf3-srv_10.42.42.10(pid=11738): Launched 18:21:33.356366 tst iperf3m4.py:8: start network... 18:21:33.576314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:34.083980 run create_hlr_db(pid=11739): Launched 18:21:34.210961 bus /gobi_6: Setting Powered False 18:21:35.272105 run create_hlr_db(pid=11739): Terminated: ok {rc=0} 18:21:35.719271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11741): Launched 18:21:36.049488 run osmo-hlr_10.42.42.2(pid=11742): Launched 18:21:36.175794 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:36.740125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11744): Launched 18:21:37.070162 run osmo-stp_10.42.42.5(pid=11745): Launched 18:21:37.195899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:37.761323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11747): Launched 18:21:37.886992 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:38.166641 run patchelf(pid=11748): Launched 18:21:38.350699 run osmo-stp_10.42.42.5(pid=11745): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11745)] 18:21:38.488851 run osmo-stp_10.42.42.5(pid=11745): stdout: | (launched: 2022-12-12_18:21:37.009366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:38.628509 run osmo-stp_10.42.42.5(pid=11745): stderr: | [0;m[38;5;43m20221212182137199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182137199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182137199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182137200 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182137200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182137200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182137200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:38.768450 run osmo-stp_10.42.42.5(pid=11745): stdout: | (launched: 2022-12-12_18:21:37.009366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:38.902943 run osmo-stp_10.42.42.5(pid=11745): stderr: | [0;m[38;5;43m20221212182137199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182137199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182137199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182137200 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182137200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182137200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182137200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:39.061596 run patchelf(pid=11748): Terminating (SIGINT) 18:21:39.244744 run patchelf(pid=11748): Terminated: ok {rc=0} 18:21:39.376548 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11745): Process ended prematurely: osmo-stp_10.42.42.5(pid=11745) [trial-2380↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11745)] [trial-2380↪gprs:trx-umtrx↪iperf3m4.py:8] 18:21:39.386985 tst iperf3m4.py:8: Test FAILED (11.1 sec) 18:21:39.416034 run osmo-hlr_10.42.42.2(pid=11742): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11742)] 18:21:39.466485 run osmo-hlr_10.42.42.2(pid=11742): stdout: | (launched: 2022-12-12_18:21:35.989122) 18:21:39.518753 run osmo-hlr_10.42.42.2(pid=11742): stderr: | [0;m[1;31m20221212182136184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182136184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182136184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182136184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182136184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182136184 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182136196 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182136205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182136206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182136206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:39.571342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11731): Terminating (SIGTERM) 18:21:39.613862 run iperf3-srv_10.42.42.10(pid=11732): Terminating (SIGTERM) 18:21:39.656219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11733): Terminating (SIGTERM) 18:21:39.698607 run iperf3-srv_10.42.42.10(pid=11734): Terminating (SIGTERM) 18:21:39.741031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11735): Terminating (SIGTERM) 18:21:39.782970 run iperf3-srv_10.42.42.10(pid=11736): Terminating (SIGTERM) 18:21:39.824734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11737): Terminating (SIGTERM) 18:21:39.866509 run iperf3-srv_10.42.42.10(pid=11738): Terminating (SIGTERM) 18:21:39.907988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11741): Terminating (SIGTERM) 18:21:39.950479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11744): Terminating (SIGTERM) 18:21:39.992102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11747): Terminating (SIGTERM) 18:21:40.034098 --- ParallelTerminationStrategy: PID 11731 died... 18:21:40.054218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11731): Terminated: ok {rc=0} 18:21:40.100205 --- ParallelTerminationStrategy: PID 11732 died... 18:21:40.119654 run iperf3-srv_10.42.42.10(pid=11732): Terminated {rc=256} 18:21:40.165246 --- ParallelTerminationStrategy: PID 11733 died... 18:21:40.184599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11733): Terminated: ok {rc=0} 18:21:40.232578 --- ParallelTerminationStrategy: PID 11734 died... 18:21:40.251099 run iperf3-srv_10.42.42.10(pid=11734): Terminated {rc=256} 18:21:40.296259 --- ParallelTerminationStrategy: PID 11735 died... 18:21:40.314862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11735): Terminated: ok {rc=0} 18:21:40.359851 --- ParallelTerminationStrategy: PID 11736 died... 18:21:40.378460 run iperf3-srv_10.42.42.10(pid=11736): Terminated {rc=256} 18:21:40.423467 --- ParallelTerminationStrategy: PID 11737 died... 18:21:40.442214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11737): Terminated: ok {rc=0} 18:21:40.486811 --- ParallelTerminationStrategy: PID 11738 died... 18:21:40.505456 run iperf3-srv_10.42.42.10(pid=11738): Terminated {rc=256} 18:21:40.549824 --- ParallelTerminationStrategy: PID 11741 died... 18:21:40.568557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11741): Terminated: ok {rc=0} 18:21:40.613132 --- ParallelTerminationStrategy: PID 11744 died... 18:21:40.631750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11744): Terminated: ok {rc=0} 18:21:40.676303 --- ParallelTerminationStrategy: PID 11747 died... 18:21:40.694935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11747): Terminated: ok {rc=0} 18:21:40.781363 bus /gobi_4: Setting Powered False 18:21:41.881871 bus /gobi_4: Setting Powered False 18:21:42.997955 bus /gobi_1: Setting Powered False 18:21:44.096330 bus /gobi_1: Setting Powered False 18:21:45.211089 bus /gobi_0: Setting Powered False 18:21:46.309957 bus /gobi_0: Setting Powered False 18:21:47.430721 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx ping.py ---------------------------------------------- 18:21:48.532294 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:48.543793 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 18:21:48.593444 tst ping.py: using LAC 30639 18:21:48.711845 tst ping.py: using RAC 39 18:21:48.838979 tst ping.py: using CellId 30639 18:21:48.966629 tst ping.py: using BVCI 30640 18:21:49.084099 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:49.095532 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:49.106823 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:49.118614 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:49.130048 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:49.141510 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:49.153108 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:49.164581 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 18:21:49.282245 tst ping.py:19: start network... 18:21:49.498107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:49.994705 run create_hlr_db(pid=11750): Launched 18:21:50.126069 bus /gobi_6: Setting Powered False 18:21:51.189202 run create_hlr_db(pid=11750): Terminated: ok {rc=0} 18:21:51.615945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11752): Launched 18:21:51.917047 run osmo-hlr_10.42.42.2(pid=11753): Launched 18:21:52.031570 run osmo-stp_10.42.42.5: Starting osmo-stp 18:21:52.550188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11755): Launched 18:21:52.851114 run osmo-stp_10.42.42.5(pid=11756): Launched 18:21:52.967248 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:21:53.483351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11758): Launched 18:21:53.598427 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:21:53.852667 run patchelf(pid=11759): Launched 18:21:54.021149 run osmo-stp_10.42.42.5(pid=11756): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11756)] 18:21:54.147749 run osmo-stp_10.42.42.5(pid=11756): stdout: | (launched: 2022-12-12_18:21:52.794899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:54.276250 run osmo-stp_10.42.42.5(pid=11756): stderr: | [0;m[38;5;43m20221212182152964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182152964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182152964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182152965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182152965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182152965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182152965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:54.404645 run osmo-stp_10.42.42.5(pid=11756): stdout: | (launched: 2022-12-12_18:21:52.794899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:21:54.527454 run osmo-stp_10.42.42.5(pid=11756): stderr: | [0;m[38;5;43m20221212182152964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182152964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182152964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182152965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182152965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182152965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182152965 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:21:54.672580 run patchelf(pid=11759): Terminating (SIGINT) 18:21:54.840594 run patchelf(pid=11759): Terminated: ok {rc=0} 18:21:54.963323 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11756): Process ended prematurely: osmo-stp_10.42.42.5(pid=11756) [trial-2380↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11756)] [trial-2380↪gprs:trx-umtrx↪ping.py:22] 18:21:54.972485 tst ping.py:22: Test FAILED (6.4 sec) 18:21:54.999970 run osmo-hlr_10.42.42.2(pid=11753): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11753)] 18:21:55.047390 run osmo-hlr_10.42.42.2(pid=11753): stdout: | (launched: 2022-12-12_18:21:51.861214) 18:21:55.097299 run osmo-hlr_10.42.42.2(pid=11753): stderr: | [0;m[1;31m20221212182152034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182152034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182152034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182152034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182152034 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182152035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182152047 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182152058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182152058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182152058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:21:55.147016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11752): Terminating (SIGTERM) 18:21:55.186843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11755): Terminating (SIGTERM) 18:21:55.226568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11758): Terminating (SIGTERM) 18:21:55.266539 --- ParallelTerminationStrategy: PID 11752 died... 18:21:55.285003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11752): Terminated: ok {rc=0} 18:21:55.329200 --- ParallelTerminationStrategy: PID 11755 died... 18:21:55.347513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11755): Terminated: ok {rc=0} 18:21:55.391600 --- ParallelTerminationStrategy: PID 11758 died... 18:21:55.410064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11758): Terminated: ok {rc=0} 18:21:55.494933 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 18:21:56.581871 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:56.594534 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 18:21:56.647812 tst ping_idle_ping.py: using LAC 30640 18:21:56.776559 tst ping_idle_ping.py: using RAC 40 18:21:56.904601 tst ping_idle_ping.py: using CellId 30640 18:21:57.033086 tst ping_idle_ping.py: using BVCI 30641 18:21:57.150244 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:57.161631 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:57.172601 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:57.184204 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:57.195556 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:57.207009 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:57.218681 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 18:21:57.230323 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 18:21:57.349663 tst ping_idle_ping.py:24: start network... 18:21:57.565799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:21:58.068092 run create_hlr_db(pid=11760): Launched 18:21:58.201513 bus /gobi_6: Setting Powered False 18:21:59.266008 run create_hlr_db(pid=11760): Terminated: ok {rc=0} 18:21:59.699550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11762): Launched 18:22:00.003738 run osmo-hlr_10.42.42.2(pid=11763): Launched 18:22:00.119545 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:00.653300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11765): Launched 18:22:00.975739 run osmo-stp_10.42.42.5(pid=11766): Launched 18:22:01.136072 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:01.897799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11768): Launched 18:22:02.033161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:02.317131 run patchelf(pid=11769): Launched 18:22:02.502509 run osmo-stp_10.42.42.5(pid=11766): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11766)] 18:22:02.638498 run osmo-stp_10.42.42.5(pid=11766): stdout: | (launched: 2022-12-12_18:22:00.910995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:02.776796 run osmo-stp_10.42.42.5(pid=11766): stderr: | [0;m[38;5;43m20221212182201280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182201280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182201280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182201282 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182201283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182201283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182201283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:02.914624 run osmo-stp_10.42.42.5(pid=11766): stdout: | (launched: 2022-12-12_18:22:00.910995) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:03.047123 run osmo-stp_10.42.42.5(pid=11766): stderr: | [0;m[38;5;43m20221212182201280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182201280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182201280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182201282 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182201283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182201283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182201283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:03.203608 run patchelf(pid=11769): Terminating (SIGINT) 18:22:03.382887 run patchelf(pid=11769): Terminated: ok {rc=0} 18:22:03.511975 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11766): Process ended prematurely: osmo-stp_10.42.42.5(pid=11766) [trial-2380↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11766)] [trial-2380↪gprs:trx-umtrx↪ping_idle_ping.py:27] 18:22:03.521687 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 18:22:03.549844 run osmo-hlr_10.42.42.2(pid=11763): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11763)] 18:22:03.601964 run osmo-hlr_10.42.42.2(pid=11763): stdout: | (launched: 2022-12-12_18:21:59.947692) 18:22:03.653967 run osmo-hlr_10.42.42.2(pid=11763): stderr: | [0;m[1;31m20221212182200122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182200122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182200122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182200122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182200122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182200122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182200134 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182200144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182200145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182200145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:03.706088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11762): Terminating (SIGTERM) 18:22:03.748146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11765): Terminating (SIGTERM) 18:22:03.790979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11768): Terminating (SIGTERM) 18:22:03.833508 --- ParallelTerminationStrategy: PID 11762 died... 18:22:03.853819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11762): Terminated: ok {rc=0} 18:22:03.900467 --- ParallelTerminationStrategy: PID 11765 died... 18:22:03.920186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11765): Terminated: ok {rc=0} 18:22:03.966784 --- ParallelTerminationStrategy: PID 11768 died... 18:22:03.986793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11768): Terminated: ok {rc=0} 18:22:04.075510 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 18:22:05.379137 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:22:05.385711 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:22:05.419793 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:22:05.459576 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:22:05.549394 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:22:05.582715 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:22:05.622303 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:22:06.219022 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:22:06.271875 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:06.283304 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:22:06.334928 tst cs_paging_gprs_active.py: using LAC 30641 18:22:06.464550 tst cs_paging_gprs_active.py: using RAC 41 18:22:06.592807 tst cs_paging_gprs_active.py: using CellId 30641 18:22:06.720523 tst cs_paging_gprs_active.py: using BVCI 30642 18:22:06.833593 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:06.844679 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:06.855390 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:06.866551 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:06.877740 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:06.892058 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:06.903490 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:06.914557 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:06.925833 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:22:07.045300 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:22:07.165845 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:22:07.372430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:07.680803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11773): Launched 18:22:07.949434 run iperf3-srv_10.42.42.10(pid=11774): Launched 18:22:08.064586 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:22:08.269791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:08.576884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11775): Launched 18:22:08.844233 run iperf3-srv_10.42.42.10(pid=11776): Launched 18:22:08.960456 tst cs_paging_gprs_active.py:38: start network... 18:22:09.165896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:09.639745 run create_hlr_db(pid=11777): Launched 18:22:09.756864 bus /gobi_6: Setting Powered False 18:22:10.818132 run create_hlr_db(pid=11777): Terminated: ok {rc=0} 18:22:11.245738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11779): Launched 18:22:11.553924 run osmo-hlr_10.42.42.2(pid=11780): Launched 18:22:11.673256 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:12.212210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11782): Launched 18:22:12.520711 run osmo-stp_10.42.42.5(pid=11783): Launched 18:22:12.640292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:13.167600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11785): Launched 18:22:13.286710 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:13.546122 run patchelf(pid=11786): Launched 18:22:13.718418 run osmo-stp_10.42.42.5(pid=11783): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11783)] 18:22:13.847707 run osmo-stp_10.42.42.5(pid=11783): stdout: | (launched: 2022-12-12_18:22:12.463648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:13.978331 run osmo-stp_10.42.42.5(pid=11783): stderr: | [0;m[38;5;43m20221212182212632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182212632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182212632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182212633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182212633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182212633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182212633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:14.108597 run osmo-stp_10.42.42.5(pid=11783): stdout: | (launched: 2022-12-12_18:22:12.463648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:14.232937 run osmo-stp_10.42.42.5(pid=11783): stderr: | [0;m[38;5;43m20221212182212632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182212632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182212632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182212633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182212633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182212633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182212633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:14.380324 run patchelf(pid=11786): Terminating (SIGINT) 18:22:14.551635 run patchelf(pid=11786): Terminated: ok {rc=0} 18:22:14.674974 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11783): Process ended prematurely: osmo-stp_10.42.42.5(pid=11783) [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11783)] [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:22:14.684550 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 18:22:14.712367 run osmo-hlr_10.42.42.2(pid=11780): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11780)] 18:22:14.760487 run osmo-hlr_10.42.42.2(pid=11780): stdout: | (launched: 2022-12-12_18:22:11.496264) 18:22:14.810064 run osmo-hlr_10.42.42.2(pid=11780): stderr: | [0;m[1;31m20221212182211670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182211670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182211670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182211671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182211671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182211671 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182211683 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182211691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182211691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182211691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:14.859984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11773): Terminating (SIGTERM) 18:22:14.900046 run iperf3-srv_10.42.42.10(pid=11774): Terminating (SIGTERM) 18:22:14.939833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11775): Terminating (SIGTERM) 18:22:14.979744 run iperf3-srv_10.42.42.10(pid=11776): Terminating (SIGTERM) 18:22:15.019581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11779): Terminating (SIGTERM) 18:22:15.059693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11782): Terminating (SIGTERM) 18:22:15.099940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11785): Terminating (SIGTERM) 18:22:15.140168 --- ParallelTerminationStrategy: PID 11773 died... 18:22:15.159188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11773): Terminated: ok {rc=0} 18:22:15.204060 --- ParallelTerminationStrategy: PID 11774 died... 18:22:15.222646 run iperf3-srv_10.42.42.10(pid=11774): Terminated {rc=256} 18:22:15.267335 --- ParallelTerminationStrategy: PID 11775 died... 18:22:15.285909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11775): Terminated: ok {rc=0} 18:22:15.330515 --- ParallelTerminationStrategy: PID 11776 died... 18:22:15.349155 run iperf3-srv_10.42.42.10(pid=11776): Terminated {rc=256} 18:22:15.393275 --- ParallelTerminationStrategy: PID 11779 died... 18:22:15.411684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11779): Terminated: ok {rc=0} 18:22:15.456042 --- ParallelTerminationStrategy: PID 11782 died... 18:22:15.474650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11782): Terminated: ok {rc=0} 18:22:15.518701 --- ParallelTerminationStrategy: PID 11785 died... 18:22:15.537230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11785): Terminated: ok {rc=0} 18:22:15.623795 bus /gobi_0: Setting Powered False 18:22:16.740308 bus /gobi_0: Setting Powered False 18:22:17.854716 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:22:19.000346 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:19.012196 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:22:19.065367 tst iperf3.py: using LAC 30642 18:22:19.188421 tst iperf3.py: using RAC 42 18:22:19.309728 tst iperf3.py: using CellId 30642 18:22:19.429769 tst iperf3.py: using BVCI 30643 18:22:19.543099 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:19.554131 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:19.564831 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:19.575810 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:19.586794 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:19.597861 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:19.608881 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:19.619759 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:19.630832 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:22:19.747480 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:22:19.952142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:20.259075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11787): Launched 18:22:20.527922 run iperf3-srv_10.42.42.10(pid=11788): Launched 18:22:20.642453 tst iperf3.py:8: start network... 18:22:20.846261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:21.318066 run create_hlr_db(pid=11789): Launched 18:22:21.437704 bus /gobi_6: Setting Powered False 18:22:22.498247 run create_hlr_db(pid=11789): Terminated: ok {rc=0} 18:22:22.944306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11791): Launched 18:22:23.271879 run osmo-hlr_10.42.42.2(pid=11792): Launched 18:22:23.398148 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:23.967139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11794): Launched 18:22:24.295148 run osmo-stp_10.42.42.5(pid=11795): Launched 18:22:24.421971 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:24.986396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11797): Launched 18:22:25.112689 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:25.390084 run patchelf(pid=11798): Launched 18:22:25.572593 run osmo-stp_10.42.42.5(pid=11795): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11795)] 18:22:25.709693 run osmo-stp_10.42.42.5(pid=11795): stdout: | (launched: 2022-12-12_18:22:24.234570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:25.848723 run osmo-stp_10.42.42.5(pid=11795): stderr: | [0;m[38;5;43m20221212182224425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182224425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182224425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182224426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182224426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182224426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182224426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:25.987575 run osmo-stp_10.42.42.5(pid=11795): stdout: | (launched: 2022-12-12_18:22:24.234570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:26.120260 run osmo-stp_10.42.42.5(pid=11795): stderr: | [0;m[38;5;43m20221212182224425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182224425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182224425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182224426 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182224426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182224426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182224426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:26.277749 run patchelf(pid=11798): Terminating (SIGINT) 18:22:26.459439 run patchelf(pid=11798): Terminated: ok {rc=0} 18:22:26.590750 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11795): Process ended prematurely: osmo-stp_10.42.42.5(pid=11795) [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11795)] [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 18:22:26.601043 tst iperf3.py:8: Test FAILED (7.6 sec) 18:22:26.629579 run osmo-hlr_10.42.42.2(pid=11792): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11792)] 18:22:26.679097 run osmo-hlr_10.42.42.2(pid=11792): stdout: | (launched: 2022-12-12_18:22:23.211416) 18:22:26.730326 run osmo-hlr_10.42.42.2(pid=11792): stderr: | [0;m[1;31m20221212182223407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182223407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182223407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182223408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182223408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182223408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182223420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182223431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182223431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182223431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:26.782499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11787): Terminating (SIGTERM) 18:22:26.824084 run iperf3-srv_10.42.42.10(pid=11788): Terminating (SIGTERM) 18:22:26.865700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11791): Terminating (SIGTERM) 18:22:26.907172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11794): Terminating (SIGTERM) 18:22:26.948449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11797): Terminating (SIGTERM) 18:22:26.990392 --- ParallelTerminationStrategy: PID 11787 died... 18:22:27.010434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11787): Terminated: ok {rc=0} 18:22:27.056269 --- ParallelTerminationStrategy: PID 11788 died... 18:22:27.075648 run iperf3-srv_10.42.42.10(pid=11788): Terminated {rc=256} 18:22:27.121321 --- ParallelTerminationStrategy: PID 11791 died... 18:22:27.140674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11791): Terminated: ok {rc=0} 18:22:27.187251 --- ParallelTerminationStrategy: PID 11794 died... 18:22:27.206962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11794): Terminated: ok {rc=0} 18:22:27.252611 --- ParallelTerminationStrategy: PID 11797 died... 18:22:27.272193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11797): Terminated: ok {rc=0} 18:22:27.359079 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:22:28.506242 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:28.518043 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:22:28.567376 tst iperf3m4.py: using LAC 30643 18:22:28.687122 tst iperf3m4.py: using RAC 43 18:22:28.805701 tst iperf3m4.py: using CellId 30643 18:22:28.933757 tst iperf3m4.py: using BVCI 30644 18:22:29.053066 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:29.064460 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:29.075848 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:29.087251 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:29.098430 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:29.109590 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:29.120849 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:29.131879 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:29.143159 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:22:29.262290 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:22:29.385493 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:22:29.500687 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:22:29.618161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:22:29.822582 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:30.128129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11799): Launched 18:22:30.394999 run iperf3-srv_10.42.42.10(pid=11800): Launched 18:22:30.511825 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:22:30.716036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:31.043919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11801): Launched 18:22:31.325774 run iperf3-srv_10.42.42.10(pid=11802): Launched 18:22:31.455990 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:22:31.665588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:31.984256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11803): Launched 18:22:32.290379 run iperf3-srv_10.42.42.10(pid=11804): Launched 18:22:32.406284 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:22:32.610236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:22:32.917861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11805): Launched 18:22:33.187115 run iperf3-srv_10.42.42.10(pid=11806): Launched 18:22:33.302583 tst iperf3m4.py:8: start network... 18:22:33.506577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:33.980153 run create_hlr_db(pid=11807): Launched 18:22:34.097811 bus /gobi_6: Setting Powered False 18:22:35.158686 run create_hlr_db(pid=11807): Terminated: ok {rc=0} 18:22:35.607401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11809): Launched 18:22:35.936443 run osmo-hlr_10.42.42.2(pid=11810): Launched 18:22:36.062381 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:36.629151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11812): Launched 18:22:36.960471 run osmo-stp_10.42.42.5(pid=11813): Launched 18:22:37.086214 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:37.653072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11815): Launched 18:22:37.779878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:38.058689 run patchelf(pid=11816): Launched 18:22:38.241377 run osmo-stp_10.42.42.5(pid=11813): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11813)] 18:22:38.379780 run osmo-stp_10.42.42.5(pid=11813): stdout: | (launched: 2022-12-12_18:22:36.899720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:38.519713 run osmo-stp_10.42.42.5(pid=11813): stderr: | [0;m[38;5;43m20221212182237089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182237089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182237089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182237089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182237090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182237090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182237090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:38.659765 run osmo-stp_10.42.42.5(pid=11813): stdout: | (launched: 2022-12-12_18:22:36.899720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:38.794251 run osmo-stp_10.42.42.5(pid=11813): stderr: | [0;m[38;5;43m20221212182237089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182237089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182237089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182237089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182237090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182237090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182237090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:38.952849 run patchelf(pid=11816): Terminating (SIGINT) 18:22:39.135999 run patchelf(pid=11816): Terminated: ok {rc=0} 18:22:39.268237 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11813): Process ended prematurely: osmo-stp_10.42.42.5(pid=11813) [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11813)] [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 18:22:39.278827 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:22:39.308009 run osmo-hlr_10.42.42.2(pid=11810): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11810)] 18:22:39.358074 run osmo-hlr_10.42.42.2(pid=11810): stdout: | (launched: 2022-12-12_18:22:35.875768) 18:22:39.409948 run osmo-hlr_10.42.42.2(pid=11810): stderr: | [0;m[1;31m20221212182236069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182236069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182236070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182236070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182236070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182236070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182236082 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182236093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182236093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182236094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:39.461873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11799): Terminating (SIGTERM) 18:22:39.503870 run iperf3-srv_10.42.42.10(pid=11800): Terminating (SIGTERM) 18:22:39.546151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11801): Terminating (SIGTERM) 18:22:39.588325 run iperf3-srv_10.42.42.10(pid=11802): Terminating (SIGTERM) 18:22:39.630407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11803): Terminating (SIGTERM) 18:22:39.672557 run iperf3-srv_10.42.42.10(pid=11804): Terminating (SIGTERM) 18:22:39.714762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11805): Terminating (SIGTERM) 18:22:39.756920 run iperf3-srv_10.42.42.10(pid=11806): Terminating (SIGTERM) 18:22:39.799202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11809): Terminating (SIGTERM) 18:22:39.841623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11812): Terminating (SIGTERM) 18:22:39.883784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11815): Terminating (SIGTERM) 18:22:39.926368 --- ParallelTerminationStrategy: PID 11799 died... 18:22:39.946580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11799): Terminated: ok {rc=0} 18:22:39.993156 --- ParallelTerminationStrategy: PID 11800 died... 18:22:40.012736 run iperf3-srv_10.42.42.10(pid=11800): Terminated {rc=256} 18:22:40.058900 --- ParallelTerminationStrategy: PID 11801 died... 18:22:40.078576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11801): Terminated: ok {rc=0} 18:22:40.124884 --- ParallelTerminationStrategy: PID 11802 died... 18:22:40.144632 run iperf3-srv_10.42.42.10(pid=11802): Terminated {rc=256} 18:22:40.190865 --- ParallelTerminationStrategy: PID 11803 died... 18:22:40.210644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11803): Terminated: ok {rc=0} 18:22:40.256845 --- ParallelTerminationStrategy: PID 11804 died... 18:22:40.276901 run iperf3-srv_10.42.42.10(pid=11804): Terminated {rc=256} 18:22:40.322955 --- ParallelTerminationStrategy: PID 11805 died... 18:22:40.342642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11805): Terminated: ok {rc=0} 18:22:40.389143 --- ParallelTerminationStrategy: PID 11806 died... 18:22:40.408843 run iperf3-srv_10.42.42.10(pid=11806): Terminated {rc=256} 18:22:40.455235 --- ParallelTerminationStrategy: PID 11809 died... 18:22:40.475073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11809): Terminated: ok {rc=0} 18:22:40.521580 --- ParallelTerminationStrategy: PID 11812 died... 18:22:40.541381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11812): Terminated: ok {rc=0} 18:22:40.587693 --- ParallelTerminationStrategy: PID 11815 died... 18:22:40.607472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11815): Terminated: ok {rc=0} 18:22:40.695688 bus /gobi_4: Setting Powered False 18:22:41.797457 bus /gobi_4: Setting Powered False 18:22:42.914341 bus /gobi_1: Setting Powered False 18:22:44.010640 bus /gobi_1: Setting Powered False 18:22:45.125758 bus /gobi_0: Setting Powered False 18:22:46.225796 bus /gobi_0: Setting Powered False 18:22:47.346384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 18:22:48.450538 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:48.462377 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:22:48.512938 tst ping.py: using LAC 30644 18:22:48.635131 tst ping.py: using RAC 44 18:22:48.750822 tst ping.py: using CellId 30644 18:22:48.869033 tst ping.py: using BVCI 30645 18:22:48.977940 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:48.988879 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:48.999698 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:49.010775 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:49.021805 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:49.032755 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:49.044031 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:49.054995 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:22:49.170348 tst ping.py:19: start network... 18:22:49.370632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:49.835821 run create_hlr_db(pid=11817): Launched 18:22:49.951373 bus /gobi_6: Setting Powered False 18:22:51.011338 run create_hlr_db(pid=11817): Terminated: ok {rc=0} 18:22:51.433401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11819): Launched 18:22:51.736759 run osmo-hlr_10.42.42.2(pid=11820): Launched 18:22:51.851890 run osmo-stp_10.42.42.5: Starting osmo-stp 18:22:52.374918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11822): Launched 18:22:52.676218 run osmo-stp_10.42.42.5(pid=11823): Launched 18:22:52.792822 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:22:53.311602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11825): Launched 18:22:53.426583 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:22:53.681244 run patchelf(pid=11826): Launched 18:22:53.848063 run osmo-stp_10.42.42.5(pid=11823): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11823)] 18:22:53.974527 run osmo-stp_10.42.42.5(pid=11823): stdout: | (launched: 2022-12-12_18:22:52.620066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:54.102645 run osmo-stp_10.42.42.5(pid=11823): stderr: | [0;m[38;5;43m20221212182252788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182252789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182252789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182252789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182252790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182252790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182252790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:54.230890 run osmo-stp_10.42.42.5(pid=11823): stdout: | (launched: 2022-12-12_18:22:52.620066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:22:54.353919 run osmo-stp_10.42.42.5(pid=11823): stderr: | [0;m[38;5;43m20221212182252788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182252789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182252789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182252789 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182252790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182252790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182252790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:22:54.498715 run patchelf(pid=11826): Terminating (SIGINT) 18:22:54.666648 run patchelf(pid=11826): Terminated: ok {rc=0} 18:22:54.787978 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11823): Process ended prematurely: osmo-stp_10.42.42.5(pid=11823) [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11823)] [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 18:22:54.797067 tst ping.py:22: Test FAILED (6.3 sec) 18:22:54.824676 run osmo-hlr_10.42.42.2(pid=11820): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11820)] 18:22:54.872486 run osmo-hlr_10.42.42.2(pid=11820): stdout: | (launched: 2022-12-12_18:22:51.680214) 18:22:54.921955 run osmo-hlr_10.42.42.2(pid=11820): stderr: | [0;m[1;31m20221212182251854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182251854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182251854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182251854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182251854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182251854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182251867 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182251877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182251878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182251878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:22:54.971848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11819): Terminating (SIGTERM) 18:22:55.011929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11822): Terminating (SIGTERM) 18:22:55.052063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11825): Terminating (SIGTERM) 18:22:55.092356 --- ParallelTerminationStrategy: PID 11819 died... 18:22:55.111590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11819): Terminated: ok {rc=0} 18:22:55.156178 --- ParallelTerminationStrategy: PID 11822 died... 18:22:55.174942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11822): Terminated: ok {rc=0} 18:22:55.219786 --- ParallelTerminationStrategy: PID 11825 died... 18:22:55.238483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11825): Terminated: ok {rc=0} 18:22:55.325400 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:22:56.414901 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:56.427129 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:22:56.478474 tst ping_idle_ping.py: using LAC 30645 18:22:56.597136 tst ping_idle_ping.py: using RAC 45 18:22:56.713711 tst ping_idle_ping.py: using CellId 30645 18:22:56.831206 tst ping_idle_ping.py: using BVCI 30646 18:22:56.939738 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:56.950782 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:56.961578 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:56.972672 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:56.984064 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:56.995060 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:57.006204 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:22:57.017215 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:22:57.137264 tst ping_idle_ping.py:24: start network... 18:22:57.356034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:22:57.861884 run create_hlr_db(pid=11827): Launched 18:22:57.995513 bus /gobi_6: Setting Powered False 18:22:59.059177 run create_hlr_db(pid=11827): Terminated: ok {rc=0} 18:22:59.492023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11829): Launched 18:22:59.796168 run osmo-hlr_10.42.42.2(pid=11830): Launched 18:22:59.911764 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:00.445807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11832): Launched 18:23:00.748660 run osmo-stp_10.42.42.5(pid=11833): Launched 18:23:00.866521 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:01.481653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11835): Launched 18:23:01.623594 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:01.889808 run patchelf(pid=11836): Launched 18:23:02.091124 run osmo-stp_10.42.42.5(pid=11833): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11833)] 18:23:02.242725 run osmo-stp_10.42.42.5(pid=11833): stdout: | (launched: 2022-12-12_18:23:00.691973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:02.375429 run osmo-stp_10.42.42.5(pid=11833): stderr: | [0;m[38;5;43m20221212182300915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182300915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182300915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182300916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182300916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182300916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182300916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:02.506309 run osmo-stp_10.42.42.5(pid=11833): stdout: | (launched: 2022-12-12_18:23:00.691973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:02.630517 run osmo-stp_10.42.42.5(pid=11833): stderr: | [0;m[38;5;43m20221212182300915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182300915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182300915 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182300916 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182300916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182300916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182300916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:02.777054 run patchelf(pid=11836): Terminating (SIGINT) 18:23:02.947262 run patchelf(pid=11836): Terminated: ok {rc=0} 18:23:03.069392 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11833): Process ended prematurely: osmo-stp_10.42.42.5(pid=11833) [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11833)] [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 18:23:03.078573 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:23:03.106510 run osmo-hlr_10.42.42.2(pid=11830): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11830)] 18:23:03.155198 run osmo-hlr_10.42.42.2(pid=11830): stdout: | (launched: 2022-12-12_18:22:59.739725) 18:23:03.206092 run osmo-hlr_10.42.42.2(pid=11830): stderr: | [0;m[1;31m20221212182259914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182259914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182259914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182259915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182259915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182259915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182259925 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182259934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182259934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182259935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:03.256893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11829): Terminating (SIGTERM) 18:23:03.297916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11832): Terminating (SIGTERM) 18:23:03.338690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11835): Terminating (SIGTERM) 18:23:03.379704 --- ParallelTerminationStrategy: PID 11829 died... 18:23:03.399184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11829): Terminated: ok {rc=0} 18:23:03.444455 --- ParallelTerminationStrategy: PID 11832 died... 18:23:03.463545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11832): Terminated: ok {rc=0} 18:23:03.509033 --- ParallelTerminationStrategy: PID 11835 died... 18:23:03.528105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11835): Terminated: ok {rc=0} 18:23:03.615774 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:23:04.916115 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:23:04.922284 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:23:04.955219 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:23:04.993607 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:23:05.085339 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:23:05.118609 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:23:05.157093 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:23:05.745645 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:23:05.800313 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:05.812015 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:23:05.881728 tst cs_paging_gprs_active.py: using LAC 30646 18:23:06.011528 tst cs_paging_gprs_active.py: using RAC 46 18:23:06.141969 tst cs_paging_gprs_active.py: using CellId 30646 18:23:06.270784 tst cs_paging_gprs_active.py: using BVCI 30647 18:23:06.390228 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:06.401760 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:06.413044 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:06.424300 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:06.435565 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:06.446979 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:06.458406 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:06.469606 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:06.480937 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:23:06.599088 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:23:06.719267 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:23:06.943195 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:07.274370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11842): Launched 18:23:07.561900 run iperf3-srv_10.42.42.10(pid=11843): Launched 18:23:07.685767 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:23:07.917399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:08.248489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11844): Launched 18:23:08.537345 run iperf3-srv_10.42.42.10(pid=11845): Launched 18:23:08.662129 tst cs_paging_gprs_active.py:38: start network... 18:23:08.884298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:09.395403 run create_hlr_db(pid=11846): Launched 18:23:09.530952 bus /gobi_6: Setting Powered False 18:23:10.596364 run create_hlr_db(pid=11846): Terminated: ok {rc=0} 18:23:11.034985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11848): Launched 18:23:11.344759 run osmo-hlr_10.42.42.2(pid=11849): Launched 18:23:11.463708 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:12.002946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11851): Launched 18:23:12.312040 run osmo-stp_10.42.42.5(pid=11852): Launched 18:23:12.430054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:12.958919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11854): Launched 18:23:13.078173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:13.345825 run patchelf(pid=11855): Launched 18:23:13.517195 run osmo-stp_10.42.42.5(pid=11852): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11852)] 18:23:13.647113 run osmo-stp_10.42.42.5(pid=11852): stdout: | (launched: 2022-12-12_18:23:12.254753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:13.778161 run osmo-stp_10.42.42.5(pid=11852): stderr: | [0;m[38;5;43m20221212182312423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182312423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182312424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182312424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182312424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182312425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182312425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:13.908851 run osmo-stp_10.42.42.5(pid=11852): stdout: | (launched: 2022-12-12_18:23:12.254753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:14.034025 run osmo-stp_10.42.42.5(pid=11852): stderr: | [0;m[38;5;43m20221212182312423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182312423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182312424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182312424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182312424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182312425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182312425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:14.182409 run patchelf(pid=11855): Terminating (SIGINT) 18:23:14.354097 run patchelf(pid=11855): Terminated: ok {rc=0} 18:23:14.477469 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11852): Process ended prematurely: osmo-stp_10.42.42.5(pid=11852) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11852)] [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:23:14.487022 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:23:14.514682 run osmo-hlr_10.42.42.2(pid=11849): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11849)] 18:23:14.562586 run osmo-hlr_10.42.42.2(pid=11849): stdout: | (launched: 2022-12-12_18:23:11.287472) 18:23:14.611934 run osmo-hlr_10.42.42.2(pid=11849): stderr: | [0;m[1;31m20221212182311460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182311460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182311461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182311461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182311461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182311461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182311476 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182311486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182311487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182311487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:14.661778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11842): Terminating (SIGTERM) 18:23:14.701858 run iperf3-srv_10.42.42.10(pid=11843): Terminating (SIGTERM) 18:23:14.742029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11844): Terminating (SIGTERM) 18:23:14.781843 run iperf3-srv_10.42.42.10(pid=11845): Terminating (SIGTERM) 18:23:14.821537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11848): Terminating (SIGTERM) 18:23:14.861362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11851): Terminating (SIGTERM) 18:23:14.901043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11854): Terminating (SIGTERM) 18:23:14.941170 --- ParallelTerminationStrategy: PID 11842 died... 18:23:14.959906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11842): Terminated: ok {rc=0} 18:23:15.004096 --- ParallelTerminationStrategy: PID 11843 died... 18:23:15.022619 run iperf3-srv_10.42.42.10(pid=11843): Terminated {rc=256} 18:23:15.067258 --- ParallelTerminationStrategy: PID 11844 died... 18:23:15.085863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11844): Terminated: ok {rc=0} 18:23:15.129977 --- ParallelTerminationStrategy: PID 11845 died... 18:23:15.148430 run iperf3-srv_10.42.42.10(pid=11845): Terminated {rc=256} 18:23:15.192326 --- ParallelTerminationStrategy: PID 11848 died... 18:23:15.210930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11848): Terminated: ok {rc=0} 18:23:15.254981 --- ParallelTerminationStrategy: PID 11851 died... 18:23:15.273509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11851): Terminated: ok {rc=0} 18:23:15.317570 --- ParallelTerminationStrategy: PID 11854 died... 18:23:15.336130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11854): Terminated: ok {rc=0} 18:23:15.421770 bus /gobi_0: Setting Powered False 18:23:16.520294 bus /gobi_0: Setting Powered False 18:23:17.635972 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:23:18.778759 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:18.790512 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:23:18.861365 tst iperf3.py: using LAC 30647 18:23:18.982601 tst iperf3.py: using RAC 47 18:23:19.104236 tst iperf3.py: using CellId 30647 18:23:19.233179 tst iperf3.py: using BVCI 30648 18:23:19.352241 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:19.363949 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:19.375278 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:19.386731 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:19.398034 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:19.409231 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:19.420433 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:19.431547 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:19.442986 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:23:19.563294 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:23:19.784829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:20.113992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11856): Launched 18:23:20.402820 run iperf3-srv_10.42.42.10(pid=11857): Launched 18:23:20.525876 tst iperf3.py:8: start network... 18:23:20.746451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:21.254519 run create_hlr_db(pid=11858): Launched 18:23:21.389290 bus /gobi_6: Setting Powered False 18:23:22.453826 run create_hlr_db(pid=11858): Terminated: ok {rc=0} 18:23:22.909356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11860): Launched 18:23:23.239095 run osmo-hlr_10.42.42.2(pid=11861): Launched 18:23:23.365020 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:24.025259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11863): Launched 18:23:24.345537 run osmo-stp_10.42.42.5(pid=11864): Launched 18:23:24.468737 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:25.022528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11866): Launched 18:23:25.144753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:25.416686 run patchelf(pid=11867): Launched 18:23:25.594907 run osmo-stp_10.42.42.5(pid=11864): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11864)] 18:23:25.730725 run osmo-stp_10.42.42.5(pid=11864): stdout: | (launched: 2022-12-12_18:23:24.286237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:25.868450 run osmo-stp_10.42.42.5(pid=11864): stderr: | [0;m[38;5;43m20221212182324477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182324477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182324477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182324477 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182324478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182324478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182324478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:26.005405 run osmo-stp_10.42.42.5(pid=11864): stdout: | (launched: 2022-12-12_18:23:24.286237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:26.136675 run osmo-stp_10.42.42.5(pid=11864): stderr: | [0;m[38;5;43m20221212182324477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182324477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182324477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182324477 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182324478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182324478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182324478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:26.291550 run patchelf(pid=11867): Terminating (SIGINT) 18:23:26.470404 run patchelf(pid=11867): Terminated: ok {rc=0} 18:23:26.599374 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11864): Process ended prematurely: osmo-stp_10.42.42.5(pid=11864) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11864)] [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 18:23:26.609793 tst iperf3.py:8: Test FAILED (7.9 sec) 18:23:26.638373 run osmo-hlr_10.42.42.2(pid=11861): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11861)] 18:23:26.688084 run osmo-hlr_10.42.42.2(pid=11861): stdout: | (launched: 2022-12-12_18:23:23.178286) 18:23:26.739646 run osmo-hlr_10.42.42.2(pid=11861): stderr: | [0;m[1;31m20221212182323375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182323375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182323375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182323375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182323375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182323375 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182323387 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182323398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182323398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182323398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:26.791630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11856): Terminating (SIGTERM) 18:23:26.833626 run iperf3-srv_10.42.42.10(pid=11857): Terminating (SIGTERM) 18:23:26.875536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11860): Terminating (SIGTERM) 18:23:26.917499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11863): Terminating (SIGTERM) 18:23:26.959224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11866): Terminating (SIGTERM) 18:23:27.001441 --- ParallelTerminationStrategy: PID 11856 died... 18:23:27.021638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11856): Terminated: ok {rc=0} 18:23:27.067783 --- ParallelTerminationStrategy: PID 11857 died... 18:23:27.087451 run iperf3-srv_10.42.42.10(pid=11857): Terminated {rc=256} 18:23:27.133718 --- ParallelTerminationStrategy: PID 11860 died... 18:23:27.153482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11860): Terminated: ok {rc=0} 18:23:27.199993 --- ParallelTerminationStrategy: PID 11863 died... 18:23:27.219740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11863): Terminated: ok {rc=0} 18:23:27.266057 --- ParallelTerminationStrategy: PID 11866 died... 18:23:27.285701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11866): Terminated: ok {rc=0} 18:23:27.373472 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:23:28.523932 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:28.536171 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:23:28.607717 tst iperf3m4.py: using LAC 30648 18:23:28.735617 tst iperf3m4.py: using RAC 48 18:23:28.864934 tst iperf3m4.py: using CellId 30648 18:23:28.991704 tst iperf3m4.py: using BVCI 30649 18:23:29.108009 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:29.119637 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:29.131015 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:29.142251 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:29.153556 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:29.164846 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:29.176293 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:29.187646 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:29.198918 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:23:29.315382 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:23:29.433074 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:23:29.549769 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:23:29.670495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:23:29.887136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:30.209729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11868): Launched 18:23:30.489670 run iperf3-srv_10.42.42.10(pid=11869): Launched 18:23:30.612184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:23:30.837681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:31.178556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11870): Launched 18:23:31.472434 run iperf3-srv_10.42.42.10(pid=11871): Launched 18:23:31.607415 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:23:31.828100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:32.161745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11872): Launched 18:23:32.432814 run iperf3-srv_10.42.42.10(pid=11873): Launched 18:23:32.546419 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:23:32.746759 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:23:33.049490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11874): Launched 18:23:33.312201 run iperf3-srv_10.42.42.10(pid=11875): Launched 18:23:33.425094 tst iperf3m4.py:8: start network... 18:23:33.625552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:34.097556 run create_hlr_db(pid=11876): Launched 18:23:34.214132 bus /gobi_6: Setting Powered False 18:23:35.273887 run create_hlr_db(pid=11876): Terminated: ok {rc=0} 18:23:35.717432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11878): Launched 18:23:36.042782 run osmo-hlr_10.42.42.2(pid=11879): Launched 18:23:36.165443 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:36.721341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11881): Launched 18:23:37.047011 run osmo-stp_10.42.42.5(pid=11882): Launched 18:23:37.170791 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:37.726555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11884): Launched 18:23:37.850829 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:38.124618 run patchelf(pid=11885): Launched 18:23:38.305588 run osmo-stp_10.42.42.5(pid=11882): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11882)] 18:23:38.441525 run osmo-stp_10.42.42.5(pid=11882): stdout: | (launched: 2022-12-12_18:23:36.986716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:38.578982 run osmo-stp_10.42.42.5(pid=11882): stderr: | [0;m[38;5;43m20221212182337176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182337176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182337176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182337177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182337177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182337177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182337177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:38.716559 run osmo-stp_10.42.42.5(pid=11882): stdout: | (launched: 2022-12-12_18:23:36.986716) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:38.848236 run osmo-stp_10.42.42.5(pid=11882): stderr: | [0;m[38;5;43m20221212182337176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182337176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182337176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182337177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182337177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182337177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182337177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:39.003929 run patchelf(pid=11885): Terminating (SIGINT) 18:23:39.184033 run patchelf(pid=11885): Terminated: ok {rc=0} 18:23:39.313975 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11882): Process ended prematurely: osmo-stp_10.42.42.5(pid=11882) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11882)] [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:23:39.324318 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:23:39.353438 run osmo-hlr_10.42.42.2(pid=11879): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11879)] 18:23:39.403612 run osmo-hlr_10.42.42.2(pid=11879): stdout: | (launched: 2022-12-12_18:23:35.982038) 18:23:39.455727 run osmo-hlr_10.42.42.2(pid=11879): stderr: | [0;m[1;31m20221212182336178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182336178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182336178 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182336179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182336179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182336179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182336191 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182336199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182336200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182336200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:39.508165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11868): Terminating (SIGTERM) 18:23:39.550350 run iperf3-srv_10.42.42.10(pid=11869): Terminating (SIGTERM) 18:23:39.592508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11870): Terminating (SIGTERM) 18:23:39.634539 run iperf3-srv_10.42.42.10(pid=11871): Terminating (SIGTERM) 18:23:39.676164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11872): Terminating (SIGTERM) 18:23:39.718180 run iperf3-srv_10.42.42.10(pid=11873): Terminating (SIGTERM) 18:23:39.760012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11874): Terminating (SIGTERM) 18:23:39.802430 run iperf3-srv_10.42.42.10(pid=11875): Terminating (SIGTERM) 18:23:39.844263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11878): Terminating (SIGTERM) 18:23:39.886634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11881): Terminating (SIGTERM) 18:23:39.928585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11884): Terminating (SIGTERM) 18:23:39.971428 --- ParallelTerminationStrategy: PID 11868 died... 18:23:39.991580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11868): Terminated: ok {rc=0} 18:23:40.037904 --- ParallelTerminationStrategy: PID 11869 died... 18:23:40.057382 run iperf3-srv_10.42.42.10(pid=11869): Terminated {rc=256} 18:23:40.103949 --- ParallelTerminationStrategy: PID 11870 died... 18:23:40.123522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11870): Terminated: ok {rc=0} 18:23:40.169730 --- ParallelTerminationStrategy: PID 11871 died... 18:23:40.189205 run iperf3-srv_10.42.42.10(pid=11871): Terminated {rc=256} 18:23:40.235254 --- ParallelTerminationStrategy: PID 11872 died... 18:23:40.254930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11872): Terminated: ok {rc=0} 18:23:40.301140 --- ParallelTerminationStrategy: PID 11873 died... 18:23:40.320679 run iperf3-srv_10.42.42.10(pid=11873): Terminated {rc=256} 18:23:40.366788 --- ParallelTerminationStrategy: PID 11874 died... 18:23:40.386404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11874): Terminated: ok {rc=0} 18:23:40.432549 --- ParallelTerminationStrategy: PID 11875 died... 18:23:40.452135 run iperf3-srv_10.42.42.10(pid=11875): Terminated {rc=256} 18:23:40.498587 --- ParallelTerminationStrategy: PID 11878 died... 18:23:40.518299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11878): Terminated: ok {rc=0} 18:23:40.564532 --- ParallelTerminationStrategy: PID 11881 died... 18:23:40.584316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11881): Terminated: ok {rc=0} 18:23:40.630785 --- ParallelTerminationStrategy: PID 11884 died... 18:23:40.650558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11884): Terminated: ok {rc=0} 18:23:40.739450 bus /gobi_4: Setting Powered False 18:23:41.840433 bus /gobi_4: Setting Powered False 18:23:42.957354 bus /gobi_1: Setting Powered False 18:23:44.056384 bus /gobi_1: Setting Powered False 18:23:45.176058 bus /gobi_0: Setting Powered False 18:23:46.295680 bus /gobi_0: Setting Powered False 18:23:47.462167 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:23:48.598179 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:48.611543 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:23:48.700748 tst ping.py: using LAC 30649 18:23:48.832262 tst ping.py: using RAC 49 18:23:48.961436 tst ping.py: using CellId 30649 18:23:49.088063 tst ping.py: using BVCI 30650 18:23:49.207027 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:49.219736 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:49.232096 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:49.244560 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:49.256419 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:49.268450 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:49.281609 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:49.296132 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:23:49.421197 tst ping.py:19: start network... 18:23:49.638982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:50.150821 run create_hlr_db(pid=12157): Launched 18:23:50.301968 bus /gobi_6: Setting Powered False 18:23:51.361607 run create_hlr_db(pid=12157): Terminated: ok {rc=0} 18:23:51.789498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12160): Launched 18:23:52.137617 run osmo-hlr_10.42.42.2(pid=12161): Launched 18:23:52.375696 run osmo-stp_10.42.42.5: Starting osmo-stp 18:23:53.057628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12163): Launched 18:23:53.390576 run osmo-stp_10.42.42.5(pid=12164): Launched 18:23:53.628746 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:23:54.271905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12166): Launched 18:23:54.406380 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:23:54.679710 run patchelf(pid=12167): Launched 18:23:54.872383 run osmo-stp_10.42.42.5(pid=12164): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12164)] 18:23:55.009506 run osmo-stp_10.42.42.5(pid=12164): stdout: | (launched: 2022-12-12_18:23:53.331193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:55.148112 run osmo-stp_10.42.42.5(pid=12164): stderr: | [0;m[38;5;43m20221212182353619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182353620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182353620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182353620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182353629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182353629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182353629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:55.286745 run osmo-stp_10.42.42.5(pid=12164): stdout: | (launched: 2022-12-12_18:23:53.331193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:23:55.419741 run osmo-stp_10.42.42.5(pid=12164): stderr: | [0;m[38;5;43m20221212182353619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182353620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182353620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182353620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182353629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182353629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182353629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:23:55.577205 run patchelf(pid=12167): Terminating (SIGINT) 18:23:55.757791 run patchelf(pid=12167): Terminated: ok {rc=0} 18:23:55.889070 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12164): Process ended prematurely: osmo-stp_10.42.42.5(pid=12164) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12164)] [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 18:23:55.900050 tst ping.py:22: Test FAILED (7.3 sec) 18:23:55.930598 run osmo-hlr_10.42.42.2(pid=12161): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12161)] 18:23:55.983425 run osmo-hlr_10.42.42.2(pid=12161): stdout: | (launched: 2022-12-12_18:23:52.078824) 18:23:56.037423 run osmo-hlr_10.42.42.2(pid=12161): stderr: | [0;m[1;31m20221212182352379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182352379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182352379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182352379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182352379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182352379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182352399 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182352412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182352412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182352412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:23:56.092222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12160): Terminating (SIGTERM) 18:23:56.136178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12163): Terminating (SIGTERM) 18:23:56.180802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12166): Terminating (SIGTERM) 18:23:56.230466 --- ParallelTerminationStrategy: PID 12160 died... 18:23:56.251660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12160): Terminated: ok {rc=0} 18:23:56.301697 --- ParallelTerminationStrategy: PID 12163 died... 18:23:56.322763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12163): Terminated: ok {rc=0} 18:23:56.371853 --- ParallelTerminationStrategy: PID 12166 died... 18:23:56.392872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12166): Terminated: ok {rc=0} 18:23:56.484901 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:23:57.579320 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:57.592751 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:23:57.668072 tst ping_idle_ping.py: using LAC 30650 18:23:57.795078 tst ping_idle_ping.py: using RAC 50 18:23:57.923873 tst ping_idle_ping.py: using CellId 30650 18:23:58.050317 tst ping_idle_ping.py: using BVCI 30651 18:23:58.172421 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:58.184776 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:58.197371 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:58.209612 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:58.221621 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:58.234010 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:58.246405 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:23:58.258563 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:23:58.382461 tst ping_idle_ping.py:24: start network... 18:23:58.604285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:23:59.115760 run create_hlr_db(pid=12168): Launched 18:23:59.282871 bus /gobi_6: Setting Powered False 18:24:00.348587 run create_hlr_db(pid=12168): Terminated: ok {rc=0} 18:24:00.808202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12170): Launched 18:24:01.196107 run osmo-hlr_10.42.42.2(pid=12171): Launched 18:24:01.403816 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:02.206003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12173): Launched 18:24:02.627454 run osmo-stp_10.42.42.5(pid=12174): Launched 18:24:02.901267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:24:03.497811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12176): Launched 18:24:03.673420 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:24:03.937782 run patchelf(pid=12177): Launched 18:24:04.127432 run osmo-stp_10.42.42.5(pid=12174): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12174)] 18:24:04.266085 run osmo-stp_10.42.42.5(pid=12174): stdout: | (launched: 2022-12-12_18:24:02.548457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:04.407512 run osmo-stp_10.42.42.5(pid=12174): stderr: | [0;m[38;5;43m20221212182402828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182402828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182402828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182402829 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182402829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182402829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182402829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:04.549800 run osmo-stp_10.42.42.5(pid=12174): stdout: | (launched: 2022-12-12_18:24:02.548457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:04.684483 run osmo-stp_10.42.42.5(pid=12174): stderr: | [0;m[38;5;43m20221212182402828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182402828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182402828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182402829 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182402829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182402829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182402829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:04.845472 run patchelf(pid=12177): Terminating (SIGINT) 18:24:05.031134 run patchelf(pid=12177): Terminated: ok {rc=0} 18:24:05.164466 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12174): Process ended prematurely: osmo-stp_10.42.42.5(pid=12174) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12174)] [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:24:05.175619 tst ping_idle_ping.py:27: Test FAILED (7.6 sec) 18:24:05.206142 run osmo-hlr_10.42.42.2(pid=12171): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12171)] 18:24:05.258807 run osmo-hlr_10.42.42.2(pid=12171): stdout: | (launched: 2022-12-12_18:24:01.122380) 18:24:05.313899 run osmo-hlr_10.42.42.2(pid=12171): stderr: | [0;m[1;31m20221212182401466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182401466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182401466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182401466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182401466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182401466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182401485 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182401497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182401497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182401497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:05.368375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12170): Terminating (SIGTERM) 18:24:05.412440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12173): Terminating (SIGTERM) 18:24:05.458321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12176): Terminating (SIGTERM) 18:24:05.506305 --- ParallelTerminationStrategy: PID 12170 died... 18:24:05.527943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12170): Terminated: ok {rc=0} 18:24:05.577617 --- ParallelTerminationStrategy: PID 12173 died... 18:24:05.598821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12173): Terminated: ok {rc=0} 18:24:05.647153 --- ParallelTerminationStrategy: PID 12176 died... 18:24:05.668532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12176): Terminated: ok {rc=0} 18:24:05.762332 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:24:07.077946 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:24:07.085559 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:24:07.121837 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:24:07.163239 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:24:07.253747 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:24:07.288276 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:24:07.330760 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:24:07.927006 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:24:07.982337 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:07.995141 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:24:08.068288 tst cs_paging_gprs_active.py: using LAC 30651 18:24:08.198442 tst cs_paging_gprs_active.py: using RAC 51 18:24:08.330422 tst cs_paging_gprs_active.py: using CellId 30651 18:24:08.459121 tst cs_paging_gprs_active.py: using BVCI 30652 18:24:08.582050 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:08.594901 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:08.607500 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:08.619878 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:08.632374 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:08.644919 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:08.657903 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:08.670732 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:08.682908 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:24:08.810403 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:24:08.942187 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:24:09.167311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:24:09.508695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12181): Launched 18:24:09.779103 run iperf3-srv_10.42.42.10(pid=12182): Launched 18:24:09.895323 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:24:10.098836 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:24:10.403966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12183): Launched 18:24:10.670145 run iperf3-srv_10.42.42.10(pid=12184): Launched 18:24:10.785925 tst cs_paging_gprs_active.py:38: start network... 18:24:10.989382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:11.460567 run create_hlr_db(pid=12185): Launched 18:24:11.577251 bus /gobi_6: Setting Powered False 18:24:12.637529 run create_hlr_db(pid=12185): Terminated: ok {rc=0} 18:24:13.060783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12187): Launched 18:24:13.366819 run osmo-hlr_10.42.42.2(pid=12188): Launched 18:24:13.484715 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:14.022122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12190): Launched 18:24:14.327422 run osmo-stp_10.42.42.5(pid=12191): Launched 18:24:14.446368 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:24:14.969555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12193): Launched 18:24:15.086480 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:24:15.346805 run patchelf(pid=12194): Launched 18:24:15.517989 run osmo-stp_10.42.42.5(pid=12191): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12191)] 18:24:15.645742 run osmo-stp_10.42.42.5(pid=12191): stdout: | (launched: 2022-12-12_18:24:14.270517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:15.775172 run osmo-stp_10.42.42.5(pid=12191): stderr: | [0;m[38;5;43m20221212182414442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182414442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182414442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182414443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182414443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182414443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182414443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:15.913546 run osmo-stp_10.42.42.5(pid=12191): stdout: | (launched: 2022-12-12_18:24:14.270517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:16.040242 run osmo-stp_10.42.42.5(pid=12191): stderr: | [0;m[38;5;43m20221212182414442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182414442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182414442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182414443 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182414443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182414443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182414443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:16.191310 run patchelf(pid=12194): Terminating (SIGINT) 18:24:16.365549 run patchelf(pid=12194): Terminated: ok {rc=0} 18:24:16.492136 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12191): Process ended prematurely: osmo-stp_10.42.42.5(pid=12191) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12191)] [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:24:16.503143 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 18:24:16.534618 run osmo-hlr_10.42.42.2(pid=12188): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12188)] 18:24:16.585199 run osmo-hlr_10.42.42.2(pid=12188): stdout: | (launched: 2022-12-12_18:24:13.309625) 18:24:16.637287 run osmo-hlr_10.42.42.2(pid=12188): stderr: | [0;m[1;31m20221212182413485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182413485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182413486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182413486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182413486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182413486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182413499 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182413510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182413510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182413510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:16.689991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12181): Terminating (SIGTERM) 18:24:16.732564 run iperf3-srv_10.42.42.10(pid=12182): Terminating (SIGTERM) 18:24:16.774973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12183): Terminating (SIGTERM) 18:24:16.817446 run iperf3-srv_10.42.42.10(pid=12184): Terminating (SIGTERM) 18:24:16.861336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12187): Terminating (SIGTERM) 18:24:16.904214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12190): Terminating (SIGTERM) 18:24:16.946453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12193): Terminating (SIGTERM) 18:24:16.989128 --- ParallelTerminationStrategy: PID 12181 died... 18:24:17.008775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12181): Terminated: ok {rc=0} 18:24:17.056304 --- ParallelTerminationStrategy: PID 12182 died... 18:24:17.076016 run iperf3-srv_10.42.42.10(pid=12182): Terminated {rc=256} 18:24:17.123509 --- ParallelTerminationStrategy: PID 12183 died... 18:24:17.143014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12183): Terminated: ok {rc=0} 18:24:17.190351 --- ParallelTerminationStrategy: PID 12184 died... 18:24:17.209853 run iperf3-srv_10.42.42.10(pid=12184): Terminated {rc=256} 18:24:17.255570 --- ParallelTerminationStrategy: PID 12187 died... 18:24:17.274056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12187): Terminated: ok {rc=0} 18:24:17.318217 --- ParallelTerminationStrategy: PID 12190 died... 18:24:17.336832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12190): Terminated: ok {rc=0} 18:24:17.381501 --- ParallelTerminationStrategy: PID 12193 died... 18:24:17.400097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12193): Terminated: ok {rc=0} 18:24:17.485106 bus /gobi_0: Setting Powered False 18:24:18.581779 bus /gobi_0: Setting Powered False 18:24:19.696690 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:24:20.844091 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:20.855801 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:24:20.926454 tst iperf3.py: using LAC 30652 18:24:21.045376 tst iperf3.py: using RAC 52 18:24:21.171628 tst iperf3.py: using CellId 30652 18:24:21.294669 tst iperf3.py: using BVCI 30653 18:24:21.406375 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:21.417478 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:21.428314 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:21.440019 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:21.451593 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:21.463111 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:21.474770 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:21.486375 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:21.498307 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:24:21.616851 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:24:21.819205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:24:22.123461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12195): Launched 18:24:22.390497 run iperf3-srv_10.42.42.10(pid=12196): Launched 18:24:22.505899 tst iperf3.py:8: start network... 18:24:22.707753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:23.176694 run create_hlr_db(pid=12197): Launched 18:24:23.292433 bus /gobi_6: Setting Powered False 18:24:24.353667 run create_hlr_db(pid=12197): Terminated: ok {rc=0} 18:24:24.778136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12199): Launched 18:24:25.083720 run osmo-hlr_10.42.42.2(pid=12200): Launched 18:24:25.202562 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:25.742536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12202): Launched 18:24:26.049522 run osmo-stp_10.42.42.5(pid=12203): Launched 18:24:26.167935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:24:26.693423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12205): Launched 18:24:26.810995 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:24:27.068218 run patchelf(pid=12206): Launched 18:24:27.238723 run osmo-stp_10.42.42.5(pid=12203): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12203)] 18:24:27.366493 run osmo-stp_10.42.42.5(pid=12203): stdout: | (launched: 2022-12-12_18:24:25.992152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:27.495830 run osmo-stp_10.42.42.5(pid=12203): stderr: | [0;m[38;5;43m20221212182426164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182426164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182426164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182426165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182426165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182426165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182426165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:27.625848 run osmo-stp_10.42.42.5(pid=12203): stdout: | (launched: 2022-12-12_18:24:25.992152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:27.749699 run osmo-stp_10.42.42.5(pid=12203): stderr: | [0;m[38;5;43m20221212182426164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182426164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182426164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182426165 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182426165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182426165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182426165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:27.897260 run patchelf(pid=12206): Terminating (SIGINT) 18:24:28.067295 run patchelf(pid=12206): Terminated: ok {rc=0} 18:24:28.190830 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12203): Process ended prematurely: osmo-stp_10.42.42.5(pid=12203) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12203)] [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 18:24:28.200435 tst iperf3.py:8: Test FAILED (7.4 sec) 18:24:28.228003 run osmo-hlr_10.42.42.2(pid=12200): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12200)] 18:24:28.276298 run osmo-hlr_10.42.42.2(pid=12200): stdout: | (launched: 2022-12-12_18:24:25.025803) 18:24:28.325671 run osmo-hlr_10.42.42.2(pid=12200): stderr: | [0;m[1;31m20221212182425203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182425203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182425203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182425203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182425203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182425203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182425219 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182425229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182425229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182425229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:28.375642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12195): Terminating (SIGTERM) 18:24:28.415536 run iperf3-srv_10.42.42.10(pid=12196): Terminating (SIGTERM) 18:24:28.455570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12199): Terminating (SIGTERM) 18:24:28.495997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12202): Terminating (SIGTERM) 18:24:28.536239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12205): Terminating (SIGTERM) 18:24:28.576729 --- ParallelTerminationStrategy: PID 12195 died... 18:24:28.596002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12195): Terminated: ok {rc=0} 18:24:28.640598 --- ParallelTerminationStrategy: PID 12196 died... 18:24:28.659305 run iperf3-srv_10.42.42.10(pid=12196): Terminated {rc=256} 18:24:28.703906 --- ParallelTerminationStrategy: PID 12199 died... 18:24:28.722471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12199): Terminated: ok {rc=0} 18:24:28.767288 --- ParallelTerminationStrategy: PID 12202 died... 18:24:28.785961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12202): Terminated: ok {rc=0} 18:24:28.830465 --- ParallelTerminationStrategy: PID 12205 died... 18:24:28.849151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12205): Terminated: ok {rc=0} 18:24:28.936432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:24:30.085887 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:30.097795 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:24:30.169413 tst iperf3m4.py: using LAC 30653 18:24:30.289376 tst iperf3m4.py: using RAC 53 18:24:30.408110 tst iperf3m4.py: using CellId 30653 18:24:30.529151 tst iperf3m4.py: using BVCI 30654 18:24:30.647431 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:30.658954 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:30.670412 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:30.681760 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:30.692892 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:30.704358 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:30.715868 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:30.727138 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:30.738611 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:24:30.853039 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:24:30.978819 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:24:31.110575 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:24:31.228829 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:24:31.436503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:24:31.751867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12207): Launched 18:24:32.035330 run iperf3-srv_10.42.42.10(pid=12208): Launched 18:24:32.167930 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:24:32.372305 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:24:32.678700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12209): Launched 18:24:32.946790 run iperf3-srv_10.42.42.10(pid=12210): Launched 18:24:33.063245 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:24:33.265771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:24:33.570643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12211): Launched 18:24:33.838078 run iperf3-srv_10.42.42.10(pid=12212): Launched 18:24:33.954000 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:24:34.156065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:24:34.470203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12214): Launched 18:24:34.755080 run iperf3-srv_10.42.42.10(pid=12215): Launched 18:24:34.879409 tst iperf3m4.py:8: start network... 18:24:35.097726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:35.600920 run create_hlr_db(pid=12216): Launched 18:24:35.732754 bus /gobi_6: Setting Powered False 18:24:36.797210 run create_hlr_db(pid=12216): Terminated: ok {rc=0} 18:24:37.233660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12218): Launched 18:24:37.540134 run osmo-hlr_10.42.42.2(pid=12219): Launched 18:24:37.657124 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:38.180192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12221): Launched 18:24:38.508096 run osmo-stp_10.42.42.5(pid=12222): Launched 18:24:38.633926 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:24:39.195650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12224): Launched 18:24:39.321079 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:24:39.597239 run patchelf(pid=12225): Launched 18:24:39.779420 run osmo-stp_10.42.42.5(pid=12222): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12222)] 18:24:39.916801 run osmo-stp_10.42.42.5(pid=12222): stdout: | (launched: 2022-12-12_18:24:38.447349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:40.055758 run osmo-stp_10.42.42.5(pid=12222): stderr: | [0;m[38;5;43m20221212182438639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182438639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182438640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182438640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182438641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182438641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182438641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:40.194605 run osmo-stp_10.42.42.5(pid=12222): stdout: | (launched: 2022-12-12_18:24:38.447349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:40.327761 run osmo-stp_10.42.42.5(pid=12222): stderr: | [0;m[38;5;43m20221212182438639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182438639 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182438640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182438640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182438641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182438641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182438641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:40.485355 run patchelf(pid=12225): Terminating (SIGINT) 18:24:40.666256 run patchelf(pid=12225): Terminated: ok {rc=0} 18:24:40.796775 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12222): Process ended prematurely: osmo-stp_10.42.42.5(pid=12222) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12222)] [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:24:40.807129 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:24:40.836602 run osmo-hlr_10.42.42.2(pid=12219): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12219)] 18:24:40.887363 run osmo-hlr_10.42.42.2(pid=12219): stdout: | (launched: 2022-12-12_18:24:37.482385) 18:24:40.939864 run osmo-hlr_10.42.42.2(pid=12219): stderr: | [0;m[1;31m20221212182437657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182437657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182437657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182437657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182437657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182437657 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182437670 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182437678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182437678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182437679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:40.992886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12207): Terminating (SIGTERM) 18:24:41.035293 run iperf3-srv_10.42.42.10(pid=12208): Terminating (SIGTERM) 18:24:41.077477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12209): Terminating (SIGTERM) 18:24:41.119827 run iperf3-srv_10.42.42.10(pid=12210): Terminating (SIGTERM) 18:24:41.162088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12211): Terminating (SIGTERM) 18:24:41.204307 run iperf3-srv_10.42.42.10(pid=12212): Terminating (SIGTERM) 18:24:41.246604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12214): Terminating (SIGTERM) 18:24:41.288874 run iperf3-srv_10.42.42.10(pid=12215): Terminating (SIGTERM) 18:24:41.331086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12218): Terminating (SIGTERM) 18:24:41.373469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12221): Terminating (SIGTERM) 18:24:41.415835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12224): Terminating (SIGTERM) 18:24:41.458492 --- ParallelTerminationStrategy: PID 12207 died... 18:24:41.478791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12207): Terminated: ok {rc=0} 18:24:41.525769 --- ParallelTerminationStrategy: PID 12208 died... 18:24:41.545512 run iperf3-srv_10.42.42.10(pid=12208): Terminated {rc=256} 18:24:41.592048 --- ParallelTerminationStrategy: PID 12209 died... 18:24:41.611737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12209): Terminated: ok {rc=0} 18:24:41.657874 --- ParallelTerminationStrategy: PID 12210 died... 18:24:41.677463 run iperf3-srv_10.42.42.10(pid=12210): Terminated {rc=256} 18:24:41.724128 --- ParallelTerminationStrategy: PID 12211 died... 18:24:41.743734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12211): Terminated: ok {rc=0} 18:24:41.790051 --- ParallelTerminationStrategy: PID 12212 died... 18:24:41.809665 run iperf3-srv_10.42.42.10(pid=12212): Terminated {rc=256} 18:24:41.856130 --- ParallelTerminationStrategy: PID 12214 died... 18:24:41.875780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12214): Terminated: ok {rc=0} 18:24:41.922543 --- ParallelTerminationStrategy: PID 12215 died... 18:24:41.942228 run iperf3-srv_10.42.42.10(pid=12215): Terminated {rc=256} 18:24:41.988756 --- ParallelTerminationStrategy: PID 12218 died... 18:24:42.008560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12218): Terminated: ok {rc=0} 18:24:42.054958 --- ParallelTerminationStrategy: PID 12221 died... 18:24:42.074689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12221): Terminated: ok {rc=0} 18:24:42.121248 --- ParallelTerminationStrategy: PID 12224 died... 18:24:42.140892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12224): Terminated: ok {rc=0} 18:24:42.230177 bus /gobi_4: Setting Powered False 18:24:43.331986 bus /gobi_4: Setting Powered False 18:24:44.449015 bus /gobi_1: Setting Powered False 18:24:45.548724 bus /gobi_1: Setting Powered False 18:24:46.676829 bus /gobi_0: Setting Powered False 18:24:47.777212 bus /gobi_0: Setting Powered False 18:24:48.895273 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:24:50.000280 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:50.011997 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:24:50.083350 tst ping.py: using LAC 30654 18:24:50.209322 tst ping.py: using RAC 54 18:24:50.335456 tst ping.py: using CellId 30654 18:24:50.462265 tst ping.py: using BVCI 30655 18:24:50.579736 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:50.591459 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:50.602795 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:50.614591 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:50.626324 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:50.638146 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:50.650079 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:50.662004 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:24:50.780529 tst ping.py:19: start network... 18:24:50.979323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:51.441699 run create_hlr_db(pid=12227): Launched 18:24:51.575955 bus /gobi_6: Setting Powered False 18:24:52.639756 run create_hlr_db(pid=12227): Terminated: ok {rc=0} 18:24:53.084249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12229): Launched 18:24:53.405086 run osmo-hlr_10.42.42.2(pid=12230): Launched 18:24:53.528409 run osmo-stp_10.42.42.5: Starting osmo-stp 18:24:54.074974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12232): Launched 18:24:54.395998 run osmo-stp_10.42.42.5(pid=12233): Launched 18:24:54.518775 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:24:55.070541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12235): Launched 18:24:55.193565 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:24:55.463537 run patchelf(pid=12236): Launched 18:24:55.641796 run osmo-stp_10.42.42.5(pid=12233): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12233)] 18:24:55.775726 run osmo-stp_10.42.42.5(pid=12233): stdout: | (launched: 2022-12-12_18:24:54.335754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:55.911713 run osmo-stp_10.42.42.5(pid=12233): stderr: | [0;m[38;5;43m20221212182454529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182454529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182454530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182454530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182454531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182454531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182454531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:56.047551 run osmo-stp_10.42.42.5(pid=12233): stdout: | (launched: 2022-12-12_18:24:54.335754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:24:56.177584 run osmo-stp_10.42.42.5(pid=12233): stderr: | [0;m[38;5;43m20221212182454529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182454529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182454530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182454530 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182454531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182454531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182454531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:24:56.331764 run patchelf(pid=12236): Terminating (SIGINT) 18:24:56.509940 run patchelf(pid=12236): Terminated: ok {rc=0} 18:24:56.637762 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12233): Process ended prematurely: osmo-stp_10.42.42.5(pid=12233) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12233)] [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 18:24:56.647502 tst ping.py:22: Test FAILED (6.6 sec) 18:24:56.676017 run osmo-hlr_10.42.42.2(pid=12230): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12230)] 18:24:56.726542 run osmo-hlr_10.42.42.2(pid=12230): stdout: | (launched: 2022-12-12_18:24:53.345458) 18:24:56.778870 run osmo-hlr_10.42.42.2(pid=12230): stderr: | [0;m[1;31m20221212182453545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182453545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182453545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182453545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182453545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182453545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182453556 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182453564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182453564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182453565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:24:56.831355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12229): Terminating (SIGTERM) 18:24:56.874082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12232): Terminating (SIGTERM) 18:24:56.916443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12235): Terminating (SIGTERM) 18:24:56.958940 --- ParallelTerminationStrategy: PID 12229 died... 18:24:56.979288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12229): Terminated: ok {rc=0} 18:24:57.026028 --- ParallelTerminationStrategy: PID 12232 died... 18:24:57.045754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12232): Terminated: ok {rc=0} 18:24:57.092281 --- ParallelTerminationStrategy: PID 12235 died... 18:24:57.112176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12235): Terminated: ok {rc=0} 18:24:57.200765 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:24:58.290887 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:58.303925 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:24:58.380631 tst ping_idle_ping.py: using LAC 30655 18:24:58.505933 tst ping_idle_ping.py: using RAC 55 18:24:58.630908 tst ping_idle_ping.py: using CellId 30655 18:24:58.755670 tst ping_idle_ping.py: using BVCI 30656 18:24:58.874035 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:58.885820 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:58.897400 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:58.908738 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:58.919946 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:58.931444 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:58.942901 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:24:58.954184 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:24:59.072472 tst ping_idle_ping.py:24: start network... 18:24:59.286712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:24:59.782003 run create_hlr_db(pid=12237): Launched 18:24:59.914109 bus /gobi_6: Setting Powered False 18:25:00.999504 run create_hlr_db(pid=12237): Terminated: ok {rc=0} 18:25:01.487723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12242): Launched 18:25:01.814209 run osmo-hlr_10.42.42.2(pid=12243): Launched 18:25:02.021834 run osmo-stp_10.42.42.5: Starting osmo-stp 18:25:02.712159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12245): Launched 18:25:03.017293 run osmo-stp_10.42.42.5(pid=12246): Launched 18:25:03.133228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:25:03.649504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12248): Launched 18:25:03.763912 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:25:04.018630 run patchelf(pid=12249): Launched 18:25:04.187420 run osmo-stp_10.42.42.5(pid=12246): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12246)] 18:25:04.314247 run osmo-stp_10.42.42.5(pid=12246): stdout: | (launched: 2022-12-12_18:25:02.960414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:04.443191 run osmo-stp_10.42.42.5(pid=12246): stderr: | [0;m[38;5;43m20221212182503132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182503132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182503132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182503132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182503133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182503133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182503133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:04.571616 run osmo-stp_10.42.42.5(pid=12246): stdout: | (launched: 2022-12-12_18:25:02.960414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:04.694177 run osmo-stp_10.42.42.5(pid=12246): stderr: | [0;m[38;5;43m20221212182503132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182503132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182503132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182503132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182503133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182503133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182503133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:04.839445 run patchelf(pid=12249): Terminating (SIGINT) 18:25:05.007564 run patchelf(pid=12249): Terminated: ok {rc=0} 18:25:05.128212 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12246): Process ended prematurely: osmo-stp_10.42.42.5(pid=12246) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12246)] [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:25:05.137279 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 18:25:05.165101 run osmo-hlr_10.42.42.2(pid=12243): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12243)] 18:25:05.213476 run osmo-hlr_10.42.42.2(pid=12243): stdout: | (launched: 2022-12-12_18:25:01.754321) 18:25:05.263731 run osmo-hlr_10.42.42.2(pid=12243): stderr: | [0;m[1;31m20221212182502069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182502069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182502069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182502069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182502069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182502069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182502087 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182502101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182502101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182502101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:05.314187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12242): Terminating (SIGTERM) 18:25:05.354483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12245): Terminating (SIGTERM) 18:25:05.394562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12248): Terminating (SIGTERM) 18:25:05.435064 --- ParallelTerminationStrategy: PID 12242 died... 18:25:05.454367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12242): Terminated: ok {rc=0} 18:25:05.499212 --- ParallelTerminationStrategy: PID 12245 died... 18:25:05.517979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12245): Terminated: ok {rc=0} 18:25:05.562500 --- ParallelTerminationStrategy: PID 12248 died... 18:25:05.581633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12248): Terminated: ok {rc=0} 18:25:05.668292 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 18:25:06.974535 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:25:06.982935 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 18:25:07.016639 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 18:25:07.056711 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 18:25:07.146183 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 18:25:07.179278 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 18:25:07.218778 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 18:25:07.828745 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 18:25:07.881157 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:07.894936 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:25:07.951257 tst cs_paging_gprs_active.py: using LAC 30656 18:25:08.076165 tst cs_paging_gprs_active.py: using RAC 56 18:25:08.200858 tst cs_paging_gprs_active.py: using CellId 30656 18:25:08.326684 tst cs_paging_gprs_active.py: using BVCI 30657 18:25:08.443869 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:08.455777 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:08.467619 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:08.479531 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:08.491236 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:08.502835 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:08.514605 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:08.526328 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:08.538216 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:25:08.656636 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:25:08.777834 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:25:08.998070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:25:09.324434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12253): Launched 18:25:09.609332 run iperf3-srv_10.42.42.10(pid=12254): Launched 18:25:09.731146 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:25:09.950427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:25:10.277517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12255): Launched 18:25:10.563156 run iperf3-srv_10.42.42.10(pid=12256): Launched 18:25:10.686508 tst cs_paging_gprs_active.py:38: start network... 18:25:10.905525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:11.410015 run create_hlr_db(pid=12257): Launched 18:25:11.544003 bus /gobi_6: Setting Powered False 18:25:12.607553 run create_hlr_db(pid=12257): Terminated: ok {rc=0} 18:25:13.055103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12259): Launched 18:25:13.381279 run osmo-hlr_10.42.42.2(pid=12260): Launched 18:25:13.505599 run osmo-stp_10.42.42.5: Starting osmo-stp 18:25:14.064608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12262): Launched 18:25:14.390951 run osmo-stp_10.42.42.5(pid=12263): Launched 18:25:14.515708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:25:15.075705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12265): Launched 18:25:15.201407 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:25:15.476332 run patchelf(pid=12266): Launched 18:25:15.657895 run osmo-stp_10.42.42.5(pid=12263): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12263)] 18:25:15.794479 run osmo-stp_10.42.42.5(pid=12263): stdout: | (launched: 2022-12-12_18:25:14.330634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:15.952467 run osmo-stp_10.42.42.5(pid=12263): stderr: | [0;m[38;5;43m20221212182514524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182514524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182514525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182514525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182514526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182514526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182514526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:16.109792 run osmo-stp_10.42.42.5(pid=12263): stdout: | (launched: 2022-12-12_18:25:14.330634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:16.244472 run osmo-stp_10.42.42.5(pid=12263): stderr: | [0;m[38;5;43m20221212182514524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182514524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182514525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182514525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182514526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182514526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182514526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:16.404354 run patchelf(pid=12266): Terminating (SIGINT) 18:25:16.590058 run patchelf(pid=12266): Terminated: ok {rc=0} 18:25:16.721571 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12263): Process ended prematurely: osmo-stp_10.42.42.5(pid=12263) [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12263)] [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 18:25:16.733197 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 18:25:16.765068 run osmo-hlr_10.42.42.2(pid=12260): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12260)] 18:25:16.816703 run osmo-hlr_10.42.42.2(pid=12260): stdout: | (launched: 2022-12-12_18:25:13.320572) 18:25:16.869664 run osmo-hlr_10.42.42.2(pid=12260): stderr: | [0;m[1;31m20221212182513520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182513520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182513520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182513520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182513520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182513520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182513533 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182513541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182513541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182513542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:16.924251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12253): Terminating (SIGTERM) 18:25:16.967914 run iperf3-srv_10.42.42.10(pid=12254): Terminating (SIGTERM) 18:25:17.014452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12255): Terminating (SIGTERM) 18:25:17.058467 run iperf3-srv_10.42.42.10(pid=12256): Terminating (SIGTERM) 18:25:17.105693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12259): Terminating (SIGTERM) 18:25:17.149820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12262): Terminating (SIGTERM) 18:25:17.194446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12265): Terminating (SIGTERM) 18:25:17.240079 --- ParallelTerminationStrategy: PID 12253 died... 18:25:17.260439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12253): Terminated: ok {rc=0} 18:25:17.307662 --- ParallelTerminationStrategy: PID 12254 died... 18:25:17.327234 run iperf3-srv_10.42.42.10(pid=12254): Terminated {rc=256} 18:25:17.372855 --- ParallelTerminationStrategy: PID 12255 died... 18:25:17.392375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12255): Terminated: ok {rc=0} 18:25:17.438209 --- ParallelTerminationStrategy: PID 12256 died... 18:25:17.457602 run iperf3-srv_10.42.42.10(pid=12256): Terminated {rc=256} 18:25:17.503446 --- ParallelTerminationStrategy: PID 12259 died... 18:25:17.522873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12259): Terminated: ok {rc=0} 18:25:17.568652 --- ParallelTerminationStrategy: PID 12262 died... 18:25:17.588078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12262): Terminated: ok {rc=0} 18:25:17.633680 --- ParallelTerminationStrategy: PID 12265 died... 18:25:17.653138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12265): Terminated: ok {rc=0} 18:25:17.741450 bus /gobi_0: Setting Powered False 18:25:18.842164 bus /gobi_0: Setting Powered False 18:25:19.960658 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 18:25:21.106879 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:21.119064 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:25:21.174650 tst iperf3.py: using LAC 30657 18:25:21.294746 tst iperf3.py: using RAC 57 18:25:21.415429 tst iperf3.py: using CellId 30657 18:25:21.534890 tst iperf3.py: using BVCI 30658 18:25:21.646882 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:21.658378 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:21.669600 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:21.681082 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:21.692461 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:21.703844 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:21.715331 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:21.726734 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:21.738314 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:25:21.858609 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:25:22.076856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:25:22.402692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12267): Launched 18:25:22.686931 run iperf3-srv_10.42.42.10(pid=12268): Launched 18:25:22.810138 tst iperf3.py:8: start network... 18:25:23.028174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:23.530485 run create_hlr_db(pid=12269): Launched 18:25:23.664448 bus /gobi_6: Setting Powered False 18:25:24.728709 run create_hlr_db(pid=12269): Terminated: ok {rc=0} 18:25:25.162645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12271): Launched 18:25:25.468821 run osmo-hlr_10.42.42.2(pid=12272): Launched 18:25:25.587095 run osmo-stp_10.42.42.5: Starting osmo-stp 18:25:26.109580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12274): Launched 18:25:26.414540 run osmo-stp_10.42.42.5(pid=12275): Launched 18:25:26.533230 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:25:27.056554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12277): Launched 18:25:27.174295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:25:27.431946 run patchelf(pid=12278): Launched 18:25:27.604016 run osmo-stp_10.42.42.5(pid=12275): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12275)] 18:25:27.732347 run osmo-stp_10.42.42.5(pid=12275): stdout: | (launched: 2022-12-12_18:25:26.357397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:27.862214 run osmo-stp_10.42.42.5(pid=12275): stderr: | [0;m[38;5;43m20221212182526530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182526531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182526531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182526531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182526532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182526532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182526532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:27.992344 run osmo-stp_10.42.42.5(pid=12275): stdout: | (launched: 2022-12-12_18:25:26.357397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:28.116594 run osmo-stp_10.42.42.5(pid=12275): stderr: | [0;m[38;5;43m20221212182526530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182526531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182526531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182526531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182526532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182526532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182526532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:28.263585 run patchelf(pid=12278): Terminating (SIGINT) 18:25:28.434035 run patchelf(pid=12278): Terminated: ok {rc=0} 18:25:28.556858 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12275): Process ended prematurely: osmo-stp_10.42.42.5(pid=12275) [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12275)] [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 18:25:28.567279 tst iperf3.py:8: Test FAILED (7.5 sec) 18:25:28.594930 run osmo-hlr_10.42.42.2(pid=12272): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12272)] 18:25:28.643508 run osmo-hlr_10.42.42.2(pid=12272): stdout: | (launched: 2022-12-12_18:25:25.411826) 18:25:28.693461 run osmo-hlr_10.42.42.2(pid=12272): stderr: | [0;m[1;31m20221212182525591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182525591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182525591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182525591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182525591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182525591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182525605 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182525614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182525614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182525614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:28.743532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12267): Terminating (SIGTERM) 18:25:28.783710 run iperf3-srv_10.42.42.10(pid=12268): Terminating (SIGTERM) 18:25:28.823742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12271): Terminating (SIGTERM) 18:25:28.863776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12274): Terminating (SIGTERM) 18:25:28.903947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12277): Terminating (SIGTERM) 18:25:28.944267 --- ParallelTerminationStrategy: PID 12267 died... 18:25:28.963407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12267): Terminated: ok {rc=0} 18:25:29.008185 --- ParallelTerminationStrategy: PID 12268 died... 18:25:29.026730 run iperf3-srv_10.42.42.10(pid=12268): Terminated {rc=256} 18:25:29.071123 --- ParallelTerminationStrategy: PID 12271 died... 18:25:29.089807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12271): Terminated: ok {rc=0} 18:25:29.134306 --- ParallelTerminationStrategy: PID 12274 died... 18:25:29.153090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12274): Terminated: ok {rc=0} 18:25:29.197963 --- ParallelTerminationStrategy: PID 12277 died... 18:25:29.216698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12277): Terminated: ok {rc=0} 18:25:29.303531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 18:25:30.451292 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:30.463922 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:25:30.518663 tst iperf3m4.py: using LAC 30658 18:25:30.638370 tst iperf3m4.py: using RAC 58 18:25:30.759499 tst iperf3m4.py: using CellId 30658 18:25:30.906213 tst iperf3m4.py: using BVCI 30659 18:25:31.029415 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:31.042531 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:31.055537 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:31.068396 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:31.081598 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:31.094873 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:31.109103 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:31.121958 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:31.135110 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:25:31.259830 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:25:31.404839 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:25:31.541654 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:25:31.686980 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:25:31.944083 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:25:32.279432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12279): Launched 18:25:32.585774 run iperf3-srv_10.42.42.10(pid=12280): Launched 18:25:32.709336 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:25:32.927367 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:25:33.252594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12281): Launched 18:25:33.536319 run iperf3-srv_10.42.42.10(pid=12282): Launched 18:25:33.658339 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:25:33.876111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:25:34.202691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12283): Launched 18:25:34.487314 run iperf3-srv_10.42.42.10(pid=12284): Launched 18:25:34.610151 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:25:34.827982 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:25:35.153747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12285): Launched 18:25:35.436343 run iperf3-srv_10.42.42.10(pid=12286): Launched 18:25:35.558956 tst iperf3m4.py:8: start network... 18:25:35.776348 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:36.279675 run create_hlr_db(pid=12287): Launched 18:25:36.412747 bus /gobi_6: Setting Powered False 18:25:37.477230 run create_hlr_db(pid=12287): Terminated: ok {rc=0} 18:25:37.930923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12289): Launched 18:25:38.255818 run osmo-hlr_10.42.42.2(pid=12290): Launched 18:25:38.380929 run osmo-stp_10.42.42.5: Starting osmo-stp 18:25:38.946655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12292): Launched 18:25:39.274270 run osmo-stp_10.42.42.5(pid=12293): Launched 18:25:39.399247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:25:39.960878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12295): Launched 18:25:40.086287 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:25:40.361979 run patchelf(pid=12296): Launched 18:25:40.543277 run osmo-stp_10.42.42.5(pid=12293): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12293)] 18:25:40.680131 run osmo-stp_10.42.42.5(pid=12293): stdout: | (launched: 2022-12-12_18:25:39.213516) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:40.819344 run osmo-stp_10.42.42.5(pid=12293): stderr: | [0;m[38;5;43m20221212182539404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182539404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182539404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182539405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182539405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182539405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182539405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:40.959106 run osmo-stp_10.42.42.5(pid=12293): stdout: | (launched: 2022-12-12_18:25:39.213516) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:41.091605 run osmo-stp_10.42.42.5(pid=12293): stderr: | [0;m[38;5;43m20221212182539404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182539404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182539404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182539405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182539405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182539405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182539405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:41.249254 run patchelf(pid=12296): Terminating (SIGINT) 18:25:41.430601 run patchelf(pid=12296): Terminated: ok {rc=0} 18:25:41.561227 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12293): Process ended prematurely: osmo-stp_10.42.42.5(pid=12293) [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12293)] [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 18:25:41.571680 tst iperf3m4.py:8: Test FAILED (11.2 sec) 18:25:41.600612 run osmo-hlr_10.42.42.2(pid=12290): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12290)] 18:25:41.650752 run osmo-hlr_10.42.42.2(pid=12290): stdout: | (launched: 2022-12-12_18:25:38.195383) 18:25:41.702344 run osmo-hlr_10.42.42.2(pid=12290): stderr: | [0;m[1;31m20221212182538394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182538394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182538394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182538394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182538394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182538394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182538407 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182538417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182538417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182538417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:41.754350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12279): Terminating (SIGTERM) 18:25:41.796106 run iperf3-srv_10.42.42.10(pid=12280): Terminating (SIGTERM) 18:25:41.837916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12281): Terminating (SIGTERM) 18:25:41.879845 run iperf3-srv_10.42.42.10(pid=12282): Terminating (SIGTERM) 18:25:41.921730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12283): Terminating (SIGTERM) 18:25:41.963475 run iperf3-srv_10.42.42.10(pid=12284): Terminating (SIGTERM) 18:25:42.005543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12285): Terminating (SIGTERM) 18:25:42.047223 run iperf3-srv_10.42.42.10(pid=12286): Terminating (SIGTERM) 18:25:42.088615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12289): Terminating (SIGTERM) 18:25:42.130456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12292): Terminating (SIGTERM) 18:25:42.172022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12295): Terminating (SIGTERM) 18:25:42.214884 --- ParallelTerminationStrategy: PID 12279 died... 18:25:42.235129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12279): Terminated: ok {rc=0} 18:25:42.281891 --- ParallelTerminationStrategy: PID 12280 died... 18:25:42.301601 run iperf3-srv_10.42.42.10(pid=12280): Terminated {rc=256} 18:25:42.347942 --- ParallelTerminationStrategy: PID 12281 died... 18:25:42.367820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12281): Terminated: ok {rc=0} 18:25:42.414307 --- ParallelTerminationStrategy: PID 12282 died... 18:25:42.433887 run iperf3-srv_10.42.42.10(pid=12282): Terminated {rc=256} 18:25:42.480020 --- ParallelTerminationStrategy: PID 12283 died... 18:25:42.499849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12283): Terminated: ok {rc=0} 18:25:42.546155 --- ParallelTerminationStrategy: PID 12284 died... 18:25:42.565799 run iperf3-srv_10.42.42.10(pid=12284): Terminated {rc=256} 18:25:42.611992 --- ParallelTerminationStrategy: PID 12285 died... 18:25:42.631784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12285): Terminated: ok {rc=0} 18:25:42.677899 --- ParallelTerminationStrategy: PID 12286 died... 18:25:42.697605 run iperf3-srv_10.42.42.10(pid=12286): Terminated {rc=256} 18:25:42.744161 --- ParallelTerminationStrategy: PID 12289 died... 18:25:42.764193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12289): Terminated: ok {rc=0} 18:25:42.810665 --- ParallelTerminationStrategy: PID 12292 died... 18:25:42.830337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12292): Terminated: ok {rc=0} 18:25:42.877267 --- ParallelTerminationStrategy: PID 12295 died... 18:25:42.896935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12295): Terminated: ok {rc=0} 18:25:42.985945 bus /gobi_4: Setting Powered False 18:25:44.085844 bus /gobi_4: Setting Powered False 18:25:45.202619 bus /gobi_1: Setting Powered False 18:25:46.304403 bus /gobi_1: Setting Powered False 18:25:47.424017 bus /gobi_0: Setting Powered False 18:25:48.523654 bus /gobi_0: Setting Powered False 18:25:49.639944 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 18:25:50.744310 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:50.756399 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:25:50.809464 tst ping.py: using LAC 30659 18:25:50.935521 tst ping.py: using RAC 59 18:25:51.062630 tst ping.py: using CellId 30659 18:25:51.189106 tst ping.py: using BVCI 30660 18:25:51.304479 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:51.316521 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:51.328271 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:51.340091 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:51.351719 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:51.363339 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:51.375189 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:51.386888 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:25:51.501999 tst ping.py:19: start network... 18:25:51.700350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:25:52.162665 run create_hlr_db(pid=12297): Launched 18:25:52.279755 bus /gobi_6: Setting Powered False 18:25:53.339817 run create_hlr_db(pid=12297): Terminated: ok {rc=0} 18:25:53.775712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12299): Launched 18:25:54.098605 run osmo-hlr_10.42.42.2(pid=12300): Launched 18:25:54.222573 run osmo-stp_10.42.42.5: Starting osmo-stp 18:25:54.775025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12302): Launched 18:25:55.097127 run osmo-stp_10.42.42.5(pid=12303): Launched 18:25:55.221137 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:25:55.774214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12305): Launched 18:25:55.898278 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:25:56.169356 run patchelf(pid=12306): Launched 18:25:56.348358 run osmo-stp_10.42.42.5(pid=12303): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12303)] 18:25:56.483104 run osmo-stp_10.42.42.5(pid=12303): stdout: | (launched: 2022-12-12_18:25:55.036735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:56.619561 run osmo-stp_10.42.42.5(pid=12303): stderr: | [0;m[38;5;43m20221212182555228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182555228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182555228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182555229 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182555229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182555229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182555229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:56.755813 run osmo-stp_10.42.42.5(pid=12303): stdout: | (launched: 2022-12-12_18:25:55.036735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:25:56.887478 run osmo-stp_10.42.42.5(pid=12303): stderr: | [0;m[38;5;43m20221212182555228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182555228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182555228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182555229 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182555229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182555229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182555229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:25:57.042657 run patchelf(pid=12306): Terminating (SIGINT) 18:25:57.220319 run patchelf(pid=12306): Terminated: ok {rc=0} 18:25:57.347964 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12303): Process ended prematurely: osmo-stp_10.42.42.5(pid=12303) [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12303)] [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 18:25:57.357734 tst ping.py:22: Test FAILED (6.6 sec) 18:25:57.385804 run osmo-hlr_10.42.42.2(pid=12300): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12300)] 18:25:57.435666 run osmo-hlr_10.42.42.2(pid=12300): stdout: | (launched: 2022-12-12_18:25:54.039148) 18:25:57.487114 run osmo-hlr_10.42.42.2(pid=12300): stderr: | [0;m[1;31m20221212182554236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182554236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182554236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182554237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182554237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182554237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182554259 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182554268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182554268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182554268 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:25:57.539105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12299): Terminating (SIGTERM) 18:25:57.581051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12302): Terminating (SIGTERM) 18:25:57.622874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12305): Terminating (SIGTERM) 18:25:57.664756 --- ParallelTerminationStrategy: PID 12299 died... 18:25:57.684846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12299): Terminated: ok {rc=0} 18:25:57.731281 --- ParallelTerminationStrategy: PID 12302 died... 18:25:57.750959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12302): Terminated: ok {rc=0} 18:25:57.797619 --- ParallelTerminationStrategy: PID 12305 died... 18:25:57.817479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12305): Terminated: ok {rc=0} 18:25:57.906044 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 18:25:58.994603 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:59.007476 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:25:59.064697 tst ping_idle_ping.py: using LAC 30660 18:25:59.193152 tst ping_idle_ping.py: using RAC 60 18:25:59.318736 tst ping_idle_ping.py: using CellId 30660 18:25:59.444351 tst ping_idle_ping.py: using BVCI 30661 18:25:59.560467 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:59.572832 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:59.584845 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:59.597396 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:59.609611 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:59.622095 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:59.634659 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:25:59.647044 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:25:59.766221 tst ping_idle_ping.py:24: start network... 18:25:59.982311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:26:00.480659 run create_hlr_db(pid=12307): Launched 18:26:00.611861 bus /gobi_6: Setting Powered False 18:26:01.689893 run create_hlr_db(pid=12307): Terminated: ok {rc=0} 18:26:02.121366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12309): Launched 18:26:02.455450 run osmo-hlr_10.42.42.2(pid=12310): Launched 18:26:02.576852 run osmo-stp_10.42.42.5: Starting osmo-stp 18:26:03.132216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12312): Launched 18:26:03.453824 run osmo-stp_10.42.42.5(pid=12313): Launched 18:26:03.577043 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:26:04.132853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12315): Launched 18:26:04.257054 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:26:04.528626 run patchelf(pid=12316): Launched 18:26:04.708277 run osmo-stp_10.42.42.5(pid=12313): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12313)] 18:26:04.843081 run osmo-stp_10.42.42.5(pid=12313): stdout: | (launched: 2022-12-12_18:26:03.393478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:26:04.980671 run osmo-stp_10.42.42.5(pid=12313): stderr: | [0;m[38;5;43m20221212182603585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182603586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182603586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182603586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182603587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182603587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182603587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:26:05.117572 run osmo-stp_10.42.42.5(pid=12313): stdout: | (launched: 2022-12-12_18:26:03.393478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:26:05.248751 run osmo-stp_10.42.42.5(pid=12313): stderr: | [0;m[38;5;43m20221212182603585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182603586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182603586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182603586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182603587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182603587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182603587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:26:05.403458 run patchelf(pid=12316): Terminating (SIGINT) 18:26:05.582404 run patchelf(pid=12316): Terminated: ok {rc=0} 18:26:05.711086 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12313): Process ended prematurely: osmo-stp_10.42.42.5(pid=12313) [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12313)] [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 18:26:05.720776 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:26:05.749339 run osmo-hlr_10.42.42.2(pid=12310): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12310)] 18:26:05.799681 run osmo-hlr_10.42.42.2(pid=12310): stdout: | (launched: 2022-12-12_18:26:02.395484) 18:26:05.851743 run osmo-hlr_10.42.42.2(pid=12310): stderr: | [0;m[1;31m20221212182602595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182602595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182602595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182602595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182602595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182602595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182602607 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182602616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182602616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182602616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:26:05.904252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12309): Terminating (SIGTERM) 18:26:05.946612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12312): Terminating (SIGTERM) 18:26:05.989187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12315): Terminating (SIGTERM) 18:26:06.032025 --- ParallelTerminationStrategy: PID 12309 died... 18:26:06.052257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12309): Terminated: ok {rc=0} 18:26:06.099532 --- ParallelTerminationStrategy: PID 12312 died... 18:26:06.119428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12312): Terminated: ok {rc=0} 18:26:06.166278 --- ParallelTerminationStrategy: PID 12315 died... 18:26:06.186068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12315): Terminated: ok {rc=0} 18:26:06.275136 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:26:07.583006 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:26:07.590645 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:26:07.624406 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:26:07.660263 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:26:07.715191 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:26:07.749007 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:26:07.785474 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:26:08.351040 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:26:08.356639 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:26:08.368647 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:26:08.440457 tst switch_tch_pdch.py: using LAC 30661 18:26:08.565011 tst switch_tch_pdch.py: using RAC 61 18:26:08.690948 tst switch_tch_pdch.py: using CellId 30661 18:26:08.816599 tst switch_tch_pdch.py: using BVCI 30662 18:26:08.926207 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:26:08.937641 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:26:08.949173 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:26:08.960530 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:26:08.971862 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:26:08.983220 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:26:08.994717 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:26:09.006785 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:26:09.126775 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:26:09.243396 tst switch_tch_pdch.py:51: start network... 18:26:09.442527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:26:09.903784 run create_hlr_db(pid=12320): Launched 18:26:10.019355 bus /gobi_6: Setting Powered False 18:26:11.078643 run create_hlr_db(pid=12320): Terminated: ok {rc=0} 18:26:11.495328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12322): Launched 18:26:11.795798 run osmo-hlr_10.42.42.2(pid=12323): Launched 18:26:11.912619 run osmo-stp_10.42.42.5: Starting osmo-stp 18:26:12.438393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12325): Launched 18:26:12.738134 run osmo-stp_10.42.42.5(pid=12326): Launched 18:26:12.854269 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:26:13.369155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12328): Launched 18:26:13.483174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:26:13.735313 run patchelf(pid=12329): Launched 18:26:13.902225 run osmo-stp_10.42.42.5(pid=12326): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12326)] 18:26:14.027780 run osmo-stp_10.42.42.5(pid=12326): stdout: | (launched: 2022-12-12_18:26:12.682182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:26:14.154940 run osmo-stp_10.42.42.5(pid=12326): stderr: | [0;m[38;5;43m20221212182612852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182612852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182612853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182612853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182612853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182612854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182612854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:26:14.282147 run osmo-stp_10.42.42.5(pid=12326): stdout: | (launched: 2022-12-12_18:26:12.682182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:26:14.403810 run osmo-stp_10.42.42.5(pid=12326): stderr: | [0;m[38;5;43m20221212182612852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182612852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182612853 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182612853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182612853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182612854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182612854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:26:14.547947 run patchelf(pid=12329): Terminating (SIGINT) 18:26:14.714829 run patchelf(pid=12329): Terminated: ok {rc=0} 18:26:14.834982 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12326): Process ended prematurely: osmo-stp_10.42.42.5(pid=12326) [trial-2380↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12326)] [trial-2380↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:26:14.843991 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 18:26:14.871456 run osmo-hlr_10.42.42.2(pid=12323): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12323)] 18:26:14.919343 run osmo-hlr_10.42.42.2(pid=12323): stdout: | (launched: 2022-12-12_18:26:11.739658) 18:26:14.969311 run osmo-hlr_10.42.42.2(pid=12323): stderr: | [0;m[1;31m20221212182611916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182611916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182611916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182611916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182611916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182611916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182611928 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182611936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182611937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182611937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:26:15.019632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12322): Terminating (SIGTERM) 18:26:15.059553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12325): Terminating (SIGTERM) 18:26:15.099648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12328): Terminating (SIGTERM) 18:26:15.139969 --- ParallelTerminationStrategy: PID 12322 died... 18:26:15.159296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12322): Terminated: ok {rc=0} 18:26:15.204266 --- ParallelTerminationStrategy: PID 12325 died... 18:26:15.222889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12325): Terminated: ok {rc=0} 18:26:15.267228 --- ParallelTerminationStrategy: PID 12328 died... 18:26:15.285777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12328): Terminated: ok {rc=0} 18:26:15.371407 bus /gobi_0: Setting Powered False 18:26:16.474877 bus /gobi_0: Setting Powered False 18:26:17.594919 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:26:18.846534 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:26:18.852588 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:26:18.886012 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:26:18.920568 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:26:18.975151 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:26:19.008224 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:26:19.043203 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:26:19.595994 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:26:19.601224 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:26:19.612019 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:26:19.681413 tst switch_tch_pdch.py: using LAC 30662 18:26:19.799164 tst switch_tch_pdch.py: using RAC 62 18:26:19.919862 tst switch_tch_pdch.py: using CellId 30662 18:26:20.033977 tst switch_tch_pdch.py: using BVCI 30663 18:26:20.142460 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:26:20.153487 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:26:20.164235 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:26:20.175416 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:26:20.186517 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:26:20.197587 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:26:20.208717 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:26:20.219805 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:26:20.338479 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:26:20.456148 tst switch_tch_pdch.py:51: start network... 18:26:20.653586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:26:21.088460 run create_hlr_db(pid=12333): Launched 18:26:21.202799 bus /gobi_6: Setting Powered False 18:26:22.262196 run create_hlr_db(pid=12333): Terminated: ok {rc=0} 18:26:22.653469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12335): Launched 18:26:22.952631 run osmo-hlr_10.42.42.2(pid=12336): Launched 18:26:23.067822 run osmo-stp_10.42.42.5: Starting osmo-stp 18:26:23.567700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12338): Launched 18:26:23.868462 run osmo-stp_10.42.42.5(pid=12339): Launched 18:26:23.985017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:26:24.473028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12341): Launched 18:26:24.586793 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:26:24.838656 run patchelf(pid=12342): Launched 18:26:25.005445 run osmo-stp_10.42.42.5(pid=12339): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12339)] 18:26:25.131469 run osmo-stp_10.42.42.5(pid=12339): stdout: | (launched: 2022-12-12_18:26:23.812211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:26:25.258714 run osmo-stp_10.42.42.5(pid=12339): stderr: | [0;m[38;5;43m20221212182623982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182623982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182623982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182623983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182623983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182623983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182623983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:26:25.385817 run osmo-stp_10.42.42.5(pid=12339): stdout: | (launched: 2022-12-12_18:26:23.812211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:26:25.507241 run osmo-stp_10.42.42.5(pid=12339): stderr: | [0;m[38;5;43m20221212182623982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182623982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182623982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182623983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182623983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182623983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182623983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:26:25.650721 run patchelf(pid=12342): Terminating (SIGINT) 18:26:25.817252 run patchelf(pid=12342): Terminated: ok {rc=0} 18:26:25.937376 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12339): Process ended prematurely: osmo-stp_10.42.42.5(pid=12339) [trial-2380↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12339)] [trial-2380↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:26:25.946520 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 18:26:25.973529 run osmo-hlr_10.42.42.2(pid=12336): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12336)] 18:26:26.021677 run osmo-hlr_10.42.42.2(pid=12336): stdout: | (launched: 2022-12-12_18:26:22.896376) 18:26:26.070957 run osmo-hlr_10.42.42.2(pid=12336): stderr: | [0;m[1;31m20221212182623072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182623072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182623072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182623072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182623072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182623072 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182623084 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182623092 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182623093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182623093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:26:26.120844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12335): Terminating (SIGTERM) 18:26:26.160863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12338): Terminating (SIGTERM) 18:26:26.201062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12341): Terminating (SIGTERM) 18:26:26.241239 --- ParallelTerminationStrategy: PID 12335 died... 18:26:26.260356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12335): Terminated: ok {rc=0} 18:26:26.304756 --- ParallelTerminationStrategy: PID 12338 died... 18:26:26.323343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12338): Terminated: ok {rc=0} 18:26:26.367361 --- ParallelTerminationStrategy: PID 12341 died... 18:26:26.385974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12341): Terminated: ok {rc=0} 18:26:26.472200 bus /gobi_0: Setting Powered False 18:26:27.571556 bus /gobi_0: Setting Powered False 18:26:28.687850 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_sms:trx-lms --------------------------------------------------------------------- 18:26:29.947311 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:26:29.951727 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 18:26:29.986072 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 18:26:29.993293 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 18:26:30.051583 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 18:26:30.086352 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 18:26:30.093385 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 18:26:30.626577 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 18:26:30.632111 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 18:26:30.643440 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 18:26:30.692862 tst mo_mt_sms.py: using LAC 30663 18:26:30.817013 tst mo_mt_sms.py: using RAC 63 18:26:30.957074 tst mo_mt_sms.py: using CellId 30663 18:26:31.086446 tst mo_mt_sms.py: using BVCI 30664 18:26:31.206172 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 18:26:31.331476 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 18:26:31.481515 tst mo_mt_sms.py:9: start nitb and bts... 18:26:31.696271 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:26:32.320069 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12346): Launched 18:26:32.622540 run osmo-nitb_10.42.42.2(pid=12347): Launched 18:26:32.789883 run osmo-nitb_10.42.42.2(pid=12347): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12347)] 18:26:32.924124 run osmo-nitb_10.42.42.2(pid=12347): stdout: | (launched: 2022-12-12_18:26:32.566341) 18:26:33.059895 run osmo-nitb_10.42.42.2(pid=12347): stderr: | (launched: 2022-12-12_18:26:32.610334) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:26:33.196308 run osmo-nitb_10.42.42.2(pid=12347): stdout: | (launched: 2022-12-12_18:26:32.566341) 18:26:33.326560 run osmo-nitb_10.42.42.2(pid=12347): stderr: | (launched: 2022-12-12_18:26:32.610334) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12347): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12347) [trial-2380↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12347)] 18:26:33.737832 tst osmo-nitb_10.42.42.2(pid=12347): stdout: | (launched: 2022-12-12_18:26:32.566341) 18:26:33.858128 tst osmo-nitb_10.42.42.2(pid=12347): stderr: | (launched: 2022-12-12_18:26:32.610334) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:26:33.999638 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12347): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12347) [trial-2380↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12347)] [trial-2380↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 18:26:34.008123 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 18:26:34.014872 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12346): Terminating (SIGTERM) 18:26:34.224532 --- ParallelTerminationStrategy: PID 12346 died... 18:26:34.245032 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12346): Terminated: ok {rc=0} 18:26:34.330509 bus /sierra_3: Setting Powered False 18:26:35.430196 bus /sierra_3: Setting Powered False 18:26:36.547042 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 sms:trx-lms --------------------------------------------------------------------- 18:26:37.748609 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:26:37.753673 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 18:26:37.788305 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 18:26:37.814913 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 18:26:37.868302 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 18:26:37.901589 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 18:26:37.929705 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 18:26:38.474118 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 18:26:38.479404 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 18:26:38.490323 tst sms:trx-lms: Using 1 x bts (candidates: 1) 18:26:38.538772 tst mo_mt_sms.py: using LAC 30664 18:26:38.656870 tst mo_mt_sms.py: using RAC 64 18:26:38.773287 tst mo_mt_sms.py: using CellId 30664 18:26:38.892030 tst mo_mt_sms.py: using BVCI 30665 18:26:39.000786 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 18:26:39.011403 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 18:26:39.021887 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 18:26:39.032732 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 18:26:39.043798 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 18:26:39.054867 tst sms:trx-lms: Using 1 x modem (candidates: 2) 18:26:39.168626 tst sms:trx-lms: Using 1 x modem (candidates: 2) 18:26:39.286698 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:26:39.747816 run create_hlr_db(pid=12351): Launched 18:26:39.863405 bus /sierra_2: Setting Powered False 18:26:40.922102 run create_hlr_db(pid=12351): Terminated: ok {rc=0} 18:26:41.358818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12353): Launched 18:26:41.678141 run osmo-hlr_10.42.42.2(pid=12354): Launched 18:26:41.801498 run osmo-stp_10.42.42.5: Starting osmo-stp 18:26:42.349549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12356): Launched 18:26:42.667510 run osmo-stp_10.42.42.5(pid=12357): Launched 18:26:42.790082 run osmo-msc_10.42.42.6: Starting osmo-msc 18:26:43.367359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12359): Launched 18:26:43.688223 run osmo-msc_10.42.42.6(pid=12360): Launched 18:26:43.866861 run osmo-stp_10.42.42.5(pid=12357): ERR: Terminated: ERROR {rc=1} [trial-2380↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12357)] 18:26:44.000934 run osmo-stp_10.42.42.5(pid=12357): stdout: | (launched: 2022-12-12_18:26:42.608234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:26:44.135381 run osmo-stp_10.42.42.5(pid=12357): stderr: | [0;m[38;5;43m20221212182642800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182642800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182642800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182642801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182642801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182642802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182642802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:26:44.268696 run osmo-stp_10.42.42.5(pid=12357): stdout: | (launched: 2022-12-12_18:26:42.608234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:26:44.394968 run osmo-stp_10.42.42.5(pid=12357): stderr: | [0;m[38;5;43m20221212182642800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182642800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182642800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182642801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182642801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182642802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182642802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:26:44.545849 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12357): Process ended prematurely: osmo-stp_10.42.42.5(pid=12357) [trial-2380↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12357)] [trial-2380↪sms:trx-lms↪mo_mt_sms.py:16] 18:26:44.554912 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 18:26:44.582151 run osmo-hlr_10.42.42.2(pid=12354): ERR: Terminated: ERROR {rc=237} [trial-2380↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12354)] 18:26:44.632554 run osmo-hlr_10.42.42.2(pid=12354): stdout: | (launched: 2022-12-12_18:26:41.618753) 18:26:44.684456 run osmo-hlr_10.42.42.2(pid=12354): stderr: | [0;m[1;31m20221212182641816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182641816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182641816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182641816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182641816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182641816 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182641828 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182641837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182641837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182641837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:26:44.756611 run osmo-msc_10.42.42.6(pid=12360): ERR: Terminated: ERROR {rc=2} [trial-2380↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12360)] 18:26:44.806624 run osmo-msc_10.42.42.6(pid=12360): stdout: | (launched: 2022-12-12_18:26:43.628471) 18:26:44.858251 run osmo-msc_10.42.42.6(pid=12360): stderr: | [0;m[38;5;43m20221212182643952 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182643952 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4ba28b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182643952 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182643952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182643953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182643953 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182643954 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182643955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182643955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182643955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:26:44.910637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12353): Terminating (SIGTERM) 18:26:44.952427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12356): Terminating (SIGTERM) 18:26:44.994162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12359): Terminating (SIGTERM) 18:26:45.036069 --- ParallelTerminationStrategy: PID 12353 died... 18:26:45.056159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12353): Terminated: ok {rc=0} 18:26:45.102241 --- ParallelTerminationStrategy: PID 12356 died... 18:26:45.122143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12356): Terminated: ok {rc=0} 18:26:45.168383 --- ParallelTerminationStrategy: PID 12359 died... 18:26:45.187805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12359): Terminated: ok {rc=0} 18:26:45.276754 bus /sierra_3: Setting Powered False 18:26:46.381019 bus /sierra_3: Setting Powered False 18:26:47.505944 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_ussd:trx-lms --------------------------------------------------------------------- 18:26:48.738932 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:26:48.743369 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 18:26:48.777652 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 18:26:48.784606 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 18:26:48.820733 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 18:26:48.854721 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 18:26:48.861784 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 18:26:49.381968 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2380 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 18:26:49.387196 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 18:26:49.398655 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 18:26:49.447984 tst assert_extension.py: using LAC 30665 18:26:49.576529 tst assert_extension.py: using RAC 65 18:26:49.704674 tst assert_extension.py: using CellId 30665 18:26:49.832291 tst assert_extension.py: using BVCI 30666 18:26:49.943206 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 18:26:50.057142 tst assert_extension.py:10: start nitb and bts... 18:26:50.256511 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:26:50.866616 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12365): Launched 18:26:51.167431 run osmo-nitb_10.42.42.2(pid=12366): Launched 18:26:51.336087 run osmo-nitb_10.42.42.2(pid=12366): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12366)] 18:26:51.469845 run osmo-nitb_10.42.42.2(pid=12366): stdout: | (launched: 2022-12-12_18:26:51.111069) 18:26:51.604756 run osmo-nitb_10.42.42.2(pid=12366): stderr: | (launched: 2022-12-12_18:26:51.155273) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:26:51.739700 run osmo-nitb_10.42.42.2(pid=12366): stdout: | (launched: 2022-12-12_18:26:51.111069) 18:26:51.869318 run osmo-nitb_10.42.42.2(pid=12366): stderr: | (launched: 2022-12-12_18:26:51.155273) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12366): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12366) [trial-2380↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12366)] 18:26:52.283672 tst osmo-nitb_10.42.42.2(pid=12366): stdout: | (launched: 2022-12-12_18:26:51.111069) 18:26:52.403874 tst osmo-nitb_10.42.42.2(pid=12366): stderr: | (launched: 2022-12-12_18:26:51.155273) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:26:52.546562 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12366): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12366) [trial-2380↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12366)] [trial-2380↪nitb_ussd:trx-lms↪assert_extension.py:12] 18:26:52.554989 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:26:52.561636 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12365): Terminating (SIGTERM) 18:26:52.772877 --- ParallelTerminationStrategy: PID 12365 died... 18:26:52.793490 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12365): Terminated: ok {rc=0} 18:26:52.881602 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 ussd:trx-lms --------------------------------------------------------------------- 18:26:54.059950 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:26:54.064242 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 18:26:54.099960 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 18:26:54.127316 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 18:26:54.163829 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 18:26:54.197968 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 18:26:54.225272 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 18:26:54.755050 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2380 ussd:trx-lms assert_extension.py ---------------------------------------------- 18:26:54.760796 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 18:26:54.772127 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 18:26:54.824769 tst assert_extension.py: using LAC 30666 18:26:54.954164 tst assert_extension.py: using RAC 66 18:26:55.078971 tst assert_extension.py: using CellId 30666 18:26:55.201997 tst assert_extension.py: using BVCI 30667 18:26:55.317515 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 18:26:55.328772 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 18:26:55.339894 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 18:26:55.351495 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 18:26:55.362928 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 18:26:55.374383 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 18:26:55.492246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:26:55.989976 run create_hlr_db(pid=12371): Launched 18:26:56.122918 bus /sierra_2: Setting Powered False 18:26:57.186204 run create_hlr_db(pid=12371): Terminated: ok {rc=0} 18:26:57.614179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12373): Launched 18:26:57.916058 run osmo-hlr_10.42.42.2(pid=12374): Launched 18:26:58.031519 run osmo-stp_10.42.42.5: Starting osmo-stp 18:26:58.563402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12376): Launched 18:26:58.863857 run osmo-stp_10.42.42.5(pid=12377): Launched 18:26:58.979206 run osmo-msc_10.42.42.6: Starting osmo-msc 18:26:59.520214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12379): Launched 18:26:59.821431 run osmo-msc_10.42.42.6(pid=12380): Launched 18:26:59.991914 run osmo-stp_10.42.42.5(pid=12377): ERR: Terminated: ERROR {rc=1} [trial-2380↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12377)] 18:27:00.118654 run osmo-stp_10.42.42.5(pid=12377): stdout: | (launched: 2022-12-12_18:26:58.807831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:00.245346 run osmo-stp_10.42.42.5(pid=12377): stderr: | [0;m[38;5;43m20221212182658980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182658980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182658980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182658980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182658981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182658981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182658981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:00.369579 run osmo-stp_10.42.42.5(pid=12377): stdout: | (launched: 2022-12-12_18:26:58.807831) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:00.488171 run osmo-stp_10.42.42.5(pid=12377): stderr: | [0;m[38;5;43m20221212182658980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182658980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182658980 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182658980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182658981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182658981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182658981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:00.629969 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12377): Process ended prematurely: osmo-stp_10.42.42.5(pid=12377) [trial-2380↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12377)] [trial-2380↪ussd:trx-lms↪assert_extension.py:17] 18:27:00.638472 tst assert_extension.py:17: Test FAILED (5.9 sec) 18:27:00.665186 run osmo-hlr_10.42.42.2(pid=12374): ERR: Terminated: ERROR {rc=237} [trial-2380↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12374)] 18:27:00.713774 run osmo-hlr_10.42.42.2(pid=12374): stdout: | (launched: 2022-12-12_18:26:57.859863) 18:27:00.763755 run osmo-hlr_10.42.42.2(pid=12374): stderr: | [0;m[1;31m20221212182658035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182658035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182658035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182658035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182658035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182658035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182658047 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182658057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182658058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182658058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:27:00.834937 run osmo-msc_10.42.42.6(pid=12380): ERR: Terminated: ERROR {rc=2} [trial-2380↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12380)] 18:27:00.884563 run osmo-msc_10.42.42.6(pid=12380): stdout: | (launched: 2022-12-12_18:26:59.765279) 18:27:00.956826 run osmo-msc_10.42.42.6(pid=12380): stderr: | [0;m[38;5;43m20221212182700037 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182700037 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6219b0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182700037 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182700037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182700037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182700037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182700039 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182700039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182700040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182700040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:27:01.023686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12373): Terminating (SIGTERM) 18:27:01.067328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12376): Terminating (SIGTERM) 18:27:01.110182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12379): Terminating (SIGTERM) 18:27:01.151521 --- ParallelTerminationStrategy: PID 12373 died... 18:27:01.171180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12373): Terminated: ok {rc=0} 18:27:01.216635 --- ParallelTerminationStrategy: PID 12376 died... 18:27:01.236060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12376): Terminated: ok {rc=0} 18:27:01.281799 --- ParallelTerminationStrategy: PID 12379 died... 18:27:01.303544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12379): Terminated: ok {rc=0} 18:27:01.399822 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:27:02.619044 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:27:02.627013 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:27:02.662961 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:27:02.691315 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:27:02.743548 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:27:02.777959 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:27:02.806137 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:27:03.359744 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:27:03.413637 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:27:03.425307 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:27:03.496701 tst mo_mt_call.py: using LAC 30667 18:27:03.622236 tst mo_mt_call.py: using RAC 67 18:27:03.749497 tst mo_mt_call.py: using CellId 30667 18:27:03.877398 tst mo_mt_call.py: using BVCI 30668 18:27:03.996441 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:27:04.008298 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:27:04.019809 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:27:04.031845 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:27:04.043928 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:27:04.055970 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:27:04.173777 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:27:04.292268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:27:04.763762 run create_hlr_db(pid=12385): Launched 18:27:04.882418 bus /sierra_2: Setting Powered False 18:27:05.943387 run create_hlr_db(pid=12385): Terminated: ok {rc=0} 18:27:06.388886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12387): Launched 18:27:06.715686 run osmo-hlr_10.42.42.2(pid=12388): Launched 18:27:06.841661 run osmo-stp_10.42.42.5: Starting osmo-stp 18:27:07.400596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12390): Launched 18:27:07.728657 run osmo-stp_10.42.42.5(pid=12391): Launched 18:27:07.854501 run osmo-msc_10.42.42.6: Starting osmo-msc 18:27:08.442056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12393): Launched 18:27:08.767072 run osmo-msc_10.42.42.6(pid=12394): Launched 18:27:08.949813 run osmo-stp_10.42.42.5(pid=12391): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12391)] 18:27:09.085830 run osmo-stp_10.42.42.5(pid=12391): stdout: | (launched: 2022-12-12_18:27:07.667952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:09.222108 run osmo-stp_10.42.42.5(pid=12391): stderr: | [0;m[38;5;43m20221212182707860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182707860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182707860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182707861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182707861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182707861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182707861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:09.356941 run osmo-stp_10.42.42.5(pid=12391): stdout: | (launched: 2022-12-12_18:27:07.667952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:09.485729 run osmo-stp_10.42.42.5(pid=12391): stderr: | [0;m[38;5;43m20221212182707860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182707860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182707860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182707861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182707861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182707861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182707861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:09.639546 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12391): Process ended prematurely: osmo-stp_10.42.42.5(pid=12391) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12391)] [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:27:09.649230 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:27:09.677255 run osmo-hlr_10.42.42.2(pid=12388): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12388)] 18:27:09.727492 run osmo-hlr_10.42.42.2(pid=12388): stdout: | (launched: 2022-12-12_18:27:06.655457) 18:27:09.779253 run osmo-hlr_10.42.42.2(pid=12388): stderr: | [0;m[1;31m20221212182706853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182706853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182706853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182706853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182706853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182706853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182706866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182706875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182706875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182706875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:27:09.851437 run osmo-msc_10.42.42.6(pid=12394): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12394)] 18:27:09.901941 run osmo-msc_10.42.42.6(pid=12394): stdout: | (launched: 2022-12-12_18:27:08.706435) 18:27:09.953649 run osmo-msc_10.42.42.6(pid=12394): stderr: | [0;m[38;5;43m20221212182709029 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182709029 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f504201fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182709030 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182709030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182709030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182709030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182709032 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182709032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182709032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182709032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:27:10.005877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12387): Terminating (SIGTERM) 18:27:10.047523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12390): Terminating (SIGTERM) 18:27:10.089348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12393): Terminating (SIGTERM) 18:27:10.131218 --- ParallelTerminationStrategy: PID 12387 died... 18:27:10.151240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12387): Terminated: ok {rc=0} 18:27:10.197533 --- ParallelTerminationStrategy: PID 12390 died... 18:27:10.217231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12390): Terminated: ok {rc=0} 18:27:10.264171 --- ParallelTerminationStrategy: PID 12393 died... 18:27:10.283887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12393): Terminated: ok {rc=0} 18:27:10.371579 bus /sierra_3: Setting Powered False 18:27:11.472645 bus /sierra_3: Setting Powered False 18:27:12.591076 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:27:13.737177 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:27:13.749051 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:27:13.818777 tst mo_mt_call_osmux.py: using LAC 30668 18:27:13.937299 tst mo_mt_call_osmux.py: using RAC 68 18:27:14.057338 tst mo_mt_call_osmux.py: using CellId 30668 18:27:14.176454 tst mo_mt_call_osmux.py: using BVCI 30669 18:27:14.287893 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:27:14.299105 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:27:14.310172 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:27:14.321510 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:27:14.332839 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:27:14.344196 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:27:14.465065 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:27:14.587595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:27:15.058856 run create_hlr_db(pid=12396): Launched 18:27:15.177629 bus /sierra_2: Setting Powered False 18:27:16.237851 run create_hlr_db(pid=12396): Terminated: ok {rc=0} 18:27:16.672125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12398): Launched 18:27:16.996701 run osmo-hlr_10.42.42.2(pid=12399): Launched 18:27:17.228221 run osmo-stp_10.42.42.5: Starting osmo-stp 18:27:17.791770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12401): Launched 18:27:18.121478 run osmo-stp_10.42.42.5(pid=12402): Launched 18:27:18.246847 run osmo-msc_10.42.42.6: Starting osmo-msc 18:27:18.836790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12404): Launched 18:27:19.165719 run osmo-msc_10.42.42.6(pid=12405): Launched 18:27:19.348083 run osmo-stp_10.42.42.5(pid=12402): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12402)] 18:27:19.483954 run osmo-stp_10.42.42.5(pid=12402): stdout: | (launched: 2022-12-12_18:27:18.060566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:19.621391 run osmo-stp_10.42.42.5(pid=12402): stderr: | [0;m[38;5;43m20221212182718255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182718255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182718255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182718256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182718256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182718256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182718256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:19.757506 run osmo-stp_10.42.42.5(pid=12402): stdout: | (launched: 2022-12-12_18:27:18.060566) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:19.887116 run osmo-stp_10.42.42.5(pid=12402): stderr: | [0;m[38;5;43m20221212182718255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182718255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182718255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182718256 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182718256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182718256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182718256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:20.042407 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12402): Process ended prematurely: osmo-stp_10.42.42.5(pid=12402) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12402)] [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:27:20.052110 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:27:20.080632 run osmo-hlr_10.42.42.2(pid=12399): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12399)] 18:27:20.131383 run osmo-hlr_10.42.42.2(pid=12399): stdout: | (launched: 2022-12-12_18:27:16.936608) 18:27:20.183644 run osmo-hlr_10.42.42.2(pid=12399): stderr: | [0;m[1;31m20221212182717220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182717220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182717220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182717220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182717220 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182717221 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182717235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182717245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182717245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182717245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:27:20.256149 run osmo-msc_10.42.42.6(pid=12405): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12405)] 18:27:20.306610 run osmo-msc_10.42.42.6(pid=12405): stdout: | (launched: 2022-12-12_18:27:19.105130) 18:27:20.358437 run osmo-msc_10.42.42.6(pid=12405): stderr: | [0;m[38;5;43m20221212182719429 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182719430 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb2c6f71c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182719430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182719430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182719430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182719430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182719432 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182719432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182719432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182719432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:27:20.410723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12398): Terminating (SIGTERM) 18:27:20.452806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12401): Terminating (SIGTERM) 18:27:20.494901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12404): Terminating (SIGTERM) 18:27:20.537419 --- ParallelTerminationStrategy: PID 12398 died... 18:27:20.557570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12398): Terminated: ok {rc=0} 18:27:20.604889 --- ParallelTerminationStrategy: PID 12401 died... 18:27:20.624707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12401): Terminated: ok {rc=0} 18:27:20.671506 --- ParallelTerminationStrategy: PID 12404 died... 18:27:20.691301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12404): Terminated: ok {rc=0} 18:27:20.780940 bus /sierra_3: Setting Powered False 18:27:21.881101 bus /sierra_3: Setting Powered False 18:27:23.002108 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:27:24.257770 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:27:24.265131 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:27:24.299486 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:27:24.327089 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:27:24.382525 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:27:24.416790 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:27:24.444205 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:27:24.995367 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:27:25.047667 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:27:25.059323 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:27:25.130285 tst mo_mt_call.py: using LAC 30669 18:27:25.258332 tst mo_mt_call.py: using RAC 69 18:27:25.386171 tst mo_mt_call.py: using CellId 30669 18:27:25.514401 tst mo_mt_call.py: using BVCI 30670 18:27:25.633850 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:27:25.645630 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:27:25.657247 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:27:25.668771 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:27:25.680420 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:27:25.692032 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:27:25.813745 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:27:25.931217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:27:26.402431 run create_hlr_db(pid=12410): Launched 18:27:26.521926 bus /sierra_2: Setting Powered False 18:27:27.583444 run create_hlr_db(pid=12410): Terminated: ok {rc=0} 18:27:28.008256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12412): Launched 18:27:28.316376 run osmo-hlr_10.42.42.2(pid=12413): Launched 18:27:28.433431 run osmo-stp_10.42.42.5: Starting osmo-stp 18:27:28.969410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12415): Launched 18:27:29.275674 run osmo-stp_10.42.42.5(pid=12416): Launched 18:27:29.394007 run osmo-msc_10.42.42.6: Starting osmo-msc 18:27:29.945008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12418): Launched 18:27:30.250999 run osmo-msc_10.42.42.6(pid=12419): Launched 18:27:30.423927 run osmo-stp_10.42.42.5(pid=12416): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12416)] 18:27:30.552920 run osmo-stp_10.42.42.5(pid=12416): stdout: | (launched: 2022-12-12_18:27:29.218661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:30.681365 run osmo-stp_10.42.42.5(pid=12416): stderr: | [0;m[38;5;43m20221212182729390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182729390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182729390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182729391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182729391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182729391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182729391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:30.807581 run osmo-stp_10.42.42.5(pid=12416): stdout: | (launched: 2022-12-12_18:27:29.218661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:30.963644 run osmo-stp_10.42.42.5(pid=12416): stderr: | [0;m[38;5;43m20221212182729390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182729390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182729390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182729391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182729391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182729391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182729391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:31.123309 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12416): Process ended prematurely: osmo-stp_10.42.42.5(pid=12416) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12416)] [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:27:31.133558 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:27:31.163155 run osmo-hlr_10.42.42.2(pid=12413): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12413)] 18:27:31.214773 run osmo-hlr_10.42.42.2(pid=12413): stdout: | (launched: 2022-12-12_18:27:28.259450) 18:27:31.271488 run osmo-hlr_10.42.42.2(pid=12413): stderr: | [0;m[1;31m20221212182728434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182728434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182728434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182728434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182728434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182728434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182728446 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182728457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182728457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182728457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:27:31.347264 run osmo-msc_10.42.42.6(pid=12419): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12419)] 18:27:31.399464 run osmo-msc_10.42.42.6(pid=12419): stdout: | (launched: 2022-12-12_18:27:30.193468) 18:27:31.452606 run osmo-msc_10.42.42.6(pid=12419): stderr: | [0;m[38;5;43m20221212182730467 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182730467 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f07e4898c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182730467 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182730467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182730467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182730468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182730469 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182730470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182730470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182730470 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:27:31.507190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12412): Terminating (SIGTERM) 18:27:31.551420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12415): Terminating (SIGTERM) 18:27:31.597455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12418): Terminating (SIGTERM) 18:27:31.641926 --- ParallelTerminationStrategy: PID 12412 died... 18:27:31.664594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12412): Terminated: ok {rc=0} 18:27:31.715187 --- ParallelTerminationStrategy: PID 12415 died... 18:27:31.735691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12415): Terminated: ok {rc=0} 18:27:31.783956 --- ParallelTerminationStrategy: PID 12418 died... 18:27:31.804857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12418): Terminated: ok {rc=0} 18:27:31.895443 bus /sierra_3: Setting Powered False 18:27:32.996641 bus /sierra_3: Setting Powered False 18:27:34.113193 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:27:35.264142 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:27:35.276563 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:27:35.348743 tst mo_mt_call_osmux.py: using LAC 30670 18:27:35.475338 tst mo_mt_call_osmux.py: using RAC 70 18:27:35.602480 tst mo_mt_call_osmux.py: using CellId 30670 18:27:35.728859 tst mo_mt_call_osmux.py: using BVCI 30671 18:27:35.845676 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:27:35.857325 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:27:35.868746 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:27:35.880094 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:27:35.891530 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:27:35.902826 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:27:36.023305 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:27:36.142337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:27:36.613445 run create_hlr_db(pid=12421): Launched 18:27:36.732595 bus /sierra_2: Setting Powered False 18:27:37.793773 run create_hlr_db(pid=12421): Terminated: ok {rc=0} 18:27:38.240106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12423): Launched 18:27:38.567508 run osmo-hlr_10.42.42.2(pid=12424): Launched 18:27:38.693325 run osmo-stp_10.42.42.5: Starting osmo-stp 18:27:39.251228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12426): Launched 18:27:39.578333 run osmo-stp_10.42.42.5(pid=12427): Launched 18:27:39.705193 run osmo-msc_10.42.42.6: Starting osmo-msc 18:27:40.293670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12429): Launched 18:27:40.621847 run osmo-msc_10.42.42.6(pid=12430): Launched 18:27:40.802931 run osmo-stp_10.42.42.5(pid=12427): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12427)] 18:27:40.939492 run osmo-stp_10.42.42.5(pid=12427): stdout: | (launched: 2022-12-12_18:27:39.517683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:41.076375 run osmo-stp_10.42.42.5(pid=12427): stderr: | [0;m[38;5;43m20221212182739713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182739713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182739713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182739714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182739714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182739714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182739714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:41.212142 run osmo-stp_10.42.42.5(pid=12427): stdout: | (launched: 2022-12-12_18:27:39.517683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:41.341375 run osmo-stp_10.42.42.5(pid=12427): stderr: | [0;m[38;5;43m20221212182739713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182739713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182739713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182739714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182739714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182739714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182739714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:41.496321 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12427): Process ended prematurely: osmo-stp_10.42.42.5(pid=12427) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12427)] [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:27:41.506038 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:27:41.534532 run osmo-hlr_10.42.42.2(pid=12424): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12424)] 18:27:41.585059 run osmo-hlr_10.42.42.2(pid=12424): stdout: | (launched: 2022-12-12_18:27:38.506893) 18:27:41.637282 run osmo-hlr_10.42.42.2(pid=12424): stderr: | [0;m[1;31m20221212182738708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182738708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182738708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182738708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182738708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182738708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182738720 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182738728 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182738729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182738729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:27:41.710283 run osmo-msc_10.42.42.6(pid=12430): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12430)] 18:27:41.760553 run osmo-msc_10.42.42.6(pid=12430): stdout: | (launched: 2022-12-12_18:27:40.560764) 18:27:41.812443 run osmo-msc_10.42.42.6(pid=12430): stderr: | [0;m[38;5;43m20221212182740886 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182740886 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6adfa6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182740887 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182740887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182740887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182740887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182740889 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182740889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182740889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182740889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:27:41.864837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12423): Terminating (SIGTERM) 18:27:41.910156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12426): Terminating (SIGTERM) 18:27:41.953798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12429): Terminating (SIGTERM) 18:27:41.996341 --- ParallelTerminationStrategy: PID 12423 died... 18:27:42.016586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12423): Terminated: ok {rc=0} 18:27:42.063068 --- ParallelTerminationStrategy: PID 12426 died... 18:27:42.082856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12426): Terminated: ok {rc=0} 18:27:42.129177 --- ParallelTerminationStrategy: PID 12429 died... 18:27:42.148786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12429): Terminated: ok {rc=0} 18:27:42.238116 bus /sierra_3: Setting Powered False 18:27:43.338849 bus /sierra_3: Setting Powered False 18:27:44.457318 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:27:45.715813 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:27:45.723591 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:27:45.758002 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:27:45.785825 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:27:45.852647 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:27:45.918809 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:27:45.957471 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:27:46.489840 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:27:46.563818 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:27:46.579713 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:27:46.662744 tst mo_mt_call.py: using LAC 30671 18:27:46.821742 tst mo_mt_call.py: using RAC 71 18:27:46.943636 tst mo_mt_call.py: using CellId 30671 18:27:47.071006 tst mo_mt_call.py: using BVCI 30672 18:27:47.185079 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:27:47.197510 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:27:47.209664 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:27:47.223548 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:27:47.235745 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:27:47.248670 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:27:47.373091 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:27:47.496743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:27:48.003087 run create_hlr_db(pid=12435): Launched 18:27:48.135941 bus /sierra_2: Setting Powered False 18:27:49.201034 run create_hlr_db(pid=12435): Terminated: ok {rc=0} 18:27:49.638085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12437): Launched 18:27:49.945920 run osmo-hlr_10.42.42.2(pid=12438): Launched 18:27:50.064259 run osmo-stp_10.42.42.5: Starting osmo-stp 18:27:50.602735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12440): Launched 18:27:50.907412 run osmo-stp_10.42.42.5(pid=12441): Launched 18:27:51.025092 run osmo-msc_10.42.42.6: Starting osmo-msc 18:27:51.574620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12443): Launched 18:27:51.882732 run osmo-msc_10.42.42.6(pid=12444): Launched 18:27:52.055137 run osmo-stp_10.42.42.5(pid=12441): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12441)] 18:27:52.183644 run osmo-stp_10.42.42.5(pid=12441): stdout: | (launched: 2022-12-12_18:27:50.850312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:52.311865 run osmo-stp_10.42.42.5(pid=12441): stderr: | [0;m[38;5;43m20221212182751022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182751022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182751023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182751023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182751023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182751023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182751024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:52.437934 run osmo-stp_10.42.42.5(pid=12441): stdout: | (launched: 2022-12-12_18:27:50.850312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:27:52.559226 run osmo-stp_10.42.42.5(pid=12441): stderr: | [0;m[38;5;43m20221212182751022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182751022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182751023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182751023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182751023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182751023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182751024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:27:52.703940 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12441): Process ended prematurely: osmo-stp_10.42.42.5(pid=12441) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12441)] [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:27:52.713336 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:27:52.740928 run osmo-hlr_10.42.42.2(pid=12438): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12438)] 18:27:52.789539 run osmo-hlr_10.42.42.2(pid=12438): stdout: | (launched: 2022-12-12_18:27:49.888715) 18:27:52.839872 run osmo-hlr_10.42.42.2(pid=12438): stderr: | [0;m[1;31m20221212182750066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182750066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182750066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182750066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182750066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182750066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182750079 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182750089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182750090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182750090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:27:52.909752 run osmo-msc_10.42.42.6(pid=12444): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12444)] 18:27:52.958474 run osmo-msc_10.42.42.6(pid=12444): stdout: | (launched: 2022-12-12_18:27:51.825517) 18:27:53.008848 run osmo-msc_10.42.42.6(pid=12444): stderr: | [0;m[38;5;43m20221212182752099 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182752099 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f14fb21dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182752099 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182752099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182752100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182752100 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182752101 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182752102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182752102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182752102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:27:53.059542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12437): Terminating (SIGTERM) 18:27:53.100149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12440): Terminating (SIGTERM) 18:27:53.141030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12443): Terminating (SIGTERM) 18:27:53.182282 --- ParallelTerminationStrategy: PID 12437 died... 18:27:53.201649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12437): Terminated: ok {rc=0} 18:27:53.246685 --- ParallelTerminationStrategy: PID 12440 died... 18:27:53.265569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12440): Terminated: ok {rc=0} 18:27:53.310491 --- ParallelTerminationStrategy: PID 12443 died... 18:27:53.329405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12443): Terminated: ok {rc=0} 18:27:53.413882 bus /sierra_3: Setting Powered False 18:27:54.513983 bus /sierra_3: Setting Powered False 18:27:55.631140 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:27:56.780863 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:27:56.793370 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:27:56.865806 tst mo_mt_call_osmux.py: using LAC 30672 18:27:56.994931 tst mo_mt_call_osmux.py: using RAC 72 18:27:57.123662 tst mo_mt_call_osmux.py: using CellId 30672 18:27:57.256404 tst mo_mt_call_osmux.py: using BVCI 30673 18:27:57.375886 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:27:57.387646 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:27:57.399104 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:27:57.410612 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:27:57.422121 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:27:57.433614 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:27:57.553660 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:27:57.669959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:27:58.142910 run create_hlr_db(pid=12446): Launched 18:27:58.261867 bus /sierra_2: Setting Powered False 18:27:59.322548 run create_hlr_db(pid=12446): Terminated: ok {rc=0} 18:27:59.768463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12448): Launched 18:28:00.097420 run osmo-hlr_10.42.42.2(pid=12449): Launched 18:28:00.222678 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:00.785691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12451): Launched 18:28:01.143399 run osmo-stp_10.42.42.5(pid=12452): Launched 18:28:01.364878 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:02.083459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12454): Launched 18:28:02.407597 run osmo-msc_10.42.42.6(pid=12455): Launched 18:28:02.582075 run osmo-stp_10.42.42.5(pid=12452): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12452)] 18:28:02.713288 run osmo-stp_10.42.42.5(pid=12452): stdout: | (launched: 2022-12-12_18:28:01.084032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:02.841709 run osmo-stp_10.42.42.5(pid=12452): stderr: | [0;m[38;5;43m20221212182801423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182801423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182801423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182801424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182801424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182801424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182801425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:02.968496 run osmo-stp_10.42.42.5(pid=12452): stdout: | (launched: 2022-12-12_18:28:01.084032) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:03.089749 run osmo-stp_10.42.42.5(pid=12452): stderr: | [0;m[38;5;43m20221212182801423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182801423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182801423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182801424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182801424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182801424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182801425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:03.235495 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12452): Process ended prematurely: osmo-stp_10.42.42.5(pid=12452) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12452)] [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:28:03.244576 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:28:03.272058 run osmo-hlr_10.42.42.2(pid=12449): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12449)] 18:28:03.321474 run osmo-hlr_10.42.42.2(pid=12449): stdout: | (launched: 2022-12-12_18:28:00.036784) 18:28:03.372108 run osmo-hlr_10.42.42.2(pid=12449): stderr: | [0;m[1;31m20221212182800238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182800238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182800238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182800238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182800238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182800238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182800251 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182800261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182800261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182800262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:03.442247 run osmo-msc_10.42.42.6(pid=12455): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12455)] 18:28:03.491128 run osmo-msc_10.42.42.6(pid=12455): stdout: | (launched: 2022-12-12_18:28:02.350219) 18:28:03.541558 run osmo-msc_10.42.42.6(pid=12455): stderr: | [0;m[38;5;43m20221212182802621 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182802621 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4cd7b01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182802621 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182802621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182802621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182802621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182802623 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182802624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182802624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182802624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:03.592450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12448): Terminating (SIGTERM) 18:28:03.633089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12451): Terminating (SIGTERM) 18:28:03.673675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12454): Terminating (SIGTERM) 18:28:03.714812 --- ParallelTerminationStrategy: PID 12448 died... 18:28:03.734068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12448): Terminated: ok {rc=0} 18:28:03.779883 --- ParallelTerminationStrategy: PID 12451 died... 18:28:03.798678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12451): Terminated: ok {rc=0} 18:28:03.844150 --- ParallelTerminationStrategy: PID 12454 died... 18:28:03.863152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12454): Terminated: ok {rc=0} 18:28:03.951529 bus /sierra_3: Setting Powered False 18:28:05.052308 bus /sierra_3: Setting Powered False 18:28:06.170514 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:28:07.427557 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:28:07.434923 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:28:07.469344 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:28:07.497030 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:28:07.550704 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:28:07.585364 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:28:07.613440 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:28:08.164855 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:28:08.217610 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:28:08.229459 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:28:08.304536 tst mo_mt_call.py: using LAC 30673 18:28:08.430421 tst mo_mt_call.py: using RAC 73 18:28:08.555480 tst mo_mt_call.py: using CellId 30673 18:28:08.680927 tst mo_mt_call.py: using BVCI 30674 18:28:08.798211 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:28:08.810012 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:28:08.821567 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:28:08.833103 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:28:08.844715 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:28:08.856313 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:28:08.972533 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:28:09.089112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:09.559391 run create_hlr_db(pid=12460): Launched 18:28:09.678617 bus /sierra_2: Setting Powered False 18:28:10.739389 run create_hlr_db(pid=12460): Terminated: ok {rc=0} 18:28:11.185296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12462): Launched 18:28:11.513281 run osmo-hlr_10.42.42.2(pid=12463): Launched 18:28:11.639712 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:12.205562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12465): Launched 18:28:12.531874 run osmo-stp_10.42.42.5(pid=12466): Launched 18:28:12.658018 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:13.246394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12468): Launched 18:28:13.574258 run osmo-msc_10.42.42.6(pid=12469): Launched 18:28:13.755544 run osmo-stp_10.42.42.5(pid=12466): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12466)] 18:28:13.891078 run osmo-stp_10.42.42.5(pid=12466): stdout: | (launched: 2022-12-12_18:28:12.471374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:14.028895 run osmo-stp_10.42.42.5(pid=12466): stderr: | [0;m[38;5;43m20221212182812664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182812664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182812664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182812664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182812665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182812665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182812665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:14.164653 run osmo-stp_10.42.42.5(pid=12466): stdout: | (launched: 2022-12-12_18:28:12.471374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:14.293937 run osmo-stp_10.42.42.5(pid=12466): stderr: | [0;m[38;5;43m20221212182812664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182812664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182812664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182812664 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182812665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182812665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182812665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:14.449291 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12466): Process ended prematurely: osmo-stp_10.42.42.5(pid=12466) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12466)] [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:28:14.459212 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:28:14.487673 run osmo-hlr_10.42.42.2(pid=12463): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12463)] 18:28:14.538530 run osmo-hlr_10.42.42.2(pid=12463): stdout: | (launched: 2022-12-12_18:28:11.452565) 18:28:14.591162 run osmo-hlr_10.42.42.2(pid=12463): stderr: | [0;m[1;31m20221212182811652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182811652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182811652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182811652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182811652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182811653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182811666 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182811674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182811674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182811674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:14.664301 run osmo-msc_10.42.42.6(pid=12469): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12469)] 18:28:14.715136 run osmo-msc_10.42.42.6(pid=12469): stdout: | (launched: 2022-12-12_18:28:13.513482) 18:28:14.767226 run osmo-msc_10.42.42.6(pid=12469): stderr: | [0;m[38;5;43m20221212182813838 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182813838 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa7740cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182813838 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182813838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182813838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182813839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182813840 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182813841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182813841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182813841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:14.819868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12462): Terminating (SIGTERM) 18:28:14.861755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12465): Terminating (SIGTERM) 18:28:14.903601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12468): Terminating (SIGTERM) 18:28:14.946033 --- ParallelTerminationStrategy: PID 12462 died... 18:28:14.966042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12462): Terminated: ok {rc=0} 18:28:15.012859 --- ParallelTerminationStrategy: PID 12465 died... 18:28:15.032655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12465): Terminated: ok {rc=0} 18:28:15.079429 --- ParallelTerminationStrategy: PID 12468 died... 18:28:15.099250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12468): Terminated: ok {rc=0} 18:28:15.189202 bus /sierra_3: Setting Powered False 18:28:16.288017 bus /sierra_3: Setting Powered False 18:28:17.409909 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:28:18.561207 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:28:18.573892 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:28:18.646398 tst mo_mt_call_osmux.py: using LAC 30674 18:28:18.775541 tst mo_mt_call_osmux.py: using RAC 74 18:28:18.903290 tst mo_mt_call_osmux.py: using CellId 30674 18:28:19.033439 tst mo_mt_call_osmux.py: using BVCI 30675 18:28:19.152388 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:28:19.164078 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:28:19.175542 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:28:19.187140 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:28:19.198845 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:28:19.210468 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:28:19.328858 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:28:19.446062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:19.918887 run create_hlr_db(pid=12471): Launched 18:28:20.037641 bus /sierra_2: Setting Powered False 18:28:21.098028 run create_hlr_db(pid=12471): Terminated: ok {rc=0} 18:28:21.524329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12473): Launched 18:28:21.831655 run osmo-hlr_10.42.42.2(pid=12474): Launched 18:28:21.950525 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:22.489576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12476): Launched 18:28:22.794909 run osmo-stp_10.42.42.5(pid=12477): Launched 18:28:22.912692 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:23.462025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12479): Launched 18:28:23.767748 run osmo-msc_10.42.42.6(pid=12480): Launched 18:28:23.940264 run osmo-stp_10.42.42.5(pid=12477): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12477)] 18:28:24.069165 run osmo-stp_10.42.42.5(pid=12477): stdout: | (launched: 2022-12-12_18:28:22.737692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:24.197263 run osmo-stp_10.42.42.5(pid=12477): stderr: | [0;m[38;5;43m20221212182822909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182822910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182822910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182822910 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182822911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182822911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182822911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:24.323970 run osmo-stp_10.42.42.5(pid=12477): stdout: | (launched: 2022-12-12_18:28:22.737692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:24.445524 run osmo-stp_10.42.42.5(pid=12477): stderr: | [0;m[38;5;43m20221212182822909 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182822910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182822910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182822910 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182822911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182822911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182822911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:24.590682 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12477): Process ended prematurely: osmo-stp_10.42.42.5(pid=12477) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12477)] [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:28:24.599945 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:28:24.627527 run osmo-hlr_10.42.42.2(pid=12474): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12474)] 18:28:24.676641 run osmo-hlr_10.42.42.2(pid=12474): stdout: | (launched: 2022-12-12_18:28:21.774445) 18:28:24.726772 run osmo-hlr_10.42.42.2(pid=12474): stderr: | [0;m[1;31m20221212182821951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182821951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182821952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182821952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182821952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182821952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182821964 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182821972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182821972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182821972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:24.796222 run osmo-msc_10.42.42.6(pid=12480): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12480)] 18:28:24.844115 run osmo-msc_10.42.42.6(pid=12480): stdout: | (launched: 2022-12-12_18:28:23.710446) 18:28:24.893473 run osmo-msc_10.42.42.6(pid=12480): stderr: | [0;m[38;5;43m20221212182823984 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182823984 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e7e3f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182823985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182823985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182823985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182823985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182823987 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182823987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182823987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182823987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:24.943322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12473): Terminating (SIGTERM) 18:28:24.983249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12476): Terminating (SIGTERM) 18:28:25.023230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12479): Terminating (SIGTERM) 18:28:25.063655 --- ParallelTerminationStrategy: PID 12473 died... 18:28:25.082878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12473): Terminated: ok {rc=0} 18:28:25.127842 --- ParallelTerminationStrategy: PID 12476 died... 18:28:25.146640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12476): Terminated: ok {rc=0} 18:28:25.190844 --- ParallelTerminationStrategy: PID 12479 died... 18:28:25.209580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12479): Terminated: ok {rc=0} 18:28:25.295986 bus /sierra_3: Setting Powered False 18:28:26.396416 bus /sierra_3: Setting Powered False 18:28:27.512885 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:28:28.768810 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:28:28.775444 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:28:28.809604 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:28:28.836327 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:28:28.891616 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:28:28.925594 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:28:28.952291 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:28:29.498876 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:28:29.548130 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:28:29.559837 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:28:29.634578 tst mo_mt_call.py: using LAC 30675 18:28:29.754764 tst mo_mt_call.py: using RAC 75 18:28:29.875610 tst mo_mt_call.py: using CellId 30675 18:28:29.992624 tst mo_mt_call.py: using BVCI 30676 18:28:30.103205 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:28:30.114331 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:28:30.125261 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:28:30.136480 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:28:30.147939 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:28:30.159257 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:28:30.279936 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:28:30.396493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:30.884724 run create_hlr_db(pid=12485): Launched 18:28:31.056028 bus /sierra_2: Setting Powered False 18:28:32.123914 run create_hlr_db(pid=12485): Terminated: ok {rc=0} 18:28:32.562029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12487): Launched 18:28:32.869789 run osmo-hlr_10.42.42.2(pid=12488): Launched 18:28:32.986639 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:33.511293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12490): Launched 18:28:33.817265 run osmo-stp_10.42.42.5(pid=12491): Launched 18:28:33.933879 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:34.485463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12493): Launched 18:28:34.791543 run osmo-msc_10.42.42.6(pid=12494): Launched 18:28:34.964481 run osmo-stp_10.42.42.5(pid=12491): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12491)] 18:28:35.093457 run osmo-stp_10.42.42.5(pid=12491): stdout: | (launched: 2022-12-12_18:28:33.760054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:35.222395 run osmo-stp_10.42.42.5(pid=12491): stderr: | [0;m[38;5;43m20221212182833930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182833930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182833930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182833931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182833931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182833931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182833931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:35.348935 run osmo-stp_10.42.42.5(pid=12491): stdout: | (launched: 2022-12-12_18:28:33.760054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:35.469880 run osmo-stp_10.42.42.5(pid=12491): stderr: | [0;m[38;5;43m20221212182833930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182833930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182833930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182833931 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182833931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182833931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182833931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:35.614709 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12491): Process ended prematurely: osmo-stp_10.42.42.5(pid=12491) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12491)] [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:28:35.623854 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:28:35.651113 run osmo-hlr_10.42.42.2(pid=12488): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12488)] 18:28:35.699347 run osmo-hlr_10.42.42.2(pid=12488): stdout: | (launched: 2022-12-12_18:28:32.812512) 18:28:35.749399 run osmo-hlr_10.42.42.2(pid=12488): stderr: | [0;m[1;31m20221212182832991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182832991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182832991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182832991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182832991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182832991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182833002 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182833011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182833011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182833011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:35.818945 run osmo-msc_10.42.42.6(pid=12494): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12494)] 18:28:35.867198 run osmo-msc_10.42.42.6(pid=12494): stdout: | (launched: 2022-12-12_18:28:34.734109) 18:28:35.917241 run osmo-msc_10.42.42.6(pid=12494): stderr: | [0;m[38;5;43m20221212182835007 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182835007 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6a146cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182835007 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182835007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182835007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182835007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182835009 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182835010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182835010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182835010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:35.967396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12487): Terminating (SIGTERM) 18:28:36.007535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12490): Terminating (SIGTERM) 18:28:36.047864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12493): Terminating (SIGTERM) 18:28:36.088340 --- ParallelTerminationStrategy: PID 12487 died... 18:28:36.107875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12487): Terminated: ok {rc=0} 18:28:36.153267 --- ParallelTerminationStrategy: PID 12490 died... 18:28:36.171774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12490): Terminated: ok {rc=0} 18:28:36.216115 --- ParallelTerminationStrategy: PID 12493 died... 18:28:36.234775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12493): Terminated: ok {rc=0} 18:28:36.321166 bus /sierra_3: Setting Powered False 18:28:37.421242 bus /sierra_3: Setting Powered False 18:28:38.537340 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:28:39.684221 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:28:39.696377 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:28:39.770078 tst mo_mt_call_osmux.py: using LAC 30676 18:28:39.899151 tst mo_mt_call_osmux.py: using RAC 76 18:28:40.020159 tst mo_mt_call_osmux.py: using CellId 30676 18:28:40.140722 tst mo_mt_call_osmux.py: using BVCI 30677 18:28:40.252274 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:28:40.263425 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:28:40.274402 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:28:40.285630 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:28:40.296778 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:28:40.307938 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:28:40.424260 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:28:40.544856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:41.049403 run create_hlr_db(pid=12496): Launched 18:28:41.182841 bus /sierra_2: Setting Powered False 18:28:42.247060 run create_hlr_db(pid=12496): Terminated: ok {rc=0} 18:28:42.683247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12498): Launched 18:28:42.990371 run osmo-hlr_10.42.42.2(pid=12499): Launched 18:28:43.106461 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:43.642384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12501): Launched 18:28:43.947886 run osmo-stp_10.42.42.5(pid=12502): Launched 18:28:44.065549 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:44.614939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12504): Launched 18:28:44.921527 run osmo-msc_10.42.42.6(pid=12505): Launched 18:28:45.091616 run osmo-stp_10.42.42.5(pid=12502): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12502)] 18:28:45.220297 run osmo-stp_10.42.42.5(pid=12502): stdout: | (launched: 2022-12-12_18:28:43.890904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:45.348367 run osmo-stp_10.42.42.5(pid=12502): stderr: | [0;m[38;5;43m20221212182844060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182844060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182844061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182844061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182844062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182844062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182844062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:45.474326 run osmo-stp_10.42.42.5(pid=12502): stdout: | (launched: 2022-12-12_18:28:43.890904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:45.595129 run osmo-stp_10.42.42.5(pid=12502): stderr: | [0;m[38;5;43m20221212182844060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182844060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182844061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182844061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182844062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182844062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182844062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:45.739593 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12502): Process ended prematurely: osmo-stp_10.42.42.5(pid=12502) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12502)] [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:28:45.748660 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:28:45.775633 run osmo-hlr_10.42.42.2(pid=12499): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12499)] 18:28:45.824046 run osmo-hlr_10.42.42.2(pid=12499): stdout: | (launched: 2022-12-12_18:28:42.933311) 18:28:45.886330 run osmo-hlr_10.42.42.2(pid=12499): stderr: | [0;m[1;31m20221212182843110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182843110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182843110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182843110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182843110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182843110 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182843122 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182843133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182843133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182843133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:45.978785 run osmo-msc_10.42.42.6(pid=12505): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12505)] 18:28:46.031181 run osmo-msc_10.42.42.6(pid=12505): stdout: | (launched: 2022-12-12_18:28:44.864209) 18:28:46.085611 run osmo-msc_10.42.42.6(pid=12505): stderr: | [0;m[38;5;43m20221212182845136 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182845136 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb8485e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182845136 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182845136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182845136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182845137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182845138 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182845139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182845139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182845139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:46.141674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12498): Terminating (SIGTERM) 18:28:46.186220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12501): Terminating (SIGTERM) 18:28:46.232317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12504): Terminating (SIGTERM) 18:28:46.279171 --- ParallelTerminationStrategy: PID 12498 died... 18:28:46.300592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12498): Terminated: ok {rc=0} 18:28:46.351331 --- ParallelTerminationStrategy: PID 12501 died... 18:28:46.372277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12501): Terminated: ok {rc=0} 18:28:46.419759 --- ParallelTerminationStrategy: PID 12504 died... 18:28:46.440365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12504): Terminated: ok {rc=0} 18:28:46.535968 bus /sierra_3: Setting Powered False 18:28:47.634031 bus /sierra_3: Setting Powered False 18:28:48.751028 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:28:50.007071 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:28:50.014771 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:28:50.049064 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:28:50.076612 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:28:50.129558 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:28:50.163773 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:28:50.191342 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:28:50.744186 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:28:50.796452 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:28:50.808268 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:28:50.880328 tst mo_mt_call.py: using LAC 30677 18:28:51.007536 tst mo_mt_call.py: using RAC 77 18:28:51.134607 tst mo_mt_call.py: using CellId 30677 18:28:51.263256 tst mo_mt_call.py: using BVCI 30678 18:28:51.381156 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:28:51.392932 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:28:51.404558 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:28:51.416181 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:28:51.427879 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:28:51.439606 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:28:51.559843 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:28:51.676128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:28:52.149666 run create_hlr_db(pid=12510): Launched 18:28:52.269538 bus /sierra_2: Setting Powered False 18:28:53.330283 run create_hlr_db(pid=12510): Terminated: ok {rc=0} 18:28:53.776705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12512): Launched 18:28:54.105629 run osmo-hlr_10.42.42.2(pid=12513): Launched 18:28:54.229926 run osmo-stp_10.42.42.5: Starting osmo-stp 18:28:54.788655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12515): Launched 18:28:55.115109 run osmo-stp_10.42.42.5(pid=12516): Launched 18:28:55.239347 run osmo-msc_10.42.42.6: Starting osmo-msc 18:28:55.826552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12518): Launched 18:28:56.153514 run osmo-msc_10.42.42.6(pid=12519): Launched 18:28:56.336937 run osmo-stp_10.42.42.5(pid=12516): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12516)] 18:28:56.473326 run osmo-stp_10.42.42.5(pid=12516): stdout: | (launched: 2022-12-12_18:28:55.054667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:56.609647 run osmo-stp_10.42.42.5(pid=12516): stderr: | [0;m[38;5;43m20221212182855249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182855249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182855250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182855250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182855251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182855251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182855251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:56.745227 run osmo-stp_10.42.42.5(pid=12516): stdout: | (launched: 2022-12-12_18:28:55.054667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:28:56.873906 run osmo-stp_10.42.42.5(pid=12516): stderr: | [0;m[38;5;43m20221212182855249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182855249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182855250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182855250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182855251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182855251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182855251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:28:57.028539 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12516): Process ended prematurely: osmo-stp_10.42.42.5(pid=12516) [trial-2380↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12516)] [trial-2380↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:28:57.038339 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:28:57.066362 run osmo-hlr_10.42.42.2(pid=12513): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12513)] 18:28:57.116712 run osmo-hlr_10.42.42.2(pid=12513): stdout: | (launched: 2022-12-12_18:28:54.044901) 18:28:57.168359 run osmo-hlr_10.42.42.2(pid=12513): stderr: | [0;m[1;31m20221212182854244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182854244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182854244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182854244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182854244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182854245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182854256 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182854264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182854265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182854265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:28:57.240566 run osmo-msc_10.42.42.6(pid=12519): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12519)] 18:28:57.290787 run osmo-msc_10.42.42.6(pid=12519): stdout: | (launched: 2022-12-12_18:28:56.092664) 18:28:57.342961 run osmo-msc_10.42.42.6(pid=12519): stderr: | [0;m[38;5;43m20221212182856416 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182856417 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe9a778bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182856417 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182856417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182856417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182856417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182856419 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182856419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182856419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182856419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:28:57.394959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12512): Terminating (SIGTERM) 18:28:57.436622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12515): Terminating (SIGTERM) 18:28:57.478393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12518): Terminating (SIGTERM) 18:28:57.520336 --- ParallelTerminationStrategy: PID 12512 died... 18:28:57.540480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12512): Terminated: ok {rc=0} 18:28:57.587279 --- ParallelTerminationStrategy: PID 12515 died... 18:28:57.606743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12515): Terminated: ok {rc=0} 18:28:57.652651 --- ParallelTerminationStrategy: PID 12518 died... 18:28:57.672247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12518): Terminated: ok {rc=0} 18:28:57.760669 bus /sierra_3: Setting Powered False 18:28:58.861020 bus /sierra_3: Setting Powered False 18:28:59.979855 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:29:01.132630 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:29:01.146561 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:29:01.222002 tst mo_mt_call_osmux.py: using LAC 30678 18:29:01.369375 tst mo_mt_call_osmux.py: using RAC 78 18:29:01.524588 tst mo_mt_call_osmux.py: using CellId 30678 18:29:01.648529 tst mo_mt_call_osmux.py: using BVCI 30679 18:29:01.770174 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:29:01.782613 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:29:01.795176 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:29:01.807397 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:29:01.819745 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:29:01.831879 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:29:01.955235 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:29:02.103862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:02.583451 run create_hlr_db(pid=12521): Launched 18:29:02.704700 bus /sierra_2: Setting Powered False 18:29:03.766459 run create_hlr_db(pid=12521): Terminated: ok {rc=0} 18:29:04.192069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12523): Launched 18:29:04.501420 run osmo-hlr_10.42.42.2(pid=12524): Launched 18:29:04.618386 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:05.156858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12526): Launched 18:29:05.464223 run osmo-stp_10.42.42.5(pid=12527): Launched 18:29:05.580908 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:06.137800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12529): Launched 18:29:06.446016 run osmo-msc_10.42.42.6(pid=12530): Launched 18:29:06.618615 run osmo-stp_10.42.42.5(pid=12527): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12527)] 18:29:06.747995 run osmo-stp_10.42.42.5(pid=12527): stdout: | (launched: 2022-12-12_18:29:05.407066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:06.877141 run osmo-stp_10.42.42.5(pid=12527): stderr: | [0;m[38;5;43m20221212182905579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182905579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182905580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182905580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182905580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182905581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182905581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:07.003775 run osmo-stp_10.42.42.5(pid=12527): stdout: | (launched: 2022-12-12_18:29:05.407066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:07.125077 run osmo-stp_10.42.42.5(pid=12527): stderr: | [0;m[38;5;43m20221212182905579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182905579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182905580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182905580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182905580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182905581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182905581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:07.270247 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12527): Process ended prematurely: osmo-stp_10.42.42.5(pid=12527) [trial-2380↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12527)] [trial-2380↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:29:07.279392 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 18:29:07.306489 run osmo-hlr_10.42.42.2(pid=12524): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12524)] 18:29:07.354823 run osmo-hlr_10.42.42.2(pid=12524): stdout: | (launched: 2022-12-12_18:29:04.443812) 18:29:07.404450 run osmo-hlr_10.42.42.2(pid=12524): stderr: | [0;m[1;31m20221212182904623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182904623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182904623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182904623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182904623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182904623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182904636 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182904644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182904645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182904645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:07.473680 run osmo-msc_10.42.42.6(pid=12530): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12530)] 18:29:07.521793 run osmo-msc_10.42.42.6(pid=12530): stdout: | (launched: 2022-12-12_18:29:06.388497) 18:29:07.571693 run osmo-msc_10.42.42.6(pid=12530): stderr: | [0;m[38;5;43m20221212182906663 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182906663 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0f65a44c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182906663 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182906663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182906663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182906664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182906665 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182906666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182906666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182906666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:07.621689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12523): Terminating (SIGTERM) 18:29:07.661733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12526): Terminating (SIGTERM) 18:29:07.702052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12529): Terminating (SIGTERM) 18:29:07.742523 --- ParallelTerminationStrategy: PID 12523 died... 18:29:07.761445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12523): Terminated: ok {rc=0} 18:29:07.806200 --- ParallelTerminationStrategy: PID 12526 died... 18:29:07.824841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12526): Terminated: ok {rc=0} 18:29:07.869520 --- ParallelTerminationStrategy: PID 12529 died... 18:29:07.888115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12529): Terminated: ok {rc=0} 18:29:07.972535 bus /sierra_3: Setting Powered False 18:29:09.068722 bus /sierra_3: Setting Powered False 18:29:10.184992 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:29:11.441598 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:11.447956 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:29:11.482199 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:29:11.509672 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:29:11.564130 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:29:11.599158 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:29:11.627122 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:29:12.175012 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:29:12.227358 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:29:12.239017 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:29:12.311196 tst mo_mt_call.py: using LAC 30679 18:29:12.439496 tst mo_mt_call.py: using RAC 79 18:29:12.565294 tst mo_mt_call.py: using CellId 30679 18:29:12.691412 tst mo_mt_call.py: using BVCI 30680 18:29:12.808476 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:29:12.819884 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:29:12.831055 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:29:12.842277 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:29:12.853468 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:29:12.864656 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:29:12.981579 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:29:13.099306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:13.571482 run create_hlr_db(pid=12535): Launched 18:29:13.691323 bus /sierra_2: Setting Powered False 18:29:14.751773 run create_hlr_db(pid=12535): Terminated: ok {rc=0} 18:29:15.198234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12537): Launched 18:29:15.526377 run osmo-hlr_10.42.42.2(pid=12538): Launched 18:29:15.652758 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:16.254159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12540): Launched 18:29:16.597416 run osmo-stp_10.42.42.5(pid=12541): Launched 18:29:16.848680 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:17.515647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12543): Launched 18:29:17.841843 run osmo-msc_10.42.42.6(pid=12544): Launched 18:29:18.023264 run osmo-stp_10.42.42.5(pid=12541): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12541)] 18:29:18.159000 run osmo-stp_10.42.42.5(pid=12541): stdout: | (launched: 2022-12-12_18:29:16.536205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:18.295789 run osmo-stp_10.42.42.5(pid=12541): stderr: | [0;m[38;5;43m20221212182916834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182916834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182916834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182916834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182916835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182916835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182916835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:18.431673 run osmo-stp_10.42.42.5(pid=12541): stdout: | (launched: 2022-12-12_18:29:16.536205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:18.561567 run osmo-stp_10.42.42.5(pid=12541): stderr: | [0;m[38;5;43m20221212182916834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182916834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182916834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182916834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182916835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182916835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182916835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:18.716141 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12541): Process ended prematurely: osmo-stp_10.42.42.5(pid=12541) [trial-2380↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12541)] [trial-2380↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:29:18.726102 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 18:29:18.754260 run osmo-hlr_10.42.42.2(pid=12538): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12538)] 18:29:18.804574 run osmo-hlr_10.42.42.2(pid=12538): stdout: | (launched: 2022-12-12_18:29:15.465761) 18:29:18.856219 run osmo-hlr_10.42.42.2(pid=12538): stderr: | [0;m[1;31m20221212182915663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182915663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182915663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182915663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182915663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182915663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182915675 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182915684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182915684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182915684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:18.928328 run osmo-msc_10.42.42.6(pid=12544): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12544)] 18:29:18.978655 run osmo-msc_10.42.42.6(pid=12544): stdout: | (launched: 2022-12-12_18:29:17.781369) 18:29:19.030493 run osmo-msc_10.42.42.6(pid=12544): stderr: | [0;m[38;5;43m20221212182918106 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182918106 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbe36e94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182918106 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182918106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182918106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182918106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182918108 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182918109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182918109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182918109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:19.082522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12537): Terminating (SIGTERM) 18:29:19.124165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12540): Terminating (SIGTERM) 18:29:19.166216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12543): Terminating (SIGTERM) 18:29:19.207996 --- ParallelTerminationStrategy: PID 12537 died... 18:29:19.228082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12537): Terminated: ok {rc=0} 18:29:19.275060 --- ParallelTerminationStrategy: PID 12540 died... 18:29:19.294524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12540): Terminated: ok {rc=0} 18:29:19.340600 --- ParallelTerminationStrategy: PID 12543 died... 18:29:19.360259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12543): Terminated: ok {rc=0} 18:29:19.449045 bus /sierra_3: Setting Powered False 18:29:20.550015 bus /sierra_3: Setting Powered False 18:29:21.667177 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:29:22.816572 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:29:22.828903 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:29:22.902172 tst mo_mt_call_osmux.py: using LAC 30680 18:29:23.031526 tst mo_mt_call_osmux.py: using RAC 80 18:29:23.160286 tst mo_mt_call_osmux.py: using CellId 30680 18:29:23.288612 tst mo_mt_call_osmux.py: using BVCI 30681 18:29:23.406507 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:29:23.417937 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:29:23.429150 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:29:23.440474 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:29:23.451731 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:29:23.463015 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:29:23.580238 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:29:23.702417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:24.208261 run create_hlr_db(pid=12546): Launched 18:29:24.342578 bus /sierra_2: Setting Powered False 18:29:25.407424 run create_hlr_db(pid=12546): Terminated: ok {rc=0} 18:29:25.862792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12548): Launched 18:29:26.191498 run osmo-hlr_10.42.42.2(pid=12549): Launched 18:29:26.317204 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:26.880680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12551): Launched 18:29:27.208160 run osmo-stp_10.42.42.5(pid=12552): Launched 18:29:27.332880 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:27.927636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12554): Launched 18:29:28.256262 run osmo-msc_10.42.42.6(pid=12555): Launched 18:29:28.439361 run osmo-stp_10.42.42.5(pid=12552): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12552)] 18:29:28.576670 run osmo-stp_10.42.42.5(pid=12552): stdout: | (launched: 2022-12-12_18:29:27.147528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:28.713623 run osmo-stp_10.42.42.5(pid=12552): stderr: | [0;m[38;5;43m20221212182927341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182927341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182927341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182927342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182927342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182927342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182927342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:28.849241 run osmo-stp_10.42.42.5(pid=12552): stdout: | (launched: 2022-12-12_18:29:27.147528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:28.978958 run osmo-stp_10.42.42.5(pid=12552): stderr: | [0;m[38;5;43m20221212182927341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182927341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182927341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182927342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182927342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182927342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182927342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:29.134820 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12552): Process ended prematurely: osmo-stp_10.42.42.5(pid=12552) [trial-2380↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12552)] [trial-2380↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:29:29.144597 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:29:29.173043 run osmo-hlr_10.42.42.2(pid=12549): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12549)] 18:29:29.223894 run osmo-hlr_10.42.42.2(pid=12549): stdout: | (launched: 2022-12-12_18:29:26.130998) 18:29:29.276270 run osmo-hlr_10.42.42.2(pid=12549): stderr: | [0;m[1;31m20221212182926331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182926331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182926331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182926331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182926331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182926331 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182926344 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182926352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182926352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182926353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:29.349301 run osmo-msc_10.42.42.6(pid=12555): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12555)] 18:29:29.399898 run osmo-msc_10.42.42.6(pid=12555): stdout: | (launched: 2022-12-12_18:29:28.195603) 18:29:29.452181 run osmo-msc_10.42.42.6(pid=12555): stderr: | [0;m[38;5;43m20221212182928519 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182928520 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1319416c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182928520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182928520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182928520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182928520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182928522 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182928523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182928523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182928523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:29.504595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12548): Terminating (SIGTERM) 18:29:29.546978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12551): Terminating (SIGTERM) 18:29:29.589592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12554): Terminating (SIGTERM) 18:29:29.632291 --- ParallelTerminationStrategy: PID 12548 died... 18:29:29.652582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12548): Terminated: ok {rc=0} 18:29:29.699457 --- ParallelTerminationStrategy: PID 12551 died... 18:29:29.719357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12551): Terminated: ok {rc=0} 18:29:29.765773 --- ParallelTerminationStrategy: PID 12554 died... 18:29:29.785501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12554): Terminated: ok {rc=0} 18:29:29.873783 bus /sierra_3: Setting Powered False 18:29:30.985256 bus /sierra_3: Setting Powered False 18:29:32.103067 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 emergency:trx-lms --------------------------------------------------------------------- 18:29:33.349762 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:33.354473 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 18:29:33.387907 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 18:29:33.414387 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 18:29:33.499952 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 18:29:33.533077 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 18:29:33.560002 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 18:29:34.142378 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2380 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 18:29:34.147379 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 18:29:34.158154 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 18:29:34.206908 tst emergency_mo_mt_call.py: using LAC 30681 18:29:34.324280 tst emergency_mo_mt_call.py: using RAC 81 18:29:34.443748 tst emergency_mo_mt_call.py: using CellId 30681 18:29:34.560743 tst emergency_mo_mt_call.py: using BVCI 30682 18:29:34.678816 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 18:29:34.690268 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 18:29:34.701522 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 18:29:34.712847 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 18:29:34.725288 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 18:29:34.736513 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 18:29:34.855764 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 18:29:34.974478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:35.440936 run create_hlr_db(pid=12564): Launched 18:29:35.556155 bus /sierra_2: Setting Powered False 18:29:36.617123 run create_hlr_db(pid=12564): Terminated: ok {rc=0} 18:29:37.056338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12566): Launched 18:29:37.379094 run osmo-hlr_10.42.42.2(pid=12567): Launched 18:29:37.503290 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:38.054576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12569): Launched 18:29:38.375536 run osmo-stp_10.42.42.5(pid=12570): Launched 18:29:38.508130 tst emergency_mo_mt_call.py: using MSISDN 7905 18:29:38.671569 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:39.247520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12572): Launched 18:29:39.567979 run osmo-msc_10.42.42.6(pid=12573): Launched 18:29:39.746390 run osmo-stp_10.42.42.5(pid=12570): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12570)] 18:29:39.880088 run osmo-stp_10.42.42.5(pid=12570): stdout: | (launched: 2022-12-12_18:29:38.315814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:40.015437 run osmo-stp_10.42.42.5(pid=12570): stderr: | [0;m[38;5;43m20221212182938508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182938509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182938509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182938509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182938510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182938510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182938510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:40.149693 run osmo-stp_10.42.42.5(pid=12570): stdout: | (launched: 2022-12-12_18:29:38.315814) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:40.276354 run osmo-stp_10.42.42.5(pid=12570): stderr: | [0;m[38;5;43m20221212182938508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182938509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182938509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182938509 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182938510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182938510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182938510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:40.428000 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12570): Process ended prematurely: osmo-stp_10.42.42.5(pid=12570) [trial-2380↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12570)] [trial-2380↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 18:29:40.437468 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 18:29:40.465194 run osmo-hlr_10.42.42.2(pid=12567): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12567)] 18:29:40.515476 run osmo-hlr_10.42.42.2(pid=12567): stdout: | (launched: 2022-12-12_18:29:37.319155) 18:29:40.567388 run osmo-hlr_10.42.42.2(pid=12567): stderr: | [0;m[1;31m20221212182937518 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182937519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182937519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182937519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182937519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182937519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182937531 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182937539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182937540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182937540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:40.639787 run osmo-msc_10.42.42.6(pid=12573): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12573)] 18:29:40.689910 run osmo-msc_10.42.42.6(pid=12573): stdout: | (launched: 2022-12-12_18:29:39.507542) 18:29:40.741602 run osmo-msc_10.42.42.6(pid=12573): stderr: | [0;m[38;5;43m20221212182939831 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182939831 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc90f6e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182939831 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182939831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182939831 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182939832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182939833 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182939834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182939834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182939834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:40.793587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12566): Terminating (SIGTERM) 18:29:40.835349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12569): Terminating (SIGTERM) 18:29:40.877020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12572): Terminating (SIGTERM) 18:29:40.919264 --- ParallelTerminationStrategy: PID 12566 died... 18:29:40.939314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12566): Terminated: ok {rc=0} 18:29:40.985930 --- ParallelTerminationStrategy: PID 12569 died... 18:29:41.005679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12569): Terminated: ok {rc=0} 18:29:41.051872 --- ParallelTerminationStrategy: PID 12572 died... 18:29:41.071534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12572): Terminated: ok {rc=0} 18:29:41.158820 bus /sierra_3: Setting Powered False 18:29:42.257947 bus /sierra_3: Setting Powered False 18:29:43.375165 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 18:29:44.463068 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 18:29:44.474669 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 18:29:44.537990 tst emergency_preemptive_call.py: using LAC 30682 18:29:44.654996 tst emergency_preemptive_call.py: using RAC 82 18:29:44.775211 tst emergency_preemptive_call.py: using CellId 30682 18:29:44.893162 tst emergency_preemptive_call.py: using BVCI 30683 18:29:45.010136 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 18:29:45.021571 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 18:29:45.032926 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 18:29:45.044524 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 18:29:45.055802 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 18:29:45.066952 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 18:29:45.184350 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 18:29:45.300719 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 18:29:45.420584 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 18:29:45.536807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:29:46.026903 run create_hlr_db(pid=12575): Launched 18:29:46.189053 bus /sierra_2: Setting Powered False 18:29:47.249100 run create_hlr_db(pid=12575): Terminated: ok {rc=0} 18:29:47.701696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12577): Launched 18:29:48.025085 run osmo-hlr_10.42.42.2(pid=12578): Launched 18:29:48.149082 run osmo-stp_10.42.42.5: Starting osmo-stp 18:29:48.703957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12580): Launched 18:29:49.026850 run osmo-stp_10.42.42.5(pid=12581): Launched 18:29:49.159966 tst emergency_preemptive_call.py: using MSISDN 7906 18:29:49.322264 run osmo-msc_10.42.42.6: Starting osmo-msc 18:29:49.896912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12583): Launched 18:29:50.219072 run osmo-msc_10.42.42.6(pid=12584): Launched 18:29:50.399007 run osmo-stp_10.42.42.5(pid=12581): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12581)] 18:29:50.533272 run osmo-stp_10.42.42.5(pid=12581): stdout: | (launched: 2022-12-12_18:29:48.966055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:50.667910 run osmo-stp_10.42.42.5(pid=12581): stderr: | [0;m[38;5;43m20221212182949161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182949161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182949161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182949162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182949162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182949162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182949162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:50.802596 run osmo-stp_10.42.42.5(pid=12581): stdout: | (launched: 2022-12-12_18:29:48.966055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:29:50.929332 run osmo-stp_10.42.42.5(pid=12581): stderr: | [0;m[38;5;43m20221212182949161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212182949161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212182949161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212182949162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212182949162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212182949162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212182949162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:29:51.081538 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12581): Process ended prematurely: osmo-stp_10.42.42.5(pid=12581) [trial-2380↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12581)] [trial-2380↪emergency:trx-lms↪emergency_preemptive_call.py:32] 18:29:51.090625 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 18:29:51.118506 run osmo-hlr_10.42.42.2(pid=12578): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12578)] 18:29:51.168923 run osmo-hlr_10.42.42.2(pid=12578): stdout: | (launched: 2022-12-12_18:29:47.964567) 18:29:51.221240 run osmo-hlr_10.42.42.2(pid=12578): stderr: | [0;m[1;31m20221212182948165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212182948165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212182948165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212182948165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212182948165 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212182948166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212182948178 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212182948186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212182948186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212182948186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:29:51.294057 run osmo-msc_10.42.42.6(pid=12584): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12584)] 18:29:51.344899 run osmo-msc_10.42.42.6(pid=12584): stdout: | (launched: 2022-12-12_18:29:50.159475) 18:29:51.397192 run osmo-msc_10.42.42.6(pid=12584): stderr: | [0;m[38;5;43m20221212182950480 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212182950480 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8abaaf6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212182950481 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212182950481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212182950481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212182950481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212182950483 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212182950483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212182950483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212182950483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:29:51.449593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12577): Terminating (SIGTERM) 18:29:51.491709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12580): Terminating (SIGTERM) 18:29:51.533964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12583): Terminating (SIGTERM) 18:29:51.576112 --- ParallelTerminationStrategy: PID 12577 died... 18:29:51.596341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12577): Terminated: ok {rc=0} 18:29:51.642783 --- ParallelTerminationStrategy: PID 12580 died... 18:29:51.662609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12580): Terminated: ok {rc=0} 18:29:51.709273 --- ParallelTerminationStrategy: PID 12583 died... 18:29:51.729132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12583): Terminated: ok {rc=0} 18:29:51.818522 bus /sierra_9: Setting Powered False 18:29:52.919287 bus /sierra_9: Setting Powered False 18:29:54.037343 bus /sierra_8: Setting Powered False 18:29:55.140119 bus /sierra_8: Setting Powered False 18:29:56.257447 bus /sierra_3: Setting Powered False 18:29:57.357286 bus /sierra_3: Setting Powered False 18:29:58.477180 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-lms --------------------------------------------------------------------- 18:29:59.753050 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:29:59.757405 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 18:29:59.790649 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 18:29:59.829229 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 18:29:59.916202 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 18:29:59.949355 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 18:29:59.987950 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 18:30:00.576748 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 18:30:00.627303 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:00.637908 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 18:30:00.691372 tst cs_paging_gprs_active.py: using LAC 30683 18:30:00.810046 tst cs_paging_gprs_active.py: using RAC 83 18:30:00.946985 tst cs_paging_gprs_active.py: using CellId 30683 18:30:01.080736 tst cs_paging_gprs_active.py: using BVCI 30684 18:30:01.194730 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:01.206633 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:01.218212 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:01.230963 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:01.243679 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:01.256247 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:01.269147 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:01.281663 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:01.294124 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 18:30:01.434812 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 18:30:01.582559 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:30:01.836705 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:30:02.216115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12598): Launched 18:30:02.560479 run iperf3-srv_10.42.42.10(pid=12602): Launched 18:30:02.708374 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:30:02.915283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:30:03.222999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12603): Launched 18:30:03.491413 run iperf3-srv_10.42.42.10(pid=12604): Launched 18:30:03.607597 tst cs_paging_gprs_active.py:38: start network... 18:30:03.810615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:04.282213 run create_hlr_db(pid=12605): Launched 18:30:04.403055 bus /sierra_2: Setting Powered False 18:30:05.463807 run create_hlr_db(pid=12605): Terminated: ok {rc=0} 18:30:05.889114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12607): Launched 18:30:06.197454 run osmo-hlr_10.42.42.2(pid=12608): Launched 18:30:06.315601 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:06.843827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12610): Launched 18:30:07.153109 run osmo-stp_10.42.42.5(pid=12611): Launched 18:30:07.270512 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:30:07.798173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12613): Launched 18:30:07.916693 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:30:08.174870 run patchelf(pid=12614): Launched 18:30:08.346460 run osmo-stp_10.42.42.5(pid=12611): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12611)] 18:30:08.474868 run osmo-stp_10.42.42.5(pid=12611): stdout: | (launched: 2022-12-12_18:30:07.095502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:08.604873 run osmo-stp_10.42.42.5(pid=12611): stderr: | [0;m[38;5;43m20221212183007266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183007266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183007266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183007267 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183007267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183007267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183007267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:08.734772 run osmo-stp_10.42.42.5(pid=12611): stdout: | (launched: 2022-12-12_18:30:07.095502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:08.859505 run osmo-stp_10.42.42.5(pid=12611): stderr: | [0;m[38;5;43m20221212183007266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183007266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183007266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183007267 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183007267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183007267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183007267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:09.007237 run patchelf(pid=12614): Terminating (SIGINT) 18:30:09.177137 run patchelf(pid=12614): Terminated: ok {rc=0} 18:30:09.299805 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12611): Process ended prematurely: osmo-stp_10.42.42.5(pid=12611) [trial-2380↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12611)] [trial-2380↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 18:30:09.309583 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:30:09.337284 run osmo-hlr_10.42.42.2(pid=12608): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12608)] 18:30:09.385589 run osmo-hlr_10.42.42.2(pid=12608): stdout: | (launched: 2022-12-12_18:30:06.139869) 18:30:09.435321 run osmo-hlr_10.42.42.2(pid=12608): stderr: | [0;m[1;31m20221212183006316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183006316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183006316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183006316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183006316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183006316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183006329 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183006338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183006338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183006338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:09.485798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12598): Terminating (SIGTERM) 18:30:09.526440 run iperf3-srv_10.42.42.10(pid=12602): Terminating (SIGTERM) 18:30:09.566814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12603): Terminating (SIGTERM) 18:30:09.607381 run iperf3-srv_10.42.42.10(pid=12604): Terminating (SIGTERM) 18:30:09.647708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12607): Terminating (SIGTERM) 18:30:09.688103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12610): Terminating (SIGTERM) 18:30:09.728342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12613): Terminating (SIGTERM) 18:30:09.769065 --- ParallelTerminationStrategy: PID 12598 died... 18:30:09.788447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12598): Terminated: ok {rc=0} 18:30:09.833742 --- ParallelTerminationStrategy: PID 12602 died... 18:30:09.852547 run iperf3-srv_10.42.42.10(pid=12602): Terminated {rc=256} 18:30:09.897278 --- ParallelTerminationStrategy: PID 12603 died... 18:30:09.915831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12603): Terminated: ok {rc=0} 18:30:09.961108 --- ParallelTerminationStrategy: PID 12604 died... 18:30:09.980237 run iperf3-srv_10.42.42.10(pid=12604): Terminated {rc=256} 18:30:10.024205 --- ParallelTerminationStrategy: PID 12607 died... 18:30:10.042687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12607): Terminated: ok {rc=0} 18:30:10.086632 --- ParallelTerminationStrategy: PID 12610 died... 18:30:10.105175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12610): Terminated: ok {rc=0} 18:30:10.149725 --- ParallelTerminationStrategy: PID 12613 died... 18:30:10.168216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12613): Terminated: ok {rc=0} 18:30:10.251993 bus /gobi_0: Setting Powered False 18:30:11.348388 bus /gobi_0: Setting Powered False 18:30:12.464885 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms iperf3.py ---------------------------------------------- 18:30:13.632630 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:13.645523 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 18:30:13.699198 tst iperf3.py: using LAC 30684 18:30:13.825422 tst iperf3.py: using RAC 84 18:30:13.949452 tst iperf3.py: using CellId 30684 18:30:14.072814 tst iperf3.py: using BVCI 30685 18:30:14.192308 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:14.204086 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:14.215586 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:14.226958 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:14.238286 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:14.249598 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:14.260931 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:14.272214 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:14.283633 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 18:30:14.402561 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:30:14.622391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:30:14.944340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12966): Launched 18:30:15.225634 run iperf3-srv_10.42.42.10(pid=12967): Launched 18:30:15.346978 tst iperf3.py:8: start network... 18:30:15.561231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:16.074842 run create_hlr_db(pid=12968): Launched 18:30:16.235127 bus /gobi_6: Setting Powered False 18:30:17.298439 run create_hlr_db(pid=12968): Terminated: ok {rc=0} 18:30:17.726130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12970): Launched 18:30:18.026172 run osmo-hlr_10.42.42.2(pid=12971): Launched 18:30:18.139832 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:18.651861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12973): Launched 18:30:18.949953 run osmo-stp_10.42.42.5(pid=12974): Launched 18:30:19.063326 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:30:19.573899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12976): Launched 18:30:19.688095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:30:19.939851 run patchelf(pid=12977): Launched 18:30:20.105703 run osmo-stp_10.42.42.5(pid=12974): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12974)] 18:30:20.231721 run osmo-stp_10.42.42.5(pid=12974): stdout: | (launched: 2022-12-12_18:30:18.893653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:20.358955 run osmo-stp_10.42.42.5(pid=12974): stderr: | [0;m[38;5;43m20221212183019064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183019064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183019064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183019065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183019065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183019065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183019065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:20.486468 run osmo-stp_10.42.42.5(pid=12974): stdout: | (launched: 2022-12-12_18:30:18.893653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:20.608024 run osmo-stp_10.42.42.5(pid=12974): stderr: | [0;m[38;5;43m20221212183019064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183019064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183019064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183019065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183019065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183019065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183019065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:20.752123 run patchelf(pid=12977): Terminating (SIGINT) 18:30:20.918624 run patchelf(pid=12977): Terminated: ok {rc=0} 18:30:21.039347 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12974): Process ended prematurely: osmo-stp_10.42.42.5(pid=12974) [trial-2380↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12974)] [trial-2380↪gprs:trx-lms↪iperf3.py:8] 18:30:21.048743 tst iperf3.py:8: Test FAILED (7.5 sec) 18:30:21.076412 run osmo-hlr_10.42.42.2(pid=12971): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12971)] 18:30:21.124130 run osmo-hlr_10.42.42.2(pid=12971): stdout: | (launched: 2022-12-12_18:30:17.970190) 18:30:21.173525 run osmo-hlr_10.42.42.2(pid=12971): stderr: | [0;m[1;31m20221212183018141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183018141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183018141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183018141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183018141 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183018142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183018154 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183018163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183018163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183018164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:21.223332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12966): Terminating (SIGTERM) 18:30:21.262969 run iperf3-srv_10.42.42.10(pid=12967): Terminating (SIGTERM) 18:30:21.302491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12970): Terminating (SIGTERM) 18:30:21.342176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12973): Terminating (SIGTERM) 18:30:21.381860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12976): Terminating (SIGTERM) 18:30:21.421775 --- ParallelTerminationStrategy: PID 12966 died... 18:30:21.440706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12966): Terminated: ok {rc=0} 18:30:21.484719 --- ParallelTerminationStrategy: PID 12967 died... 18:30:21.503130 run iperf3-srv_10.42.42.10(pid=12967): Terminated {rc=256} 18:30:21.546765 --- ParallelTerminationStrategy: PID 12970 died... 18:30:21.565223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12970): Terminated: ok {rc=0} 18:30:21.609270 --- ParallelTerminationStrategy: PID 12973 died... 18:30:21.627703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12973): Terminated: ok {rc=0} 18:30:21.671660 --- ParallelTerminationStrategy: PID 12976 died... 18:30:21.690063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12976): Terminated: ok {rc=0} 18:30:21.772808 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms iperf3m4.py ---------------------------------------------- 18:30:22.920935 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:22.932748 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 18:30:22.986765 tst iperf3m4.py: using LAC 30685 18:30:23.112592 tst iperf3m4.py: using RAC 85 18:30:23.242616 tst iperf3m4.py: using CellId 30685 18:30:23.367503 tst iperf3m4.py: using BVCI 30686 18:30:23.483754 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:23.495465 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:23.507127 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:23.520924 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:23.534560 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:23.546039 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:23.560005 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:23.572798 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:23.584535 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 18:30:23.708152 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 18:30:23.833982 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 18:30:23.954853 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 18:30:24.073983 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:30:24.288538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:30:24.624228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13153): Launched 18:30:24.921591 run iperf3-srv_10.42.42.10(pid=13154): Launched 18:30:25.052906 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:30:25.260365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:30:25.572018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13155): Launched 18:30:25.868715 run iperf3-srv_10.42.42.10(pid=13156): Launched 18:30:26.005385 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:30:26.225289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:30:26.557606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13157): Launched 18:30:26.856677 run iperf3-srv_10.42.42.10(pid=13158): Launched 18:30:26.994185 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:30:27.216876 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:30:27.549278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13159): Launched 18:30:27.848573 run iperf3-srv_10.42.42.10(pid=13160): Launched 18:30:27.985556 tst iperf3m4.py:8: start network... 18:30:28.207571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:28.727574 run create_hlr_db(pid=13161): Launched 18:30:28.893361 bus /gobi_6: Setting Powered False 18:30:29.957299 run create_hlr_db(pid=13161): Terminated: ok {rc=0} 18:30:30.401523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13164): Launched 18:30:30.709901 run osmo-hlr_10.42.42.2(pid=13165): Launched 18:30:30.836288 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:31.485533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13167): Launched 18:30:31.810181 run osmo-stp_10.42.42.5(pid=13168): Launched 18:30:31.971444 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:30:32.698783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13170): Launched 18:30:32.816578 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:30:33.075584 run patchelf(pid=13171): Launched 18:30:33.247060 run osmo-stp_10.42.42.5(pid=13168): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13168)] 18:30:33.375523 run osmo-stp_10.42.42.5(pid=13168): stdout: | (launched: 2022-12-12_18:30:31.751068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:33.505607 run osmo-stp_10.42.42.5(pid=13168): stderr: | [0;m[38;5;43m20221212183032118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183032118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183032118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183032119 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183032120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183032120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183032120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:33.635913 run osmo-stp_10.42.42.5(pid=13168): stdout: | (launched: 2022-12-12_18:30:31.751068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:33.760220 run osmo-stp_10.42.42.5(pid=13168): stderr: | [0;m[38;5;43m20221212183032118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183032118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183032118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183032119 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183032120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183032120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183032120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:33.907658 run patchelf(pid=13171): Terminating (SIGINT) 18:30:34.078838 run patchelf(pid=13171): Terminated: ok {rc=0} 18:30:34.201869 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13168): Process ended prematurely: osmo-stp_10.42.42.5(pid=13168) [trial-2380↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13168)] [trial-2380↪gprs:trx-lms↪iperf3m4.py:8] 18:30:34.211540 tst iperf3m4.py:8: Test FAILED (11.3 sec) 18:30:34.239624 run osmo-hlr_10.42.42.2(pid=13165): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13165)] 18:30:34.288285 run osmo-hlr_10.42.42.2(pid=13165): stdout: | (launched: 2022-12-12_18:30:30.652007) 18:30:34.338052 run osmo-hlr_10.42.42.2(pid=13165): stderr: | [0;m[1;31m20221212183030831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183030831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183030831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183030831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183030831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183030831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183030847 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183030855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183030855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183030855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:34.388056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13153): Terminating (SIGTERM) 18:30:34.428004 run iperf3-srv_10.42.42.10(pid=13154): Terminating (SIGTERM) 18:30:34.467832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13155): Terminating (SIGTERM) 18:30:34.507422 run iperf3-srv_10.42.42.10(pid=13156): Terminating (SIGTERM) 18:30:34.547637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13157): Terminating (SIGTERM) 18:30:34.587627 run iperf3-srv_10.42.42.10(pid=13158): Terminating (SIGTERM) 18:30:34.627508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13159): Terminating (SIGTERM) 18:30:34.667253 run iperf3-srv_10.42.42.10(pid=13160): Terminating (SIGTERM) 18:30:34.707011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13164): Terminating (SIGTERM) 18:30:34.746942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13167): Terminating (SIGTERM) 18:30:34.786827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13170): Terminating (SIGTERM) 18:30:34.827093 --- ParallelTerminationStrategy: PID 13153 died... 18:30:34.846371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13153): Terminated: ok {rc=0} 18:30:34.891704 --- ParallelTerminationStrategy: PID 13154 died... 18:30:34.910374 run iperf3-srv_10.42.42.10(pid=13154): Terminated {rc=256} 18:30:34.954375 --- ParallelTerminationStrategy: PID 13155 died... 18:30:34.972923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13155): Terminated: ok {rc=0} 18:30:35.017249 --- ParallelTerminationStrategy: PID 13156 died... 18:30:35.035896 run iperf3-srv_10.42.42.10(pid=13156): Terminated {rc=256} 18:30:35.080754 --- ParallelTerminationStrategy: PID 13157 died... 18:30:35.099434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13157): Terminated: ok {rc=0} 18:30:35.143554 --- ParallelTerminationStrategy: PID 13158 died... 18:30:35.161982 run iperf3-srv_10.42.42.10(pid=13158): Terminated {rc=256} 18:30:35.206575 --- ParallelTerminationStrategy: PID 13159 died... 18:30:35.225266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13159): Terminated: ok {rc=0} 18:30:35.269693 --- ParallelTerminationStrategy: PID 13160 died... 18:30:35.288032 run iperf3-srv_10.42.42.10(pid=13160): Terminated {rc=256} 18:30:35.332716 --- ParallelTerminationStrategy: PID 13164 died... 18:30:35.351496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13164): Terminated: ok {rc=0} 18:30:35.395571 --- ParallelTerminationStrategy: PID 13167 died... 18:30:35.414196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13167): Terminated: ok {rc=0} 18:30:35.459056 --- ParallelTerminationStrategy: PID 13170 died... 18:30:35.477695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13170): Terminated: ok {rc=0} 18:30:35.563749 bus /gobi_4: Setting Powered False 18:30:36.664292 bus /gobi_4: Setting Powered False 18:30:37.779193 bus /gobi_1: Setting Powered False 18:30:38.878134 bus /gobi_1: Setting Powered False 18:30:39.993109 bus /gobi_0: Setting Powered False 18:30:41.092198 bus /gobi_0: Setting Powered False 18:30:42.207286 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms ping.py ---------------------------------------------- 18:30:43.310082 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:43.321911 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 18:30:43.372859 tst ping.py: using LAC 30686 18:30:43.490506 tst ping.py: using RAC 86 18:30:43.609388 tst ping.py: using CellId 30686 18:30:43.726594 tst ping.py: using BVCI 30687 18:30:43.836190 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:43.846836 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:43.857384 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:43.868082 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:43.878897 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:43.889637 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:43.900323 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:43.911093 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 18:30:44.031159 tst ping.py:19: start network... 18:30:44.246533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:44.746595 run create_hlr_db(pid=13172): Launched 18:30:44.878729 bus /gobi_6: Setting Powered False 18:30:45.947163 run create_hlr_db(pid=13172): Terminated: ok {rc=0} 18:30:46.445292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13174): Launched 18:30:46.784070 run osmo-hlr_10.42.42.2(pid=13175): Launched 18:30:46.933997 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:47.664524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13177): Launched 18:30:47.985272 run osmo-stp_10.42.42.5(pid=13178): Launched 18:30:48.108853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:30:48.658993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13180): Launched 18:30:48.780895 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:30:49.052171 run patchelf(pid=13181): Launched 18:30:49.231947 run osmo-stp_10.42.42.5(pid=13178): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13178)] 18:30:49.366521 run osmo-stp_10.42.42.5(pid=13178): stdout: | (launched: 2022-12-12_18:30:47.925050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:49.502858 run osmo-stp_10.42.42.5(pid=13178): stderr: | [0;m[38;5;43m20221212183048119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183048120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183048120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183048121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183048121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183048121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183048121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:49.639291 run osmo-stp_10.42.42.5(pid=13178): stdout: | (launched: 2022-12-12_18:30:47.925050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:49.769835 run osmo-stp_10.42.42.5(pid=13178): stderr: | [0;m[38;5;43m20221212183048119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183048120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183048120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183048121 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183048121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183048121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183048121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:49.925031 run patchelf(pid=13181): Terminating (SIGINT) 18:30:50.103303 run patchelf(pid=13181): Terminated: ok {rc=0} 18:30:50.231890 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13178): Process ended prematurely: osmo-stp_10.42.42.5(pid=13178) [trial-2380↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13178)] [trial-2380↪gprs:trx-lms↪ping.py:22] 18:30:50.241695 tst ping.py:22: Test FAILED (6.9 sec) 18:30:50.269969 run osmo-hlr_10.42.42.2(pid=13175): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13175)] 18:30:50.319899 run osmo-hlr_10.42.42.2(pid=13175): stdout: | (launched: 2022-12-12_18:30:46.722800) 18:30:50.371441 run osmo-hlr_10.42.42.2(pid=13175): stderr: | [0;m[1;31m20221212183047115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183047115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183047115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183047115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183047115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183047115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183047136 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183047163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183047164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183047164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:50.423685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13174): Terminating (SIGTERM) 18:30:50.465243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13177): Terminating (SIGTERM) 18:30:50.507037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13180): Terminating (SIGTERM) 18:30:50.549119 --- ParallelTerminationStrategy: PID 13174 died... 18:30:50.569158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13174): Terminated: ok {rc=0} 18:30:50.615285 --- ParallelTerminationStrategy: PID 13177 died... 18:30:50.634852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13177): Terminated: ok {rc=0} 18:30:50.681079 --- ParallelTerminationStrategy: PID 13180 died... 18:30:50.700691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13180): Terminated: ok {rc=0} 18:30:50.790247 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 18:30:51.879313 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:51.891817 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 18:30:51.944520 tst ping_idle_ping.py: using LAC 30687 18:30:52.072199 tst ping_idle_ping.py: using RAC 87 18:30:52.198830 tst ping_idle_ping.py: using CellId 30687 18:30:52.323257 tst ping_idle_ping.py: using BVCI 30688 18:30:52.433884 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:52.444875 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:52.456065 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:52.467759 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:52.479243 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:52.490747 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:52.502338 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 18:30:52.513909 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 18:30:52.634296 tst ping_idle_ping.py:24: start network... 18:30:52.849731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:30:53.349994 run create_hlr_db(pid=13182): Launched 18:30:53.482512 bus /gobi_6: Setting Powered False 18:30:54.558146 run create_hlr_db(pid=13182): Terminated: ok {rc=0} 18:30:54.984797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13184): Launched 18:30:55.285553 run osmo-hlr_10.42.42.2(pid=13185): Launched 18:30:55.400449 run osmo-stp_10.42.42.5: Starting osmo-stp 18:30:55.925345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13187): Launched 18:30:56.224604 run osmo-stp_10.42.42.5(pid=13188): Launched 18:30:56.338604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:30:56.853049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13190): Launched 18:30:56.966697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:30:57.218662 run patchelf(pid=13191): Launched 18:30:57.386715 run osmo-stp_10.42.42.5(pid=13188): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13188)] 18:30:57.513120 run osmo-stp_10.42.42.5(pid=13188): stdout: | (launched: 2022-12-12_18:30:56.169400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:57.641768 run osmo-stp_10.42.42.5(pid=13188): stderr: | [0;m[38;5;43m20221212183056336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183056336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183056336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183056337 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183056337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183056338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183056338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:57.769754 run osmo-stp_10.42.42.5(pid=13188): stdout: | (launched: 2022-12-12_18:30:56.169400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:30:57.892123 run osmo-stp_10.42.42.5(pid=13188): stderr: | [0;m[38;5;43m20221212183056336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183056336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183056336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183056337 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183056337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183056338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183056338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:30:58.037176 run patchelf(pid=13191): Terminating (SIGINT) 18:30:58.204345 run patchelf(pid=13191): Terminated: ok {rc=0} 18:30:58.324469 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13188): Process ended prematurely: osmo-stp_10.42.42.5(pid=13188) [trial-2380↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13188)] [trial-2380↪gprs:trx-lms↪ping_idle_ping.py:27] 18:30:58.333588 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 18:30:58.360716 run osmo-hlr_10.42.42.2(pid=13185): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13185)] 18:30:58.408921 run osmo-hlr_10.42.42.2(pid=13185): stdout: | (launched: 2022-12-12_18:30:55.229823) 18:30:58.458617 run osmo-hlr_10.42.42.2(pid=13185): stderr: | [0;m[1;31m20221212183055403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183055403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183055403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183055403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183055403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183055403 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183055415 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183055423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183055423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183055423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:30:58.508643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13184): Terminating (SIGTERM) 18:30:58.548543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13187): Terminating (SIGTERM) 18:30:58.588504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13190): Terminating (SIGTERM) 18:30:58.629027 --- ParallelTerminationStrategy: PID 13184 died... 18:30:58.648116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13184): Terminated: ok {rc=0} 18:30:58.692491 --- ParallelTerminationStrategy: PID 13187 died... 18:30:58.711143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13187): Terminated: ok {rc=0} 18:30:58.755515 --- ParallelTerminationStrategy: PID 13190 died... 18:30:58.774091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13190): Terminated: ok {rc=0} 18:30:58.860263 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 18:31:00.159028 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:31:00.164373 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:31:00.198523 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:31:00.237214 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:31:00.325321 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:31:00.360277 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:31:00.400730 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:31:01.006538 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:31:01.062601 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:01.074506 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:31:01.126848 tst cs_paging_gprs_active.py: using LAC 30688 18:31:01.312247 tst cs_paging_gprs_active.py: using RAC 88 18:31:01.475400 tst cs_paging_gprs_active.py: using CellId 30688 18:31:01.597999 tst cs_paging_gprs_active.py: using BVCI 30689 18:31:01.715750 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:01.728680 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:01.741453 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:01.753408 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:01.766189 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:01.780282 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:01.793624 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:01.805599 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:01.818452 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:31:01.944630 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:31:02.094066 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:31:02.331893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:31:02.659659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13195): Launched 18:31:02.945230 run iperf3-srv_10.42.42.10(pid=13196): Launched 18:31:03.070710 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:31:03.290532 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:31:03.617539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13197): Launched 18:31:03.902686 run iperf3-srv_10.42.42.10(pid=13198): Launched 18:31:04.027016 tst cs_paging_gprs_active.py:38: start network... 18:31:04.246533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:04.750202 run create_hlr_db(pid=13199): Launched 18:31:04.881887 bus /gobi_6: Setting Powered False 18:31:05.946363 run create_hlr_db(pid=13199): Terminated: ok {rc=0} 18:31:06.379504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13201): Launched 18:31:06.684186 run osmo-hlr_10.42.42.2(pid=13202): Launched 18:31:06.800324 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:07.333752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13204): Launched 18:31:07.637247 run osmo-stp_10.42.42.5(pid=13205): Launched 18:31:07.753192 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:31:08.274974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13207): Launched 18:31:08.391536 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:31:08.648358 run patchelf(pid=13208): Launched 18:31:08.819792 run osmo-stp_10.42.42.5(pid=13205): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13205)] 18:31:08.947990 run osmo-stp_10.42.42.5(pid=13205): stdout: | (launched: 2022-12-12_18:31:07.581228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:09.078064 run osmo-stp_10.42.42.5(pid=13205): stderr: | [0;m[38;5;43m20221212183107748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183107748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183107749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183107749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183107749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183107750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183107750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:09.208564 run osmo-stp_10.42.42.5(pid=13205): stdout: | (launched: 2022-12-12_18:31:07.581228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:09.333108 run osmo-stp_10.42.42.5(pid=13205): stderr: | [0;m[38;5;43m20221212183107748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183107748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183107749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183107749 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183107749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183107750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183107750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:09.481114 run patchelf(pid=13208): Terminating (SIGINT) 18:31:09.651653 run patchelf(pid=13208): Terminated: ok {rc=0} 18:31:09.774464 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13205): Process ended prematurely: osmo-stp_10.42.42.5(pid=13205) [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13205)] [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:31:09.783996 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 18:31:09.811783 run osmo-hlr_10.42.42.2(pid=13202): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13202)] 18:31:09.859720 run osmo-hlr_10.42.42.2(pid=13202): stdout: | (launched: 2022-12-12_18:31:06.628083) 18:31:09.909256 run osmo-hlr_10.42.42.2(pid=13202): stderr: | [0;m[1;31m20221212183106802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183106802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183106802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183106802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183106802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183106803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183106818 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183106828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183106828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183106828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:09.959055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13195): Terminating (SIGTERM) 18:31:09.998925 run iperf3-srv_10.42.42.10(pid=13196): Terminating (SIGTERM) 18:31:10.038589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13197): Terminating (SIGTERM) 18:31:10.078393 run iperf3-srv_10.42.42.10(pid=13198): Terminating (SIGTERM) 18:31:10.117951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13201): Terminating (SIGTERM) 18:31:10.157481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13204): Terminating (SIGTERM) 18:31:10.197174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13207): Terminating (SIGTERM) 18:31:10.237020 --- ParallelTerminationStrategy: PID 13195 died... 18:31:10.256100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13195): Terminated: ok {rc=0} 18:31:10.300513 --- ParallelTerminationStrategy: PID 13196 died... 18:31:10.319129 run iperf3-srv_10.42.42.10(pid=13196): Terminated {rc=256} 18:31:10.363188 --- ParallelTerminationStrategy: PID 13197 died... 18:31:10.381777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13197): Terminated: ok {rc=0} 18:31:10.425723 --- ParallelTerminationStrategy: PID 13198 died... 18:31:10.444257 run iperf3-srv_10.42.42.10(pid=13198): Terminated {rc=256} 18:31:10.488269 --- ParallelTerminationStrategy: PID 13201 died... 18:31:10.506801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13201): Terminated: ok {rc=0} 18:31:10.551169 --- ParallelTerminationStrategy: PID 13204 died... 18:31:10.570013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13204): Terminated: ok {rc=0} 18:31:10.614901 --- ParallelTerminationStrategy: PID 13207 died... 18:31:10.633716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13207): Terminated: ok {rc=0} 18:31:10.720393 bus /gobi_0: Setting Powered False 18:31:11.819520 bus /gobi_0: Setting Powered False 18:31:12.935527 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:31:14.083020 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:14.094896 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:31:14.146947 tst iperf3.py: using LAC 30689 18:31:14.267976 tst iperf3.py: using RAC 89 18:31:14.394908 tst iperf3.py: using CellId 30689 18:31:14.514463 tst iperf3.py: using BVCI 30690 18:31:14.627541 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:14.638540 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:14.649306 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:14.660901 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:14.672383 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:14.683728 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:14.695436 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:14.706883 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:14.718475 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:31:14.840255 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:31:15.061272 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:31:15.387463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13209): Launched 18:31:15.672446 run iperf3-srv_10.42.42.10(pid=13210): Launched 18:31:15.794686 tst iperf3.py:8: start network... 18:31:16.031362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:16.542457 run create_hlr_db(pid=13211): Launched 18:31:16.701946 bus /gobi_6: Setting Powered False 18:31:17.766317 run create_hlr_db(pid=13211): Terminated: ok {rc=0} 18:31:18.225019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13213): Launched 18:31:18.549652 run osmo-hlr_10.42.42.2(pid=13214): Launched 18:31:18.674503 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:19.232338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13216): Launched 18:31:19.558362 run osmo-stp_10.42.42.5(pid=13217): Launched 18:31:19.683216 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:31:20.240676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13219): Launched 18:31:20.365880 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:31:20.639528 run patchelf(pid=13220): Launched 18:31:20.821757 run osmo-stp_10.42.42.5(pid=13217): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13217)] 18:31:20.957848 run osmo-stp_10.42.42.5(pid=13217): stdout: | (launched: 2022-12-12_18:31:19.498852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:21.096358 run osmo-stp_10.42.42.5(pid=13217): stderr: | [0;m[38;5;43m20221212183119686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183119687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183119687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183119687 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183119688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183119688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183119688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:21.235052 run osmo-stp_10.42.42.5(pid=13217): stdout: | (launched: 2022-12-12_18:31:19.498852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:21.366909 run osmo-stp_10.42.42.5(pid=13217): stderr: | [0;m[38;5;43m20221212183119686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183119687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183119687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183119687 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183119688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183119688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183119688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:21.524045 run patchelf(pid=13220): Terminating (SIGINT) 18:31:21.704373 run patchelf(pid=13220): Terminated: ok {rc=0} 18:31:21.835243 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13217): Process ended prematurely: osmo-stp_10.42.42.5(pid=13217) [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13217)] [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 18:31:21.845749 tst iperf3.py:8: Test FAILED (7.8 sec) 18:31:21.874322 run osmo-hlr_10.42.42.2(pid=13214): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13214)] 18:31:21.925288 run osmo-hlr_10.42.42.2(pid=13214): stdout: | (launched: 2022-12-12_18:31:18.490227) 18:31:21.976842 run osmo-hlr_10.42.42.2(pid=13214): stderr: | [0;m[1;31m20221212183118684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183118684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183118684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183118685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183118685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183118685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183118697 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183118706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183118706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183118706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:22.029459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13209): Terminating (SIGTERM) 18:31:22.071450 run iperf3-srv_10.42.42.10(pid=13210): Terminating (SIGTERM) 18:31:22.113265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13213): Terminating (SIGTERM) 18:31:22.155117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13216): Terminating (SIGTERM) 18:31:22.196830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13219): Terminating (SIGTERM) 18:31:22.239369 --- ParallelTerminationStrategy: PID 13209 died... 18:31:22.259389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13209): Terminated: ok {rc=0} 18:31:22.305913 --- ParallelTerminationStrategy: PID 13210 died... 18:31:22.325715 run iperf3-srv_10.42.42.10(pid=13210): Terminated {rc=256} 18:31:22.371719 --- ParallelTerminationStrategy: PID 13213 died... 18:31:22.391207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13213): Terminated: ok {rc=0} 18:31:22.437098 --- ParallelTerminationStrategy: PID 13216 died... 18:31:22.456561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13216): Terminated: ok {rc=0} 18:31:22.502712 --- ParallelTerminationStrategy: PID 13219 died... 18:31:22.522298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13219): Terminated: ok {rc=0} 18:31:22.609429 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:31:23.757809 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:23.769659 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:31:23.821817 tst iperf3m4.py: using LAC 30690 18:31:23.943698 tst iperf3m4.py: using RAC 90 18:31:24.078580 tst iperf3m4.py: using CellId 30690 18:31:24.202796 tst iperf3m4.py: using BVCI 30691 18:31:24.314476 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:24.325618 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:24.336510 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:24.348331 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:24.359862 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:24.371457 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:24.383212 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:24.394661 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:24.406495 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:31:24.525385 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:31:24.646985 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:31:24.765591 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:31:24.884533 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:31:25.089399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:31:25.393934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13221): Launched 18:31:25.661204 run iperf3-srv_10.42.42.10(pid=13222): Launched 18:31:25.777105 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:31:25.979457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:31:26.283567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13223): Launched 18:31:26.548941 run iperf3-srv_10.42.42.10(pid=13224): Launched 18:31:26.663503 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:31:26.866480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:31:27.171044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13225): Launched 18:31:27.436004 run iperf3-srv_10.42.42.10(pid=13226): Launched 18:31:27.550605 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:31:27.752801 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:31:28.056850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13227): Launched 18:31:28.321332 run iperf3-srv_10.42.42.10(pid=13228): Launched 18:31:28.435694 tst iperf3m4.py:8: start network... 18:31:28.638131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:29.109069 run create_hlr_db(pid=13229): Launched 18:31:29.225264 bus /gobi_6: Setting Powered False 18:31:30.286100 run create_hlr_db(pid=13229): Terminated: ok {rc=0} 18:31:30.710857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13231): Launched 18:31:31.046174 run osmo-hlr_10.42.42.2(pid=13232): Launched 18:31:31.225376 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:31.993723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13234): Launched 18:31:32.342257 run osmo-stp_10.42.42.5(pid=13235): Launched 18:31:32.487128 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:31:33.050599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13237): Launched 18:31:33.174772 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:31:33.449602 run patchelf(pid=13238): Launched 18:31:33.630958 run osmo-stp_10.42.42.5(pid=13235): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13235)] 18:31:33.768214 run osmo-stp_10.42.42.5(pid=13235): stdout: | (launched: 2022-12-12_18:31:32.278723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:33.907337 run osmo-stp_10.42.42.5(pid=13235): stderr: | [0;m[38;5;43m20221212183132478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183132479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183132479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183132479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183132480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183132480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183132480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:34.046877 run osmo-stp_10.42.42.5(pid=13235): stdout: | (launched: 2022-12-12_18:31:32.278723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:34.179779 run osmo-stp_10.42.42.5(pid=13235): stderr: | [0;m[38;5;43m20221212183132478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183132479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183132479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183132479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183132480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183132480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183132480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:34.337806 run patchelf(pid=13238): Terminating (SIGINT) 18:31:34.519378 run patchelf(pid=13238): Terminated: ok {rc=0} 18:31:34.650058 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13235): Process ended prematurely: osmo-stp_10.42.42.5(pid=13235) [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13235)] [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 18:31:34.660347 tst iperf3m4.py:8: Test FAILED (10.9 sec) 18:31:34.689486 run osmo-hlr_10.42.42.2(pid=13232): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13232)] 18:31:34.739720 run osmo-hlr_10.42.42.2(pid=13232): stdout: | (launched: 2022-12-12_18:31:30.988240) 18:31:34.791537 run osmo-hlr_10.42.42.2(pid=13232): stderr: | [0;m[1;31m20221212183131337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183131337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183131337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183131337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183131337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183131337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183131351 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183131371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183131372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183131372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:34.843764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13221): Terminating (SIGTERM) 18:31:34.885653 run iperf3-srv_10.42.42.10(pid=13222): Terminating (SIGTERM) 18:31:34.927535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13223): Terminating (SIGTERM) 18:31:34.969440 run iperf3-srv_10.42.42.10(pid=13224): Terminating (SIGTERM) 18:31:35.011093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13225): Terminating (SIGTERM) 18:31:35.053238 run iperf3-srv_10.42.42.10(pid=13226): Terminating (SIGTERM) 18:31:35.095002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13227): Terminating (SIGTERM) 18:31:35.136878 run iperf3-srv_10.42.42.10(pid=13228): Terminating (SIGTERM) 18:31:35.179228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13231): Terminating (SIGTERM) 18:31:35.223199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13234): Terminating (SIGTERM) 18:31:35.264013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13237): Terminating (SIGTERM) 18:31:35.305248 --- ParallelTerminationStrategy: PID 13221 died... 18:31:35.324404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13221): Terminated: ok {rc=0} 18:31:35.370140 --- ParallelTerminationStrategy: PID 13222 died... 18:31:35.388620 run iperf3-srv_10.42.42.10(pid=13222): Terminated {rc=256} 18:31:35.433942 --- ParallelTerminationStrategy: PID 13223 died... 18:31:35.452618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13223): Terminated: ok {rc=0} 18:31:35.498652 --- ParallelTerminationStrategy: PID 13224 died... 18:31:35.517214 run iperf3-srv_10.42.42.10(pid=13224): Terminated {rc=256} 18:31:35.562994 --- ParallelTerminationStrategy: PID 13225 died... 18:31:35.581934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13225): Terminated: ok {rc=0} 18:31:35.627553 --- ParallelTerminationStrategy: PID 13226 died... 18:31:35.646318 run iperf3-srv_10.42.42.10(pid=13226): Terminated {rc=256} 18:31:35.691450 --- ParallelTerminationStrategy: PID 13227 died... 18:31:35.709956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13227): Terminated: ok {rc=0} 18:31:35.755458 --- ParallelTerminationStrategy: PID 13228 died... 18:31:35.774167 run iperf3-srv_10.42.42.10(pid=13228): Terminated {rc=256} 18:31:35.819310 --- ParallelTerminationStrategy: PID 13231 died... 18:31:35.837924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13231): Terminated: ok {rc=0} 18:31:35.883286 --- ParallelTerminationStrategy: PID 13234 died... 18:31:35.901813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13234): Terminated: ok {rc=0} 18:31:35.947481 --- ParallelTerminationStrategy: PID 13237 died... 18:31:35.966300 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13237): Terminated: ok {rc=0} 18:31:36.053161 bus /gobi_4: Setting Powered False 18:31:37.156612 bus /gobi_4: Setting Powered False 18:31:38.273947 bus /gobi_1: Setting Powered False 18:31:39.374447 bus /gobi_1: Setting Powered False 18:31:40.491402 bus /gobi_0: Setting Powered False 18:31:41.588632 bus /gobi_0: Setting Powered False 18:31:42.705166 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 18:31:43.808659 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:43.820374 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:31:43.871710 tst ping.py: using LAC 30691 18:31:43.990258 tst ping.py: using RAC 91 18:31:44.106752 tst ping.py: using CellId 30691 18:31:44.225390 tst ping.py: using BVCI 30692 18:31:44.333379 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:44.344481 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:44.355213 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:44.366335 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:44.376835 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:44.388027 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:44.399152 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:44.410147 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:31:44.525460 tst ping.py:19: start network... 18:31:44.724770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:45.186286 run create_hlr_db(pid=13239): Launched 18:31:45.302807 bus /gobi_6: Setting Powered False 18:31:46.377388 run create_hlr_db(pid=13239): Terminated: ok {rc=0} 18:31:46.867070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13241): Launched 18:31:47.203858 run osmo-hlr_10.42.42.2(pid=13242): Launched 18:31:47.326805 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:47.882265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13244): Launched 18:31:48.202822 run osmo-stp_10.42.42.5(pid=13245): Launched 18:31:48.323507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:31:48.874029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13247): Launched 18:31:48.998228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:31:49.269487 run patchelf(pid=13248): Launched 18:31:49.449390 run osmo-stp_10.42.42.5(pid=13245): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13245)] 18:31:49.584221 run osmo-stp_10.42.42.5(pid=13245): stdout: | (launched: 2022-12-12_18:31:48.144329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:49.721684 run osmo-stp_10.42.42.5(pid=13245): stderr: | [0;m[38;5;43m20221212183148330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183148330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183148330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183148331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183148331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183148331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183148331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:49.858666 run osmo-stp_10.42.42.5(pid=13245): stdout: | (launched: 2022-12-12_18:31:48.144329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:49.990346 run osmo-stp_10.42.42.5(pid=13245): stderr: | [0;m[38;5;43m20221212183148330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183148330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183148330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183148331 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183148331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183148331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183148331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:50.146413 run patchelf(pid=13248): Terminating (SIGINT) 18:31:50.324912 run patchelf(pid=13248): Terminated: ok {rc=0} 18:31:50.453929 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13245): Process ended prematurely: osmo-stp_10.42.42.5(pid=13245) [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13245)] [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 18:31:50.463745 tst ping.py:22: Test FAILED (6.6 sec) 18:31:50.492399 run osmo-hlr_10.42.42.2(pid=13242): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13242)] 18:31:50.542834 run osmo-hlr_10.42.42.2(pid=13242): stdout: | (launched: 2022-12-12_18:31:47.144488) 18:31:50.595358 run osmo-hlr_10.42.42.2(pid=13242): stderr: | [0;m[1;31m20221212183147336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183147336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183147336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183147336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183147336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183147336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183147349 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183147358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183147358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183147358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:50.647774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13241): Terminating (SIGTERM) 18:31:50.689884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13244): Terminating (SIGTERM) 18:31:50.732047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13247): Terminating (SIGTERM) 18:31:50.774717 --- ParallelTerminationStrategy: PID 13241 died... 18:31:50.794956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13241): Terminated: ok {rc=0} 18:31:50.841858 --- ParallelTerminationStrategy: PID 13244 died... 18:31:50.861634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13244): Terminated: ok {rc=0} 18:31:50.907971 --- ParallelTerminationStrategy: PID 13247 died... 18:31:50.927428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13247): Terminated: ok {rc=0} 18:31:51.015670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:31:52.104801 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:52.117838 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:31:52.172205 tst ping_idle_ping.py: using LAC 30692 18:31:52.298536 tst ping_idle_ping.py: using RAC 92 18:31:52.423744 tst ping_idle_ping.py: using CellId 30692 18:31:52.549257 tst ping_idle_ping.py: using BVCI 30693 18:31:52.658895 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:52.670268 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:52.681490 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:52.693351 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:52.704784 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:52.716329 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:52.727993 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:31:52.739533 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:31:52.858460 tst ping_idle_ping.py:24: start network... 18:31:53.058906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:31:53.523170 run create_hlr_db(pid=13249): Launched 18:31:53.639891 bus /gobi_6: Setting Powered False 18:31:54.699448 run create_hlr_db(pid=13249): Terminated: ok {rc=0} 18:31:55.138773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13251): Launched 18:31:55.460426 run osmo-hlr_10.42.42.2(pid=13252): Launched 18:31:55.584425 run osmo-stp_10.42.42.5: Starting osmo-stp 18:31:56.136305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13254): Launched 18:31:56.458370 run osmo-stp_10.42.42.5(pid=13255): Launched 18:31:56.582452 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:31:57.135131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13257): Launched 18:31:57.258562 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:31:57.528300 run patchelf(pid=13258): Launched 18:31:57.708026 run osmo-stp_10.42.42.5(pid=13255): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13255)] 18:31:57.843810 run osmo-stp_10.42.42.5(pid=13255): stdout: | (launched: 2022-12-12_18:31:56.399403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:57.980766 run osmo-stp_10.42.42.5(pid=13255): stderr: | [0;m[38;5;43m20221212183156587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183156587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183156587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183156588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183156588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183156588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183156588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:58.118395 run osmo-stp_10.42.42.5(pid=13255): stdout: | (launched: 2022-12-12_18:31:56.399403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:31:58.249127 run osmo-stp_10.42.42.5(pid=13255): stderr: | [0;m[38;5;43m20221212183156587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183156587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183156587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183156588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183156588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183156588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183156588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:31:58.403995 run patchelf(pid=13258): Terminating (SIGINT) 18:31:58.583189 run patchelf(pid=13258): Terminated: ok {rc=0} 18:31:58.711981 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13255): Process ended prematurely: osmo-stp_10.42.42.5(pid=13255) [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13255)] [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 18:31:58.721916 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:31:58.750415 run osmo-hlr_10.42.42.2(pid=13252): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13252)] 18:31:58.800388 run osmo-hlr_10.42.42.2(pid=13252): stdout: | (launched: 2022-12-12_18:31:55.401665) 18:31:58.852173 run osmo-hlr_10.42.42.2(pid=13252): stderr: | [0;m[1;31m20221212183155596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183155596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183155596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183155596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183155596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183155596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183155609 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183155618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183155618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183155618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:31:58.904319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13251): Terminating (SIGTERM) 18:31:58.946184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13254): Terminating (SIGTERM) 18:31:58.987961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13257): Terminating (SIGTERM) 18:31:59.030280 --- ParallelTerminationStrategy: PID 13251 died... 18:31:59.050537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13251): Terminated: ok {rc=0} 18:31:59.097392 --- ParallelTerminationStrategy: PID 13254 died... 18:31:59.117137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13254): Terminated: ok {rc=0} 18:31:59.163527 --- ParallelTerminationStrategy: PID 13257 died... 18:31:59.183304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13257): Terminated: ok {rc=0} 18:31:59.270957 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:32:00.580499 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:32:00.587241 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:32:00.621760 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:32:00.661562 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:32:00.751901 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:32:00.786143 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:32:00.825456 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:32:01.463200 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:32:01.517229 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:01.529450 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:32:01.601885 tst cs_paging_gprs_active.py: using LAC 30693 18:32:01.751565 tst cs_paging_gprs_active.py: using RAC 93 18:32:01.934856 tst cs_paging_gprs_active.py: using CellId 30693 18:32:02.095822 tst cs_paging_gprs_active.py: using BVCI 30694 18:32:02.218282 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:02.230560 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:02.242612 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:02.255090 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:02.268074 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:02.280498 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:02.293619 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:02.306817 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:02.319899 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:32:02.439523 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:32:02.556900 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:32:02.762379 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:32:03.068926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13262): Launched 18:32:03.335593 run iperf3-srv_10.42.42.10(pid=13263): Launched 18:32:03.450813 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:32:03.654436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:32:03.960718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13264): Launched 18:32:04.226632 run iperf3-srv_10.42.42.10(pid=13265): Launched 18:32:04.342821 tst cs_paging_gprs_active.py:38: start network... 18:32:04.546203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:05.016209 run create_hlr_db(pid=13266): Launched 18:32:05.133798 bus /gobi_6: Setting Powered False 18:32:06.195364 run create_hlr_db(pid=13266): Terminated: ok {rc=0} 18:32:06.640625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13268): Launched 18:32:06.967384 run osmo-hlr_10.42.42.2(pid=13269): Launched 18:32:07.092082 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:07.648155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13271): Launched 18:32:07.975400 run osmo-stp_10.42.42.5(pid=13272): Launched 18:32:08.102900 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:32:08.660582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13274): Launched 18:32:08.786264 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:32:09.068558 run patchelf(pid=13275): Launched 18:32:09.251074 run osmo-stp_10.42.42.5(pid=13272): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13272)] 18:32:09.388306 run osmo-stp_10.42.42.5(pid=13272): stdout: | (launched: 2022-12-12_18:32:07.915719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:09.526837 run osmo-stp_10.42.42.5(pid=13272): stderr: | [0;m[38;5;43m20221212183208102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183208103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183208103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183208103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183208104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183208104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183208104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:09.665427 run osmo-stp_10.42.42.5(pid=13272): stdout: | (launched: 2022-12-12_18:32:07.915719) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:09.797618 run osmo-stp_10.42.42.5(pid=13272): stderr: | [0;m[38;5;43m20221212183208102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183208103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183208103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183208103 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183208104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183208104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183208104 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:09.955332 run patchelf(pid=13275): Terminating (SIGINT) 18:32:10.137977 run patchelf(pid=13275): Terminated: ok {rc=0} 18:32:10.268621 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13272): Process ended prematurely: osmo-stp_10.42.42.5(pid=13272) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13272)] [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:32:10.278920 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 18:32:10.307704 run osmo-hlr_10.42.42.2(pid=13269): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13269)] 18:32:10.357720 run osmo-hlr_10.42.42.2(pid=13269): stdout: | (launched: 2022-12-12_18:32:06.907857) 18:32:10.409318 run osmo-hlr_10.42.42.2(pid=13269): stderr: | [0;m[1;31m20221212183207101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183207101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183207101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183207101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183207101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183207102 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183207118 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183207128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183207128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183207128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:10.461485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13262): Terminating (SIGTERM) 18:32:10.503174 run iperf3-srv_10.42.42.10(pid=13263): Terminating (SIGTERM) 18:32:10.545233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13264): Terminating (SIGTERM) 18:32:10.587165 run iperf3-srv_10.42.42.10(pid=13265): Terminating (SIGTERM) 18:32:10.628916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13268): Terminating (SIGTERM) 18:32:10.670921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13271): Terminating (SIGTERM) 18:32:10.712730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13274): Terminating (SIGTERM) 18:32:10.755309 --- ParallelTerminationStrategy: PID 13262 died... 18:32:10.775466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13262): Terminated: ok {rc=0} 18:32:10.821798 --- ParallelTerminationStrategy: PID 13263 died... 18:32:10.841429 run iperf3-srv_10.42.42.10(pid=13263): Terminated {rc=256} 18:32:10.887493 --- ParallelTerminationStrategy: PID 13264 died... 18:32:10.906982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13264): Terminated: ok {rc=0} 18:32:10.953292 --- ParallelTerminationStrategy: PID 13265 died... 18:32:10.972770 run iperf3-srv_10.42.42.10(pid=13265): Terminated {rc=256} 18:32:11.018979 --- ParallelTerminationStrategy: PID 13268 died... 18:32:11.038597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13268): Terminated: ok {rc=0} 18:32:11.084901 --- ParallelTerminationStrategy: PID 13271 died... 18:32:11.104809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13271): Terminated: ok {rc=0} 18:32:11.150929 --- ParallelTerminationStrategy: PID 13274 died... 18:32:11.170637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13274): Terminated: ok {rc=0} 18:32:11.257736 bus /gobi_0: Setting Powered False 18:32:12.358367 bus /gobi_0: Setting Powered False 18:32:13.474127 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:32:14.623137 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:14.635537 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:32:14.708825 tst iperf3.py: using LAC 30694 18:32:14.828805 tst iperf3.py: using RAC 94 18:32:14.948412 tst iperf3.py: using CellId 30694 18:32:15.080921 tst iperf3.py: using BVCI 30695 18:32:15.199676 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:15.211212 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:15.222625 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:15.234230 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:15.245498 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:15.256521 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:15.267796 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:15.278841 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:15.290285 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:32:15.405689 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:32:15.610336 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:32:15.933179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13276): Launched 18:32:16.253769 run iperf3-srv_10.42.42.10(pid=13277): Launched 18:32:16.381234 tst iperf3.py:8: start network... 18:32:16.589433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:17.069808 run create_hlr_db(pid=13278): Launched 18:32:17.232932 bus /gobi_6: Setting Powered False 18:32:18.297200 run create_hlr_db(pid=13278): Terminated: ok {rc=0} 18:32:18.749507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13280): Launched 18:32:19.076829 run osmo-hlr_10.42.42.2(pid=13281): Launched 18:32:19.201013 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:19.764018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13283): Launched 18:32:20.089266 run osmo-stp_10.42.42.5(pid=13284): Launched 18:32:20.211756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:32:20.770211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13286): Launched 18:32:20.894508 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:32:21.168833 run patchelf(pid=13287): Launched 18:32:21.349729 run osmo-stp_10.42.42.5(pid=13284): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13284)] 18:32:21.486210 run osmo-stp_10.42.42.5(pid=13284): stdout: | (launched: 2022-12-12_18:32:20.029196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:21.624746 run osmo-stp_10.42.42.5(pid=13284): stderr: | [0;m[38;5;43m20221212183220219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183220219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183220220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183220220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183220221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183220221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183220221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:21.763306 run osmo-stp_10.42.42.5(pid=13284): stdout: | (launched: 2022-12-12_18:32:20.029196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:21.895904 run osmo-stp_10.42.42.5(pid=13284): stderr: | [0;m[38;5;43m20221212183220219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183220219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183220220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183220220 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183220221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183220221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183220221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:22.054200 run patchelf(pid=13287): Terminating (SIGINT) 18:32:22.235522 run patchelf(pid=13287): Terminated: ok {rc=0} 18:32:22.366104 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13284): Process ended prematurely: osmo-stp_10.42.42.5(pid=13284) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13284)] [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 18:32:22.376301 tst iperf3.py:8: Test FAILED (7.8 sec) 18:32:22.404908 run osmo-hlr_10.42.42.2(pid=13281): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13281)] 18:32:22.454806 run osmo-hlr_10.42.42.2(pid=13281): stdout: | (launched: 2022-12-12_18:32:19.016857) 18:32:22.506459 run osmo-hlr_10.42.42.2(pid=13281): stderr: | [0;m[1;31m20221212183219211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183219212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183219212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183219212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183219212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183219212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183219229 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183219239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183219239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183219239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:22.558372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13276): Terminating (SIGTERM) 18:32:22.600399 run iperf3-srv_10.42.42.10(pid=13277): Terminating (SIGTERM) 18:32:22.642121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13280): Terminating (SIGTERM) 18:32:22.684013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13283): Terminating (SIGTERM) 18:32:22.725944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13286): Terminating (SIGTERM) 18:32:22.767953 --- ParallelTerminationStrategy: PID 13276 died... 18:32:22.788172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13276): Terminated: ok {rc=0} 18:32:22.834621 --- ParallelTerminationStrategy: PID 13277 died... 18:32:22.854365 run iperf3-srv_10.42.42.10(pid=13277): Terminated {rc=256} 18:32:22.900083 --- ParallelTerminationStrategy: PID 13280 died... 18:32:22.919602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13280): Terminated: ok {rc=0} 18:32:22.965834 --- ParallelTerminationStrategy: PID 13283 died... 18:32:22.985413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13283): Terminated: ok {rc=0} 18:32:23.031985 --- ParallelTerminationStrategy: PID 13286 died... 18:32:23.052140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13286): Terminated: ok {rc=0} 18:32:23.141173 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:32:24.292931 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:24.305150 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:32:24.377214 tst iperf3m4.py: using LAC 30695 18:32:24.505397 tst iperf3m4.py: using RAC 95 18:32:24.632737 tst iperf3m4.py: using CellId 30695 18:32:24.759770 tst iperf3m4.py: using BVCI 30696 18:32:24.877648 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:24.889204 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:24.900339 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:24.911639 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:24.922794 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:24.934066 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:24.945427 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:24.956477 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:24.967891 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:32:25.085668 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:32:25.209331 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:32:25.329967 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:32:25.448923 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:32:25.653630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:32:25.959022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13288): Launched 18:32:26.224437 run iperf3-srv_10.42.42.10(pid=13289): Launched 18:32:26.338796 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:32:26.541120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:32:26.846391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13290): Launched 18:32:27.110907 run iperf3-srv_10.42.42.10(pid=13291): Launched 18:32:27.226733 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:32:27.428569 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:32:27.733067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13292): Launched 18:32:27.998630 run iperf3-srv_10.42.42.10(pid=13293): Launched 18:32:28.112777 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:32:28.314842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:32:28.618685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13294): Launched 18:32:28.885697 run iperf3-srv_10.42.42.10(pid=13295): Launched 18:32:28.999888 tst iperf3m4.py:8: start network... 18:32:29.202558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:29.672295 run create_hlr_db(pid=13296): Launched 18:32:29.790692 bus /gobi_6: Setting Powered False 18:32:30.862226 run create_hlr_db(pid=13296): Terminated: ok {rc=0} 18:32:31.337425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13298): Launched 18:32:31.681369 run osmo-hlr_10.42.42.2(pid=13299): Launched 18:32:31.819509 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:32.561596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13301): Launched 18:32:32.865448 run osmo-stp_10.42.42.5(pid=13302): Launched 18:32:32.981304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:32:33.504217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13304): Launched 18:32:33.620697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:32:33.877176 run patchelf(pid=13305): Launched 18:32:34.046325 run osmo-stp_10.42.42.5(pid=13302): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13302)] 18:32:34.174956 run osmo-stp_10.42.42.5(pid=13302): stdout: | (launched: 2022-12-12_18:32:32.808857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:34.304510 run osmo-stp_10.42.42.5(pid=13302): stderr: | [0;m[38;5;43m20221212183232979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183232979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183232979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183232980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183232980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183232980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183232980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:34.434832 run osmo-stp_10.42.42.5(pid=13302): stdout: | (launched: 2022-12-12_18:32:32.808857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:34.559134 run osmo-stp_10.42.42.5(pid=13302): stderr: | [0;m[38;5;43m20221212183232979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183232979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183232979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183232980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183232980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183232980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183232980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:34.706947 run patchelf(pid=13305): Terminating (SIGINT) 18:32:34.876804 run patchelf(pid=13305): Terminated: ok {rc=0} 18:32:34.999509 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13302): Process ended prematurely: osmo-stp_10.42.42.5(pid=13302) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13302)] [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:32:35.009140 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:32:35.037516 run osmo-hlr_10.42.42.2(pid=13299): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13299)] 18:32:35.085495 run osmo-hlr_10.42.42.2(pid=13299): stdout: | (launched: 2022-12-12_18:32:31.621089) 18:32:35.135191 run osmo-hlr_10.42.42.2(pid=13299): stderr: | [0;m[1;31m20221212183232026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183232026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183232026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183232026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183232026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183232026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183232047 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183232070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183232070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183232070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:35.185935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13288): Terminating (SIGTERM) 18:32:35.226234 run iperf3-srv_10.42.42.10(pid=13289): Terminating (SIGTERM) 18:32:35.266531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13290): Terminating (SIGTERM) 18:32:35.306871 run iperf3-srv_10.42.42.10(pid=13291): Terminating (SIGTERM) 18:32:35.346833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13292): Terminating (SIGTERM) 18:32:35.386910 run iperf3-srv_10.42.42.10(pid=13293): Terminating (SIGTERM) 18:32:35.426811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13294): Terminating (SIGTERM) 18:32:35.466815 run iperf3-srv_10.42.42.10(pid=13295): Terminating (SIGTERM) 18:32:35.506930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13298): Terminating (SIGTERM) 18:32:35.546794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13301): Terminating (SIGTERM) 18:32:35.586530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13304): Terminating (SIGTERM) 18:32:35.627372 --- ParallelTerminationStrategy: PID 13288 died... 18:32:35.647323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13288): Terminated: ok {rc=0} 18:32:35.692686 --- ParallelTerminationStrategy: PID 13289 died... 18:32:35.711760 run iperf3-srv_10.42.42.10(pid=13289): Terminated {rc=256} 18:32:35.757237 --- ParallelTerminationStrategy: PID 13290 died... 18:32:35.776063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13290): Terminated: ok {rc=0} 18:32:35.821291 --- ParallelTerminationStrategy: PID 13291 died... 18:32:35.840107 run iperf3-srv_10.42.42.10(pid=13291): Terminated {rc=256} 18:32:35.885185 --- ParallelTerminationStrategy: PID 13292 died... 18:32:35.903957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13292): Terminated: ok {rc=0} 18:32:35.948811 --- ParallelTerminationStrategy: PID 13293 died... 18:32:35.968048 run iperf3-srv_10.42.42.10(pid=13293): Terminated {rc=256} 18:32:36.013035 --- ParallelTerminationStrategy: PID 13294 died... 18:32:36.032093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13294): Terminated: ok {rc=0} 18:32:36.077105 --- ParallelTerminationStrategy: PID 13295 died... 18:32:36.096187 run iperf3-srv_10.42.42.10(pid=13295): Terminated {rc=256} 18:32:36.141170 --- ParallelTerminationStrategy: PID 13298 died... 18:32:36.160309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13298): Terminated: ok {rc=0} 18:32:36.205481 --- ParallelTerminationStrategy: PID 13301 died... 18:32:36.224180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13301): Terminated: ok {rc=0} 18:32:36.269199 --- ParallelTerminationStrategy: PID 13304 died... 18:32:36.288110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13304): Terminated: ok {rc=0} 18:32:36.376097 bus /gobi_4: Setting Powered False 18:32:37.476157 bus /gobi_4: Setting Powered False 18:32:38.593044 bus /gobi_1: Setting Powered False 18:32:39.693144 bus /gobi_1: Setting Powered False 18:32:40.807043 bus /gobi_0: Setting Powered False 18:32:41.902984 bus /gobi_0: Setting Powered False 18:32:43.017778 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:32:44.122018 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:44.134323 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:32:44.206506 tst ping.py: using LAC 30696 18:32:44.333214 tst ping.py: using RAC 96 18:32:44.458809 tst ping.py: using CellId 30696 18:32:44.584346 tst ping.py: using BVCI 30697 18:32:44.699570 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:44.711007 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:44.722189 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:44.733398 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:44.744531 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:44.755733 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:44.767029 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:44.778361 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:32:44.893657 tst ping.py:19: start network... 18:32:45.094075 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:45.556152 run create_hlr_db(pid=13306): Launched 18:32:45.672862 bus /gobi_6: Setting Powered False 18:32:46.752780 run create_hlr_db(pid=13306): Terminated: ok {rc=0} 18:32:47.225746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13308): Launched 18:32:47.547658 run osmo-hlr_10.42.42.2(pid=13309): Launched 18:32:47.671234 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:48.223913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13311): Launched 18:32:48.545777 run osmo-stp_10.42.42.5(pid=13312): Launched 18:32:48.668456 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:32:49.220915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13314): Launched 18:32:49.342719 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:32:49.613155 run patchelf(pid=13315): Launched 18:32:49.791399 run osmo-stp_10.42.42.5(pid=13312): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13312)] 18:32:49.926162 run osmo-stp_10.42.42.5(pid=13312): stdout: | (launched: 2022-12-12_18:32:48.486594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:50.062549 run osmo-stp_10.42.42.5(pid=13312): stderr: | [0;m[38;5;43m20221212183248674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183248674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183248674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183248675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183248675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183248675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183248675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:50.199807 run osmo-stp_10.42.42.5(pid=13312): stdout: | (launched: 2022-12-12_18:32:48.486594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:50.331022 run osmo-stp_10.42.42.5(pid=13312): stderr: | [0;m[38;5;43m20221212183248674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183248674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183248674 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183248675 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183248675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183248675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183248675 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:50.485762 run patchelf(pid=13315): Terminating (SIGINT) 18:32:50.663937 run patchelf(pid=13315): Terminated: ok {rc=0} 18:32:50.792522 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13312): Process ended prematurely: osmo-stp_10.42.42.5(pid=13312) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13312)] [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 18:32:50.802415 tst ping.py:22: Test FAILED (6.7 sec) 18:32:50.831096 run osmo-hlr_10.42.42.2(pid=13309): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13309)] 18:32:50.881261 run osmo-hlr_10.42.42.2(pid=13309): stdout: | (launched: 2022-12-12_18:32:47.488544) 18:32:50.933304 run osmo-hlr_10.42.42.2(pid=13309): stderr: | [0;m[1;31m20221212183247682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183247682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183247682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183247682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183247682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183247682 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183247694 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183247703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183247703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183247703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:50.985859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13308): Terminating (SIGTERM) 18:32:51.028096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13311): Terminating (SIGTERM) 18:32:51.070929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13314): Terminating (SIGTERM) 18:32:51.113958 --- ParallelTerminationStrategy: PID 13308 died... 18:32:51.134359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13308): Terminated: ok {rc=0} 18:32:51.181566 --- ParallelTerminationStrategy: PID 13311 died... 18:32:51.201620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13311): Terminated: ok {rc=0} 18:32:51.248640 --- ParallelTerminationStrategy: PID 13314 died... 18:32:51.268808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13314): Terminated: ok {rc=0} 18:32:51.358593 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:32:52.446898 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:52.459179 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:32:52.532001 tst ping_idle_ping.py: using LAC 30697 18:32:52.657358 tst ping_idle_ping.py: using RAC 97 18:32:52.782903 tst ping_idle_ping.py: using CellId 30697 18:32:52.911171 tst ping_idle_ping.py: using BVCI 30698 18:32:53.028443 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:53.040017 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:53.051382 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:53.062853 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:53.074776 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:53.086357 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:53.097990 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:32:53.109506 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:32:53.226168 tst ping_idle_ping.py:24: start network... 18:32:53.427206 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:32:53.894912 run create_hlr_db(pid=13316): Launched 18:32:54.012632 bus /gobi_6: Setting Powered False 18:32:55.073169 run create_hlr_db(pid=13316): Terminated: ok {rc=0} 18:32:55.513924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13318): Launched 18:32:55.837351 run osmo-hlr_10.42.42.2(pid=13319): Launched 18:32:55.961396 run osmo-stp_10.42.42.5: Starting osmo-stp 18:32:56.512109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13321): Launched 18:32:56.834591 run osmo-stp_10.42.42.5(pid=13322): Launched 18:32:56.958131 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:32:57.511324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13324): Launched 18:32:57.635371 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:32:57.906944 run patchelf(pid=13325): Launched 18:32:58.087769 run osmo-stp_10.42.42.5(pid=13322): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13322)] 18:32:58.224234 run osmo-stp_10.42.42.5(pid=13322): stdout: | (launched: 2022-12-12_18:32:56.775386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:58.361830 run osmo-stp_10.42.42.5(pid=13322): stderr: | [0;m[38;5;43m20221212183256965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183256965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183256965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183256966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183256966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183256966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183256966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:58.499145 run osmo-stp_10.42.42.5(pid=13322): stdout: | (launched: 2022-12-12_18:32:56.775386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:32:58.630831 run osmo-stp_10.42.42.5(pid=13322): stderr: | [0;m[38;5;43m20221212183256965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183256965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183256965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183256966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183256966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183256966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183256966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:32:58.786734 run patchelf(pid=13325): Terminating (SIGINT) 18:32:58.965905 run patchelf(pid=13325): Terminated: ok {rc=0} 18:32:59.095384 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13322): Process ended prematurely: osmo-stp_10.42.42.5(pid=13322) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13322)] [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:32:59.105078 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:32:59.133788 run osmo-hlr_10.42.42.2(pid=13319): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13319)] 18:32:59.184939 run osmo-hlr_10.42.42.2(pid=13319): stdout: | (launched: 2022-12-12_18:32:55.778115) 18:32:59.237207 run osmo-hlr_10.42.42.2(pid=13319): stderr: | [0;m[1;31m20221212183255973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183255973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183255974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183255974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183255974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183255974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183255986 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183255995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183255995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183255995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:32:59.289444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13318): Terminating (SIGTERM) 18:32:59.332048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13321): Terminating (SIGTERM) 18:32:59.374669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13324): Terminating (SIGTERM) 18:32:59.417738 --- ParallelTerminationStrategy: PID 13318 died... 18:32:59.438120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13318): Terminated: ok {rc=0} 18:32:59.485353 --- ParallelTerminationStrategy: PID 13321 died... 18:32:59.505391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13321): Terminated: ok {rc=0} 18:32:59.552302 --- ParallelTerminationStrategy: PID 13324 died... 18:32:59.572381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13324): Terminated: ok {rc=0} 18:32:59.661434 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:33:00.991603 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:33:00.998345 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:33:01.035717 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:33:01.076386 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:33:01.169920 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:33:01.218402 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:33:01.275705 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:33:01.879641 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:33:01.962227 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:01.978216 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:33:02.065282 tst cs_paging_gprs_active.py: using LAC 30698 18:33:02.194094 tst cs_paging_gprs_active.py: using RAC 98 18:33:02.323197 tst cs_paging_gprs_active.py: using CellId 30698 18:33:02.453655 tst cs_paging_gprs_active.py: using BVCI 30699 18:33:02.574013 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:02.585731 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:02.597223 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:02.608768 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:02.620409 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:02.631930 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:02.643499 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:02.654847 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:02.666556 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:33:02.783697 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:33:02.912370 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:33:03.133486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:33:03.459498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13330): Launched 18:33:03.744596 run iperf3-srv_10.42.42.10(pid=13331): Launched 18:33:03.866814 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:33:04.086423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:33:04.413990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13332): Launched 18:33:04.697145 run iperf3-srv_10.42.42.10(pid=13333): Launched 18:33:04.820686 tst cs_paging_gprs_active.py:38: start network... 18:33:05.039538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:05.543464 run create_hlr_db(pid=13334): Launched 18:33:05.678477 bus /gobi_6: Setting Powered False 18:33:06.743289 run create_hlr_db(pid=13334): Terminated: ok {rc=0} 18:33:07.177433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13336): Launched 18:33:07.482850 run osmo-hlr_10.42.42.2(pid=13337): Launched 18:33:07.602996 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:08.137695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13339): Launched 18:33:08.442747 run osmo-stp_10.42.42.5(pid=13340): Launched 18:33:08.560412 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:33:09.083679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13342): Launched 18:33:09.200151 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:33:09.457249 run patchelf(pid=13343): Launched 18:33:09.628456 run osmo-stp_10.42.42.5(pid=13340): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13340)] 18:33:09.757160 run osmo-stp_10.42.42.5(pid=13340): stdout: | (launched: 2022-12-12_18:33:08.386564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:09.887087 run osmo-stp_10.42.42.5(pid=13340): stderr: | [0;m[38;5;43m20221212183308554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183308554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183308555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183308555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183308555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183308556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183308556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:10.017341 run osmo-stp_10.42.42.5(pid=13340): stdout: | (launched: 2022-12-12_18:33:08.386564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:10.141506 run osmo-stp_10.42.42.5(pid=13340): stderr: | [0;m[38;5;43m20221212183308554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183308554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183308555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183308555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183308555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183308556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183308556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:10.289258 run patchelf(pid=13343): Terminating (SIGINT) 18:33:10.459504 run patchelf(pid=13343): Terminated: ok {rc=0} 18:33:10.582539 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13340): Process ended prematurely: osmo-stp_10.42.42.5(pid=13340) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13340)] [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:33:10.592201 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:33:10.620181 run osmo-hlr_10.42.42.2(pid=13337): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13337)] 18:33:10.668344 run osmo-hlr_10.42.42.2(pid=13337): stdout: | (launched: 2022-12-12_18:33:07.426542) 18:33:10.718133 run osmo-hlr_10.42.42.2(pid=13337): stderr: | [0;m[1;31m20221212183307601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183307601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183307601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183307601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183307601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183307601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183307614 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183307622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183307622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183307622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:10.768513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13330): Terminating (SIGTERM) 18:33:10.808843 run iperf3-srv_10.42.42.10(pid=13331): Terminating (SIGTERM) 18:33:10.849122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13332): Terminating (SIGTERM) 18:33:10.889316 run iperf3-srv_10.42.42.10(pid=13333): Terminating (SIGTERM) 18:33:10.929166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13336): Terminating (SIGTERM) 18:33:10.969681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13339): Terminating (SIGTERM) 18:33:11.009340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13342): Terminating (SIGTERM) 18:33:11.049891 --- ParallelTerminationStrategy: PID 13330 died... 18:33:11.069052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13330): Terminated: ok {rc=0} 18:33:11.113427 --- ParallelTerminationStrategy: PID 13331 died... 18:33:11.131996 run iperf3-srv_10.42.42.10(pid=13331): Terminated {rc=256} 18:33:11.176335 --- ParallelTerminationStrategy: PID 13332 died... 18:33:11.194937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13332): Terminated: ok {rc=0} 18:33:11.239076 --- ParallelTerminationStrategy: PID 13333 died... 18:33:11.257519 run iperf3-srv_10.42.42.10(pid=13333): Terminated {rc=256} 18:33:11.301600 --- ParallelTerminationStrategy: PID 13336 died... 18:33:11.320091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13336): Terminated: ok {rc=0} 18:33:11.364185 --- ParallelTerminationStrategy: PID 13339 died... 18:33:11.382849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13339): Terminated: ok {rc=0} 18:33:11.427520 --- ParallelTerminationStrategy: PID 13342 died... 18:33:11.446194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13342): Terminated: ok {rc=0} 18:33:11.532441 bus /gobi_0: Setting Powered False 18:33:12.632923 bus /gobi_0: Setting Powered False 18:33:13.748178 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:33:14.896287 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:14.908096 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:33:14.978962 tst iperf3.py: using LAC 30699 18:33:15.098433 tst iperf3.py: using RAC 99 18:33:15.219505 tst iperf3.py: using CellId 30699 18:33:15.338390 tst iperf3.py: using BVCI 30700 18:33:15.449285 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:15.460148 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:15.471110 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:15.482159 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:15.493098 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:15.504147 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:15.515258 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:15.526470 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:15.537565 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:33:15.657746 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:33:15.915402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:33:16.246222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13344): Launched 18:33:16.545970 run iperf3-srv_10.42.42.10(pid=13345): Launched 18:33:16.675751 tst iperf3.py:8: start network... 18:33:16.887315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:17.371515 run create_hlr_db(pid=13346): Launched 18:33:17.489354 bus /gobi_6: Setting Powered False 18:33:18.550867 run create_hlr_db(pid=13346): Terminated: ok {rc=0} 18:33:18.997720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13348): Launched 18:33:19.325687 run osmo-hlr_10.42.42.2(pid=13349): Launched 18:33:19.451454 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:20.014103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13351): Launched 18:33:20.341126 run osmo-stp_10.42.42.5(pid=13352): Launched 18:33:20.466742 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:33:21.026437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13354): Launched 18:33:21.150815 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:33:21.426070 run patchelf(pid=13355): Launched 18:33:21.607239 run osmo-stp_10.42.42.5(pid=13352): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13352)] 18:33:21.744089 run osmo-stp_10.42.42.5(pid=13352): stdout: | (launched: 2022-12-12_18:33:20.281216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:21.883088 run osmo-stp_10.42.42.5(pid=13352): stderr: | [0;m[38;5;43m20221212183320470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183320470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183320470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183320470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183320471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183320471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183320471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:22.021989 run osmo-stp_10.42.42.5(pid=13352): stdout: | (launched: 2022-12-12_18:33:20.281216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:22.155389 run osmo-stp_10.42.42.5(pid=13352): stderr: | [0;m[38;5;43m20221212183320470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183320470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183320470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183320470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183320471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183320471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183320471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:22.313245 run patchelf(pid=13355): Terminating (SIGINT) 18:33:22.495017 run patchelf(pid=13355): Terminated: ok {rc=0} 18:33:22.625910 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13352): Process ended prematurely: osmo-stp_10.42.42.5(pid=13352) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13352)] [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 18:33:22.636116 tst iperf3.py:8: Test FAILED (7.8 sec) 18:33:22.665129 run osmo-hlr_10.42.42.2(pid=13349): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13349)] 18:33:22.715159 run osmo-hlr_10.42.42.2(pid=13349): stdout: | (launched: 2022-12-12_18:33:19.265942) 18:33:22.766719 run osmo-hlr_10.42.42.2(pid=13349): stderr: | [0;m[1;31m20221212183319461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183319461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183319461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183319461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183319461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183319461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183319473 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183319482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183319482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183319482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:22.819111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13344): Terminating (SIGTERM) 18:33:22.861121 run iperf3-srv_10.42.42.10(pid=13345): Terminating (SIGTERM) 18:33:22.902872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13348): Terminating (SIGTERM) 18:33:22.944714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13351): Terminating (SIGTERM) 18:33:22.986889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13354): Terminating (SIGTERM) 18:33:23.029475 --- ParallelTerminationStrategy: PID 13344 died... 18:33:23.049716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13344): Terminated: ok {rc=0} 18:33:23.096629 --- ParallelTerminationStrategy: PID 13345 died... 18:33:23.116262 run iperf3-srv_10.42.42.10(pid=13345): Terminated {rc=256} 18:33:23.162748 --- ParallelTerminationStrategy: PID 13348 died... 18:33:23.182525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13348): Terminated: ok {rc=0} 18:33:23.229512 --- ParallelTerminationStrategy: PID 13351 died... 18:33:23.249304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13351): Terminated: ok {rc=0} 18:33:23.296014 --- ParallelTerminationStrategy: PID 13354 died... 18:33:23.315887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13354): Terminated: ok {rc=0} 18:33:23.405438 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:33:24.557698 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:24.570520 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:33:24.644936 tst iperf3m4.py: using LAC 30700 18:33:24.773387 tst iperf3m4.py: using RAC 100 18:33:24.900746 tst iperf3m4.py: using CellId 30700 18:33:25.027287 tst iperf3m4.py: using BVCI 30701 18:33:25.145708 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:25.157503 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:25.168756 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:25.180129 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:25.191338 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:25.202614 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:25.214094 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:25.225247 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:25.236733 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:33:25.359591 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:33:25.481759 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:33:25.599923 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:33:25.721833 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:33:25.943043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:33:26.271237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13356): Launched 18:33:26.559449 run iperf3-srv_10.42.42.10(pid=13357): Launched 18:33:26.684443 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:33:26.904609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:33:27.234522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13358): Launched 18:33:27.519499 run iperf3-srv_10.42.42.10(pid=13359): Launched 18:33:27.644046 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:33:27.863956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:33:28.192193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13360): Launched 18:33:28.477628 run iperf3-srv_10.42.42.10(pid=13361): Launched 18:33:28.599879 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:33:28.818610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:33:29.146168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13362): Launched 18:33:29.431497 run iperf3-srv_10.42.42.10(pid=13363): Launched 18:33:29.553780 tst iperf3m4.py:8: start network... 18:33:29.772236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:30.278083 run create_hlr_db(pid=13364): Launched 18:33:30.411717 bus /gobi_6: Setting Powered False 18:33:31.470851 run create_hlr_db(pid=13364): Terminated: ok {rc=0} 18:33:31.912589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13366): Launched 18:33:32.239178 run osmo-hlr_10.42.42.2(pid=13367): Launched 18:33:32.358089 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:32.889413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13369): Launched 18:33:33.195310 run osmo-stp_10.42.42.5(pid=13370): Launched 18:33:33.311267 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:33:33.835988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13372): Launched 18:33:33.954064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:33:34.211134 run patchelf(pid=13373): Launched 18:33:34.380601 run osmo-stp_10.42.42.5(pid=13370): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13370)] 18:33:34.509933 run osmo-stp_10.42.42.5(pid=13370): stdout: | (launched: 2022-12-12_18:33:33.138670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:34.640192 run osmo-stp_10.42.42.5(pid=13370): stderr: | [0;m[38;5;43m20221212183333309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183333309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183333309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183333310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183333310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183333310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183333311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:34.770361 run osmo-stp_10.42.42.5(pid=13370): stdout: | (launched: 2022-12-12_18:33:33.138670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:34.894662 run osmo-stp_10.42.42.5(pid=13370): stderr: | [0;m[38;5;43m20221212183333309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183333309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183333309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183333310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183333310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183333310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183333311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:35.042373 run patchelf(pid=13373): Terminating (SIGINT) 18:33:35.213193 run patchelf(pid=13373): Terminated: ok {rc=0} 18:33:35.336566 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13370): Process ended prematurely: osmo-stp_10.42.42.5(pid=13370) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13370)] [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:33:35.346229 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:33:35.375054 run osmo-hlr_10.42.42.2(pid=13367): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13367)] 18:33:35.423802 run osmo-hlr_10.42.42.2(pid=13367): stdout: | (launched: 2022-12-12_18:33:32.182614) 18:33:35.474471 run osmo-hlr_10.42.42.2(pid=13367): stderr: | [0;m[1;31m20221212183332357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183332358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183332358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183332358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183332358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183332358 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183332370 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183332378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183332378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183332378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:35.525685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13356): Terminating (SIGTERM) 18:33:35.566377 run iperf3-srv_10.42.42.10(pid=13357): Terminating (SIGTERM) 18:33:35.608035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13358): Terminating (SIGTERM) 18:33:35.652026 run iperf3-srv_10.42.42.10(pid=13359): Terminating (SIGTERM) 18:33:35.694064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13360): Terminating (SIGTERM) 18:33:35.736037 run iperf3-srv_10.42.42.10(pid=13361): Terminating (SIGTERM) 18:33:35.778355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13362): Terminating (SIGTERM) 18:33:35.820213 run iperf3-srv_10.42.42.10(pid=13363): Terminating (SIGTERM) 18:33:35.862012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13366): Terminating (SIGTERM) 18:33:35.903885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13369): Terminating (SIGTERM) 18:33:35.945878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13372): Terminating (SIGTERM) 18:33:35.988249 --- ParallelTerminationStrategy: PID 13356 died... 18:33:36.008495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13356): Terminated: ok {rc=0} 18:33:36.055047 --- ParallelTerminationStrategy: PID 13357 died... 18:33:36.074785 run iperf3-srv_10.42.42.10(pid=13357): Terminated {rc=256} 18:33:36.121534 --- ParallelTerminationStrategy: PID 13358 died... 18:33:36.141338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13358): Terminated: ok {rc=0} 18:33:36.188051 --- ParallelTerminationStrategy: PID 13359 died... 18:33:36.207736 run iperf3-srv_10.42.42.10(pid=13359): Terminated {rc=256} 18:33:36.254068 --- ParallelTerminationStrategy: PID 13360 died... 18:33:36.274202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13360): Terminated: ok {rc=0} 18:33:36.320479 --- ParallelTerminationStrategy: PID 13361 died... 18:33:36.340318 run iperf3-srv_10.42.42.10(pid=13361): Terminated {rc=256} 18:33:36.386724 --- ParallelTerminationStrategy: PID 13362 died... 18:33:36.406414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13362): Terminated: ok {rc=0} 18:33:36.452888 --- ParallelTerminationStrategy: PID 13363 died... 18:33:36.472909 run iperf3-srv_10.42.42.10(pid=13363): Terminated {rc=256} 18:33:36.519641 --- ParallelTerminationStrategy: PID 13366 died... 18:33:36.539312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13366): Terminated: ok {rc=0} 18:33:36.585952 --- ParallelTerminationStrategy: PID 13369 died... 18:33:36.605629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13369): Terminated: ok {rc=0} 18:33:36.651449 --- ParallelTerminationStrategy: PID 13372 died... 18:33:36.671016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13372): Terminated: ok {rc=0} 18:33:36.758204 bus /gobi_4: Setting Powered False 18:33:37.859231 bus /gobi_4: Setting Powered False 18:33:38.976198 bus /gobi_1: Setting Powered False 18:33:40.075098 bus /gobi_1: Setting Powered False 18:33:41.190700 bus /gobi_0: Setting Powered False 18:33:42.289725 bus /gobi_0: Setting Powered False 18:33:43.405732 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:33:44.509186 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:44.521669 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:33:44.594945 tst ping.py: using LAC 30701 18:33:44.721501 tst ping.py: using RAC 101 18:33:44.841368 tst ping.py: using CellId 30701 18:33:44.959103 tst ping.py: using BVCI 30702 18:33:45.069633 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:45.080606 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:45.091621 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:45.102864 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:45.113882 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:45.124796 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:45.135962 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:45.147035 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:33:45.261849 tst ping.py:19: start network... 18:33:45.462212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:45.933992 run create_hlr_db(pid=13374): Launched 18:33:46.105153 bus /gobi_6: Setting Powered False 18:33:47.176741 run create_hlr_db(pid=13374): Terminated: ok {rc=0} 18:33:47.603703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13376): Launched 18:33:47.904089 run osmo-hlr_10.42.42.2(pid=13377): Launched 18:33:48.018524 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:48.550496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13379): Launched 18:33:48.852865 run osmo-stp_10.42.42.5(pid=13380): Launched 18:33:48.966498 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:33:49.483377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13382): Launched 18:33:49.600047 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:33:49.854277 run patchelf(pid=13383): Launched 18:33:50.021358 run osmo-stp_10.42.42.5(pid=13380): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13380)] 18:33:50.148371 run osmo-stp_10.42.42.5(pid=13380): stdout: | (launched: 2022-12-12_18:33:48.797273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:50.276797 run osmo-stp_10.42.42.5(pid=13380): stderr: | [0;m[38;5;43m20221212183348965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183348965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183348965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183348966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183348966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183348966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183348966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:50.405460 run osmo-stp_10.42.42.5(pid=13380): stdout: | (launched: 2022-12-12_18:33:48.797273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:50.528509 run osmo-stp_10.42.42.5(pid=13380): stderr: | [0;m[38;5;43m20221212183348965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183348965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183348965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183348966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183348966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183348966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183348966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:50.674851 run patchelf(pid=13383): Terminating (SIGINT) 18:33:50.843476 run patchelf(pid=13383): Terminated: ok {rc=0} 18:33:50.964737 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13380): Process ended prematurely: osmo-stp_10.42.42.5(pid=13380) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13380)] [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 18:33:50.973945 tst ping.py:22: Test FAILED (6.5 sec) 18:33:51.001550 run osmo-hlr_10.42.42.2(pid=13377): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13377)] 18:33:51.049691 run osmo-hlr_10.42.42.2(pid=13377): stdout: | (launched: 2022-12-12_18:33:47.848361) 18:33:51.099396 run osmo-hlr_10.42.42.2(pid=13377): stderr: | [0;m[1;31m20221212183348023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183348023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183348023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183348023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183348023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183348024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183348035 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183348045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183348045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183348045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:51.149300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13376): Terminating (SIGTERM) 18:33:51.189235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13379): Terminating (SIGTERM) 18:33:51.229391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13382): Terminating (SIGTERM) 18:33:51.269885 --- ParallelTerminationStrategy: PID 13376 died... 18:33:51.289179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13376): Terminated: ok {rc=0} 18:33:51.333931 --- ParallelTerminationStrategy: PID 13379 died... 18:33:51.352820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13379): Terminated: ok {rc=0} 18:33:51.397127 --- ParallelTerminationStrategy: PID 13382 died... 18:33:51.415839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13382): Terminated: ok {rc=0} 18:33:51.499589 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:33:52.586072 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:52.598943 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:33:52.673937 tst ping_idle_ping.py: using LAC 30702 18:33:52.800782 tst ping_idle_ping.py: using RAC 102 18:33:52.925722 tst ping_idle_ping.py: using CellId 30702 18:33:53.050432 tst ping_idle_ping.py: using BVCI 30703 18:33:53.166681 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:53.178334 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:53.189663 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:53.200917 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:53.212158 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:53.223460 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:53.234910 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:33:53.246183 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:33:53.363107 tst ping_idle_ping.py:24: start network... 18:33:53.563021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:33:54.031096 run create_hlr_db(pid=13384): Launched 18:33:54.147299 bus /gobi_6: Setting Powered False 18:33:55.207689 run create_hlr_db(pid=13384): Terminated: ok {rc=0} 18:33:55.627938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13386): Launched 18:33:55.929707 run osmo-hlr_10.42.42.2(pid=13387): Launched 18:33:56.044922 run osmo-stp_10.42.42.5: Starting osmo-stp 18:33:56.564364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13389): Launched 18:33:56.887913 run osmo-stp_10.42.42.5(pid=13390): Launched 18:33:57.011295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:33:57.566026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13392): Launched 18:33:57.688406 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:33:57.959650 run patchelf(pid=13393): Launched 18:33:58.140470 run osmo-stp_10.42.42.5(pid=13390): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13390)] 18:33:58.275293 run osmo-stp_10.42.42.5(pid=13390): stdout: | (launched: 2022-12-12_18:33:56.828735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:58.411734 run osmo-stp_10.42.42.5(pid=13390): stderr: | [0;m[38;5;43m20221212183357017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183357017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183357017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183357017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183357018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183357018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183357018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:58.548543 run osmo-stp_10.42.42.5(pid=13390): stdout: | (launched: 2022-12-12_18:33:56.828735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:33:58.679591 run osmo-stp_10.42.42.5(pid=13390): stderr: | [0;m[38;5;43m20221212183357017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183357017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183357017 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183357017 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183357018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183357018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183357018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:33:58.835474 run patchelf(pid=13393): Terminating (SIGINT) 18:33:59.014263 run patchelf(pid=13393): Terminated: ok {rc=0} 18:33:59.143181 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13390): Process ended prematurely: osmo-stp_10.42.42.5(pid=13390) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13390)] [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:33:59.153127 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:33:59.181497 run osmo-hlr_10.42.42.2(pid=13387): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13387)] 18:33:59.231707 run osmo-hlr_10.42.42.2(pid=13387): stdout: | (launched: 2022-12-12_18:33:55.873736) 18:33:59.283898 run osmo-hlr_10.42.42.2(pid=13387): stderr: | [0;m[1;31m20221212183356048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183356049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183356049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183356049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183356049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183356049 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183356061 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183356070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183356070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183356070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:33:59.336625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13386): Terminating (SIGTERM) 18:33:59.378908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13389): Terminating (SIGTERM) 18:33:59.421337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13392): Terminating (SIGTERM) 18:33:59.464103 --- ParallelTerminationStrategy: PID 13386 died... 18:33:59.484582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13386): Terminated: ok {rc=0} 18:33:59.531503 --- ParallelTerminationStrategy: PID 13389 died... 18:33:59.551557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13389): Terminated: ok {rc=0} 18:33:59.598337 --- ParallelTerminationStrategy: PID 13392 died... 18:33:59.618192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13392): Terminated: ok {rc=0} 18:33:59.706494 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:34:01.031585 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:01.044683 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:34:01.082934 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:34:01.120338 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:34:01.177392 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:34:01.222544 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:34:01.270019 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:34:01.829324 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:34:01.839383 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:34:01.854885 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:34:01.942806 tst switch_tch_pdch.py: using LAC 30703 18:34:02.067982 tst switch_tch_pdch.py: using RAC 103 18:34:02.197309 tst switch_tch_pdch.py: using CellId 30703 18:34:02.332210 tst switch_tch_pdch.py: using BVCI 30704 18:34:02.443984 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:34:02.455564 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:34:02.466849 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:34:02.478481 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:34:02.490135 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:34:02.501757 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:34:02.513461 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:34:02.524687 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:34:02.647210 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:34:02.772887 tst switch_tch_pdch.py:51: start network... 18:34:02.973498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:03.436435 run create_hlr_db(pid=13397): Launched 18:34:03.551752 bus /gobi_6: Setting Powered False 18:34:04.612399 run create_hlr_db(pid=13397): Terminated: ok {rc=0} 18:34:05.050579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13399): Launched 18:34:05.372440 run osmo-hlr_10.42.42.2(pid=13400): Launched 18:34:05.495781 run osmo-stp_10.42.42.5: Starting osmo-stp 18:34:06.046829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13402): Launched 18:34:06.368299 run osmo-stp_10.42.42.5(pid=13403): Launched 18:34:06.491541 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:34:07.044346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13405): Launched 18:34:07.168478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:34:07.439295 run patchelf(pid=13406): Launched 18:34:07.618996 run osmo-stp_10.42.42.5(pid=13403): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13403)] 18:34:07.754293 run osmo-stp_10.42.42.5(pid=13403): stdout: | (launched: 2022-12-12_18:34:06.309330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:07.891290 run osmo-stp_10.42.42.5(pid=13403): stderr: | [0;m[38;5;43m20221212183406497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183406497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183406497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183406498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183406498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183406498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183406498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:08.028213 run osmo-stp_10.42.42.5(pid=13403): stdout: | (launched: 2022-12-12_18:34:06.309330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:08.159688 run osmo-stp_10.42.42.5(pid=13403): stderr: | [0;m[38;5;43m20221212183406497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183406497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183406497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183406498 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183406498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183406498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183406498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:08.315214 run patchelf(pid=13406): Terminating (SIGINT) 18:34:08.494998 run patchelf(pid=13406): Terminated: ok {rc=0} 18:34:08.623954 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13403): Process ended prematurely: osmo-stp_10.42.42.5(pid=13403) [trial-2380↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13403)] [trial-2380↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:34:08.633613 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 18:34:08.662132 run osmo-hlr_10.42.42.2(pid=13400): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13400)] 18:34:08.712617 run osmo-hlr_10.42.42.2(pid=13400): stdout: | (launched: 2022-12-12_18:34:05.313508) 18:34:08.765357 run osmo-hlr_10.42.42.2(pid=13400): stderr: | [0;m[1;31m20221212183405507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183405507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183405507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183405507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183405507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183405507 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183405520 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183405528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183405528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183405529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:34:08.817925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13399): Terminating (SIGTERM) 18:34:08.860139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13402): Terminating (SIGTERM) 18:34:08.902501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13405): Terminating (SIGTERM) 18:34:08.944600 --- ParallelTerminationStrategy: PID 13399 died... 18:34:08.964620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13399): Terminated: ok {rc=0} 18:34:09.011177 --- ParallelTerminationStrategy: PID 13402 died... 18:34:09.030931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13402): Terminated: ok {rc=0} 18:34:09.077402 --- ParallelTerminationStrategy: PID 13405 died... 18:34:09.097040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13405): Terminated: ok {rc=0} 18:34:09.186489 bus /gobi_0: Setting Powered False 18:34:10.286587 bus /gobi_0: Setting Powered False 18:34:11.401837 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:34:12.662683 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:12.669787 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:34:12.703532 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:34:12.738076 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:34:12.789684 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:34:12.822846 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:34:12.857774 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:34:13.417652 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:34:13.422904 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:34:13.434308 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:34:13.502923 tst switch_tch_pdch.py: using LAC 30704 18:34:13.626151 tst switch_tch_pdch.py: using RAC 104 18:34:13.750845 tst switch_tch_pdch.py: using CellId 30704 18:34:13.873215 tst switch_tch_pdch.py: using BVCI 30705 18:34:13.988570 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:34:14.000078 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:34:14.011272 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:34:14.022534 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:34:14.033742 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:34:14.044878 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:34:14.056214 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:34:14.067314 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:34:14.189533 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:34:14.309752 tst switch_tch_pdch.py:51: start network... 18:34:14.523593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:14.990659 run create_hlr_db(pid=13410): Launched 18:34:15.120414 bus /gobi_6: Setting Powered False 18:34:16.199499 run create_hlr_db(pid=13410): Terminated: ok {rc=0} 18:34:16.657970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13412): Launched 18:34:16.993796 run osmo-hlr_10.42.42.2(pid=13413): Launched 18:34:17.194104 run osmo-stp_10.42.42.5: Starting osmo-stp 18:34:17.742621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13415): Launched 18:34:18.043841 run osmo-stp_10.42.42.5(pid=13416): Launched 18:34:18.157847 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:34:18.646855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13418): Launched 18:34:18.761074 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:34:19.014263 run patchelf(pid=13419): Launched 18:34:19.182026 run osmo-stp_10.42.42.5(pid=13416): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13416)] 18:34:19.308048 run osmo-stp_10.42.42.5(pid=13416): stdout: | (launched: 2022-12-12_18:34:17.987579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:19.435822 run osmo-stp_10.42.42.5(pid=13416): stderr: | [0;m[38;5;43m20221212183418155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183418155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183418156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183418156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183418157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183418157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183418157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:19.563201 run osmo-stp_10.42.42.5(pid=13416): stdout: | (launched: 2022-12-12_18:34:17.987579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:19.685467 run osmo-stp_10.42.42.5(pid=13416): stderr: | [0;m[38;5;43m20221212183418155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183418155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183418156 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183418156 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183418157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183418157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183418157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:19.830253 run patchelf(pid=13419): Terminating (SIGINT) 18:34:19.998476 run patchelf(pid=13419): Terminated: ok {rc=0} 18:34:20.119328 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13416): Process ended prematurely: osmo-stp_10.42.42.5(pid=13416) [trial-2380↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13416)] [trial-2380↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:34:20.128451 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 18:34:20.155691 run osmo-hlr_10.42.42.2(pid=13413): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13413)] 18:34:20.203199 run osmo-hlr_10.42.42.2(pid=13413): stdout: | (launched: 2022-12-12_18:34:16.927466) 18:34:20.252299 run osmo-hlr_10.42.42.2(pid=13413): stderr: | [0;m[1;31m20221212183417258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183417258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183417258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183417258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183417258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183417259 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183417276 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183417291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183417291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183417291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:34:20.302152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13412): Terminating (SIGTERM) 18:34:20.342366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13415): Terminating (SIGTERM) 18:34:20.381745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13418): Terminating (SIGTERM) 18:34:20.421696 --- ParallelTerminationStrategy: PID 13412 died... 18:34:20.440587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13412): Terminated: ok {rc=0} 18:34:20.485387 --- ParallelTerminationStrategy: PID 13415 died... 18:34:20.503923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13415): Terminated: ok {rc=0} 18:34:20.549050 --- ParallelTerminationStrategy: PID 13418 died... 18:34:20.567798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13418): Terminated: ok {rc=0} 18:34:20.655083 bus /gobi_0: Setting Powered False 18:34:21.754088 bus /gobi_0: Setting Powered False 18:34:22.870643 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 18:34:24.119525 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:24.123560 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:34:24.152520 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 18:34:24.159165 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:34:24.211979 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:34:24.241715 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 18:34:24.248384 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:34:24.789922 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 18:34:24.795285 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 18:34:24.806866 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:34:24.851776 tst mo_mt_sms.py: using LAC 30705 18:34:24.976804 tst mo_mt_sms.py: using RAC 105 18:34:25.101083 tst mo_mt_sms.py: using CellId 30705 18:34:25.230491 tst mo_mt_sms.py: using BVCI 30706 18:34:25.347451 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:34:25.463454 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:34:25.578473 tst mo_mt_sms.py:9: start nitb and bts... 18:34:25.779168 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:34:26.387941 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13424): Launched 18:34:26.687016 run osmo-nitb_10.42.42.2(pid=13425): Launched 18:34:26.853592 run osmo-nitb_10.42.42.2(pid=13425): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13425)] 18:34:26.987357 run osmo-nitb_10.42.42.2(pid=13425): stdout: | (launched: 2022-12-12_18:34:26.631817) 18:34:27.122519 run osmo-nitb_10.42.42.2(pid=13425): stderr: | (launched: 2022-12-12_18:34:26.675895) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:34:27.257616 run osmo-nitb_10.42.42.2(pid=13425): stdout: | (launched: 2022-12-12_18:34:26.631817) 18:34:27.387378 run osmo-nitb_10.42.42.2(pid=13425): stderr: | (launched: 2022-12-12_18:34:26.675895) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13425): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13425) [trial-2380↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13425)] 18:34:27.800751 tst osmo-nitb_10.42.42.2(pid=13425): stdout: | (launched: 2022-12-12_18:34:26.631817) 18:34:27.921774 tst osmo-nitb_10.42.42.2(pid=13425): stderr: | (launched: 2022-12-12_18:34:26.675895) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:34:28.064095 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=13425): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13425) [trial-2380↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13425)] [trial-2380↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 18:34:28.072827 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 18:34:28.079512 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13424): Terminating (SIGTERM) 18:34:28.289653 --- ParallelTerminationStrategy: PID 13424 died... 18:34:28.310908 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13424): Terminated: ok {rc=0} 18:34:28.398313 bus /sierra_3: Setting Powered False 18:34:29.499971 bus /sierra_3: Setting Powered False 18:34:30.616788 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 18:34:31.838056 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:31.843882 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:34:31.882735 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:34:31.916753 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:34:31.982559 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:34:32.020461 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:34:32.054869 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:34:32.588205 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 18:34:32.593603 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:34:32.604804 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:34:32.651487 tst mo_mt_sms.py: using LAC 30706 18:34:32.777396 tst mo_mt_sms.py: using RAC 106 18:34:32.901651 tst mo_mt_sms.py: using CellId 30706 18:34:33.028388 tst mo_mt_sms.py: using BVCI 30707 18:34:33.144003 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:34:33.155192 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:34:33.166506 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:34:33.177550 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:34:33.188561 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:34:33.200100 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:34:33.320110 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:34:33.440085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:33.935693 run create_hlr_db(pid=13429): Launched 18:34:34.066929 bus /sierra_2: Setting Powered False 18:34:35.130409 run create_hlr_db(pid=13429): Terminated: ok {rc=0} 18:34:35.558479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13432): Launched 18:34:35.859399 run osmo-hlr_10.42.42.2(pid=13433): Launched 18:34:35.972712 run osmo-stp_10.42.42.5: Starting osmo-stp 18:34:36.496473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13435): Launched 18:34:36.796598 run osmo-stp_10.42.42.5(pid=13436): Launched 18:34:36.910440 run osmo-msc_10.42.42.6: Starting osmo-msc 18:34:37.455051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13438): Launched 18:34:37.754568 run osmo-msc_10.42.42.6(pid=13439): Launched 18:34:37.922006 run osmo-stp_10.42.42.5(pid=13436): ERR: Terminated: ERROR {rc=1} [trial-2380↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13436)] 18:34:38.048133 run osmo-stp_10.42.42.5(pid=13436): stdout: | (launched: 2022-12-12_18:34:36.740472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:38.174606 run osmo-stp_10.42.42.5(pid=13436): stderr: | [0;m[38;5;43m20221212183436907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183436907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183436907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183436908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183436908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183436908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183436908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:38.298876 run osmo-stp_10.42.42.5(pid=13436): stdout: | (launched: 2022-12-12_18:34:36.740472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:38.417589 run osmo-stp_10.42.42.5(pid=13436): stderr: | [0;m[38;5;43m20221212183436907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183436907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183436907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183436908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183436908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183436908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183436908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:38.559899 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=13436): Process ended prematurely: osmo-stp_10.42.42.5(pid=13436) [trial-2380↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13436)] [trial-2380↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 18:34:38.568334 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 18:34:38.595247 run osmo-hlr_10.42.42.2(pid=13433): ERR: Terminated: ERROR {rc=237} [trial-2380↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13433)] 18:34:38.643417 run osmo-hlr_10.42.42.2(pid=13433): stdout: | (launched: 2022-12-12_18:34:35.803781) 18:34:38.693458 run osmo-hlr_10.42.42.2(pid=13433): stderr: | [0;m[1;31m20221212183435976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183435976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183435977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183435977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183435977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183435977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183435989 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183435998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183435998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183435998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:34:38.763390 run osmo-msc_10.42.42.6(pid=13439): ERR: Terminated: ERROR {rc=2} [trial-2380↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13439)] 18:34:38.812093 run osmo-msc_10.42.42.6(pid=13439): stdout: | (launched: 2022-12-12_18:34:37.698988) 18:34:38.862195 run osmo-msc_10.42.42.6(pid=13439): stderr: | [0;m[38;5;43m20221212183437967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183437967 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2ed384bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183437967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183437967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183437967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183437968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183437969 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183437970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183437970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183437970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:34:38.912832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13432): Terminating (SIGTERM) 18:34:38.953247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13435): Terminating (SIGTERM) 18:34:38.993751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13438): Terminating (SIGTERM) 18:34:39.034599 --- ParallelTerminationStrategy: PID 13432 died... 18:34:39.054005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13432): Terminated: ok {rc=0} 18:34:39.098758 --- ParallelTerminationStrategy: PID 13435 died... 18:34:39.117513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13435): Terminated: ok {rc=0} 18:34:39.162063 --- ParallelTerminationStrategy: PID 13438 died... 18:34:39.180703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13438): Terminated: ok {rc=0} 18:34:39.265643 bus /sierra_3: Setting Powered False 18:34:40.365238 bus /sierra_3: Setting Powered False 18:34:41.482578 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 18:34:42.712484 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:42.716848 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:34:42.748123 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 18:34:42.755185 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 18:34:42.791857 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:34:42.821845 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 18:34:42.829412 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 18:34:43.349898 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2380 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 18:34:43.355610 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 18:34:43.366852 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:34:43.412498 tst assert_extension.py: using LAC 30707 18:34:43.533428 tst assert_extension.py: using RAC 107 18:34:43.650300 tst assert_extension.py: using CellId 30707 18:34:43.766172 tst assert_extension.py: using BVCI 30708 18:34:43.874470 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 18:34:43.991896 tst assert_extension.py:10: start nitb and bts... 18:34:44.208043 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:34:44.861820 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13444): Launched 18:34:45.184388 run osmo-nitb_10.42.42.2(pid=13445): Launched 18:34:45.362016 run osmo-nitb_10.42.42.2(pid=13445): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13445)] 18:34:45.504899 run osmo-nitb_10.42.42.2(pid=13445): stdout: | (launched: 2022-12-12_18:34:45.125338) 18:34:45.649419 run osmo-nitb_10.42.42.2(pid=13445): stderr: | (launched: 2022-12-12_18:34:45.173186) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:34:45.793952 run osmo-nitb_10.42.42.2(pid=13445): stdout: | (launched: 2022-12-12_18:34:45.125338) 18:34:45.959901 run osmo-nitb_10.42.42.2(pid=13445): stderr: | (launched: 2022-12-12_18:34:45.173186) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13445): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13445) [trial-2380↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13445)] 18:34:46.305126 tst osmo-nitb_10.42.42.2(pid=13445): stdout: | (launched: 2022-12-12_18:34:45.125338) 18:34:46.428184 tst osmo-nitb_10.42.42.2(pid=13445): stderr: | (launched: 2022-12-12_18:34:45.173186) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:34:46.575167 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=13445): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13445) [trial-2380↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13445)] [trial-2380↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 18:34:46.584809 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:34:46.592759 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13444): Terminating (SIGTERM) 18:34:46.807012 --- ParallelTerminationStrategy: PID 13444 died... 18:34:46.827417 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13444): Terminated: ok {rc=0} 18:34:46.916487 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 18:34:48.087491 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:48.091792 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:34:48.122824 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:34:48.150040 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 18:34:48.185715 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:34:48.215061 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:34:48.241691 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 18:34:48.770592 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2380 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 18:34:48.775802 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:34:48.786826 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:34:48.831591 tst assert_extension.py: using LAC 30708 18:34:48.957488 tst assert_extension.py: using RAC 108 18:34:49.080739 tst assert_extension.py: using CellId 30708 18:34:49.205727 tst assert_extension.py: using BVCI 30709 18:34:49.320545 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:34:49.332047 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:34:49.343322 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:34:49.354679 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:34:49.365795 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:34:49.376772 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 18:34:49.491042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:49.954198 run create_hlr_db(pid=13449): Launched 18:34:50.070959 bus /sierra_2: Setting Powered False 18:34:51.130996 run create_hlr_db(pid=13449): Terminated: ok {rc=0} 18:34:51.568608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13451): Launched 18:34:51.890978 run osmo-hlr_10.42.42.2(pid=13452): Launched 18:34:52.014765 run osmo-stp_10.42.42.5: Starting osmo-stp 18:34:52.569755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13454): Launched 18:34:52.891711 run osmo-stp_10.42.42.5(pid=13455): Launched 18:34:53.013834 run osmo-msc_10.42.42.6: Starting osmo-msc 18:34:53.592604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13457): Launched 18:34:53.913378 run osmo-msc_10.42.42.6(pid=13458): Launched 18:34:54.091310 run osmo-stp_10.42.42.5(pid=13455): ERR: Terminated: ERROR {rc=1} [trial-2380↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13455)] 18:34:54.226321 run osmo-stp_10.42.42.5(pid=13455): stdout: | (launched: 2022-12-12_18:34:52.832442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:54.360572 run osmo-stp_10.42.42.5(pid=13455): stderr: | [0;m[38;5;43m20221212183453022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183453022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183453022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183453023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183453023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183453023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183453023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:54.493754 run osmo-stp_10.42.42.5(pid=13455): stdout: | (launched: 2022-12-12_18:34:52.832442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:34:54.620533 run osmo-stp_10.42.42.5(pid=13455): stderr: | [0;m[38;5;43m20221212183453022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183453022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183453022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183453023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183453023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183453023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183453023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:34:54.772452 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13455): Process ended prematurely: osmo-stp_10.42.42.5(pid=13455) [trial-2380↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13455)] [trial-2380↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 18:34:54.781369 tst assert_extension.py:17: Test FAILED (6.0 sec) 18:34:54.808586 run osmo-hlr_10.42.42.2(pid=13452): ERR: Terminated: ERROR {rc=237} [trial-2380↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13452)] 18:34:54.858240 run osmo-hlr_10.42.42.2(pid=13452): stdout: | (launched: 2022-12-12_18:34:51.831926) 18:34:54.909664 run osmo-hlr_10.42.42.2(pid=13452): stderr: | [0;m[1;31m20221212183452026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183452026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183452026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183452026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183452026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183452026 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183452038 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183452049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183452049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183452049 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:34:54.981321 run osmo-msc_10.42.42.6(pid=13458): ERR: Terminated: ERROR {rc=2} [trial-2380↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13458)] 18:34:55.031164 run osmo-msc_10.42.42.6(pid=13458): stdout: | (launched: 2022-12-12_18:34:53.854314) 18:34:55.082569 run osmo-msc_10.42.42.6(pid=13458): stderr: | [0;m[38;5;43m20221212183454176 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183454176 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f87a11a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183454176 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183454176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183454176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183454176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183454178 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183454179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183454179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183454179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:34:55.135192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13451): Terminating (SIGTERM) 18:34:55.176920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13454): Terminating (SIGTERM) 18:34:55.218705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13457): Terminating (SIGTERM) 18:34:55.260701 --- ParallelTerminationStrategy: PID 13451 died... 18:34:55.280865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13451): Terminated: ok {rc=0} 18:34:55.326959 --- ParallelTerminationStrategy: PID 13454 died... 18:34:55.346573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13454): Terminated: ok {rc=0} 18:34:55.392275 --- ParallelTerminationStrategy: PID 13457 died... 18:34:55.411793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13457): Terminated: ok {rc=0} 18:34:55.499128 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:34:56.703940 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:34:56.710926 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:34:56.740780 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:34:56.767812 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:34:56.821335 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:34:56.850581 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:34:56.876886 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:34:57.430923 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:34:57.481134 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:34:57.492426 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:34:57.561070 tst mo_mt_call.py: using LAC 30709 18:34:57.679751 tst mo_mt_call.py: using RAC 109 18:34:57.797358 tst mo_mt_call.py: using CellId 30709 18:34:57.915078 tst mo_mt_call.py: using BVCI 30710 18:34:58.026432 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:34:58.037763 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:34:58.048841 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:34:58.059971 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:34:58.071645 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:34:58.082938 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:34:58.203842 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:34:58.320124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:34:58.791004 run create_hlr_db(pid=13464): Launched 18:34:58.909542 bus /sierra_2: Setting Powered False 18:34:59.969782 run create_hlr_db(pid=13464): Terminated: ok {rc=0} 18:35:00.394756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13466): Launched 18:35:00.699465 run osmo-hlr_10.42.42.2(pid=13467): Launched 18:35:00.816161 run osmo-stp_10.42.42.5: Starting osmo-stp 18:35:01.487739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13472): Launched 18:35:01.832773 run osmo-stp_10.42.42.5(pid=13473): Launched 18:35:02.228836 run osmo-msc_10.42.42.6: Starting osmo-msc 18:35:02.838338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13475): Launched 18:35:03.144532 run osmo-msc_10.42.42.6(pid=13476): Launched 18:35:03.314243 run osmo-stp_10.42.42.5(pid=13473): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13473)] 18:35:03.441634 run osmo-stp_10.42.42.5(pid=13473): stdout: | (launched: 2022-12-12_18:35:01.770941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:03.569144 run osmo-stp_10.42.42.5(pid=13473): stderr: | [0;m[38;5;43m20221212183502030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183502030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183502031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183502031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183502032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183502032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183502033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:03.694930 run osmo-stp_10.42.42.5(pid=13473): stdout: | (launched: 2022-12-12_18:35:01.770941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:03.815762 run osmo-stp_10.42.42.5(pid=13473): stderr: | [0;m[38;5;43m20221212183502030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183502030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183502031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183502031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183502032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183502032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183502033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:03.960125 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13473): Process ended prematurely: osmo-stp_10.42.42.5(pid=13473) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13473)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:35:03.969116 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 18:35:03.996013 run osmo-hlr_10.42.42.2(pid=13467): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13467)] 18:35:04.044348 run osmo-hlr_10.42.42.2(pid=13467): stdout: | (launched: 2022-12-12_18:35:00.643308) 18:35:04.094155 run osmo-hlr_10.42.42.2(pid=13467): stderr: | [0;m[1;31m20221212183500815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183500815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183500815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183500815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183500815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183500815 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183500838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183500849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183500849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183500849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:35:04.163680 run osmo-msc_10.42.42.6(pid=13476): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13476)] 18:35:04.211571 run osmo-msc_10.42.42.6(pid=13476): stdout: | (launched: 2022-12-12_18:35:03.088319) 18:35:04.261216 run osmo-msc_10.42.42.6(pid=13476): stderr: | [0;m[38;5;43m20221212183503360 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183503361 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f134c012c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183503361 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183503361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183503361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183503361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183503363 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183503363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183503364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183503364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:35:04.311195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13466): Terminating (SIGTERM) 18:35:04.351184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13472): Terminating (SIGTERM) 18:35:04.391043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13475): Terminating (SIGTERM) 18:35:04.430991 --- ParallelTerminationStrategy: PID 13466 died... 18:35:04.450188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13466): Terminated: ok {rc=0} 18:35:04.494268 --- ParallelTerminationStrategy: PID 13472 died... 18:35:04.512862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13472): Terminated: ok {rc=0} 18:35:04.557406 --- ParallelTerminationStrategy: PID 13475 died... 18:35:04.575988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13475): Terminated: ok {rc=0} 18:35:04.660096 bus /sierra_3: Setting Powered False 18:35:05.758910 bus /sierra_3: Setting Powered False 18:35:06.873659 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:35:08.023659 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:35:08.036292 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:35:08.105130 tst mo_mt_call_osmux.py: using LAC 30710 18:35:08.232878 tst mo_mt_call_osmux.py: using RAC 110 18:35:08.360740 tst mo_mt_call_osmux.py: using CellId 30710 18:35:08.488519 tst mo_mt_call_osmux.py: using BVCI 30711 18:35:08.608051 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:35:08.620033 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:35:08.631795 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:35:08.643450 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:35:08.655321 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:35:08.667006 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:35:08.785991 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:35:08.903140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:35:09.380625 run create_hlr_db(pid=13479): Launched 18:35:09.498412 bus /sierra_2: Setting Powered False 18:35:10.559501 run create_hlr_db(pid=13479): Terminated: ok {rc=0} 18:35:11.005963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13481): Launched 18:35:11.335057 run osmo-hlr_10.42.42.2(pid=13482): Launched 18:35:11.460398 run osmo-stp_10.42.42.5: Starting osmo-stp 18:35:12.022226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13484): Launched 18:35:12.350839 run osmo-stp_10.42.42.5(pid=13485): Launched 18:35:12.475788 run osmo-msc_10.42.42.6: Starting osmo-msc 18:35:13.070186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13487): Launched 18:35:13.399287 run osmo-msc_10.42.42.6(pid=13488): Launched 18:35:13.581890 run osmo-stp_10.42.42.5(pid=13485): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13485)] 18:35:13.719668 run osmo-stp_10.42.42.5(pid=13485): stdout: | (launched: 2022-12-12_18:35:12.290539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:13.857554 run osmo-stp_10.42.42.5(pid=13485): stderr: | [0;m[38;5;43m20221212183512478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183512478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183512478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183512479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183512479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183512479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183512479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:13.993160 run osmo-stp_10.42.42.5(pid=13485): stdout: | (launched: 2022-12-12_18:35:12.290539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:14.123059 run osmo-stp_10.42.42.5(pid=13485): stderr: | [0;m[38;5;43m20221212183512478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183512478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183512478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183512479 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183512479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183512479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183512479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:14.279348 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13485): Process ended prematurely: osmo-stp_10.42.42.5(pid=13485) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13485)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:35:14.288869 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:35:14.317321 run osmo-hlr_10.42.42.2(pid=13482): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13482)] 18:35:14.368278 run osmo-hlr_10.42.42.2(pid=13482): stdout: | (launched: 2022-12-12_18:35:11.274486) 18:35:14.420611 run osmo-hlr_10.42.42.2(pid=13482): stderr: | [0;m[1;31m20221212183511470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183511470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183511470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183511471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183511471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183511471 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183511483 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183511494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183511494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183511494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:35:14.493622 run osmo-msc_10.42.42.6(pid=13488): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13488)] 18:35:14.544411 run osmo-msc_10.42.42.6(pid=13488): stdout: | (launched: 2022-12-12_18:35:13.338401) 18:35:14.596806 run osmo-msc_10.42.42.6(pid=13488): stderr: | [0;m[38;5;43m20221212183513658 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183513658 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f852cbf2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183513658 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183513658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183513658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183513658 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183513660 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183513660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183513660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183513661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:35:14.649423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13481): Terminating (SIGTERM) 18:35:14.691676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13484): Terminating (SIGTERM) 18:35:14.734207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13487): Terminating (SIGTERM) 18:35:14.776828 --- ParallelTerminationStrategy: PID 13481 died... 18:35:14.797311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13481): Terminated: ok {rc=0} 18:35:14.844000 --- ParallelTerminationStrategy: PID 13484 died... 18:35:14.863901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13484): Terminated: ok {rc=0} 18:35:14.911036 --- ParallelTerminationStrategy: PID 13487 died... 18:35:14.930978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13487): Terminated: ok {rc=0} 18:35:15.019010 bus /sierra_3: Setting Powered False 18:35:16.123001 bus /sierra_3: Setting Powered False 18:35:17.258139 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:35:18.504576 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:35:18.511508 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:35:18.541434 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:35:18.568164 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:35:18.619955 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:35:18.649046 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:35:18.675779 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:35:19.228498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:35:19.278170 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:35:19.289512 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:35:19.354523 tst mo_mt_call.py: using LAC 30711 18:35:19.473370 tst mo_mt_call.py: using RAC 111 18:35:19.594582 tst mo_mt_call.py: using CellId 30711 18:35:19.715779 tst mo_mt_call.py: using BVCI 30712 18:35:19.827748 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:35:19.839101 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:35:19.850233 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:35:19.861765 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:35:19.873290 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:35:19.884672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:35:20.005733 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:35:20.124545 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:35:20.600201 run create_hlr_db(pid=13493): Launched 18:35:20.716499 bus /sierra_2: Setting Powered False 18:35:21.777838 run create_hlr_db(pid=13493): Terminated: ok {rc=0} 18:35:22.203778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13495): Launched 18:35:22.510214 run osmo-hlr_10.42.42.2(pid=13496): Launched 18:35:22.626917 run osmo-stp_10.42.42.5: Starting osmo-stp 18:35:23.161478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13498): Launched 18:35:23.467036 run osmo-stp_10.42.42.5(pid=13499): Launched 18:35:23.583237 run osmo-msc_10.42.42.6: Starting osmo-msc 18:35:24.134296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13501): Launched 18:35:24.439452 run osmo-msc_10.42.42.6(pid=13502): Launched 18:35:24.610447 run osmo-stp_10.42.42.5(pid=13499): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13499)] 18:35:24.739448 run osmo-stp_10.42.42.5(pid=13499): stdout: | (launched: 2022-12-12_18:35:23.410622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:24.868010 run osmo-stp_10.42.42.5(pid=13499): stderr: | [0;m[38;5;43m20221212183523581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183523581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183523581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183523582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183523582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183523582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183523582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:24.994282 run osmo-stp_10.42.42.5(pid=13499): stdout: | (launched: 2022-12-12_18:35:23.410622) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:25.115527 run osmo-stp_10.42.42.5(pid=13499): stderr: | [0;m[38;5;43m20221212183523581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183523581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183523581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183523582 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183523582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183523582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183523582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:25.260772 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13499): Process ended prematurely: osmo-stp_10.42.42.5(pid=13499) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13499)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:35:25.269921 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 18:35:25.296862 run osmo-hlr_10.42.42.2(pid=13496): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13496)] 18:35:25.344836 run osmo-hlr_10.42.42.2(pid=13496): stdout: | (launched: 2022-12-12_18:35:22.453657) 18:35:25.394615 run osmo-hlr_10.42.42.2(pid=13496): stderr: | [0;m[1;31m20221212183522632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183522632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183522632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183522632 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183522633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183522633 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183522645 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183522653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183522653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183522653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:35:25.463611 run osmo-msc_10.42.42.6(pid=13502): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13502)] 18:35:25.511129 run osmo-msc_10.42.42.6(pid=13502): stdout: | (launched: 2022-12-12_18:35:24.383117) 18:35:25.560525 run osmo-msc_10.42.42.6(pid=13502): stderr: | [0;m[38;5;43m20221212183524652 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183524652 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc1dbd2ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183524653 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183524653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183524653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183524653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183524655 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183524655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183524655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183524655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:35:25.610427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13495): Terminating (SIGTERM) 18:35:25.650075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13498): Terminating (SIGTERM) 18:35:25.689374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13501): Terminating (SIGTERM) 18:35:25.729307 --- ParallelTerminationStrategy: PID 13495 died... 18:35:25.748682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13495): Terminated: ok {rc=0} 18:35:25.793331 --- ParallelTerminationStrategy: PID 13498 died... 18:35:25.812121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13498): Terminated: ok {rc=0} 18:35:25.856484 --- ParallelTerminationStrategy: PID 13501 died... 18:35:25.875192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13501): Terminated: ok {rc=0} 18:35:25.961357 bus /sierra_3: Setting Powered False 18:35:27.061395 bus /sierra_3: Setting Powered False 18:35:28.177158 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:35:29.324439 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:35:29.336837 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:35:29.404172 tst mo_mt_call_osmux.py: using LAC 30712 18:35:29.523928 tst mo_mt_call_osmux.py: using RAC 112 18:35:29.645213 tst mo_mt_call_osmux.py: using CellId 30712 18:35:29.764043 tst mo_mt_call_osmux.py: using BVCI 30713 18:35:29.876203 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:35:29.887735 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:35:29.898989 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:35:29.910545 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:35:29.922204 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:35:29.933744 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:35:30.055665 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:35:30.177479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:35:30.685356 run create_hlr_db(pid=13504): Launched 18:35:30.819899 bus /sierra_2: Setting Powered False 18:35:31.885501 run create_hlr_db(pid=13504): Terminated: ok {rc=0} 18:35:32.353658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13506): Launched 18:35:32.682040 run osmo-hlr_10.42.42.2(pid=13507): Launched 18:35:32.809439 run osmo-stp_10.42.42.5: Starting osmo-stp 18:35:33.370724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13509): Launched 18:35:33.699067 run osmo-stp_10.42.42.5(pid=13510): Launched 18:35:33.823940 run osmo-msc_10.42.42.6: Starting osmo-msc 18:35:34.415737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13512): Launched 18:35:34.743950 run osmo-msc_10.42.42.6(pid=13513): Launched 18:35:34.926443 run osmo-stp_10.42.42.5(pid=13510): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13510)] 18:35:35.062730 run osmo-stp_10.42.42.5(pid=13510): stdout: | (launched: 2022-12-12_18:35:33.638938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:35.200409 run osmo-stp_10.42.42.5(pid=13510): stderr: | [0;m[38;5;43m20221212183533828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183533828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183533828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183533828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183533829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183533829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183533829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:35.336042 run osmo-stp_10.42.42.5(pid=13510): stdout: | (launched: 2022-12-12_18:35:33.638938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:35.466790 run osmo-stp_10.42.42.5(pid=13510): stderr: | [0;m[38;5;43m20221212183533828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183533828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183533828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183533828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183533829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183533829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183533829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:35.622624 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13510): Process ended prematurely: osmo-stp_10.42.42.5(pid=13510) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13510)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:35:35.632568 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:35:35.660938 run osmo-hlr_10.42.42.2(pid=13507): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13507)] 18:35:35.711233 run osmo-hlr_10.42.42.2(pid=13507): stdout: | (launched: 2022-12-12_18:35:32.621633) 18:35:35.763037 run osmo-hlr_10.42.42.2(pid=13507): stderr: | [0;m[1;31m20221212183532818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183532818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183532818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183532818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183532818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183532818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183532829 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183532838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183532838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183532838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:35:35.835615 run osmo-msc_10.42.42.6(pid=13513): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13513)] 18:35:35.885746 run osmo-msc_10.42.42.6(pid=13513): stdout: | (launched: 2022-12-12_18:35:34.683841) 18:35:35.937513 run osmo-msc_10.42.42.6(pid=13513): stderr: | [0;m[38;5;43m20221212183535004 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183535004 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faa283c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183535004 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183535004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183535004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183535004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183535006 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183535007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183535007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183535007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:35:35.989789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13506): Terminating (SIGTERM) 18:35:36.031781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13509): Terminating (SIGTERM) 18:35:36.074129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13512): Terminating (SIGTERM) 18:35:36.116473 --- ParallelTerminationStrategy: PID 13506 died... 18:35:36.136792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13506): Terminated: ok {rc=0} 18:35:36.183392 --- ParallelTerminationStrategy: PID 13509 died... 18:35:36.203409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13509): Terminated: ok {rc=0} 18:35:36.249886 --- ParallelTerminationStrategy: PID 13512 died... 18:35:36.269840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13512): Terminated: ok {rc=0} 18:35:36.358674 bus /sierra_3: Setting Powered False 18:35:37.460093 bus /sierra_3: Setting Powered False 18:35:38.577473 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:35:39.832849 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:35:39.840702 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:35:39.871351 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:35:39.899052 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:35:39.955132 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:35:39.985604 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:35:40.013364 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:35:40.564502 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:35:40.617543 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:35:40.628939 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:35:40.694835 tst mo_mt_call.py: using LAC 30713 18:35:40.813449 tst mo_mt_call.py: using RAC 113 18:35:40.941423 tst mo_mt_call.py: using CellId 30713 18:35:41.061767 tst mo_mt_call.py: using BVCI 30714 18:35:41.174736 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:35:41.186129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:35:41.197357 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:35:41.209264 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:35:41.221308 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:35:41.233308 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:35:41.353985 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:35:41.471181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:35:41.978227 run create_hlr_db(pid=13518): Launched 18:35:42.112357 bus /sierra_2: Setting Powered False 18:35:43.177990 run create_hlr_db(pid=13518): Terminated: ok {rc=0} 18:35:43.615744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13520): Launched 18:35:43.922706 run osmo-hlr_10.42.42.2(pid=13521): Launched 18:35:44.039215 run osmo-stp_10.42.42.5: Starting osmo-stp 18:35:44.575010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13523): Launched 18:35:44.880877 run osmo-stp_10.42.42.5(pid=13524): Launched 18:35:44.997249 run osmo-msc_10.42.42.6: Starting osmo-msc 18:35:45.552860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13526): Launched 18:35:45.869642 run osmo-msc_10.42.42.6(pid=13527): Launched 18:35:46.166661 run osmo-stp_10.42.42.5(pid=13524): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13524)] 18:35:46.338819 run osmo-stp_10.42.42.5(pid=13524): stdout: | (launched: 2022-12-12_18:35:44.824351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:46.538910 run osmo-stp_10.42.42.5(pid=13524): stderr: | [0;m[38;5;43m20221212183544992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183544992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183544993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183544993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183544994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183544994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183544994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:46.778797 run osmo-stp_10.42.42.5(pid=13524): stdout: | (launched: 2022-12-12_18:35:44.824351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:46.992866 run osmo-stp_10.42.42.5(pid=13524): stderr: | [0;m[38;5;43m20221212183544992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183544992 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183544993 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183544993 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183544994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183544994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183544994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:47.155763 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13524): Process ended prematurely: osmo-stp_10.42.42.5(pid=13524) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13524)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:35:47.166427 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 18:35:47.196775 run osmo-hlr_10.42.42.2(pid=13521): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13521)] 18:35:47.249639 run osmo-hlr_10.42.42.2(pid=13521): stdout: | (launched: 2022-12-12_18:35:43.866296) 18:35:47.303466 run osmo-hlr_10.42.42.2(pid=13521): stderr: | [0;m[1;31m20221212183544041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183544041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183544041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183544041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183544041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183544041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183544053 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183544061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183544062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183544062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:35:47.379240 run osmo-msc_10.42.42.6(pid=13527): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13527)] 18:35:47.430892 run osmo-msc_10.42.42.6(pid=13527): stdout: | (launched: 2022-12-12_18:35:45.803507) 18:35:47.483592 run osmo-msc_10.42.42.6(pid=13527): stderr: | [0;m[38;5;43m20221212183546452 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183546452 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fba54d0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183546452 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183546452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183546452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183546453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183546454 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183546455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183546455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183546455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:35:47.536602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13520): Terminating (SIGTERM) 18:35:47.580130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13523): Terminating (SIGTERM) 18:35:47.623013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13526): Terminating (SIGTERM) 18:35:47.666321 --- ParallelTerminationStrategy: PID 13520 died... 18:35:47.686682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13520): Terminated: ok {rc=0} 18:35:47.734502 --- ParallelTerminationStrategy: PID 13523 died... 18:35:47.754454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13523): Terminated: ok {rc=0} 18:35:47.801966 --- ParallelTerminationStrategy: PID 13526 died... 18:35:47.822117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13526): Terminated: ok {rc=0} 18:35:47.911570 bus /sierra_3: Setting Powered False 18:35:49.011400 bus /sierra_3: Setting Powered False 18:35:50.130043 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:35:51.276833 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:35:51.289248 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:35:51.356099 tst mo_mt_call_osmux.py: using LAC 30714 18:35:51.475791 tst mo_mt_call_osmux.py: using RAC 114 18:35:51.595898 tst mo_mt_call_osmux.py: using CellId 30714 18:35:51.717332 tst mo_mt_call_osmux.py: using BVCI 30715 18:35:51.829917 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:35:51.841498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:35:51.852671 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:35:51.864246 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:35:51.875846 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:35:51.887510 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:35:52.003958 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:35:52.124501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:35:52.629961 run create_hlr_db(pid=13529): Launched 18:35:52.763990 bus /sierra_2: Setting Powered False 18:35:53.829128 run create_hlr_db(pid=13529): Terminated: ok {rc=0} 18:35:54.264141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13531): Launched 18:35:54.569337 run osmo-hlr_10.42.42.2(pid=13532): Launched 18:35:54.686465 run osmo-stp_10.42.42.5: Starting osmo-stp 18:35:55.225703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13534): Launched 18:35:55.531898 run osmo-stp_10.42.42.5(pid=13535): Launched 18:35:55.648847 run osmo-msc_10.42.42.6: Starting osmo-msc 18:35:56.201833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13537): Launched 18:35:56.508809 run osmo-msc_10.42.42.6(pid=13538): Launched 18:35:56.681372 run osmo-stp_10.42.42.5(pid=13535): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13535)] 18:35:56.810689 run osmo-stp_10.42.42.5(pid=13535): stdout: | (launched: 2022-12-12_18:35:55.475237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:56.939219 run osmo-stp_10.42.42.5(pid=13535): stderr: | [0;m[38;5;43m20221212183555644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183555644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183555644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183555644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183555645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183555645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183555645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:57.066454 run osmo-stp_10.42.42.5(pid=13535): stdout: | (launched: 2022-12-12_18:35:55.475237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:35:57.187887 run osmo-stp_10.42.42.5(pid=13535): stderr: | [0;m[38;5;43m20221212183555644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183555644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183555644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183555644 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183555645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183555645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183555645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:35:57.333368 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13535): Process ended prematurely: osmo-stp_10.42.42.5(pid=13535) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13535)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:35:57.342348 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:35:57.370224 run osmo-hlr_10.42.42.2(pid=13532): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13532)] 18:35:57.418693 run osmo-hlr_10.42.42.2(pid=13532): stdout: | (launched: 2022-12-12_18:35:54.512643) 18:35:57.468596 run osmo-hlr_10.42.42.2(pid=13532): stderr: | [0;m[1;31m20221212183554686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183554686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183554686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183554686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183554686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183554686 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183554699 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183554710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183554711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183554711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:35:57.538724 run osmo-msc_10.42.42.6(pid=13538): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13538)] 18:35:57.587134 run osmo-msc_10.42.42.6(pid=13538): stdout: | (launched: 2022-12-12_18:35:56.452164) 18:35:57.637941 run osmo-msc_10.42.42.6(pid=13538): stderr: | [0;m[38;5;43m20221212183556723 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183556724 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1a68a42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183556724 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183556724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183556724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183556724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183556726 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183556726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183556726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183556726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:35:57.688584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13531): Terminating (SIGTERM) 18:35:57.728804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13534): Terminating (SIGTERM) 18:35:57.769032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13537): Terminating (SIGTERM) 18:35:57.809612 --- ParallelTerminationStrategy: PID 13531 died... 18:35:57.828490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13531): Terminated: ok {rc=0} 18:35:57.873854 --- ParallelTerminationStrategy: PID 13534 died... 18:35:57.892597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13534): Terminated: ok {rc=0} 18:35:57.937524 --- ParallelTerminationStrategy: PID 13537 died... 18:35:57.956352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13537): Terminated: ok {rc=0} 18:35:58.040508 bus /sierra_3: Setting Powered False 18:35:59.138175 bus /sierra_3: Setting Powered False 18:36:00.253980 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 18:36:01.507169 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:36:01.515078 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 18:36:01.547100 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 18:36:01.575475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 18:36:01.629662 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 18:36:01.661803 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 18:36:01.691200 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 18:36:02.252640 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 18:36:02.302125 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:36:02.313460 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:36:02.377294 tst mo_mt_call.py: using LAC 30715 18:36:02.494288 tst mo_mt_call.py: using RAC 115 18:36:02.614959 tst mo_mt_call.py: using CellId 30715 18:36:02.734434 tst mo_mt_call.py: using BVCI 30716 18:36:02.846506 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:36:02.857838 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:36:02.869102 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:36:02.880797 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:36:02.892290 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:36:02.903699 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:36:03.023174 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:36:03.141592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:36:03.617043 run create_hlr_db(pid=13543): Launched 18:36:03.734695 bus /sierra_2: Setting Powered False 18:36:04.795909 run create_hlr_db(pid=13543): Terminated: ok {rc=0} 18:36:05.243096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13545): Launched 18:36:05.571844 run osmo-hlr_10.42.42.2(pid=13546): Launched 18:36:05.698569 run osmo-stp_10.42.42.5: Starting osmo-stp 18:36:06.262645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13548): Launched 18:36:06.589085 run osmo-stp_10.42.42.5(pid=13549): Launched 18:36:06.713888 run osmo-msc_10.42.42.6: Starting osmo-msc 18:36:07.302365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13551): Launched 18:36:07.629493 run osmo-msc_10.42.42.6(pid=13552): Launched 18:36:07.812784 run osmo-stp_10.42.42.5(pid=13549): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13549)] 18:36:07.949902 run osmo-stp_10.42.42.5(pid=13549): stdout: | (launched: 2022-12-12_18:36:06.529076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:36:08.087749 run osmo-stp_10.42.42.5(pid=13549): stderr: | [0;m[38;5;43m20221212183606716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183606716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183606717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183606717 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183606718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183606718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183606718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:36:08.224364 run osmo-stp_10.42.42.5(pid=13549): stdout: | (launched: 2022-12-12_18:36:06.529076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:36:08.354328 run osmo-stp_10.42.42.5(pid=13549): stderr: | [0;m[38;5;43m20221212183606716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183606716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183606717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183606717 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183606718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183606718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183606718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:36:08.509760 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13549): Process ended prematurely: osmo-stp_10.42.42.5(pid=13549) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13549)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 18:36:08.519838 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:36:08.547962 run osmo-hlr_10.42.42.2(pid=13546): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13546)] 18:36:08.597566 run osmo-hlr_10.42.42.2(pid=13546): stdout: | (launched: 2022-12-12_18:36:05.511548) 18:36:08.649104 run osmo-hlr_10.42.42.2(pid=13546): stderr: | [0;m[1;31m20221212183605705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183605705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183605705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183605705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183605705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183605705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183605718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183605727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183605727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183605727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:36:08.720520 run osmo-msc_10.42.42.6(pid=13552): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13552)] 18:36:08.769959 run osmo-msc_10.42.42.6(pid=13552): stdout: | (launched: 2022-12-12_18:36:07.569193) 18:36:08.820918 run osmo-msc_10.42.42.6(pid=13552): stderr: | [0;m[38;5;43m20221212183607890 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183607890 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8bccf40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183607890 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183607890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183607890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183607891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183607892 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183607893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183607893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183607893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:36:08.872496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13545): Terminating (SIGTERM) 18:36:08.914050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13548): Terminating (SIGTERM) 18:36:08.955494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13551): Terminating (SIGTERM) 18:36:08.997200 --- ParallelTerminationStrategy: PID 13545 died... 18:36:09.017214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13545): Terminated: ok {rc=0} 18:36:09.063459 --- ParallelTerminationStrategy: PID 13548 died... 18:36:09.082871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13548): Terminated: ok {rc=0} 18:36:09.129091 --- ParallelTerminationStrategy: PID 13551 died... 18:36:09.148505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13551): Terminated: ok {rc=0} 18:36:09.237113 bus /sierra_3: Setting Powered False 18:36:10.334718 bus /sierra_3: Setting Powered False 18:36:11.449148 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 18:36:12.598653 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:36:12.611535 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 18:36:12.680293 tst mo_mt_call_osmux.py: using LAC 30716 18:36:12.807633 tst mo_mt_call_osmux.py: using RAC 116 18:36:12.935541 tst mo_mt_call_osmux.py: using CellId 30716 18:36:13.065724 tst mo_mt_call_osmux.py: using BVCI 30717 18:36:13.185880 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:36:13.197775 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:36:13.209455 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:36:13.221221 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:36:13.232870 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 18:36:13.244441 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:36:13.361571 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 18:36:13.480759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:36:13.954553 run create_hlr_db(pid=13554): Launched 18:36:14.073622 bus /sierra_2: Setting Powered False 18:36:15.135196 run create_hlr_db(pid=13554): Terminated: ok {rc=0} 18:36:15.582022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13556): Launched 18:36:15.928693 run osmo-hlr_10.42.42.2(pid=13557): Launched 18:36:16.134961 run osmo-stp_10.42.42.5: Starting osmo-stp 18:36:16.808327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13559): Launched 18:36:17.151383 run osmo-stp_10.42.42.5(pid=13560): Launched 18:36:17.358826 run osmo-msc_10.42.42.6: Starting osmo-msc 18:36:17.950102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13562): Launched 18:36:18.279383 run osmo-msc_10.42.42.6(pid=13563): Launched 18:36:18.462885 run osmo-stp_10.42.42.5(pid=13560): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13560)] 18:36:18.600358 run osmo-stp_10.42.42.5(pid=13560): stdout: | (launched: 2022-12-12_18:36:17.089330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:36:18.737468 run osmo-stp_10.42.42.5(pid=13560): stderr: | [0;m[38;5;43m20221212183617355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183617355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183617355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183617356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183617356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183617356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183617356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:36:18.873477 run osmo-stp_10.42.42.5(pid=13560): stdout: | (launched: 2022-12-12_18:36:17.089330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:36:19.003279 run osmo-stp_10.42.42.5(pid=13560): stderr: | [0;m[38;5;43m20221212183617355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183617355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183617355 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183617356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183617356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183617356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183617356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:36:19.158837 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13560): Process ended prematurely: osmo-stp_10.42.42.5(pid=13560) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13560)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 18:36:19.169158 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 18:36:19.197448 run osmo-hlr_10.42.42.2(pid=13557): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13557)] 18:36:19.247807 run osmo-hlr_10.42.42.2(pid=13557): stdout: | (launched: 2022-12-12_18:36:15.854110) 18:36:19.299611 run osmo-hlr_10.42.42.2(pid=13557): stderr: | [0;m[1;31m20221212183616204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183616204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183616204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183616204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183616204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183616204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183616231 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183616254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183616254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183616254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:36:19.372115 run osmo-msc_10.42.42.6(pid=13563): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13563)] 18:36:19.422131 run osmo-msc_10.42.42.6(pid=13563): stdout: | (launched: 2022-12-12_18:36:18.219150) 18:36:19.473798 run osmo-msc_10.42.42.6(pid=13563): stderr: | [0;m[38;5;43m20221212183618538 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183618538 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7aa63fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183618539 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183618539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183618539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183618539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183618541 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183618541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183618541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183618541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:36:19.525875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13556): Terminating (SIGTERM) 18:36:19.567600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13559): Terminating (SIGTERM) 18:36:19.609406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13562): Terminating (SIGTERM) 18:36:19.651456 --- ParallelTerminationStrategy: PID 13556 died... 18:36:19.671629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13556): Terminated: ok {rc=0} 18:36:19.717883 --- ParallelTerminationStrategy: PID 13559 died... 18:36:19.737271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13559): Terminated: ok {rc=0} 18:36:19.783796 --- ParallelTerminationStrategy: PID 13562 died... 18:36:19.803687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13562): Terminated: ok {rc=0} 18:36:19.891525 bus /sierra_3: Setting Powered False 18:36:20.992435 bus /sierra_3: Setting Powered False 18:36:22.111147 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:36:23.360823 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:36:23.367414 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:36:23.396811 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:36:23.423787 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:36:23.475786 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:36:23.504701 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:36:23.531035 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:36:24.089673 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:36:24.139306 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:36:24.150632 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:36:24.216871 tst mo_mt_call.py: using LAC 30717 18:36:24.336295 tst mo_mt_call.py: using RAC 117 18:36:24.455789 tst mo_mt_call.py: using CellId 30717 18:36:24.576497 tst mo_mt_call.py: using BVCI 30718 18:36:24.688454 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:36:24.699828 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:36:24.710919 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:36:24.722236 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:36:24.733832 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:36:24.745189 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:36:24.865533 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:36:24.986123 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:36:25.492850 run create_hlr_db(pid=13569): Launched 18:36:25.627560 bus /sierra_2: Setting Powered False 18:36:26.692085 run create_hlr_db(pid=13569): Terminated: ok {rc=0} 18:36:27.128566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13571): Launched 18:36:27.435213 run osmo-hlr_10.42.42.2(pid=13572): Launched 18:36:27.553106 run osmo-stp_10.42.42.5: Starting osmo-stp 18:36:28.090272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13574): Launched 18:36:28.395642 run osmo-stp_10.42.42.5(pid=13575): Launched 18:36:28.513602 run osmo-msc_10.42.42.6: Starting osmo-msc 18:36:29.064514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13577): Launched 18:36:29.371898 run osmo-msc_10.42.42.6(pid=13578): Launched 18:36:29.543445 run osmo-stp_10.42.42.5(pid=13575): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13575)] 18:36:29.672164 run osmo-stp_10.42.42.5(pid=13575): stdout: | (launched: 2022-12-12_18:36:28.339043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:36:29.800545 run osmo-stp_10.42.42.5(pid=13575): stderr: | [0;m[38;5;43m20221212183628506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183628506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183628507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183628507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183628508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183628508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183628508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:36:29.927263 run osmo-stp_10.42.42.5(pid=13575): stdout: | (launched: 2022-12-12_18:36:28.339043) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:36:30.048208 run osmo-stp_10.42.42.5(pid=13575): stderr: | [0;m[38;5;43m20221212183628506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183628506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183628507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183628507 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183628508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183628508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183628508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:36:30.193808 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13575): Process ended prematurely: osmo-stp_10.42.42.5(pid=13575) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13575)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:36:30.202920 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:36:30.229806 run osmo-hlr_10.42.42.2(pid=13572): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13572)] 18:36:30.277884 run osmo-hlr_10.42.42.2(pid=13572): stdout: | (launched: 2022-12-12_18:36:27.378390) 18:36:30.327605 run osmo-hlr_10.42.42.2(pid=13572): stderr: | [0;m[1;31m20221212183627552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183627552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183627552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183627553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183627553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183627553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183627566 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183627574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183627574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183627574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:36:30.396814 run osmo-msc_10.42.42.6(pid=13578): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13578)] 18:36:30.444502 run osmo-msc_10.42.42.6(pid=13578): stdout: | (launched: 2022-12-12_18:36:29.314681) 18:36:30.494079 run osmo-msc_10.42.42.6(pid=13578): stderr: | [0;m[38;5;43m20221212183629586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183629586 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e44100c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183629586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183629586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183629586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183629587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183629588 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183629589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183629589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183629589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:36:30.543694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13571): Terminating (SIGTERM) 18:36:30.583470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13574): Terminating (SIGTERM) 18:36:30.623314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13577): Terminating (SIGTERM) 18:36:30.663470 --- ParallelTerminationStrategy: PID 13571 died... 18:36:30.682313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13571): Terminated: ok {rc=0} 18:36:30.726823 --- ParallelTerminationStrategy: PID 13574 died... 18:36:30.745528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13574): Terminated: ok {rc=0} 18:36:30.789579 --- ParallelTerminationStrategy: PID 13577 died... 18:36:30.808067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13577): Terminated: ok {rc=0} 18:36:30.917065 bus /sierra_3: Setting Powered False 18:36:32.031322 bus /sierra_3: Setting Powered False 18:36:33.148235 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:36:34.297985 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:36:34.310665 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:36:34.382786 tst mo_mt_call_osmux.py: using LAC 30718 18:36:34.513321 tst mo_mt_call_osmux.py: using RAC 118 18:36:34.642745 tst mo_mt_call_osmux.py: using CellId 30718 18:36:34.762925 tst mo_mt_call_osmux.py: using BVCI 30719 18:36:34.873958 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:36:34.885482 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:36:34.896845 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:36:34.908395 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:36:34.919836 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:36:34.931101 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:36:35.048831 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:36:35.173388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:36:35.682767 run create_hlr_db(pid=13580): Launched 18:36:35.816723 bus /sierra_2: Setting Powered False 18:36:36.882323 run create_hlr_db(pid=13580): Terminated: ok {rc=0} 18:36:37.336895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13582): Launched 18:36:37.665929 run osmo-hlr_10.42.42.2(pid=13583): Launched 18:36:37.790946 run osmo-stp_10.42.42.5: Starting osmo-stp 18:36:38.355436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13585): Launched 18:36:38.684086 run osmo-stp_10.42.42.5(pid=13586): Launched 18:36:38.807380 run osmo-msc_10.42.42.6: Starting osmo-msc 18:36:39.398191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13588): Launched 18:36:39.726329 run osmo-msc_10.42.42.6(pid=13589): Launched 18:36:39.910540 run osmo-stp_10.42.42.5(pid=13586): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13586)] 18:36:40.048014 run osmo-stp_10.42.42.5(pid=13586): stdout: | (launched: 2022-12-12_18:36:38.623825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:36:40.185870 run osmo-stp_10.42.42.5(pid=13586): stderr: | [0;m[38;5;43m20221212183638813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183638813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183638813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183638814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183638814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183638814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183638815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:36:40.321736 run osmo-stp_10.42.42.5(pid=13586): stdout: | (launched: 2022-12-12_18:36:38.623825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:36:40.451929 run osmo-stp_10.42.42.5(pid=13586): stderr: | [0;m[38;5;43m20221212183638813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183638813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183638813 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183638814 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183638814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183638814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183638815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:36:40.607849 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13586): Process ended prematurely: osmo-stp_10.42.42.5(pid=13586) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13586)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:36:40.617481 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 18:36:40.645699 run osmo-hlr_10.42.42.2(pid=13583): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13583)] 18:36:40.696180 run osmo-hlr_10.42.42.2(pid=13583): stdout: | (launched: 2022-12-12_18:36:37.605643) 18:36:40.748122 run osmo-hlr_10.42.42.2(pid=13583): stderr: | [0;m[1;31m20221212183637801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183637801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183637801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183637801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183637801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183637801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183637814 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183637823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183637823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183637823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:36:40.820811 run osmo-msc_10.42.42.6(pid=13589): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13589)] 18:36:40.871092 run osmo-msc_10.42.42.6(pid=13589): stdout: | (launched: 2022-12-12_18:36:39.665983) 18:36:40.922961 run osmo-msc_10.42.42.6(pid=13589): stderr: | [0;m[38;5;43m20221212183639986 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183639987 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff0745b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183639987 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183639987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183639987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183639987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183639989 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183639989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183639989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183639989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:36:40.975193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13582): Terminating (SIGTERM) 18:36:41.017029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13585): Terminating (SIGTERM) 18:36:41.059065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13588): Terminating (SIGTERM) 18:36:41.101562 --- ParallelTerminationStrategy: PID 13582 died... 18:36:41.121807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13582): Terminated: ok {rc=0} 18:36:41.168251 --- ParallelTerminationStrategy: PID 13585 died... 18:36:41.188266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13585): Terminated: ok {rc=0} 18:36:41.234404 --- ParallelTerminationStrategy: PID 13588 died... 18:36:41.254091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13588): Terminated: ok {rc=0} 18:36:41.342453 bus /sierra_3: Setting Powered False 18:36:42.441491 bus /sierra_3: Setting Powered False 18:36:43.557640 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:36:44.808840 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:36:44.815427 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:36:44.845386 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:36:44.872231 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:36:44.923156 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:36:44.952468 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:36:44.978964 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:36:45.534863 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:36:45.584641 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:36:45.596086 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:36:45.661195 tst mo_mt_call.py: using LAC 30719 18:36:45.779406 tst mo_mt_call.py: using RAC 119 18:36:45.910792 tst mo_mt_call.py: using CellId 30719 18:36:46.034599 tst mo_mt_call.py: using BVCI 30720 18:36:46.197649 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:36:46.211352 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:36:46.225464 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:36:46.238778 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:36:46.251454 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:36:46.265269 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:36:46.405217 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:36:46.539619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:36:47.063805 run create_hlr_db(pid=13594): Launched 18:36:47.228048 bus /sierra_2: Setting Powered False 18:36:48.289699 run create_hlr_db(pid=13594): Terminated: ok {rc=0} 18:36:48.746289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13596): Launched 18:36:49.075291 run osmo-hlr_10.42.42.2(pid=13597): Launched 18:36:49.201018 run osmo-stp_10.42.42.5: Starting osmo-stp 18:36:49.763477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13599): Launched 18:36:50.092618 run osmo-stp_10.42.42.5(pid=13600): Launched 18:36:50.218112 run osmo-msc_10.42.42.6: Starting osmo-msc 18:36:50.808638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13602): Launched 18:36:51.138675 run osmo-msc_10.42.42.6(pid=13603): Launched 18:36:51.323197 run osmo-stp_10.42.42.5(pid=13600): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13600)] 18:36:51.460233 run osmo-stp_10.42.42.5(pid=13600): stdout: | (launched: 2022-12-12_18:36:50.031865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:36:51.597749 run osmo-stp_10.42.42.5(pid=13600): stderr: | [0;m[38;5;43m20221212183650223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183650223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183650223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183650224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183650224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183650224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183650224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:36:51.733751 run osmo-stp_10.42.42.5(pid=13600): stdout: | (launched: 2022-12-12_18:36:50.031865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:36:51.864067 run osmo-stp_10.42.42.5(pid=13600): stderr: | [0;m[38;5;43m20221212183650223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183650223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183650223 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183650224 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183650224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183650224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183650224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:36:52.020404 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13600): Process ended prematurely: osmo-stp_10.42.42.5(pid=13600) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13600)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:36:52.030223 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 18:36:52.058643 run osmo-hlr_10.42.42.2(pid=13597): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13597)] 18:36:52.109704 run osmo-hlr_10.42.42.2(pid=13597): stdout: | (launched: 2022-12-12_18:36:49.015344) 18:36:52.161549 run osmo-hlr_10.42.42.2(pid=13597): stderr: | [0;m[1;31m20221212183649211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183649211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183649211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183649211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183649211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183649211 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183649223 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183649233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183649233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183649233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:36:52.234488 run osmo-msc_10.42.42.6(pid=13603): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13603)] 18:36:52.284601 run osmo-msc_10.42.42.6(pid=13603): stdout: | (launched: 2022-12-12_18:36:51.078076) 18:36:52.336190 run osmo-msc_10.42.42.6(pid=13603): stderr: | [0;m[38;5;43m20221212183651398 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183651399 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7facb45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183651399 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183651399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183651399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183651399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183651401 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183651401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183651401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183651401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:36:52.388303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13596): Terminating (SIGTERM) 18:36:52.430391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13599): Terminating (SIGTERM) 18:36:52.472217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13602): Terminating (SIGTERM) 18:36:52.514544 --- ParallelTerminationStrategy: PID 13596 died... 18:36:52.534665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13596): Terminated: ok {rc=0} 18:36:52.581200 --- ParallelTerminationStrategy: PID 13599 died... 18:36:52.601021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13599): Terminated: ok {rc=0} 18:36:52.647656 --- ParallelTerminationStrategy: PID 13602 died... 18:36:52.667380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13602): Terminated: ok {rc=0} 18:36:52.757349 bus /sierra_3: Setting Powered False 18:36:53.858320 bus /sierra_3: Setting Powered False 18:36:54.975523 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:36:56.126245 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:36:56.138977 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:36:56.208429 tst mo_mt_call_osmux.py: using LAC 30720 18:36:56.336446 tst mo_mt_call_osmux.py: using RAC 120 18:36:56.457600 tst mo_mt_call_osmux.py: using CellId 30720 18:36:56.580278 tst mo_mt_call_osmux.py: using BVCI 30721 18:36:56.692039 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:36:56.703490 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:36:56.714725 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:36:56.726568 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:36:56.738230 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:36:56.749777 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:36:56.869508 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:36:56.993676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:36:57.501977 run create_hlr_db(pid=13605): Launched 18:36:57.637571 bus /sierra_2: Setting Powered False 18:36:58.702835 run create_hlr_db(pid=13605): Terminated: ok {rc=0} 18:36:59.140344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13607): Launched 18:36:59.448028 run osmo-hlr_10.42.42.2(pid=13608): Launched 18:36:59.565220 run osmo-stp_10.42.42.5: Starting osmo-stp 18:37:00.106233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13610): Launched 18:37:00.417312 run osmo-stp_10.42.42.5(pid=13611): Launched 18:37:00.534016 run osmo-msc_10.42.42.6: Starting osmo-msc 18:37:01.119003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13613): Launched 18:37:01.460488 run osmo-msc_10.42.42.6(pid=13614): Launched 18:37:01.775430 run osmo-stp_10.42.42.5(pid=13611): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13611)] 18:37:02.077223 run osmo-stp_10.42.42.5(pid=13611): stdout: | (launched: 2022-12-12_18:37:00.360263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:37:02.242182 run osmo-stp_10.42.42.5(pid=13611): stderr: | [0;m[38;5;43m20221212183700528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183700528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183700529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183700529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183700530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183700530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183700530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:37:02.379330 run osmo-stp_10.42.42.5(pid=13611): stdout: | (launched: 2022-12-12_18:37:00.360263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:37:02.509428 run osmo-stp_10.42.42.5(pid=13611): stderr: | [0;m[38;5;43m20221212183700528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183700528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183700529 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183700529 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183700530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183700530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183700530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:37:02.665683 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13611): Process ended prematurely: osmo-stp_10.42.42.5(pid=13611) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13611)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:37:02.675467 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 18:37:02.703957 run osmo-hlr_10.42.42.2(pid=13608): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13608)] 18:37:02.754555 run osmo-hlr_10.42.42.2(pid=13608): stdout: | (launched: 2022-12-12_18:36:59.391262) 18:37:02.806839 run osmo-hlr_10.42.42.2(pid=13608): stderr: | [0;m[1;31m20221212183659566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183659566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183659566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183659566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183659566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183659566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183659578 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183659589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183659590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183659590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:37:02.880254 run osmo-msc_10.42.42.6(pid=13614): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13614)] 18:37:02.930766 run osmo-msc_10.42.42.6(pid=13614): stdout: | (launched: 2022-12-12_18:37:01.403426) 18:37:02.983071 run osmo-msc_10.42.42.6(pid=13614): stderr: | [0;m[38;5;43m20221212183701907 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183701907 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f711b616c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183701907 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183701907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183701907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183701908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183701911 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183701913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183701913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183701913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:37:03.035524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13607): Terminating (SIGTERM) 18:37:03.077846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13610): Terminating (SIGTERM) 18:37:03.120070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13613): Terminating (SIGTERM) 18:37:03.162835 --- ParallelTerminationStrategy: PID 13607 died... 18:37:03.183151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13607): Terminated: ok {rc=0} 18:37:03.230412 --- ParallelTerminationStrategy: PID 13610 died... 18:37:03.250480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13610): Terminated: ok {rc=0} 18:37:03.297230 --- ParallelTerminationStrategy: PID 13613 died... 18:37:03.317220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13613): Terminated: ok {rc=0} 18:37:03.406655 bus /sierra_3: Setting Powered False 18:37:04.503723 bus /sierra_3: Setting Powered False 18:37:05.619201 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:37:06.876757 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:37:06.883022 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:37:06.912703 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 18:37:06.940649 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 18:37:06.994810 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:37:07.025126 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 18:37:07.052390 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 18:37:07.604678 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 18:37:07.656877 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:37:07.668634 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:37:07.737163 tst mo_mt_call.py: using LAC 30721 18:37:07.864195 tst mo_mt_call.py: using RAC 121 18:37:07.991908 tst mo_mt_call.py: using CellId 30721 18:37:08.119338 tst mo_mt_call.py: using BVCI 30722 18:37:08.233367 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:37:08.244661 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:37:08.255837 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:37:08.268276 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:37:08.280260 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:37:08.292050 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:37:08.415371 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:37:08.535409 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:37:09.042925 run create_hlr_db(pid=13619): Launched 18:37:09.178054 bus /sierra_2: Setting Powered False 18:37:10.244554 run create_hlr_db(pid=13619): Terminated: ok {rc=0} 18:37:10.699773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13621): Launched 18:37:11.028000 run osmo-hlr_10.42.42.2(pid=13622): Launched 18:37:11.153325 run osmo-stp_10.42.42.5: Starting osmo-stp 18:37:11.718529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13624): Launched 18:37:12.046306 run osmo-stp_10.42.42.5(pid=13625): Launched 18:37:12.171415 run osmo-msc_10.42.42.6: Starting osmo-msc 18:37:12.762404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13627): Launched 18:37:13.090877 run osmo-msc_10.42.42.6(pid=13628): Launched 18:37:13.275504 run osmo-stp_10.42.42.5(pid=13625): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13625)] 18:37:13.412244 run osmo-stp_10.42.42.5(pid=13625): stdout: | (launched: 2022-12-12_18:37:11.985919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:37:13.549380 run osmo-stp_10.42.42.5(pid=13625): stderr: | [0;m[38;5;43m20221212183712176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183712177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183712177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183712177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183712178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183712178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183712178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:37:13.685792 run osmo-stp_10.42.42.5(pid=13625): stdout: | (launched: 2022-12-12_18:37:11.985919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:37:13.815691 run osmo-stp_10.42.42.5(pid=13625): stderr: | [0;m[38;5;43m20221212183712176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183712177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183712177 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183712177 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183712178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183712178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183712178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:37:13.972301 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13625): Process ended prematurely: osmo-stp_10.42.42.5(pid=13625) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13625)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 18:37:13.982320 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 18:37:14.010763 run osmo-hlr_10.42.42.2(pid=13622): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13622)] 18:37:14.061278 run osmo-hlr_10.42.42.2(pid=13622): stdout: | (launched: 2022-12-12_18:37:10.967859) 18:37:14.113570 run osmo-hlr_10.42.42.2(pid=13622): stderr: | [0;m[1;31m20221212183711164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183711164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183711164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183711164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183711164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183711164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183711178 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183711186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183711187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183711187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:37:14.186205 run osmo-msc_10.42.42.6(pid=13628): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13628)] 18:37:14.237114 run osmo-msc_10.42.42.6(pid=13628): stdout: | (launched: 2022-12-12_18:37:13.030383) 18:37:14.288924 run osmo-msc_10.42.42.6(pid=13628): stderr: | [0;m[38;5;43m20221212183713351 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183713351 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0b2460ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183713351 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183713351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183713351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183713352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183713353 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183713354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183713354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183713354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:37:14.341247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13621): Terminating (SIGTERM) 18:37:14.383151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13624): Terminating (SIGTERM) 18:37:14.424906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13627): Terminating (SIGTERM) 18:37:14.467214 --- ParallelTerminationStrategy: PID 13621 died... 18:37:14.487404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13621): Terminated: ok {rc=0} 18:37:14.534075 --- ParallelTerminationStrategy: PID 13624 died... 18:37:14.554057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13624): Terminated: ok {rc=0} 18:37:14.600855 --- ParallelTerminationStrategy: PID 13627 died... 18:37:14.621213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13627): Terminated: ok {rc=0} 18:37:14.710507 bus /sierra_3: Setting Powered False 18:37:15.807785 bus /sierra_3: Setting Powered False 18:37:16.955926 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 18:37:18.115336 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:37:18.127647 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:37:18.196288 tst mo_mt_call_osmux.py: using LAC 30722 18:37:18.326819 tst mo_mt_call_osmux.py: using RAC 122 18:37:18.456903 tst mo_mt_call_osmux.py: using CellId 30722 18:37:18.584272 tst mo_mt_call_osmux.py: using BVCI 30723 18:37:18.703103 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:37:18.715063 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:37:18.726874 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:37:18.738584 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:37:18.750414 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 18:37:18.762097 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:37:18.883612 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 18:37:19.003929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:37:19.479581 run create_hlr_db(pid=13630): Launched 18:37:19.597651 bus /sierra_2: Setting Powered False 18:37:20.659006 run create_hlr_db(pid=13630): Terminated: ok {rc=0} 18:37:21.107173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13632): Launched 18:37:21.438088 run osmo-hlr_10.42.42.2(pid=13633): Launched 18:37:21.564213 run osmo-stp_10.42.42.5: Starting osmo-stp 18:37:22.130151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13635): Launched 18:37:22.459060 run osmo-stp_10.42.42.5(pid=13636): Launched 18:37:22.585472 run osmo-msc_10.42.42.6: Starting osmo-msc 18:37:23.174053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13638): Launched 18:37:23.503126 run osmo-msc_10.42.42.6(pid=13639): Launched 18:37:23.686155 run osmo-stp_10.42.42.5(pid=13636): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13636)] 18:37:23.822501 run osmo-stp_10.42.42.5(pid=13636): stdout: | (launched: 2022-12-12_18:37:22.398733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:37:23.958846 run osmo-stp_10.42.42.5(pid=13636): stderr: | [0;m[38;5;43m20221212183722587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183722588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183722588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183722588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183722589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183722589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183722589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:37:24.094261 run osmo-stp_10.42.42.5(pid=13636): stdout: | (launched: 2022-12-12_18:37:22.398733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:37:24.224632 run osmo-stp_10.42.42.5(pid=13636): stderr: | [0;m[38;5;43m20221212183722587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183722588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183722588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183722588 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183722589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183722589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183722589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:37:24.380937 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13636): Process ended prematurely: osmo-stp_10.42.42.5(pid=13636) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13636)] [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 18:37:24.390829 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:37:24.419069 run osmo-hlr_10.42.42.2(pid=13633): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13633)] 18:37:24.469717 run osmo-hlr_10.42.42.2(pid=13633): stdout: | (launched: 2022-12-12_18:37:21.377819) 18:37:24.521426 run osmo-hlr_10.42.42.2(pid=13633): stderr: | [0;m[1;31m20221212183721574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183721574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183721574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183721574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183721575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183721575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183721587 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183721596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183721596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183721596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:37:24.594004 run osmo-msc_10.42.42.6(pid=13639): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13639)] 18:37:24.643930 run osmo-msc_10.42.42.6(pid=13639): stdout: | (launched: 2022-12-12_18:37:23.442893) 18:37:24.695373 run osmo-msc_10.42.42.6(pid=13639): stderr: | [0;m[38;5;43m20221212183723763 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183723764 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f07a0834c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183723764 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183723764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183723764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183723764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183723766 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183723766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183723766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183723767 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:37:24.747368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13632): Terminating (SIGTERM) 18:37:24.788870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13635): Terminating (SIGTERM) 18:37:24.830659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13638): Terminating (SIGTERM) 18:37:24.872808 --- ParallelTerminationStrategy: PID 13632 died... 18:37:24.892734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13632): Terminated: ok {rc=0} 18:37:24.939023 --- ParallelTerminationStrategy: PID 13635 died... 18:37:24.958685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13635): Terminated: ok {rc=0} 18:37:25.004873 --- ParallelTerminationStrategy: PID 13638 died... 18:37:25.024449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13638): Terminated: ok {rc=0} 18:37:25.111423 bus /sierra_3: Setting Powered False 18:37:26.211110 bus /sierra_3: Setting Powered False 18:37:27.329960 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 18:37:28.581685 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:37:28.587329 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:37:28.617889 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:37:28.644704 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 18:37:28.730685 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:37:28.759841 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:37:28.786905 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 18:37:29.370658 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2380 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 18:37:29.375688 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:37:29.386643 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:37:29.432670 tst emergency_mo_mt_call.py: using LAC 30723 18:37:29.549191 tst emergency_mo_mt_call.py: using RAC 123 18:37:29.672134 tst emergency_mo_mt_call.py: using CellId 30723 18:37:29.801296 tst emergency_mo_mt_call.py: using BVCI 30724 18:37:29.911571 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:37:29.922666 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:37:29.933852 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:37:29.944789 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:37:29.955899 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:37:29.966930 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:37:30.086376 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:37:30.206152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:37:30.705800 run create_hlr_db(pid=13644): Launched 18:37:30.838803 bus /sierra_2: Setting Powered False 18:37:31.905612 run create_hlr_db(pid=13644): Terminated: ok {rc=0} 18:37:32.394883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13646): Launched 18:37:32.719679 run osmo-hlr_10.42.42.2(pid=13647): Launched 18:37:32.843656 run osmo-stp_10.42.42.5: Starting osmo-stp 18:37:33.395839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13649): Launched 18:37:33.719671 run osmo-stp_10.42.42.5(pid=13650): Launched 18:37:33.853344 tst emergency_mo_mt_call.py: using MSISDN 7907 18:37:34.016621 run osmo-msc_10.42.42.6: Starting osmo-msc 18:37:34.599227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13652): Launched 18:37:34.921930 run osmo-msc_10.42.42.6(pid=13653): Launched 18:37:35.102561 run osmo-stp_10.42.42.5(pid=13650): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13650)] 18:37:35.237677 run osmo-stp_10.42.42.5(pid=13650): stdout: | (launched: 2022-12-12_18:37:33.660324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:37:35.372941 run osmo-stp_10.42.42.5(pid=13650): stderr: | [0;m[38;5;43m20221212183733849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183733849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183733849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183733850 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183733850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183733851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183733851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:37:35.507086 run osmo-stp_10.42.42.5(pid=13650): stdout: | (launched: 2022-12-12_18:37:33.660324) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:37:35.634809 run osmo-stp_10.42.42.5(pid=13650): stderr: | [0;m[38;5;43m20221212183733849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183733849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183733849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183733850 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183733850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183733851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183733851 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:37:35.783480 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13650): Process ended prematurely: osmo-stp_10.42.42.5(pid=13650) [trial-2380↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13650)] [trial-2380↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 18:37:35.792068 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 18:37:35.820621 run osmo-hlr_10.42.42.2(pid=13647): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13647)] 18:37:35.869369 run osmo-hlr_10.42.42.2(pid=13647): stdout: | (launched: 2022-12-12_18:37:32.660127) 18:37:35.919867 run osmo-hlr_10.42.42.2(pid=13647): stderr: | [0;m[1;31m20221212183732856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183732856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183732856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183732856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183732856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183732856 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183732869 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183732877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183732877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183732877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:37:35.989912 run osmo-msc_10.42.42.6(pid=13653): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13653)] 18:37:36.038566 run osmo-msc_10.42.42.6(pid=13653): stdout: | (launched: 2022-12-12_18:37:34.862593) 18:37:36.089122 run osmo-msc_10.42.42.6(pid=13653): stderr: | [0;m[38;5;43m20221212183735181 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183735181 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3f8ac9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183735182 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183735182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183735182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183735182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183735184 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183735184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183735184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183735184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:37:36.140046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13646): Terminating (SIGTERM) 18:37:36.180579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13649): Terminating (SIGTERM) 18:37:36.221066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13652): Terminating (SIGTERM) 18:37:36.262110 --- ParallelTerminationStrategy: PID 13646 died... 18:37:36.280851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13646): Terminated: ok {rc=0} 18:37:36.326540 --- ParallelTerminationStrategy: PID 13649 died... 18:37:36.345408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13649): Terminated: ok {rc=0} 18:37:36.390877 --- ParallelTerminationStrategy: PID 13652 died... 18:37:36.409891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13652): Terminated: ok {rc=0} 18:37:36.498034 bus /sierra_3: Setting Powered False 18:37:37.597719 bus /sierra_3: Setting Powered False 18:37:38.711259 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 18:37:39.798904 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:37:39.811854 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:37:39.862327 tst emergency_preemptive_call.py: using LAC 30724 18:37:39.990386 tst emergency_preemptive_call.py: using RAC 124 18:37:40.117070 tst emergency_preemptive_call.py: using CellId 30724 18:37:40.244185 tst emergency_preemptive_call.py: using BVCI 30725 18:37:40.361769 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:37:40.373548 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:37:40.384663 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:37:40.395976 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:37:40.407354 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:37:40.418611 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:37:40.539123 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:37:40.658916 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:37:40.780026 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:37:40.900850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:37:41.400878 run create_hlr_db(pid=13655): Launched 18:37:41.533972 bus /sierra_2: Setting Powered False 18:37:42.597782 run create_hlr_db(pid=13655): Terminated: ok {rc=0} 18:37:43.027385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13657): Launched 18:37:43.330257 run osmo-hlr_10.42.42.2(pid=13658): Launched 18:37:43.445109 run osmo-stp_10.42.42.5: Starting osmo-stp 18:37:43.960816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13660): Launched 18:37:44.263822 run osmo-stp_10.42.42.5(pid=13661): Launched 18:37:44.389477 tst emergency_preemptive_call.py: using MSISDN 7908 18:37:44.543343 run osmo-msc_10.42.42.6: Starting osmo-msc 18:37:45.082637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13663): Launched 18:37:45.383026 run osmo-msc_10.42.42.6(pid=13664): Launched 18:37:45.551832 run osmo-stp_10.42.42.5(pid=13661): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13661)] 18:37:45.678544 run osmo-stp_10.42.42.5(pid=13661): stdout: | (launched: 2022-12-12_18:37:44.207497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:37:45.805257 run osmo-stp_10.42.42.5(pid=13661): stderr: | [0;m[38;5;43m20221212183744376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183744376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183744376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183744377 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183744377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183744377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183744377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:37:45.968411 run osmo-stp_10.42.42.5(pid=13661): stdout: | (launched: 2022-12-12_18:37:44.207497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:37:46.102082 run osmo-stp_10.42.42.5(pid=13661): stderr: | [0;m[38;5;43m20221212183744376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183744376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183744376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183744377 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183744377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183744377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183744377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:37:46.251000 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13661): Process ended prematurely: osmo-stp_10.42.42.5(pid=13661) [trial-2380↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13661)] [trial-2380↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 18:37:46.260655 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 18:37:46.291004 run osmo-hlr_10.42.42.2(pid=13658): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13658)] 18:37:46.342179 run osmo-hlr_10.42.42.2(pid=13658): stdout: | (launched: 2022-12-12_18:37:43.274614) 18:37:46.394915 run osmo-hlr_10.42.42.2(pid=13658): stderr: | [0;m[1;31m20221212183743447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183743447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183743447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183743447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183743447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183743447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183743495 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183743504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183743505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183743505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:37:46.467873 run osmo-msc_10.42.42.6(pid=13664): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13664)] 18:37:46.518898 run osmo-msc_10.42.42.6(pid=13664): stdout: | (launched: 2022-12-12_18:37:45.327100) 18:37:46.571424 run osmo-msc_10.42.42.6(pid=13664): stderr: | [0;m[38;5;43m20221212183745596 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212183745596 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f11a3014c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212183745596 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212183745596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212183745596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212183745597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212183745598 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212183745599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212183745599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212183745599 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:37:46.624552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13657): Terminating (SIGTERM) 18:37:46.667866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13660): Terminating (SIGTERM) 18:37:46.712608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13663): Terminating (SIGTERM) 18:37:46.757293 --- ParallelTerminationStrategy: PID 13657 died... 18:37:46.777053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13657): Terminated: ok {rc=0} 18:37:46.825577 --- ParallelTerminationStrategy: PID 13660 died... 18:37:46.845237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13660): Terminated: ok {rc=0} 18:37:46.893209 --- ParallelTerminationStrategy: PID 13663 died... 18:37:46.913158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13663): Terminated: ok {rc=0} 18:37:47.006543 bus /sierra_9: Setting Powered False 18:37:48.116897 bus /sierra_9: Setting Powered False 18:37:49.232842 bus /sierra_8: Setting Powered False 18:37:50.330652 bus /sierra_8: Setting Powered False 18:37:51.447140 bus /sierra_3: Setting Powered False 18:37:52.546521 bus /sierra_3: Setting Powered False 18:37:53.664451 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 18:37:54.935492 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:37:54.940020 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 18:37:54.969846 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 18:37:55.008268 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 18:37:55.094915 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 18:37:55.124053 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 18:37:55.162369 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 18:37:55.758799 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 18:37:55.814498 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:37:55.826172 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:37:55.878154 tst cs_paging_gprs_active.py: using LAC 30725 18:37:56.006749 tst cs_paging_gprs_active.py: using RAC 125 18:37:56.135218 tst cs_paging_gprs_active.py: using CellId 30725 18:37:56.263225 tst cs_paging_gprs_active.py: using BVCI 30726 18:37:56.381990 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:37:56.393580 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:37:56.404868 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:37:56.416163 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:37:56.427393 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:37:56.438714 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:37:56.450249 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:37:56.461452 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:37:56.472794 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:37:56.591239 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:37:56.710720 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:37:56.917181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:37:57.224768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13670): Launched 18:37:57.492264 run iperf3-srv_10.42.42.10(pid=13671): Launched 18:37:57.607771 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:37:57.812796 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:37:58.119844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13672): Launched 18:37:58.387076 run iperf3-srv_10.42.42.10(pid=13673): Launched 18:37:58.503794 tst cs_paging_gprs_active.py:38: start network... 18:37:58.708569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:37:59.181774 run create_hlr_db(pid=13674): Launched 18:37:59.300505 bus /sierra_2: Setting Powered False 18:38:00.362882 run create_hlr_db(pid=13674): Terminated: ok {rc=0} 18:38:00.789620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13676): Launched 18:38:01.125759 run osmo-hlr_10.42.42.2(pid=13677): Launched 18:38:01.342176 run osmo-stp_10.42.42.5: Starting osmo-stp 18:38:02.018784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13679): Launched 18:38:02.368101 run osmo-stp_10.42.42.5(pid=13680): Launched 18:38:02.499021 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:38:03.066048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13682): Launched 18:38:03.192219 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:38:03.471084 run patchelf(pid=13683): Launched 18:38:03.655652 run osmo-stp_10.42.42.5(pid=13680): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13680)] 18:38:03.794303 run osmo-stp_10.42.42.5(pid=13680): stdout: | (launched: 2022-12-12_18:38:02.306261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:38:03.935056 run osmo-stp_10.42.42.5(pid=13680): stderr: | [0;m[38;5;43m20221212183802558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183802558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183802558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183802559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183802559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183802559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183802559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:38:04.075941 run osmo-stp_10.42.42.5(pid=13680): stdout: | (launched: 2022-12-12_18:38:02.306261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:38:04.210032 run osmo-stp_10.42.42.5(pid=13680): stderr: | [0;m[38;5;43m20221212183802558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183802558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183802558 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183802559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183802559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183802559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183802559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:38:04.369331 run patchelf(pid=13683): Terminating (SIGINT) 18:38:04.553100 run patchelf(pid=13683): Terminated: ok {rc=0} 18:38:04.686010 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13680): Process ended prematurely: osmo-stp_10.42.42.5(pid=13680) [trial-2380↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13680)] [trial-2380↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 18:38:04.696522 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 18:38:04.725748 run osmo-hlr_10.42.42.2(pid=13677): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13677)] 18:38:04.775729 run osmo-hlr_10.42.42.2(pid=13677): stdout: | (launched: 2022-12-12_18:38:01.064843) 18:38:04.827487 run osmo-hlr_10.42.42.2(pid=13677): stderr: | [0;m[1;31m20221212183801325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183801325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183801325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183801325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183801325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183801325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183801346 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183801360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183801360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183801360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:38:04.879889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13670): Terminating (SIGTERM) 18:38:04.921961 run iperf3-srv_10.42.42.10(pid=13671): Terminating (SIGTERM) 18:38:04.963723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13672): Terminating (SIGTERM) 18:38:05.005780 run iperf3-srv_10.42.42.10(pid=13673): Terminating (SIGTERM) 18:38:05.047635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13676): Terminating (SIGTERM) 18:38:05.089544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13679): Terminating (SIGTERM) 18:38:05.131463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13682): Terminating (SIGTERM) 18:38:05.173734 --- ParallelTerminationStrategy: PID 13670 died... 18:38:05.193907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13670): Terminated: ok {rc=0} 18:38:05.240510 --- ParallelTerminationStrategy: PID 13671 died... 18:38:05.260210 run iperf3-srv_10.42.42.10(pid=13671): Terminated {rc=256} 18:38:05.306329 --- ParallelTerminationStrategy: PID 13672 died... 18:38:05.326129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13672): Terminated: ok {rc=0} 18:38:05.372018 --- ParallelTerminationStrategy: PID 13673 died... 18:38:05.391673 run iperf3-srv_10.42.42.10(pid=13673): Terminated {rc=256} 18:38:05.437469 --- ParallelTerminationStrategy: PID 13676 died... 18:38:05.457178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13676): Terminated: ok {rc=0} 18:38:05.503302 --- ParallelTerminationStrategy: PID 13679 died... 18:38:05.523157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13679): Terminated: ok {rc=0} 18:38:05.569208 --- ParallelTerminationStrategy: PID 13682 died... 18:38:05.588886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13682): Terminated: ok {rc=0} 18:38:05.676573 bus /gobi_0: Setting Powered False 18:38:06.775710 bus /gobi_0: Setting Powered False 18:38:07.891441 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 18:38:09.041604 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:09.053931 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:38:09.107004 tst iperf3.py: using LAC 30726 18:38:09.234451 tst iperf3.py: using RAC 126 18:38:09.361625 tst iperf3.py: using CellId 30726 18:38:09.481999 tst iperf3.py: using BVCI 30727 18:38:09.595374 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:09.606525 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:09.617533 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:09.628591 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:09.639385 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:09.650240 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:09.661267 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:09.672050 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:09.683005 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:38:09.799322 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:38:10.003868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:38:10.311219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13684): Launched 18:38:10.578493 run iperf3-srv_10.42.42.10(pid=13685): Launched 18:38:10.695554 tst iperf3.py:8: start network... 18:38:10.899635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:38:11.371938 run create_hlr_db(pid=13686): Launched 18:38:11.488598 bus /gobi_6: Setting Powered False 18:38:12.549368 run create_hlr_db(pid=13686): Terminated: ok {rc=0} 18:38:12.995541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13688): Launched 18:38:13.325227 run osmo-hlr_10.42.42.2(pid=13689): Launched 18:38:13.452150 run osmo-stp_10.42.42.5: Starting osmo-stp 18:38:14.017911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13691): Launched 18:38:14.346919 run osmo-stp_10.42.42.5(pid=13692): Launched 18:38:14.473120 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:38:15.037275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13694): Launched 18:38:15.163551 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:38:15.441137 run patchelf(pid=13695): Launched 18:38:15.624450 run osmo-stp_10.42.42.5(pid=13692): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13692)] 18:38:15.762783 run osmo-stp_10.42.42.5(pid=13692): stdout: | (launched: 2022-12-12_18:38:14.286442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:38:15.919511 run osmo-stp_10.42.42.5(pid=13692): stderr: | [0;m[38;5;43m20221212183814476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183814476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183814477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183814477 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183814478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183814478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183814478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:38:16.071561 run osmo-stp_10.42.42.5(pid=13692): stdout: | (launched: 2022-12-12_18:38:14.286442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:38:16.209139 run osmo-stp_10.42.42.5(pid=13692): stderr: | [0;m[38;5;43m20221212183814476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183814476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183814477 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183814477 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183814478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183814478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183814478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:38:16.372414 run patchelf(pid=13695): Terminating (SIGINT) 18:38:16.559082 run patchelf(pid=13695): Terminated: ok {rc=0} 18:38:16.691101 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13692): Process ended prematurely: osmo-stp_10.42.42.5(pid=13692) [trial-2380↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13692)] [trial-2380↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 18:38:16.702006 tst iperf3.py:8: Test FAILED (7.7 sec) 18:38:16.733715 run osmo-hlr_10.42.42.2(pid=13689): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13689)] 18:38:16.785985 run osmo-hlr_10.42.42.2(pid=13689): stdout: | (launched: 2022-12-12_18:38:13.264472) 18:38:16.839085 run osmo-hlr_10.42.42.2(pid=13689): stderr: | [0;m[1;31m20221212183813460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183813460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183813460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183813460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183813460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183813460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183813473 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183813482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183813482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183813482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:38:16.892925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13684): Terminating (SIGTERM) 18:38:16.937059 run iperf3-srv_10.42.42.10(pid=13685): Terminating (SIGTERM) 18:38:16.982606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13688): Terminating (SIGTERM) 18:38:17.026794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13691): Terminating (SIGTERM) 18:38:17.069835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13694): Terminating (SIGTERM) 18:38:17.113097 --- ParallelTerminationStrategy: PID 13684 died... 18:38:17.133516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13684): Terminated: ok {rc=0} 18:38:17.181169 --- ParallelTerminationStrategy: PID 13685 died... 18:38:17.200893 run iperf3-srv_10.42.42.10(pid=13685): Terminated {rc=256} 18:38:17.247608 --- ParallelTerminationStrategy: PID 13688 died... 18:38:17.267339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13688): Terminated: ok {rc=0} 18:38:17.313722 --- ParallelTerminationStrategy: PID 13691 died... 18:38:17.333539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13691): Terminated: ok {rc=0} 18:38:17.379660 --- ParallelTerminationStrategy: PID 13694 died... 18:38:17.399379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13694): Terminated: ok {rc=0} 18:38:17.487638 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 18:38:18.639750 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:18.652074 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:38:18.698780 tst iperf3m4.py: using LAC 30727 18:38:18.828896 tst iperf3m4.py: using RAC 127 18:38:18.956268 tst iperf3m4.py: using CellId 30727 18:38:19.079025 tst iperf3m4.py: using BVCI 30728 18:38:19.192200 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:19.203317 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:19.214451 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:19.226142 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:19.237900 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:19.249336 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:19.260861 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:19.272275 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:19.283875 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:38:19.405690 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:38:19.525504 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:38:19.643540 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:38:19.766809 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:38:19.988247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:38:20.317238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13696): Launched 18:38:20.603420 run iperf3-srv_10.42.42.10(pid=13697): Launched 18:38:20.728189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:38:20.948902 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:38:21.278525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13698): Launched 18:38:21.564431 run iperf3-srv_10.42.42.10(pid=13699): Launched 18:38:21.687231 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:38:21.907032 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:38:22.236204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13700): Launched 18:38:22.521166 run iperf3-srv_10.42.42.10(pid=13701): Launched 18:38:22.645632 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:38:22.865903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:38:23.194475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13702): Launched 18:38:23.482244 run iperf3-srv_10.42.42.10(pid=13703): Launched 18:38:23.606624 tst iperf3m4.py:8: start network... 18:38:23.826764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:38:24.333270 run create_hlr_db(pid=13704): Launched 18:38:24.466707 bus /gobi_6: Setting Powered False 18:38:25.531167 run create_hlr_db(pid=13704): Terminated: ok {rc=0} 18:38:25.967454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13706): Launched 18:38:26.274146 run osmo-hlr_10.42.42.2(pid=13707): Launched 18:38:26.391596 run osmo-stp_10.42.42.5: Starting osmo-stp 18:38:27.045969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13709): Launched 18:38:27.351681 run osmo-stp_10.42.42.5(pid=13710): Launched 18:38:27.465467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:38:27.982676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13712): Launched 18:38:28.097399 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:38:28.350867 run patchelf(pid=13713): Launched 18:38:28.518018 run osmo-stp_10.42.42.5(pid=13710): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13710)] 18:38:28.644766 run osmo-stp_10.42.42.5(pid=13710): stdout: | (launched: 2022-12-12_18:38:27.296207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:38:28.773492 run osmo-stp_10.42.42.5(pid=13710): stderr: | [0;m[38;5;43m20221212183827464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183827465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183827465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183827465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183827466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183827466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183827466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:38:28.902536 run osmo-stp_10.42.42.5(pid=13710): stdout: | (launched: 2022-12-12_18:38:27.296207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:38:29.025248 run osmo-stp_10.42.42.5(pid=13710): stderr: | [0;m[38;5;43m20221212183827464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183827465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183827465 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183827465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183827466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183827466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183827466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:38:29.170610 run patchelf(pid=13713): Terminating (SIGINT) 18:38:29.338858 run patchelf(pid=13713): Terminated: ok {rc=0} 18:38:29.460089 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13710): Process ended prematurely: osmo-stp_10.42.42.5(pid=13710) [trial-2380↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13710)] [trial-2380↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 18:38:29.469823 tst iperf3m4.py:8: Test FAILED (10.9 sec) 18:38:29.497582 run osmo-hlr_10.42.42.2(pid=13707): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13707)] 18:38:29.545851 run osmo-hlr_10.42.42.2(pid=13707): stdout: | (launched: 2022-12-12_18:38:26.217330) 18:38:29.595553 run osmo-hlr_10.42.42.2(pid=13707): stderr: | [0;m[1;31m20221212183826393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183826393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183826393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183826393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183826393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183826394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183826406 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183826417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183826417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183826417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:38:29.645350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13696): Terminating (SIGTERM) 18:38:29.685143 run iperf3-srv_10.42.42.10(pid=13697): Terminating (SIGTERM) 18:38:29.724902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13698): Terminating (SIGTERM) 18:38:29.765207 run iperf3-srv_10.42.42.10(pid=13699): Terminating (SIGTERM) 18:38:29.805384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13700): Terminating (SIGTERM) 18:38:29.845277 run iperf3-srv_10.42.42.10(pid=13701): Terminating (SIGTERM) 18:38:29.884918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13702): Terminating (SIGTERM) 18:38:29.925426 run iperf3-srv_10.42.42.10(pid=13703): Terminating (SIGTERM) 18:38:29.965329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13706): Terminating (SIGTERM) 18:38:30.005333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13709): Terminating (SIGTERM) 18:38:30.045492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13712): Terminating (SIGTERM) 18:38:30.085891 --- ParallelTerminationStrategy: PID 13696 died... 18:38:30.105181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13696): Terminated: ok {rc=0} 18:38:30.149624 --- ParallelTerminationStrategy: PID 13697 died... 18:38:30.168092 run iperf3-srv_10.42.42.10(pid=13697): Terminated {rc=256} 18:38:30.213307 --- ParallelTerminationStrategy: PID 13698 died... 18:38:30.231677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13698): Terminated: ok {rc=0} 18:38:30.276178 --- ParallelTerminationStrategy: PID 13699 died... 18:38:30.294903 run iperf3-srv_10.42.42.10(pid=13699): Terminated {rc=256} 18:38:30.339132 --- ParallelTerminationStrategy: PID 13700 died... 18:38:30.357883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13700): Terminated: ok {rc=0} 18:38:30.402601 --- ParallelTerminationStrategy: PID 13701 died... 18:38:30.421279 run iperf3-srv_10.42.42.10(pid=13701): Terminated {rc=256} 18:38:30.465558 --- ParallelTerminationStrategy: PID 13702 died... 18:38:30.484045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13702): Terminated: ok {rc=0} 18:38:30.528783 --- ParallelTerminationStrategy: PID 13703 died... 18:38:30.547942 run iperf3-srv_10.42.42.10(pid=13703): Terminated {rc=256} 18:38:30.593176 --- ParallelTerminationStrategy: PID 13706 died... 18:38:30.611883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13706): Terminated: ok {rc=0} 18:38:30.656105 --- ParallelTerminationStrategy: PID 13709 died... 18:38:30.674756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13709): Terminated: ok {rc=0} 18:38:30.719447 --- ParallelTerminationStrategy: PID 13712 died... 18:38:30.738103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13712): Terminated: ok {rc=0} 18:38:30.824792 bus /gobi_4: Setting Powered False 18:38:31.963707 bus /gobi_4: Setting Powered False 18:38:33.098540 bus /gobi_1: Setting Powered False 18:38:34.197136 bus /gobi_1: Setting Powered False 18:38:35.311745 bus /gobi_0: Setting Powered False 18:38:36.411134 bus /gobi_0: Setting Powered False 18:38:37.527469 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 18:38:38.630086 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:38.641729 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:38:38.690383 tst ping.py: using LAC 30728 18:38:38.809077 tst ping.py: using RAC 128 18:38:38.924527 tst ping.py: using CellId 30728 18:38:39.038789 tst ping.py: using BVCI 30729 18:38:39.145519 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:39.156400 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:39.167089 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:39.177984 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:39.188736 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:39.199569 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:39.210501 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:39.221449 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:38:39.335385 tst ping.py:19: start network... 18:38:39.531968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:38:39.987855 run create_hlr_db(pid=13714): Launched 18:38:40.100641 bus /gobi_6: Setting Powered False 18:38:41.159792 run create_hlr_db(pid=13714): Terminated: ok {rc=0} 18:38:41.592507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13716): Launched 18:38:41.908616 run osmo-hlr_10.42.42.2(pid=13717): Launched 18:38:42.030781 run osmo-stp_10.42.42.5: Starting osmo-stp 18:38:42.576516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13719): Launched 18:38:42.893403 run osmo-stp_10.42.42.5(pid=13720): Launched 18:38:43.013567 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:38:43.558173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13722): Launched 18:38:43.679103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:38:43.944909 run patchelf(pid=13723): Launched 18:38:44.120136 run osmo-stp_10.42.42.5(pid=13720): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13720)] 18:38:44.252789 run osmo-stp_10.42.42.5(pid=13720): stdout: | (launched: 2022-12-12_18:38:42.834599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:38:44.387489 run osmo-stp_10.42.42.5(pid=13720): stderr: | [0;m[38;5;43m20221212183843025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183843025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183843025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183843025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183843026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183843026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183843026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:38:44.521568 run osmo-stp_10.42.42.5(pid=13720): stdout: | (launched: 2022-12-12_18:38:42.834599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:38:44.649938 run osmo-stp_10.42.42.5(pid=13720): stderr: | [0;m[38;5;43m20221212183843025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183843025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183843025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183843025 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183843026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183843026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183843026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:38:44.802112 run patchelf(pid=13723): Terminating (SIGINT) 18:38:44.978427 run patchelf(pid=13723): Terminated: ok {rc=0} 18:38:45.104841 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13720): Process ended prematurely: osmo-stp_10.42.42.5(pid=13720) [trial-2380↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13720)] [trial-2380↪gprs:trx-lms-limenet-micro↪ping.py:22] 18:38:45.114580 tst ping.py:22: Test FAILED (6.5 sec) 18:38:45.142407 run osmo-hlr_10.42.42.2(pid=13717): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13717)] 18:38:45.191997 run osmo-hlr_10.42.42.2(pid=13717): stdout: | (launched: 2022-12-12_18:38:41.850556) 18:38:45.243802 run osmo-hlr_10.42.42.2(pid=13717): stderr: | [0;m[1;31m20221212183842044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183842044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183842044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183842044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183842044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183842044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183842057 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183842066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183842066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183842066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:38:45.295673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13716): Terminating (SIGTERM) 18:38:45.337094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13719): Terminating (SIGTERM) 18:38:45.378431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13722): Terminating (SIGTERM) 18:38:45.420145 --- ParallelTerminationStrategy: PID 13716 died... 18:38:45.440118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13716): Terminated: ok {rc=0} 18:38:45.486108 --- ParallelTerminationStrategy: PID 13719 died... 18:38:45.505617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13719): Terminated: ok {rc=0} 18:38:45.551282 --- ParallelTerminationStrategy: PID 13722 died... 18:38:45.570986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13722): Terminated: ok {rc=0} 18:38:45.659131 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 18:38:46.754252 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:46.775011 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 18:38:46.828858 tst ping_idle_ping.py: using LAC 30729 18:38:46.959395 tst ping_idle_ping.py: using RAC 129 18:38:47.123528 tst ping_idle_ping.py: using CellId 30729 18:38:47.276882 tst ping_idle_ping.py: using BVCI 30730 18:38:47.411656 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:47.423718 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:47.441084 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:47.454127 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:47.468871 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:47.483473 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:47.498561 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 18:38:47.510438 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 18:38:47.667580 tst ping_idle_ping.py:24: start network... 18:38:47.906157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:38:48.496149 run create_hlr_db(pid=13896): Launched 18:38:48.687132 bus /gobi_6: Setting Powered False 18:38:49.747418 run create_hlr_db(pid=13896): Terminated: ok {rc=0} 18:38:50.220069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13996): Launched 18:38:50.544929 run osmo-hlr_10.42.42.2(pid=13997): Launched 18:38:50.780857 run osmo-stp_10.42.42.5: Starting osmo-stp 18:38:51.424220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14001): Launched 18:38:51.747137 run osmo-stp_10.42.42.5(pid=14002): Launched 18:38:51.986266 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:38:52.653247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14004): Launched 18:38:52.785928 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:38:53.059814 run patchelf(pid=14005): Launched 18:38:53.251915 run osmo-stp_10.42.42.5(pid=14002): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14002)] 18:38:53.389157 run osmo-stp_10.42.42.5(pid=14002): stdout: | (launched: 2022-12-12_18:38:51.686419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:38:53.527147 run osmo-stp_10.42.42.5(pid=14002): stderr: | [0;m[38;5;43m20221212183852005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183852005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183852006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183852006 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183852006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183852007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183852007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:38:53.666109 run osmo-stp_10.42.42.5(pid=14002): stdout: | (launched: 2022-12-12_18:38:51.686419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:38:53.799536 run osmo-stp_10.42.42.5(pid=14002): stderr: | [0;m[38;5;43m20221212183852005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183852005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183852006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183852006 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183852006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183852007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183852007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:38:53.957587 run patchelf(pid=14005): Terminating (SIGINT) 18:38:54.139953 run patchelf(pid=14005): Terminated: ok {rc=0} 18:38:54.273096 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14002): Process ended prematurely: osmo-stp_10.42.42.5(pid=14002) [trial-2380↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14002)] [trial-2380↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 18:38:54.284054 tst ping_idle_ping.py:27: Test FAILED (7.5 sec) 18:38:54.314240 run osmo-hlr_10.42.42.2(pid=13997): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13997)] 18:38:54.366258 run osmo-hlr_10.42.42.2(pid=13997): stdout: | (launched: 2022-12-12_18:38:50.484345) 18:38:54.419291 run osmo-hlr_10.42.42.2(pid=13997): stderr: | [0;m[1;31m20221212183850829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183850829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183850829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183850830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183850830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183850830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183850846 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183850859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183850860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183850860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:38:54.473095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13996): Terminating (SIGTERM) 18:38:54.516433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14001): Terminating (SIGTERM) 18:38:54.561446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14004): Terminating (SIGTERM) 18:38:54.607981 --- ParallelTerminationStrategy: PID 13996 died... 18:38:54.629148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13996): Terminated: ok {rc=0} 18:38:54.678313 --- ParallelTerminationStrategy: PID 14001 died... 18:38:54.699296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14001): Terminated: ok {rc=0} 18:38:54.746953 --- ParallelTerminationStrategy: PID 14004 died... 18:38:54.768581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14004): Terminated: ok {rc=0} 18:38:54.859667 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 18:38:56.168045 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:38:56.174532 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:38:56.206318 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:38:56.250085 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:38:56.341926 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:38:56.374137 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:38:56.415570 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:38:57.013483 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:38:57.069485 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:38:57.082733 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:38:57.131460 tst cs_paging_gprs_active.py: using LAC 30730 18:38:57.263689 tst cs_paging_gprs_active.py: using RAC 130 18:38:57.396198 tst cs_paging_gprs_active.py: using CellId 30730 18:38:57.525395 tst cs_paging_gprs_active.py: using BVCI 30731 18:38:57.648899 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:38:57.662195 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:38:57.675002 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:38:57.687562 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:38:57.700437 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:38:57.713088 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:38:57.725418 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:38:57.738359 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:38:57.751127 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:38:57.877771 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:38:58.005637 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:38:58.231491 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:38:58.568346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14009): Launched 18:38:58.868582 run iperf3-srv_10.42.42.10(pid=14010): Launched 18:38:59.008022 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:38:59.238361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:38:59.577087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14011): Launched 18:38:59.878668 run iperf3-srv_10.42.42.10(pid=14012): Launched 18:39:00.017710 tst cs_paging_gprs_active.py:38: start network... 18:39:00.245129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:39:00.766045 run create_hlr_db(pid=14013): Launched 18:39:00.950997 bus /gobi_6: Setting Powered False 18:39:02.035484 run create_hlr_db(pid=14013): Terminated: ok {rc=0} 18:39:02.506487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14015): Launched 18:39:02.843972 run osmo-hlr_10.42.42.2(pid=14016): Launched 18:39:03.112596 run osmo-stp_10.42.42.5: Starting osmo-stp 18:39:03.782836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14018): Launched 18:39:04.107977 run osmo-stp_10.42.42.5(pid=14019): Launched 18:39:04.344859 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:39:05.029528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14021): Launched 18:39:05.160695 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:39:05.427328 run patchelf(pid=14022): Launched 18:39:05.616488 run osmo-stp_10.42.42.5(pid=14019): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14019)] 18:39:05.748588 run osmo-stp_10.42.42.5(pid=14019): stdout: | (launched: 2022-12-12_18:39:04.049667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:39:05.883510 run osmo-stp_10.42.42.5(pid=14019): stderr: | [0;m[38;5;43m20221212183904371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183904371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183904371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183904372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183904372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183904372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183904372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:39:06.019237 run osmo-stp_10.42.42.5(pid=14019): stdout: | (launched: 2022-12-12_18:39:04.049667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:39:06.147651 run osmo-stp_10.42.42.5(pid=14019): stderr: | [0;m[38;5;43m20221212183904371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183904371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183904371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183904372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183904372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183904372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183904372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:39:06.300408 run patchelf(pid=14022): Terminating (SIGINT) 18:39:06.476897 run patchelf(pid=14022): Terminated: ok {rc=0} 18:39:06.604521 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14019): Process ended prematurely: osmo-stp_10.42.42.5(pid=14019) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14019)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:39:06.615601 tst cs_paging_gprs_active.py:38: Test FAILED (9.6 sec) 18:39:06.646999 run osmo-hlr_10.42.42.2(pid=14016): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14016)] 18:39:06.698026 run osmo-hlr_10.42.42.2(pid=14016): stdout: | (launched: 2022-12-12_18:39:02.780870) 18:39:06.750492 run osmo-hlr_10.42.42.2(pid=14016): stderr: | [0;m[1;31m20221212183903096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183903096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183903096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183903096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183903096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183903096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183903117 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183903138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183903138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183903138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:39:06.804617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14009): Terminating (SIGTERM) 18:39:06.847802 run iperf3-srv_10.42.42.10(pid=14010): Terminating (SIGTERM) 18:39:06.893715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14011): Terminating (SIGTERM) 18:39:06.937161 run iperf3-srv_10.42.42.10(pid=14012): Terminating (SIGTERM) 18:39:06.984034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14015): Terminating (SIGTERM) 18:39:07.027631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14018): Terminating (SIGTERM) 18:39:07.072298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14021): Terminating (SIGTERM) 18:39:07.117753 --- ParallelTerminationStrategy: PID 14009 died... 18:39:07.137822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14009): Terminated: ok {rc=0} 18:39:07.188194 --- ParallelTerminationStrategy: PID 14010 died... 18:39:07.208190 run iperf3-srv_10.42.42.10(pid=14010): Terminated {rc=256} 18:39:07.255891 --- ParallelTerminationStrategy: PID 14011 died... 18:39:07.275747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14011): Terminated: ok {rc=0} 18:39:07.323490 --- ParallelTerminationStrategy: PID 14012 died... 18:39:07.343457 run iperf3-srv_10.42.42.10(pid=14012): Terminated {rc=256} 18:39:07.392031 --- ParallelTerminationStrategy: PID 14015 died... 18:39:07.411935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14015): Terminated: ok {rc=0} 18:39:07.459765 --- ParallelTerminationStrategy: PID 14018 died... 18:39:07.479686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14018): Terminated: ok {rc=0} 18:39:07.528430 --- ParallelTerminationStrategy: PID 14021 died... 18:39:07.548419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14021): Terminated: ok {rc=0} 18:39:07.639002 bus /gobi_0: Setting Powered False 18:39:08.740785 bus /gobi_0: Setting Powered False 18:39:09.861079 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:39:11.006666 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:11.018703 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:39:11.066461 tst iperf3.py: using LAC 30731 18:39:11.189049 tst iperf3.py: using RAC 131 18:39:11.310213 tst iperf3.py: using CellId 30731 18:39:11.430534 tst iperf3.py: using BVCI 30732 18:39:11.540393 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:11.551655 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:11.563020 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:11.574300 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:11.585406 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:11.596585 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:11.607844 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:11.618997 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:11.630547 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:39:11.750738 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:39:11.969409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:39:12.294865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14024): Launched 18:39:12.579039 run iperf3-srv_10.42.42.10(pid=14025): Launched 18:39:12.702245 tst iperf3.py:8: start network... 18:39:12.919277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:39:13.422234 run create_hlr_db(pid=14026): Launched 18:39:13.555534 bus /gobi_6: Setting Powered False 18:39:14.619167 run create_hlr_db(pid=14026): Terminated: ok {rc=0} 18:39:15.070844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14028): Launched 18:39:15.397918 run osmo-hlr_10.42.42.2(pid=14029): Launched 18:39:15.522503 run osmo-stp_10.42.42.5: Starting osmo-stp 18:39:16.109722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14031): Launched 18:39:16.437453 run osmo-stp_10.42.42.5(pid=14032): Launched 18:39:16.629749 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:39:17.256653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14034): Launched 18:39:17.389874 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:39:17.664246 run patchelf(pid=14035): Launched 18:39:17.843353 run osmo-stp_10.42.42.5(pid=14032): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14032)] 18:39:17.979282 run osmo-stp_10.42.42.5(pid=14032): stdout: | (launched: 2022-12-12_18:39:16.379314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:39:18.117478 run osmo-stp_10.42.42.5(pid=14032): stderr: | [0;m[38;5;43m20221212183916732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183916732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183916732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183916733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183916733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183916733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183916733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:39:18.255671 run osmo-stp_10.42.42.5(pid=14032): stdout: | (launched: 2022-12-12_18:39:16.379314) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:39:18.387535 run osmo-stp_10.42.42.5(pid=14032): stderr: | [0;m[38;5;43m20221212183916732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183916732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183916732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183916733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183916733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183916733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183916733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:39:18.543847 run patchelf(pid=14035): Terminating (SIGINT) 18:39:18.724267 run patchelf(pid=14035): Terminated: ok {rc=0} 18:39:18.854584 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14032): Process ended prematurely: osmo-stp_10.42.42.5(pid=14032) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14032)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 18:39:18.864801 tst iperf3.py:8: Test FAILED (7.9 sec) 18:39:18.893438 run osmo-hlr_10.42.42.2(pid=14029): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14029)] 18:39:18.943059 run osmo-hlr_10.42.42.2(pid=14029): stdout: | (launched: 2022-12-12_18:39:15.336930) 18:39:18.994579 run osmo-hlr_10.42.42.2(pid=14029): stderr: | [0;m[1;31m20221212183915535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183915535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183915535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183915535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183915535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183915535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183915548 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183915556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183915556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183915556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:39:19.046664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14024): Terminating (SIGTERM) 18:39:19.088402 run iperf3-srv_10.42.42.10(pid=14025): Terminating (SIGTERM) 18:39:19.130264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14028): Terminating (SIGTERM) 18:39:19.172220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14031): Terminating (SIGTERM) 18:39:19.214121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14034): Terminating (SIGTERM) 18:39:19.256515 --- ParallelTerminationStrategy: PID 14024 died... 18:39:19.276660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14024): Terminated: ok {rc=0} 18:39:19.323131 --- ParallelTerminationStrategy: PID 14025 died... 18:39:19.342637 run iperf3-srv_10.42.42.10(pid=14025): Terminated {rc=256} 18:39:19.388828 --- ParallelTerminationStrategy: PID 14028 died... 18:39:19.408697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14028): Terminated: ok {rc=0} 18:39:19.454567 --- ParallelTerminationStrategy: PID 14031 died... 18:39:19.474068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14031): Terminated: ok {rc=0} 18:39:19.521276 --- ParallelTerminationStrategy: PID 14034 died... 18:39:19.541007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14034): Terminated: ok {rc=0} 18:39:19.629478 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:39:20.778160 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:20.790228 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:39:20.837388 tst iperf3m4.py: using LAC 30732 18:39:20.957394 tst iperf3m4.py: using RAC 132 18:39:21.075289 tst iperf3m4.py: using CellId 30732 18:39:21.195284 tst iperf3m4.py: using BVCI 30733 18:39:21.307039 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:21.318396 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:21.329403 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:21.340558 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:21.351742 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:21.363015 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:21.374395 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:21.385895 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:21.397253 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:39:21.522742 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:39:21.638793 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:39:21.756112 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:39:21.873266 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:39:22.075812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:39:22.380380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14037): Launched 18:39:22.646811 run iperf3-srv_10.42.42.10(pid=14038): Launched 18:39:22.762854 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:39:22.965414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:39:23.270897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14039): Launched 18:39:23.536934 run iperf3-srv_10.42.42.10(pid=14040): Launched 18:39:23.651140 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:39:23.853653 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:39:24.158874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14041): Launched 18:39:24.425691 run iperf3-srv_10.42.42.10(pid=14042): Launched 18:39:24.539948 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:39:24.742570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:39:25.047803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14043): Launched 18:39:25.315769 run iperf3-srv_10.42.42.10(pid=14044): Launched 18:39:25.430179 tst iperf3m4.py:8: start network... 18:39:25.632227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:39:26.102525 run create_hlr_db(pid=14045): Launched 18:39:26.220353 bus /gobi_6: Setting Powered False 18:39:27.281725 run create_hlr_db(pid=14045): Terminated: ok {rc=0} 18:39:27.706682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14047): Launched 18:39:28.012121 run osmo-hlr_10.42.42.2(pid=14048): Launched 18:39:28.129773 run osmo-stp_10.42.42.5: Starting osmo-stp 18:39:28.653853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14050): Launched 18:39:28.959649 run osmo-stp_10.42.42.5(pid=14051): Launched 18:39:29.075770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:39:29.600142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14053): Launched 18:39:29.718538 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:39:29.976055 run patchelf(pid=14054): Launched 18:39:30.146714 run osmo-stp_10.42.42.5(pid=14051): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14051)] 18:39:30.275320 run osmo-stp_10.42.42.5(pid=14051): stdout: | (launched: 2022-12-12_18:39:28.902185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:39:30.405379 run osmo-stp_10.42.42.5(pid=14051): stderr: | [0;m[38;5;43m20221212183929070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183929070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183929071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183929071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183929072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183929072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183929072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:39:30.535569 run osmo-stp_10.42.42.5(pid=14051): stdout: | (launched: 2022-12-12_18:39:28.902185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:39:30.659889 run osmo-stp_10.42.42.5(pid=14051): stderr: | [0;m[38;5;43m20221212183929070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183929070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183929071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183929071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183929072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183929072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183929072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:39:30.806966 run patchelf(pid=14054): Terminating (SIGINT) 18:39:31.015968 run patchelf(pid=14054): Terminated: ok {rc=0} 18:39:31.146012 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14051): Process ended prematurely: osmo-stp_10.42.42.5(pid=14051) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14051)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 18:39:31.156662 tst iperf3m4.py:8: Test FAILED (10.4 sec) 18:39:31.187408 run osmo-hlr_10.42.42.2(pid=14048): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14048)] 18:39:31.237622 run osmo-hlr_10.42.42.2(pid=14048): stdout: | (launched: 2022-12-12_18:39:27.955225) 18:39:31.290267 run osmo-hlr_10.42.42.2(pid=14048): stderr: | [0;m[1;31m20221212183928129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183928129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183928129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183928129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183928129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183928129 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183928141 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183928149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183928150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183928150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:39:31.343268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14037): Terminating (SIGTERM) 18:39:31.386041 run iperf3-srv_10.42.42.10(pid=14038): Terminating (SIGTERM) 18:39:31.430137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14039): Terminating (SIGTERM) 18:39:31.473110 run iperf3-srv_10.42.42.10(pid=14040): Terminating (SIGTERM) 18:39:31.515465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14041): Terminating (SIGTERM) 18:39:31.557977 run iperf3-srv_10.42.42.10(pid=14042): Terminating (SIGTERM) 18:39:31.600263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14043): Terminating (SIGTERM) 18:39:31.642836 run iperf3-srv_10.42.42.10(pid=14044): Terminating (SIGTERM) 18:39:31.685406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14047): Terminating (SIGTERM) 18:39:31.727812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14050): Terminating (SIGTERM) 18:39:31.770226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14053): Terminating (SIGTERM) 18:39:31.812880 --- ParallelTerminationStrategy: PID 14037 died... 18:39:31.833096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14037): Terminated: ok {rc=0} 18:39:31.880475 --- ParallelTerminationStrategy: PID 14038 died... 18:39:31.900565 run iperf3-srv_10.42.42.10(pid=14038): Terminated {rc=256} 18:39:31.946973 --- ParallelTerminationStrategy: PID 14039 died... 18:39:31.966745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14039): Terminated: ok {rc=0} 18:39:32.014187 --- ParallelTerminationStrategy: PID 14040 died... 18:39:32.034044 run iperf3-srv_10.42.42.10(pid=14040): Terminated {rc=256} 18:39:32.080833 --- ParallelTerminationStrategy: PID 14041 died... 18:39:32.100734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14041): Terminated: ok {rc=0} 18:39:32.147561 --- ParallelTerminationStrategy: PID 14042 died... 18:39:32.167088 run iperf3-srv_10.42.42.10(pid=14042): Terminated {rc=256} 18:39:32.213585 --- ParallelTerminationStrategy: PID 14043 died... 18:39:32.233383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14043): Terminated: ok {rc=0} 18:39:32.279716 --- ParallelTerminationStrategy: PID 14044 died... 18:39:32.298398 run iperf3-srv_10.42.42.10(pid=14044): Terminated {rc=256} 18:39:32.342851 --- ParallelTerminationStrategy: PID 14047 died... 18:39:32.361695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14047): Terminated: ok {rc=0} 18:39:32.406329 --- ParallelTerminationStrategy: PID 14050 died... 18:39:32.425126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14050): Terminated: ok {rc=0} 18:39:32.469439 --- ParallelTerminationStrategy: PID 14053 died... 18:39:32.488154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14053): Terminated: ok {rc=0} 18:39:32.575422 bus /gobi_4: Setting Powered False 18:39:33.676575 bus /gobi_4: Setting Powered False 18:39:34.792582 bus /gobi_1: Setting Powered False 18:39:35.891562 bus /gobi_1: Setting Powered False 18:39:37.006703 bus /gobi_0: Setting Powered False 18:39:38.105704 bus /gobi_0: Setting Powered False 18:39:39.221356 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 18:39:40.324040 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:40.335974 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:39:40.383339 tst ping.py: using LAC 30733 18:39:40.501077 tst ping.py: using RAC 133 18:39:40.617683 tst ping.py: using CellId 30733 18:39:40.745124 tst ping.py: using BVCI 30734 18:39:40.860553 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:40.872307 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:40.883842 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:40.895946 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:40.907806 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:40.919834 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:40.931940 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:40.943836 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:39:41.060469 tst ping.py:19: start network... 18:39:41.260390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:39:41.722368 run create_hlr_db(pid=14057): Launched 18:39:41.838321 bus /gobi_6: Setting Powered False 18:39:42.897770 run create_hlr_db(pid=14057): Terminated: ok {rc=0} 18:39:43.332545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14059): Launched 18:39:43.654326 run osmo-hlr_10.42.42.2(pid=14060): Launched 18:39:43.777665 run osmo-stp_10.42.42.5: Starting osmo-stp 18:39:44.327696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14062): Launched 18:39:44.648231 run osmo-stp_10.42.42.5(pid=14063): Launched 18:39:44.769415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:39:45.320067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14065): Launched 18:39:45.443409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:39:45.713569 run patchelf(pid=14066): Launched 18:39:45.905209 run osmo-stp_10.42.42.5(pid=14063): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14063)] 18:39:46.036234 run osmo-stp_10.42.42.5(pid=14063): stdout: | (launched: 2022-12-12_18:39:44.588317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:39:46.169383 run osmo-stp_10.42.42.5(pid=14063): stderr: | [0;m[38;5;43m20221212183944780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183944780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183944780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183944781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183944781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183944781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183944781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:39:46.304693 run osmo-stp_10.42.42.5(pid=14063): stdout: | (launched: 2022-12-12_18:39:44.588317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:39:46.433020 run osmo-stp_10.42.42.5(pid=14063): stderr: | [0;m[38;5;43m20221212183944780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183944780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183944780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183944781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183944781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183944781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183944781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:39:46.584572 run patchelf(pid=14066): Terminating (SIGINT) 18:39:46.756770 run patchelf(pid=14066): Terminated: ok {rc=0} 18:39:46.882793 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14063): Process ended prematurely: osmo-stp_10.42.42.5(pid=14063) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14063)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 18:39:46.893206 tst ping.py:22: Test FAILED (6.6 sec) 18:39:46.924073 run osmo-hlr_10.42.42.2(pid=14060): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14060)] 18:39:46.976061 run osmo-hlr_10.42.42.2(pid=14060): stdout: | (launched: 2022-12-12_18:39:43.595188) 18:39:47.028546 run osmo-hlr_10.42.42.2(pid=14060): stderr: | [0;m[1;31m20221212183943792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183943792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183943792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183943792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183943792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183943792 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183943805 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183943813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183943814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183943814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:39:47.082191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14059): Terminating (SIGTERM) 18:39:47.125315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14062): Terminating (SIGTERM) 18:39:47.170812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14065): Terminating (SIGTERM) 18:39:47.213146 --- ParallelTerminationStrategy: PID 14059 died... 18:39:47.233287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14059): Terminated: ok {rc=0} 18:39:47.279902 --- ParallelTerminationStrategy: PID 14062 died... 18:39:47.299486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14062): Terminated: ok {rc=0} 18:39:47.345934 --- ParallelTerminationStrategy: PID 14065 died... 18:39:47.365541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14065): Terminated: ok {rc=0} 18:39:47.454008 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:39:48.541709 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:48.554267 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:39:48.607191 tst ping_idle_ping.py: using LAC 30734 18:39:48.731508 tst ping_idle_ping.py: using RAC 134 18:39:48.855024 tst ping_idle_ping.py: using CellId 30734 18:39:48.979151 tst ping_idle_ping.py: using BVCI 30735 18:39:49.094596 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:49.106377 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:49.117954 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:49.129464 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:49.140758 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:49.152680 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:49.164394 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:39:49.175877 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:39:49.295002 tst ping_idle_ping.py:24: start network... 18:39:49.509532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:39:50.006377 run create_hlr_db(pid=14067): Launched 18:39:50.137289 bus /gobi_6: Setting Powered False 18:39:51.200675 run create_hlr_db(pid=14067): Terminated: ok {rc=0} 18:39:51.646385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14069): Launched 18:39:51.966573 run osmo-hlr_10.42.42.2(pid=14070): Launched 18:39:52.088442 run osmo-stp_10.42.42.5: Starting osmo-stp 18:39:52.636609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14072): Launched 18:39:52.956520 run osmo-stp_10.42.42.5(pid=14073): Launched 18:39:53.079664 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:39:53.631447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14075): Launched 18:39:53.754327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:39:54.025228 run patchelf(pid=14076): Launched 18:39:54.205146 run osmo-stp_10.42.42.5(pid=14073): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14073)] 18:39:54.340202 run osmo-stp_10.42.42.5(pid=14073): stdout: | (launched: 2022-12-12_18:39:52.896880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:39:54.476129 run osmo-stp_10.42.42.5(pid=14073): stderr: | [0;m[38;5;43m20221212183953088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183953088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183953088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183953089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183953089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183953089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183953089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:39:54.612276 run osmo-stp_10.42.42.5(pid=14073): stdout: | (launched: 2022-12-12_18:39:52.896880) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:39:54.742878 run osmo-stp_10.42.42.5(pid=14073): stderr: | [0;m[38;5;43m20221212183953088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212183953088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212183953088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212183953089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212183953089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212183953089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212183953089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:39:54.897407 run patchelf(pid=14076): Terminating (SIGINT) 18:39:55.075478 run patchelf(pid=14076): Terminated: ok {rc=0} 18:39:55.203655 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14073): Process ended prematurely: osmo-stp_10.42.42.5(pid=14073) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14073)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 18:39:55.213442 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:39:55.242047 run osmo-hlr_10.42.42.2(pid=14070): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14070)] 18:39:55.292726 run osmo-hlr_10.42.42.2(pid=14070): stdout: | (launched: 2022-12-12_18:39:51.906169) 18:39:55.344686 run osmo-hlr_10.42.42.2(pid=14070): stderr: | [0;m[1;31m20221212183952103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212183952103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212183952103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212183952103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212183952103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212183952103 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212183952119 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212183952129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212183952130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212183952130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:39:55.397103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14069): Terminating (SIGTERM) 18:39:55.439056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14072): Terminating (SIGTERM) 18:39:55.481318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14075): Terminating (SIGTERM) 18:39:55.524190 --- ParallelTerminationStrategy: PID 14069 died... 18:39:55.544577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14069): Terminated: ok {rc=0} 18:39:55.591079 --- ParallelTerminationStrategy: PID 14072 died... 18:39:55.610753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14072): Terminated: ok {rc=0} 18:39:55.657730 --- ParallelTerminationStrategy: PID 14075 died... 18:39:55.677531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14075): Terminated: ok {rc=0} 18:39:55.766415 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:39:57.066446 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:39:57.074823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:39:57.105210 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:39:57.144764 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:39:57.233717 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:39:57.263851 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:39:57.303667 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:39:57.903067 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:39:57.955318 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:39:57.966965 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:39:58.035417 tst cs_paging_gprs_active.py: using LAC 30735 18:39:58.164303 tst cs_paging_gprs_active.py: using RAC 135 18:39:58.293880 tst cs_paging_gprs_active.py: using CellId 30735 18:39:58.421018 tst cs_paging_gprs_active.py: using BVCI 30736 18:39:58.538648 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:39:58.550413 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:39:58.561895 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:39:58.573489 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:39:58.585025 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:39:58.596445 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:39:58.608033 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:39:58.619426 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:39:58.631166 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:39:58.747952 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:39:58.866466 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:39:59.072720 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:39:59.380419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14080): Launched 18:39:59.647903 run iperf3-srv_10.42.42.10(pid=14081): Launched 18:39:59.764691 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:39:59.968159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:40:00.275360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14082): Launched 18:40:00.543522 run iperf3-srv_10.42.42.10(pid=14083): Launched 18:40:00.659702 tst cs_paging_gprs_active.py:38: start network... 18:40:00.866896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:40:01.356861 run create_hlr_db(pid=14086): Launched 18:40:01.531066 bus /gobi_6: Setting Powered False 18:40:02.595652 run create_hlr_db(pid=14086): Terminated: ok {rc=0} 18:40:03.033715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14089): Launched 18:40:03.340749 run osmo-hlr_10.42.42.2(pid=14090): Launched 18:40:03.457871 run osmo-stp_10.42.42.5: Starting osmo-stp 18:40:03.997422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14092): Launched 18:40:04.303762 run osmo-stp_10.42.42.5(pid=14093): Launched 18:40:04.421593 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:40:04.965924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14095): Launched 18:40:05.091295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:40:05.369846 run patchelf(pid=14096): Launched 18:40:05.552607 run osmo-stp_10.42.42.5(pid=14093): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14093)] 18:40:05.690960 run osmo-stp_10.42.42.5(pid=14093): stdout: | (launched: 2022-12-12_18:40:04.246556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:05.829731 run osmo-stp_10.42.42.5(pid=14093): stderr: | [0;m[38;5;43m20221212184004416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184004417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184004417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184004417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184004418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184004418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184004418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:05.968732 run osmo-stp_10.42.42.5(pid=14093): stdout: | (launched: 2022-12-12_18:40:04.246556) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:06.101505 run osmo-stp_10.42.42.5(pid=14093): stderr: | [0;m[38;5;43m20221212184004416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184004417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184004417 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184004417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184004418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184004418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184004418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:06.259450 run patchelf(pid=14096): Terminating (SIGINT) 18:40:06.442700 run patchelf(pid=14096): Terminated: ok {rc=0} 18:40:06.573974 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14093): Process ended prematurely: osmo-stp_10.42.42.5(pid=14093) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14093)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:40:06.584393 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:40:06.613264 run osmo-hlr_10.42.42.2(pid=14090): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14090)] 18:40:06.663357 run osmo-hlr_10.42.42.2(pid=14090): stdout: | (launched: 2022-12-12_18:40:03.283414) 18:40:06.715218 run osmo-hlr_10.42.42.2(pid=14090): stderr: | [0;m[1;31m20221212184003461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184003461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184003461 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184003462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184003462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184003462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184003474 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184003485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184003485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184003485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:40:06.767345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14080): Terminating (SIGTERM) 18:40:06.809416 run iperf3-srv_10.42.42.10(pid=14081): Terminating (SIGTERM) 18:40:06.851171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14082): Terminating (SIGTERM) 18:40:06.893001 run iperf3-srv_10.42.42.10(pid=14083): Terminating (SIGTERM) 18:40:06.934736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14089): Terminating (SIGTERM) 18:40:06.977030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14092): Terminating (SIGTERM) 18:40:07.018857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14095): Terminating (SIGTERM) 18:40:07.060923 --- ParallelTerminationStrategy: PID 14080 died... 18:40:07.081091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14080): Terminated: ok {rc=0} 18:40:07.127230 --- ParallelTerminationStrategy: PID 14081 died... 18:40:07.146653 run iperf3-srv_10.42.42.10(pid=14081): Terminated {rc=256} 18:40:07.192550 --- ParallelTerminationStrategy: PID 14082 died... 18:40:07.212283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14082): Terminated: ok {rc=0} 18:40:07.258575 --- ParallelTerminationStrategy: PID 14083 died... 18:40:07.278266 run iperf3-srv_10.42.42.10(pid=14083): Terminated {rc=256} 18:40:07.324386 --- ParallelTerminationStrategy: PID 14089 died... 18:40:07.343997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14089): Terminated: ok {rc=0} 18:40:07.390351 --- ParallelTerminationStrategy: PID 14092 died... 18:40:07.409902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14092): Terminated: ok {rc=0} 18:40:07.455923 --- ParallelTerminationStrategy: PID 14095 died... 18:40:07.475415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14095): Terminated: ok {rc=0} 18:40:07.563099 bus /gobi_0: Setting Powered False 18:40:08.664058 bus /gobi_0: Setting Powered False 18:40:09.780043 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:40:10.929284 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:10.941616 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:40:11.012450 tst iperf3.py: using LAC 30736 18:40:11.139923 tst iperf3.py: using RAC 136 18:40:11.268637 tst iperf3.py: using CellId 30736 18:40:11.401211 tst iperf3.py: using BVCI 30737 18:40:11.519488 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:11.531232 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:11.542754 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:11.554233 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:11.565600 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:11.577561 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:11.589062 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:11.600419 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:11.611945 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:40:11.728094 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:40:11.933477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:40:12.239767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14097): Launched 18:40:12.524867 run iperf3-srv_10.42.42.10(pid=14098): Launched 18:40:12.648867 tst iperf3.py:8: start network... 18:40:12.867174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:40:13.371063 run create_hlr_db(pid=14099): Launched 18:40:13.502609 bus /gobi_6: Setting Powered False 18:40:14.566829 run create_hlr_db(pid=14099): Terminated: ok {rc=0} 18:40:15.018859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14101): Launched 18:40:15.345084 run osmo-hlr_10.42.42.2(pid=14102): Launched 18:40:15.471203 run osmo-stp_10.42.42.5: Starting osmo-stp 18:40:16.061790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14104): Launched 18:40:16.380397 run osmo-stp_10.42.42.5(pid=14105): Launched 18:40:16.616932 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:40:17.352476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14107): Launched 18:40:17.477803 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:40:17.753975 run patchelf(pid=14109): Launched 18:40:17.935839 run osmo-stp_10.42.42.5(pid=14105): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14105)] 18:40:18.072823 run osmo-stp_10.42.42.5(pid=14105): stdout: | (launched: 2022-12-12_18:40:16.321391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:18.211292 run osmo-stp_10.42.42.5(pid=14105): stderr: | [0;m[38;5;43m20221212184016637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184016637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184016638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184016638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184016638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184016638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184016639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:18.350260 run osmo-stp_10.42.42.5(pid=14105): stdout: | (launched: 2022-12-12_18:40:16.321391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:18.482503 run osmo-stp_10.42.42.5(pid=14105): stderr: | [0;m[38;5;43m20221212184016637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184016637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184016638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184016638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184016638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184016638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184016639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:18.639410 run patchelf(pid=14109): Terminating (SIGINT) 18:40:18.821152 run patchelf(pid=14109): Terminated: ok {rc=0} 18:40:18.951888 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14105): Process ended prematurely: osmo-stp_10.42.42.5(pid=14105) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14105)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 18:40:18.962311 tst iperf3.py:8: Test FAILED (8.1 sec) 18:40:18.991028 run osmo-hlr_10.42.42.2(pid=14102): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14102)] 18:40:19.041145 run osmo-hlr_10.42.42.2(pid=14102): stdout: | (launched: 2022-12-12_18:40:15.284046) 18:40:19.093248 run osmo-hlr_10.42.42.2(pid=14102): stderr: | [0;m[1;31m20221212184015482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184015482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184015482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184015482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184015482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184015482 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184015498 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184015508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184015508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184015508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:40:19.145485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14097): Terminating (SIGTERM) 18:40:19.187138 run iperf3-srv_10.42.42.10(pid=14098): Terminating (SIGTERM) 18:40:19.228925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14101): Terminating (SIGTERM) 18:40:19.270733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14104): Terminating (SIGTERM) 18:40:19.312998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14107): Terminating (SIGTERM) 18:40:19.355121 --- ParallelTerminationStrategy: PID 14097 died... 18:40:19.375223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14097): Terminated: ok {rc=0} 18:40:19.421690 --- ParallelTerminationStrategy: PID 14098 died... 18:40:19.440913 run iperf3-srv_10.42.42.10(pid=14098): Terminated {rc=256} 18:40:19.487391 --- ParallelTerminationStrategy: PID 14101 died... 18:40:19.507134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14101): Terminated: ok {rc=0} 18:40:19.552920 --- ParallelTerminationStrategy: PID 14104 died... 18:40:19.572483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14104): Terminated: ok {rc=0} 18:40:19.618445 --- ParallelTerminationStrategy: PID 14107 died... 18:40:19.638014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14107): Terminated: ok {rc=0} 18:40:19.726745 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:40:20.878639 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:20.891128 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:40:20.958807 tst iperf3m4.py: using LAC 30737 18:40:21.088885 tst iperf3m4.py: using RAC 137 18:40:21.216858 tst iperf3m4.py: using CellId 30737 18:40:21.342755 tst iperf3m4.py: using BVCI 30738 18:40:21.460096 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:21.471853 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:21.483320 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:21.494875 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:21.506362 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:21.518008 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:21.529597 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:21.540914 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:21.552472 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:40:21.672780 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:40:21.795673 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:40:21.915467 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:40:22.035308 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:40:22.254999 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:40:22.583574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14110): Launched 18:40:22.868204 run iperf3-srv_10.42.42.10(pid=14111): Launched 18:40:22.992335 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:40:23.211625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:40:23.540865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14112): Launched 18:40:23.826350 run iperf3-srv_10.42.42.10(pid=14113): Launched 18:40:23.950431 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:40:24.169222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:40:24.497715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14114): Launched 18:40:24.783022 run iperf3-srv_10.42.42.10(pid=14115): Launched 18:40:24.907084 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:40:25.126460 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:40:25.454983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14116): Launched 18:40:25.739219 run iperf3-srv_10.42.42.10(pid=14117): Launched 18:40:25.862935 tst iperf3m4.py:8: start network... 18:40:26.082266 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:40:26.588884 run create_hlr_db(pid=14118): Launched 18:40:26.722556 bus /gobi_6: Setting Powered False 18:40:27.787327 run create_hlr_db(pid=14118): Terminated: ok {rc=0} 18:40:28.223921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14120): Launched 18:40:28.531902 run osmo-hlr_10.42.42.2(pid=14121): Launched 18:40:28.648748 run osmo-stp_10.42.42.5: Starting osmo-stp 18:40:29.190118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14123): Launched 18:40:29.496632 run osmo-stp_10.42.42.5(pid=14124): Launched 18:40:29.614980 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:40:30.139319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14126): Launched 18:40:30.256369 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:40:30.515205 run patchelf(pid=14127): Launched 18:40:30.687348 run osmo-stp_10.42.42.5(pid=14124): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14124)] 18:40:30.816271 run osmo-stp_10.42.42.5(pid=14124): stdout: | (launched: 2022-12-12_18:40:29.439300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:30.957455 run osmo-stp_10.42.42.5(pid=14124): stderr: | [0;m[38;5;43m20221212184029609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184029609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184029610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184029610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184029610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184029610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184029611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:31.090331 run osmo-stp_10.42.42.5(pid=14124): stdout: | (launched: 2022-12-12_18:40:29.439300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:31.217270 run osmo-stp_10.42.42.5(pid=14124): stderr: | [0;m[38;5;43m20221212184029609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184029609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184029610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184029610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184029610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184029610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184029611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:31.368416 run patchelf(pid=14127): Terminating (SIGINT) 18:40:31.542975 run patchelf(pid=14127): Terminated: ok {rc=0} 18:40:31.669951 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14124): Process ended prematurely: osmo-stp_10.42.42.5(pid=14124) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14124)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:40:31.680689 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:40:31.712249 run osmo-hlr_10.42.42.2(pid=14121): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14121)] 18:40:31.763078 run osmo-hlr_10.42.42.2(pid=14121): stdout: | (launched: 2022-12-12_18:40:28.474501) 18:40:31.815541 run osmo-hlr_10.42.42.2(pid=14121): stderr: | [0;m[1;31m20221212184028650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184028650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184028650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184028650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184028650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184028650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184028663 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184028671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184028672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184028672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:40:31.868168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14110): Terminating (SIGTERM) 18:40:31.911509 run iperf3-srv_10.42.42.10(pid=14111): Terminating (SIGTERM) 18:40:31.957374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14112): Terminating (SIGTERM) 18:40:32.000680 run iperf3-srv_10.42.42.10(pid=14113): Terminating (SIGTERM) 18:40:32.046306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14114): Terminating (SIGTERM) 18:40:32.089621 run iperf3-srv_10.42.42.10(pid=14115): Terminating (SIGTERM) 18:40:32.134651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14116): Terminating (SIGTERM) 18:40:32.177762 run iperf3-srv_10.42.42.10(pid=14117): Terminating (SIGTERM) 18:40:32.220093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14120): Terminating (SIGTERM) 18:40:32.260454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14123): Terminating (SIGTERM) 18:40:32.300725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14126): Terminating (SIGTERM) 18:40:32.341112 --- ParallelTerminationStrategy: PID 14110 died... 18:40:32.360154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14110): Terminated: ok {rc=0} 18:40:32.404810 --- ParallelTerminationStrategy: PID 14111 died... 18:40:32.423575 run iperf3-srv_10.42.42.10(pid=14111): Terminated {rc=256} 18:40:32.467931 --- ParallelTerminationStrategy: PID 14112 died... 18:40:32.486598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14112): Terminated: ok {rc=0} 18:40:32.530866 --- ParallelTerminationStrategy: PID 14113 died... 18:40:32.549185 run iperf3-srv_10.42.42.10(pid=14113): Terminated {rc=256} 18:40:32.594365 --- ParallelTerminationStrategy: PID 14114 died... 18:40:32.612925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14114): Terminated: ok {rc=0} 18:40:32.657906 --- ParallelTerminationStrategy: PID 14115 died... 18:40:32.676600 run iperf3-srv_10.42.42.10(pid=14115): Terminated {rc=256} 18:40:32.721120 --- ParallelTerminationStrategy: PID 14116 died... 18:40:32.739869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14116): Terminated: ok {rc=0} 18:40:32.784506 --- ParallelTerminationStrategy: PID 14117 died... 18:40:32.803147 run iperf3-srv_10.42.42.10(pid=14117): Terminated {rc=256} 18:40:32.847579 --- ParallelTerminationStrategy: PID 14120 died... 18:40:32.866377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14120): Terminated: ok {rc=0} 18:40:32.910794 --- ParallelTerminationStrategy: PID 14123 died... 18:40:32.929564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14123): Terminated: ok {rc=0} 18:40:32.974500 --- ParallelTerminationStrategy: PID 14126 died... 18:40:32.993272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14126): Terminated: ok {rc=0} 18:40:33.080573 bus /gobi_4: Setting Powered False 18:40:34.180505 bus /gobi_4: Setting Powered False 18:40:35.294351 bus /gobi_1: Setting Powered False 18:40:36.392791 bus /gobi_1: Setting Powered False 18:40:37.510637 bus /gobi_0: Setting Powered False 18:40:38.610023 bus /gobi_0: Setting Powered False 18:40:39.725866 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:40:40.829168 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:40.840918 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:40:40.907606 tst ping.py: using LAC 30738 18:40:41.024082 tst ping.py: using RAC 138 18:40:41.141688 tst ping.py: using CellId 30738 18:40:41.267968 tst ping.py: using BVCI 30739 18:40:41.383517 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:41.395402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:41.406920 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:41.418455 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:41.430241 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:41.441838 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:41.453538 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:41.465025 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:40:41.582903 tst ping.py:19: start network... 18:40:41.797398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:40:42.318056 run create_hlr_db(pid=14130): Launched 18:40:42.441609 bus /gobi_6: Setting Powered False 18:40:43.501708 run create_hlr_db(pid=14130): Terminated: ok {rc=0} 18:40:43.938016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14132): Launched 18:40:44.259870 run osmo-hlr_10.42.42.2(pid=14133): Launched 18:40:44.383871 run osmo-stp_10.42.42.5: Starting osmo-stp 18:40:44.936291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14135): Launched 18:40:45.258021 run osmo-stp_10.42.42.5(pid=14136): Launched 18:40:45.381969 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:40:45.955762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14138): Launched 18:40:46.086295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:40:46.352624 run patchelf(pid=14139): Launched 18:40:46.540305 run osmo-stp_10.42.42.5(pid=14136): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14136)] 18:40:46.673255 run osmo-stp_10.42.42.5(pid=14136): stdout: | (launched: 2022-12-12_18:40:45.198204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:46.807009 run osmo-stp_10.42.42.5(pid=14136): stderr: | [0;m[38;5;43m20221212184045392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184045392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184045392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184045393 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184045393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184045393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184045393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:46.939545 run osmo-stp_10.42.42.5(pid=14136): stdout: | (launched: 2022-12-12_18:40:45.198204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:47.067333 run osmo-stp_10.42.42.5(pid=14136): stderr: | [0;m[38;5;43m20221212184045392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184045392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184045392 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184045393 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184045393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184045393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184045393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:47.217870 run patchelf(pid=14139): Terminating (SIGINT) 18:40:47.385864 run patchelf(pid=14139): Terminated: ok {rc=0} 18:40:47.506845 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14136): Process ended prematurely: osmo-stp_10.42.42.5(pid=14136) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14136)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 18:40:47.515995 tst ping.py:22: Test FAILED (6.7 sec) 18:40:47.543596 run osmo-hlr_10.42.42.2(pid=14133): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14133)] 18:40:47.592657 run osmo-hlr_10.42.42.2(pid=14133): stdout: | (launched: 2022-12-12_18:40:44.199840) 18:40:47.642908 run osmo-hlr_10.42.42.2(pid=14133): stderr: | [0;m[1;31m20221212184044399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184044399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184044399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184044399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184044399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184044399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184044411 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184044419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184044420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184044420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:40:47.693653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14132): Terminating (SIGTERM) 18:40:47.734207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14135): Terminating (SIGTERM) 18:40:47.774921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14138): Terminating (SIGTERM) 18:40:47.815634 --- ParallelTerminationStrategy: PID 14132 died... 18:40:47.835069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14132): Terminated: ok {rc=0} 18:40:47.880174 --- ParallelTerminationStrategy: PID 14135 died... 18:40:47.898943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14135): Terminated: ok {rc=0} 18:40:47.944503 --- ParallelTerminationStrategy: PID 14138 died... 18:40:47.963495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14138): Terminated: ok {rc=0} 18:40:48.051867 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:40:49.142127 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:49.154762 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:40:49.225657 tst ping_idle_ping.py: using LAC 30739 18:40:49.352066 tst ping_idle_ping.py: using RAC 139 18:40:49.472878 tst ping_idle_ping.py: using CellId 30739 18:40:49.590329 tst ping_idle_ping.py: using BVCI 30740 18:40:49.700525 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:49.712047 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:49.723297 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:49.734808 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:49.746044 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:49.757394 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:49.768716 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:40:49.780625 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:40:49.900152 tst ping_idle_ping.py:24: start network... 18:40:50.116197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:40:50.616892 run create_hlr_db(pid=14140): Launched 18:40:50.748918 bus /gobi_6: Setting Powered False 18:40:51.812364 run create_hlr_db(pid=14140): Terminated: ok {rc=0} 18:40:52.241684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14142): Launched 18:40:52.544266 run osmo-hlr_10.42.42.2(pid=14143): Launched 18:40:52.661191 run osmo-stp_10.42.42.5: Starting osmo-stp 18:40:53.180427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14145): Launched 18:40:53.480822 run osmo-stp_10.42.42.5(pid=14146): Launched 18:40:53.597747 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:40:54.116094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14148): Launched 18:40:54.232941 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:40:54.487630 run patchelf(pid=14149): Launched 18:40:54.655917 run osmo-stp_10.42.42.5(pid=14146): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14146)] 18:40:54.782134 run osmo-stp_10.42.42.5(pid=14146): stdout: | (launched: 2022-12-12_18:40:53.424374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:54.909908 run osmo-stp_10.42.42.5(pid=14146): stderr: | [0;m[38;5;43m20221212184053596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184053596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184053596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184053597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184053597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184053597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184053597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:55.038147 run osmo-stp_10.42.42.5(pid=14146): stdout: | (launched: 2022-12-12_18:40:53.424374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:40:55.160771 run osmo-stp_10.42.42.5(pid=14146): stderr: | [0;m[38;5;43m20221212184053596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184053596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184053596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184053597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184053597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184053597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184053597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:40:55.306357 run patchelf(pid=14149): Terminating (SIGINT) 18:40:55.475219 run patchelf(pid=14149): Terminated: ok {rc=0} 18:40:55.596352 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14146): Process ended prematurely: osmo-stp_10.42.42.5(pid=14146) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14146)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:40:55.605643 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:40:55.633065 run osmo-hlr_10.42.42.2(pid=14143): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14143)] 18:40:55.681389 run osmo-hlr_10.42.42.2(pid=14143): stdout: | (launched: 2022-12-12_18:40:52.487799) 18:40:55.730987 run osmo-hlr_10.42.42.2(pid=14143): stderr: | [0;m[1;31m20221212184052666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184052666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184052666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184052666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184052666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184052666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184052678 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184052687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184052687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184052687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:40:55.781422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14142): Terminating (SIGTERM) 18:40:55.821760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14145): Terminating (SIGTERM) 18:40:55.862245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14148): Terminating (SIGTERM) 18:40:55.902918 --- ParallelTerminationStrategy: PID 14142 died... 18:40:55.922159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14142): Terminated: ok {rc=0} 18:40:55.966734 --- ParallelTerminationStrategy: PID 14145 died... 18:40:55.985682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14145): Terminated: ok {rc=0} 18:40:56.030052 --- ParallelTerminationStrategy: PID 14148 died... 18:40:56.048808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14148): Terminated: ok {rc=0} 18:40:56.136922 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 18:40:57.439368 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:40:57.445784 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 18:40:57.476093 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 18:40:57.515121 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 18:40:57.602411 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 18:40:57.631096 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 18:40:57.670551 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 18:40:58.267428 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 18:40:58.317565 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:40:58.328735 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:40:58.394603 tst cs_paging_gprs_active.py: using LAC 30740 18:40:58.513741 tst cs_paging_gprs_active.py: using RAC 140 18:40:58.633389 tst cs_paging_gprs_active.py: using CellId 30740 18:40:58.754505 tst cs_paging_gprs_active.py: using BVCI 30741 18:40:58.866948 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:40:58.878247 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:40:58.889315 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:40:58.900611 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:40:58.911923 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:40:58.923178 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:40:58.934586 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:40:58.945782 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:40:58.957171 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:40:59.078489 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:40:59.201247 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:40:59.422608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:40:59.750334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14153): Launched 18:41:00.035565 run iperf3-srv_10.42.42.10(pid=14154): Launched 18:41:00.159633 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:41:00.380192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:41:00.708751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14155): Launched 18:41:01.021831 run iperf3-srv_10.42.42.10(pid=14156): Launched 18:41:01.151771 tst cs_paging_gprs_active.py:38: start network... 18:41:01.376652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:01.892173 run create_hlr_db(pid=14157): Launched 18:41:02.060617 bus /gobi_6: Setting Powered False 18:41:03.125329 run create_hlr_db(pid=14157): Terminated: ok {rc=0} 18:41:03.562386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14159): Launched 18:41:03.870693 run osmo-hlr_10.42.42.2(pid=14160): Launched 18:41:03.988574 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:04.529416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14162): Launched 18:41:04.836806 run osmo-stp_10.42.42.5(pid=14163): Launched 18:41:04.955372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:41:05.480807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14165): Launched 18:41:05.599459 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:41:05.865707 run patchelf(pid=14166): Launched 18:41:06.036746 run osmo-stp_10.42.42.5(pid=14163): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14163)] 18:41:06.165915 run osmo-stp_10.42.42.5(pid=14163): stdout: | (launched: 2022-12-12_18:41:04.779220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:06.296456 run osmo-stp_10.42.42.5(pid=14163): stderr: | [0;m[38;5;43m20221212184104950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184104950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184104950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184104950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184104951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184104951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184104951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:06.426855 run osmo-stp_10.42.42.5(pid=14163): stdout: | (launched: 2022-12-12_18:41:04.779220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:06.551424 run osmo-stp_10.42.42.5(pid=14163): stderr: | [0;m[38;5;43m20221212184104950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184104950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184104950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184104950 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184104951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184104951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184104951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:06.699131 run patchelf(pid=14166): Terminating (SIGINT) 18:41:06.870643 run patchelf(pid=14166): Terminated: ok {rc=0} 18:41:06.994137 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14163): Process ended prematurely: osmo-stp_10.42.42.5(pid=14163) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14163)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 18:41:07.003829 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:41:07.031818 run osmo-hlr_10.42.42.2(pid=14160): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14160)] 18:41:07.080288 run osmo-hlr_10.42.42.2(pid=14160): stdout: | (launched: 2022-12-12_18:41:03.813179) 18:41:07.130235 run osmo-hlr_10.42.42.2(pid=14160): stderr: | [0;m[1;31m20221212184103990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184103990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184103990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184103990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184103990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184103990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184104002 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184104013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184104013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184104013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:07.180682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14153): Terminating (SIGTERM) 18:41:07.220858 run iperf3-srv_10.42.42.10(pid=14154): Terminating (SIGTERM) 18:41:07.261218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14155): Terminating (SIGTERM) 18:41:07.301858 run iperf3-srv_10.42.42.10(pid=14156): Terminating (SIGTERM) 18:41:07.341619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14159): Terminating (SIGTERM) 18:41:07.381782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14162): Terminating (SIGTERM) 18:41:07.421779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14165): Terminating (SIGTERM) 18:41:07.462072 --- ParallelTerminationStrategy: PID 14153 died... 18:41:07.481428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14153): Terminated: ok {rc=0} 18:41:07.525990 --- ParallelTerminationStrategy: PID 14154 died... 18:41:07.544559 run iperf3-srv_10.42.42.10(pid=14154): Terminated {rc=256} 18:41:07.589115 --- ParallelTerminationStrategy: PID 14155 died... 18:41:07.607741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14155): Terminated: ok {rc=0} 18:41:07.652796 --- ParallelTerminationStrategy: PID 14156 died... 18:41:07.672048 run iperf3-srv_10.42.42.10(pid=14156): Terminated {rc=256} 18:41:07.717010 --- ParallelTerminationStrategy: PID 14159 died... 18:41:07.735781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14159): Terminated: ok {rc=0} 18:41:07.780420 --- ParallelTerminationStrategy: PID 14162 died... 18:41:07.799393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14162): Terminated: ok {rc=0} 18:41:07.843772 --- ParallelTerminationStrategy: PID 14165 died... 18:41:07.862488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14165): Terminated: ok {rc=0} 18:41:07.949549 bus /gobi_0: Setting Powered False 18:41:09.049989 bus /gobi_0: Setting Powered False 18:41:10.163646 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 18:41:11.314158 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:11.326931 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:41:11.397541 tst iperf3.py: using LAC 30741 18:41:11.518425 tst iperf3.py: using RAC 141 18:41:11.639204 tst iperf3.py: using CellId 30741 18:41:11.760105 tst iperf3.py: using BVCI 30742 18:41:11.872129 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:11.883626 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:11.894875 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:11.906453 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:11.917927 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:11.929377 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:11.940651 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:11.951747 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:11.963141 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:41:12.083614 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:41:12.304424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:41:12.632331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14167): Launched 18:41:12.918706 run iperf3-srv_10.42.42.10(pid=14168): Launched 18:41:13.040724 tst iperf3.py:8: start network... 18:41:13.259311 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:13.764835 run create_hlr_db(pid=14169): Launched 18:41:13.897736 bus /gobi_6: Setting Powered False 18:41:14.962248 run create_hlr_db(pid=14169): Terminated: ok {rc=0} 18:41:15.398895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14171): Launched 18:41:15.705316 run osmo-hlr_10.42.42.2(pid=14172): Launched 18:41:15.823197 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:16.504604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14174): Launched 18:41:16.863469 run osmo-stp_10.42.42.5(pid=14175): Launched 18:41:17.155586 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:41:17.724254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14177): Launched 18:41:17.850349 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:41:18.126468 run patchelf(pid=14178): Launched 18:41:18.308038 run osmo-stp_10.42.42.5(pid=14175): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14175)] 18:41:18.445780 run osmo-stp_10.42.42.5(pid=14175): stdout: | (launched: 2022-12-12_18:41:16.803370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:18.584418 run osmo-stp_10.42.42.5(pid=14175): stderr: | [0;m[38;5;43m20221212184117069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184117069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184117069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184117070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184117071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184117071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184117071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:18.723224 run osmo-stp_10.42.42.5(pid=14175): stdout: | (launched: 2022-12-12_18:41:16.803370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:18.856000 run osmo-stp_10.42.42.5(pid=14175): stderr: | [0;m[38;5;43m20221212184117069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184117069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184117069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184117070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184117071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184117071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184117071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:19.014040 run patchelf(pid=14178): Terminating (SIGINT) 18:41:19.196303 run patchelf(pid=14178): Terminated: ok {rc=0} 18:41:19.327932 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14175): Process ended prematurely: osmo-stp_10.42.42.5(pid=14175) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14175)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 18:41:19.338735 tst iperf3.py:8: Test FAILED (8.1 sec) 18:41:19.367615 run osmo-hlr_10.42.42.2(pid=14172): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14172)] 18:41:19.417387 run osmo-hlr_10.42.42.2(pid=14172): stdout: | (launched: 2022-12-12_18:41:15.648202) 18:41:19.469218 run osmo-hlr_10.42.42.2(pid=14172): stderr: | [0;m[1;31m20221212184115827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184115827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184115827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184115827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184115827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184115828 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184115849 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184115871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184115871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184115871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:19.521265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14167): Terminating (SIGTERM) 18:41:19.563006 run iperf3-srv_10.42.42.10(pid=14168): Terminating (SIGTERM) 18:41:19.605216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14171): Terminating (SIGTERM) 18:41:19.647108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14174): Terminating (SIGTERM) 18:41:19.688928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14177): Terminating (SIGTERM) 18:41:19.730939 --- ParallelTerminationStrategy: PID 14167 died... 18:41:19.750990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14167): Terminated: ok {rc=0} 18:41:19.797603 --- ParallelTerminationStrategy: PID 14168 died... 18:41:19.817380 run iperf3-srv_10.42.42.10(pid=14168): Terminated {rc=256} 18:41:19.863694 --- ParallelTerminationStrategy: PID 14171 died... 18:41:19.883384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14171): Terminated: ok {rc=0} 18:41:19.929645 --- ParallelTerminationStrategy: PID 14174 died... 18:41:19.949352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14174): Terminated: ok {rc=0} 18:41:19.995636 --- ParallelTerminationStrategy: PID 14177 died... 18:41:20.015395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14177): Terminated: ok {rc=0} 18:41:20.105307 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 18:41:21.256868 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:21.269577 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:41:21.339094 tst iperf3m4.py: using LAC 30742 18:41:21.467223 tst iperf3m4.py: using RAC 142 18:41:21.596004 tst iperf3m4.py: using CellId 30742 18:41:21.728548 tst iperf3m4.py: using BVCI 30743 18:41:21.847852 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:21.859641 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:21.871172 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:21.883010 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:21.894543 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:21.906071 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:21.917675 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:21.929058 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:21.940641 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:41:22.058334 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:41:22.183823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:41:22.305490 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:41:22.423703 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:41:22.628446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:41:22.935242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14179): Launched 18:41:23.203760 run iperf3-srv_10.42.42.10(pid=14180): Launched 18:41:23.320862 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:41:23.524555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:41:23.831193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14181): Launched 18:41:24.099884 run iperf3-srv_10.42.42.10(pid=14182): Launched 18:41:24.217087 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:41:24.421807 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:41:24.728794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14183): Launched 18:41:24.997417 run iperf3-srv_10.42.42.10(pid=14184): Launched 18:41:25.113829 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:41:25.317902 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:41:25.624754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14185): Launched 18:41:25.894573 run iperf3-srv_10.42.42.10(pid=14186): Launched 18:41:26.011587 tst iperf3m4.py:8: start network... 18:41:26.215262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:26.690896 run create_hlr_db(pid=14187): Launched 18:41:26.811418 bus /gobi_6: Setting Powered False 18:41:27.871952 run create_hlr_db(pid=14187): Terminated: ok {rc=0} 18:41:28.320371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14189): Launched 18:41:28.648868 run osmo-hlr_10.42.42.2(pid=14190): Launched 18:41:28.774173 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:29.339102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14192): Launched 18:41:29.667656 run osmo-stp_10.42.42.5(pid=14193): Launched 18:41:29.790999 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:41:30.353145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14195): Launched 18:41:30.479554 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:41:30.756659 run patchelf(pid=14196): Launched 18:41:30.945773 run osmo-stp_10.42.42.5(pid=14193): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14193)] 18:41:31.084651 run osmo-stp_10.42.42.5(pid=14193): stdout: | (launched: 2022-12-12_18:41:29.606201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:31.227193 run osmo-stp_10.42.42.5(pid=14193): stderr: | [0;m[38;5;43m20221212184129797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184129797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184129798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184129798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184129798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184129799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184129799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:31.369260 run osmo-stp_10.42.42.5(pid=14193): stdout: | (launched: 2022-12-12_18:41:29.606201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:31.504804 run osmo-stp_10.42.42.5(pid=14193): stderr: | [0;m[38;5;43m20221212184129797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184129797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184129798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184129798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184129798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184129799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184129799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:31.665916 run patchelf(pid=14196): Terminating (SIGINT) 18:41:31.850486 run patchelf(pid=14196): Terminated: ok {rc=0} 18:41:31.984004 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14193): Process ended prematurely: osmo-stp_10.42.42.5(pid=14193) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14193)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 18:41:31.995327 tst iperf3m4.py:8: Test FAILED (10.8 sec) 18:41:32.025348 run osmo-hlr_10.42.42.2(pid=14190): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14190)] 18:41:32.076411 run osmo-hlr_10.42.42.2(pid=14190): stdout: | (launched: 2022-12-12_18:41:28.587570) 18:41:32.129023 run osmo-hlr_10.42.42.2(pid=14190): stderr: | [0;m[1;31m20221212184128783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184128783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184128783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184128783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184128783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184128783 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184128795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184128804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184128805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184128805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:32.181742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14179): Terminating (SIGTERM) 18:41:32.223621 run iperf3-srv_10.42.42.10(pid=14180): Terminating (SIGTERM) 18:41:32.266304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14181): Terminating (SIGTERM) 18:41:32.309928 run iperf3-srv_10.42.42.10(pid=14182): Terminating (SIGTERM) 18:41:32.350367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14183): Terminating (SIGTERM) 18:41:32.390874 run iperf3-srv_10.42.42.10(pid=14184): Terminating (SIGTERM) 18:41:32.431175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14185): Terminating (SIGTERM) 18:41:32.472093 run iperf3-srv_10.42.42.10(pid=14186): Terminating (SIGTERM) 18:41:32.514825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14189): Terminating (SIGTERM) 18:41:32.556588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14192): Terminating (SIGTERM) 18:41:32.598497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14195): Terminating (SIGTERM) 18:41:32.640524 --- ParallelTerminationStrategy: PID 14179 died... 18:41:32.660767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14179): Terminated: ok {rc=0} 18:41:32.707377 --- ParallelTerminationStrategy: PID 14180 died... 18:41:32.727026 run iperf3-srv_10.42.42.10(pid=14180): Terminated {rc=256} 18:41:32.773132 --- ParallelTerminationStrategy: PID 14181 died... 18:41:32.792638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14181): Terminated: ok {rc=0} 18:41:32.838455 --- ParallelTerminationStrategy: PID 14182 died... 18:41:32.857983 run iperf3-srv_10.42.42.10(pid=14182): Terminated {rc=256} 18:41:32.903710 --- ParallelTerminationStrategy: PID 14183 died... 18:41:32.923242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14183): Terminated: ok {rc=0} 18:41:32.969247 --- ParallelTerminationStrategy: PID 14184 died... 18:41:32.988690 run iperf3-srv_10.42.42.10(pid=14184): Terminated {rc=256} 18:41:33.035322 --- ParallelTerminationStrategy: PID 14185 died... 18:41:33.054918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14185): Terminated: ok {rc=0} 18:41:33.101692 --- ParallelTerminationStrategy: PID 14186 died... 18:41:33.121216 run iperf3-srv_10.42.42.10(pid=14186): Terminated {rc=256} 18:41:33.167078 --- ParallelTerminationStrategy: PID 14189 died... 18:41:33.186778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14189): Terminated: ok {rc=0} 18:41:33.233518 --- ParallelTerminationStrategy: PID 14192 died... 18:41:33.253286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14192): Terminated: ok {rc=0} 18:41:33.299712 --- ParallelTerminationStrategy: PID 14195 died... 18:41:33.319901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14195): Terminated: ok {rc=0} 18:41:33.408706 bus /gobi_4: Setting Powered False 18:41:34.510304 bus /gobi_4: Setting Powered False 18:41:35.628056 bus /gobi_1: Setting Powered False 18:41:36.729495 bus /gobi_1: Setting Powered False 18:41:37.847571 bus /gobi_0: Setting Powered False 18:41:38.947802 bus /gobi_0: Setting Powered False 18:41:40.065960 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 18:41:41.170866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:41.183522 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:41:41.252030 tst ping.py: using LAC 30743 18:41:41.376624 tst ping.py: using RAC 143 18:41:41.507582 tst ping.py: using CellId 30743 18:41:41.631831 tst ping.py: using BVCI 30744 18:41:41.741589 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:41.752939 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:41.764199 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:41.775547 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:41.786973 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:41.798314 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:41.809875 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:41.821199 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:41:41.940845 tst ping.py:19: start network... 18:41:42.155267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:42.651765 run create_hlr_db(pid=14197): Launched 18:41:42.782422 bus /gobi_6: Setting Powered False 18:41:43.846126 run create_hlr_db(pid=14197): Terminated: ok {rc=0} 18:41:44.277185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14199): Launched 18:41:44.578343 run osmo-hlr_10.42.42.2(pid=14200): Launched 18:41:44.694761 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:45.212077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14202): Launched 18:41:45.515042 run osmo-stp_10.42.42.5(pid=14203): Launched 18:41:45.631549 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:41:46.178101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14205): Launched 18:41:46.307189 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:41:46.569028 run patchelf(pid=14206): Launched 18:41:46.765353 run osmo-stp_10.42.42.5(pid=14203): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14203)] 18:41:46.903813 run osmo-stp_10.42.42.5(pid=14203): stdout: | (launched: 2022-12-12_18:41:45.458395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:47.044234 run osmo-stp_10.42.42.5(pid=14203): stderr: | [0;m[38;5;43m20221212184145627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184145627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184145627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184145628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184145628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184145628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184145628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:47.182798 run osmo-stp_10.42.42.5(pid=14203): stdout: | (launched: 2022-12-12_18:41:45.458395) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:47.313609 run osmo-stp_10.42.42.5(pid=14203): stderr: | [0;m[38;5;43m20221212184145627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184145627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184145627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184145628 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184145628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184145628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184145628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:47.469158 run patchelf(pid=14206): Terminating (SIGINT) 18:41:47.647443 run patchelf(pid=14206): Terminated: ok {rc=0} 18:41:47.776032 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14203): Process ended prematurely: osmo-stp_10.42.42.5(pid=14203) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14203)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 18:41:47.786036 tst ping.py:22: Test FAILED (6.6 sec) 18:41:47.814882 run osmo-hlr_10.42.42.2(pid=14200): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14200)] 18:41:47.864830 run osmo-hlr_10.42.42.2(pid=14200): stdout: | (launched: 2022-12-12_18:41:44.522152) 18:41:47.916717 run osmo-hlr_10.42.42.2(pid=14200): stderr: | [0;m[1;31m20221212184144697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184144697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184144697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184144697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184144697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184144697 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184144709 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184144718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184144718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184144718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:47.968879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14199): Terminating (SIGTERM) 18:41:48.011263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14202): Terminating (SIGTERM) 18:41:48.053571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14205): Terminating (SIGTERM) 18:41:48.096109 --- ParallelTerminationStrategy: PID 14199 died... 18:41:48.116477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14199): Terminated: ok {rc=0} 18:41:48.163142 --- ParallelTerminationStrategy: PID 14202 died... 18:41:48.183003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14202): Terminated: ok {rc=0} 18:41:48.229278 --- ParallelTerminationStrategy: PID 14205 died... 18:41:48.249097 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14205): Terminated: ok {rc=0} 18:41:48.337412 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 18:41:49.426075 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:49.438775 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 18:41:49.508859 tst ping_idle_ping.py: using LAC 30744 18:41:49.629200 tst ping_idle_ping.py: using RAC 144 18:41:49.756234 tst ping_idle_ping.py: using CellId 30744 18:41:49.881729 tst ping_idle_ping.py: using BVCI 30745 18:41:49.999463 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:50.011511 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:50.023436 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:50.035317 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:50.046919 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:50.058608 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:50.070451 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 18:41:50.082049 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 18:41:50.202017 tst ping_idle_ping.py:24: start network... 18:41:50.420620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:41:50.923485 run create_hlr_db(pid=14207): Launched 18:41:51.057142 bus /gobi_6: Setting Powered False 18:41:52.121190 run create_hlr_db(pid=14207): Terminated: ok {rc=0} 18:41:52.552734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14209): Launched 18:41:52.857093 run osmo-hlr_10.42.42.2(pid=14210): Launched 18:41:52.972922 run osmo-stp_10.42.42.5: Starting osmo-stp 18:41:53.504227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14212): Launched 18:41:53.809251 run osmo-stp_10.42.42.5(pid=14213): Launched 18:41:53.924018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:41:54.440684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14215): Launched 18:41:54.556143 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:41:54.810496 run patchelf(pid=14216): Launched 18:41:54.979472 run osmo-stp_10.42.42.5(pid=14213): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14213)] 18:41:55.106108 run osmo-stp_10.42.42.5(pid=14213): stdout: | (launched: 2022-12-12_18:41:53.752000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:55.234846 run osmo-stp_10.42.42.5(pid=14213): stderr: | [0;m[38;5;43m20221212184153919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184153919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184153919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184153920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184153920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184153920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184153920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:55.363582 run osmo-stp_10.42.42.5(pid=14213): stdout: | (launched: 2022-12-12_18:41:53.752000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:41:55.486143 run osmo-stp_10.42.42.5(pid=14213): stderr: | [0;m[38;5;43m20221212184153919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184153919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184153919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184153920 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184153920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184153920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184153920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:41:55.631654 run patchelf(pid=14216): Terminating (SIGINT) 18:41:55.799118 run patchelf(pid=14216): Terminated: ok {rc=0} 18:41:55.920155 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14213): Process ended prematurely: osmo-stp_10.42.42.5(pid=14213) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14213)] [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 18:41:55.929428 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:41:55.956941 run osmo-hlr_10.42.42.2(pid=14210): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14210)] 18:41:56.005132 run osmo-hlr_10.42.42.2(pid=14210): stdout: | (launched: 2022-12-12_18:41:52.800262) 18:41:56.054640 run osmo-hlr_10.42.42.2(pid=14210): stderr: | [0;m[1;31m20221212184152977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184152977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184152977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184152977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184152977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184152977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184152991 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184153002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184153002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184153002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:41:56.104791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14209): Terminating (SIGTERM) 18:41:56.144256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14212): Terminating (SIGTERM) 18:41:56.184468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14215): Terminating (SIGTERM) 18:41:56.224666 --- ParallelTerminationStrategy: PID 14209 died... 18:41:56.243978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14209): Terminated: ok {rc=0} 18:41:56.288479 --- ParallelTerminationStrategy: PID 14212 died... 18:41:56.307103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14212): Terminated: ok {rc=0} 18:41:56.351445 --- ParallelTerminationStrategy: PID 14215 died... 18:41:56.370083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14215): Terminated: ok {rc=0} 18:41:56.457491 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:41:57.768868 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:41:57.776601 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:41:57.807556 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:41:57.843847 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:41:57.898676 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:41:57.929520 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:41:57.966158 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:41:58.526438 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:41:58.532004 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:41:58.544120 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:41:58.613475 tst switch_tch_pdch.py: using LAC 30745 18:41:58.743092 tst switch_tch_pdch.py: using RAC 145 18:41:58.860860 tst switch_tch_pdch.py: using CellId 30745 18:41:58.975973 tst switch_tch_pdch.py: using BVCI 30746 18:41:59.084810 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:41:59.096495 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:41:59.107974 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:41:59.119739 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:41:59.131521 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:41:59.143109 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:41:59.154989 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:41:59.166725 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:41:59.284906 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:41:59.401034 tst switch_tch_pdch.py:51: start network... 18:41:59.600872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:00.063222 run create_hlr_db(pid=14220): Launched 18:42:00.179475 bus /gobi_6: Setting Powered False 18:42:01.268163 run create_hlr_db(pid=14220): Terminated: ok {rc=0} 18:42:01.693498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14230): Launched 18:42:02.019079 run osmo-hlr_10.42.42.2(pid=14231): Launched 18:42:02.305437 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:02.838802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14233): Launched 18:42:03.141340 run osmo-stp_10.42.42.5(pid=14234): Launched 18:42:03.255524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:42:03.771768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14236): Launched 18:42:03.887447 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:42:04.140312 run patchelf(pid=14237): Launched 18:42:04.309338 run osmo-stp_10.42.42.5(pid=14234): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14234)] 18:42:04.435482 run osmo-stp_10.42.42.5(pid=14234): stdout: | (launched: 2022-12-12_18:42:03.084475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:04.563654 run osmo-stp_10.42.42.5(pid=14234): stderr: | [0;m[38;5;43m20221212184203255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184203255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184203255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184203255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184203256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184203256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184203256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:04.691619 run osmo-stp_10.42.42.5(pid=14234): stdout: | (launched: 2022-12-12_18:42:03.084475) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:04.813685 run osmo-stp_10.42.42.5(pid=14234): stderr: | [0;m[38;5;43m20221212184203255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184203255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184203255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184203255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184203256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184203256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184203256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:04.958596 run patchelf(pid=14237): Terminating (SIGINT) 18:42:05.126077 run patchelf(pid=14237): Terminated: ok {rc=0} 18:42:05.246932 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14234): Process ended prematurely: osmo-stp_10.42.42.5(pid=14234) [trial-2380↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14234)] [trial-2380↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:42:05.256183 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 18:42:05.283500 run osmo-hlr_10.42.42.2(pid=14231): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14231)] 18:42:05.331561 run osmo-hlr_10.42.42.2(pid=14231): stdout: | (launched: 2022-12-12_18:42:01.953895) 18:42:05.381276 run osmo-hlr_10.42.42.2(pid=14231): stderr: | [0;m[1;31m20221212184202249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184202249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184202249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184202249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184202249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184202249 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184202267 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184202280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184202280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184202280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:05.431198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14230): Terminating (SIGTERM) 18:42:05.471504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14233): Terminating (SIGTERM) 18:42:05.511265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14236): Terminating (SIGTERM) 18:42:05.551617 --- ParallelTerminationStrategy: PID 14230 died... 18:42:05.571159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14230): Terminated: ok {rc=0} 18:42:05.615577 --- ParallelTerminationStrategy: PID 14233 died... 18:42:05.634368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14233): Terminated: ok {rc=0} 18:42:05.678882 --- ParallelTerminationStrategy: PID 14236 died... 18:42:05.697591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14236): Terminated: ok {rc=0} 18:42:05.784134 bus /gobi_0: Setting Powered False 18:42:06.884750 bus /gobi_0: Setting Powered False 18:42:08.002478 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 18:42:09.261759 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:42:09.267965 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 18:42:09.298484 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 18:42:09.334446 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 18:42:09.386852 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 18:42:09.416391 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 18:42:09.451166 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 18:42:10.009677 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 18:42:10.014936 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:42:10.026106 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 18:42:10.092116 tst switch_tch_pdch.py: using LAC 30746 18:42:10.209766 tst switch_tch_pdch.py: using RAC 146 18:42:10.330250 tst switch_tch_pdch.py: using CellId 30746 18:42:10.445618 tst switch_tch_pdch.py: using BVCI 30747 18:42:10.562021 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:42:10.574147 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:42:10.586374 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:42:10.598304 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:42:10.609821 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:42:10.621327 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:42:10.633307 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 18:42:10.644813 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:42:10.763736 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 18:42:10.880547 tst switch_tch_pdch.py:51: start network... 18:42:11.080724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:11.519266 run create_hlr_db(pid=14241): Launched 18:42:11.637353 bus /gobi_6: Setting Powered False 18:42:12.697131 run create_hlr_db(pid=14241): Terminated: ok {rc=0} 18:42:13.107552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14243): Launched 18:42:13.429637 run osmo-hlr_10.42.42.2(pid=14244): Launched 18:42:13.551491 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:14.078848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14246): Launched 18:42:14.401196 run osmo-stp_10.42.42.5(pid=14247): Launched 18:42:14.523060 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:42:15.047975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14249): Launched 18:42:15.170887 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:42:15.442529 run patchelf(pid=14250): Launched 18:42:15.620494 run osmo-stp_10.42.42.5(pid=14247): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14247)] 18:42:15.755058 run osmo-stp_10.42.42.5(pid=14247): stdout: | (launched: 2022-12-12_18:42:14.340901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:15.922893 run osmo-stp_10.42.42.5(pid=14247): stderr: | [0;m[38;5;43m20221212184214532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184214533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184214533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184214533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184214534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184214534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184214534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:16.068246 run osmo-stp_10.42.42.5(pid=14247): stdout: | (launched: 2022-12-12_18:42:14.340901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:16.201266 run osmo-stp_10.42.42.5(pid=14247): stderr: | [0;m[38;5;43m20221212184214532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184214533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184214533 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184214533 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184214534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184214534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184214534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:16.360127 run patchelf(pid=14250): Terminating (SIGINT) 18:42:16.542761 run patchelf(pid=14250): Terminated: ok {rc=0} 18:42:16.674176 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14247): Process ended prematurely: osmo-stp_10.42.42.5(pid=14247) [trial-2380↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14247)] [trial-2380↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 18:42:16.684442 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 18:42:16.713484 run osmo-hlr_10.42.42.2(pid=14244): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14244)] 18:42:16.764417 run osmo-hlr_10.42.42.2(pid=14244): stdout: | (launched: 2022-12-12_18:42:13.369882) 18:42:16.817113 run osmo-hlr_10.42.42.2(pid=14244): stderr: | [0;m[1;31m20221212184213565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184213565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184213565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184213565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184213565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184213565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184213579 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184213588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184213588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184213588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:16.870298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14243): Terminating (SIGTERM) 18:42:16.914074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14246): Terminating (SIGTERM) 18:42:16.958718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14249): Terminating (SIGTERM) 18:42:17.004311 --- ParallelTerminationStrategy: PID 14243 died... 18:42:17.025455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14243): Terminated: ok {rc=0} 18:42:17.074361 --- ParallelTerminationStrategy: PID 14246 died... 18:42:17.094727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14246): Terminated: ok {rc=0} 18:42:17.142322 --- ParallelTerminationStrategy: PID 14249 died... 18:42:17.162889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14249): Terminated: ok {rc=0} 18:42:17.252154 bus /gobi_0: Setting Powered False 18:42:18.352022 bus /gobi_0: Setting Powered False 18:42:19.468243 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_sms:nanobts --------------------------------------------------------------------- 18:42:20.715156 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:42:20.719049 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 18:42:20.743748 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 18:42:20.750870 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 18:42:20.803632 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 18:42:20.827840 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 18:42:20.834969 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 18:42:21.371533 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 18:42:21.376496 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 18:42:21.387280 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 18:42:21.425475 tst mo_mt_sms.py: using LAC 30747 18:42:21.545690 tst mo_mt_sms.py: using RAC 147 18:42:21.676758 tst mo_mt_sms.py: using CellId 30747 18:42:21.801117 tst mo_mt_sms.py: using BVCI 30748 18:42:21.916174 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 18:42:22.032056 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 18:42:22.147196 tst mo_mt_sms.py:9: start nitb and bts... 18:42:22.346232 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:42:22.958991 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14254): Launched 18:42:23.259436 run osmo-nitb_10.42.42.2(pid=14255): Launched 18:42:23.428141 run osmo-nitb_10.42.42.2(pid=14255): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14255)] 18:42:23.562492 run osmo-nitb_10.42.42.2(pid=14255): stdout: | (launched: 2022-12-12_18:42:23.203297) 18:42:23.698672 run osmo-nitb_10.42.42.2(pid=14255): stderr: | (launched: 2022-12-12_18:42:23.247575) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:42:23.834269 run osmo-nitb_10.42.42.2(pid=14255): stdout: | (launched: 2022-12-12_18:42:23.203297) 18:42:23.964244 run osmo-nitb_10.42.42.2(pid=14255): stderr: | (launched: 2022-12-12_18:42:23.247575) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14255): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14255) [trial-2380↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14255)] 18:42:24.375195 tst osmo-nitb_10.42.42.2(pid=14255): stdout: | (launched: 2022-12-12_18:42:23.203297) 18:42:24.495321 tst osmo-nitb_10.42.42.2(pid=14255): stderr: | (launched: 2022-12-12_18:42:23.247575) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:42:24.638328 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=14255): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14255) [trial-2380↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14255)] [trial-2380↪nitb_sms:nanobts↪mo_mt_sms.py:11] 18:42:24.646956 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 18:42:24.653776 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14254): Terminating (SIGTERM) 18:42:24.863414 --- ParallelTerminationStrategy: PID 14254 died... 18:42:24.884171 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14254): Terminated: ok {rc=0} 18:42:24.971407 bus /sierra_3: Setting Powered False 18:42:26.072564 bus /sierra_3: Setting Powered False 18:42:27.190870 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 sms:nanobts+band-1900 --------------------------------------------------------------------- 18:42:28.379510 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:42:28.385056 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:42:28.410035 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 18:42:28.436720 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 18:42:28.493437 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:42:28.517655 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 18:42:28.543884 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 18:42:29.087212 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 18:42:29.092226 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:42:29.103027 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:42:29.141787 tst mo_mt_sms.py: using LAC 30748 18:42:29.267244 tst mo_mt_sms.py: using RAC 148 18:42:29.392736 tst mo_mt_sms.py: using CellId 30748 18:42:29.518028 tst mo_mt_sms.py: using BVCI 30749 18:42:29.633194 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:42:29.644440 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:42:29.655663 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:42:29.666842 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:42:29.678304 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:42:29.689382 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 18:42:29.809113 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 18:42:29.925430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:30.391631 run create_hlr_db(pid=14259): Launched 18:42:30.509355 bus /sierra_2: Setting Powered False 18:42:31.569207 run create_hlr_db(pid=14259): Terminated: ok {rc=0} 18:42:31.996917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14261): Launched 18:42:32.314809 run osmo-hlr_10.42.42.2(pid=14262): Launched 18:42:32.432310 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:32.951676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14264): Launched 18:42:33.254084 run osmo-stp_10.42.42.5(pid=14265): Launched 18:42:33.370291 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:33.911733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14267): Launched 18:42:34.213764 run osmo-msc_10.42.42.6(pid=14268): Launched 18:42:34.384010 run osmo-stp_10.42.42.5(pid=14265): ERR: Terminated: ERROR {rc=1} [trial-2380↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14265)] 18:42:34.510790 run osmo-stp_10.42.42.5(pid=14265): stdout: | (launched: 2022-12-12_18:42:33.197757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:34.637156 run osmo-stp_10.42.42.5(pid=14265): stderr: | [0;m[38;5;43m20221212184233365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184233365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184233366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184233366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184233367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184233367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184233367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:34.761932 run osmo-stp_10.42.42.5(pid=14265): stdout: | (launched: 2022-12-12_18:42:33.197757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:34.881409 run osmo-stp_10.42.42.5(pid=14265): stderr: | [0;m[38;5;43m20221212184233365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184233365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184233366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184233366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184233367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184233367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184233367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:35.023707 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14265): Process ended prematurely: osmo-stp_10.42.42.5(pid=14265) [trial-2380↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14265)] [trial-2380↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 18:42:35.032248 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 18:42:35.058692 run osmo-hlr_10.42.42.2(pid=14262): ERR: Terminated: ERROR {rc=237} [trial-2380↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14262)] 18:42:35.106666 run osmo-hlr_10.42.42.2(pid=14262): stdout: | (launched: 2022-12-12_18:42:32.258089) 18:42:35.156096 run osmo-hlr_10.42.42.2(pid=14262): stderr: | [0;m[1;31m20221212184232433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184232433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184232433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184232433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184232433 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184232434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184232446 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184232455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184232455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184232455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:35.225169 run osmo-msc_10.42.42.6(pid=14268): ERR: Terminated: ERROR {rc=2} [trial-2380↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14268)] 18:42:35.273143 run osmo-msc_10.42.42.6(pid=14268): stdout: | (launched: 2022-12-12_18:42:34.157293) 18:42:35.322550 run osmo-msc_10.42.42.6(pid=14268): stderr: | [0;m[38;5;43m20221212184234429 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184234429 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9f301f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184234430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184234430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184234430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184234430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184234432 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184234432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184234432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184234432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:35.372739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14261): Terminating (SIGTERM) 18:42:35.412836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14264): Terminating (SIGTERM) 18:42:35.453159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14267): Terminating (SIGTERM) 18:42:35.493579 --- ParallelTerminationStrategy: PID 14261 died... 18:42:35.512819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14261): Terminated: ok {rc=0} 18:42:35.558249 --- ParallelTerminationStrategy: PID 14264 died... 18:42:35.576827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14264): Terminated: ok {rc=0} 18:42:35.621155 --- ParallelTerminationStrategy: PID 14267 died... 18:42:35.639785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14267): Terminated: ok {rc=0} 18:42:35.725645 bus /sierra_3: Setting Powered False 18:42:36.825415 bus /sierra_3: Setting Powered False 18:42:37.941449 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 18:42:39.171443 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:42:39.177179 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:42:39.201781 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 18:42:39.208779 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 18:42:39.245159 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:42:39.269962 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 18:42:39.277947 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 18:42:39.797376 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2380 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 18:42:39.802787 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 18:42:39.814213 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:42:39.854917 tst assert_extension.py: using LAC 30749 18:42:39.981509 tst assert_extension.py: using RAC 149 18:42:40.106438 tst assert_extension.py: using CellId 30749 18:42:40.233807 tst assert_extension.py: using BVCI 30750 18:42:40.351247 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 18:42:40.467116 tst assert_extension.py:10: start nitb and bts... 18:42:40.667163 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:42:41.278093 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14273): Launched 18:42:41.581148 run osmo-nitb_10.42.42.2(pid=14274): Launched 18:42:41.748458 run osmo-nitb_10.42.42.2(pid=14274): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14274)] 18:42:41.882471 run osmo-nitb_10.42.42.2(pid=14274): stdout: | (launched: 2022-12-12_18:42:41.524160) 18:42:42.017728 run osmo-nitb_10.42.42.2(pid=14274): stderr: | (launched: 2022-12-12_18:42:41.568289) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:42:42.152906 run osmo-nitb_10.42.42.2(pid=14274): stdout: | (launched: 2022-12-12_18:42:41.524160) 18:42:42.282646 run osmo-nitb_10.42.42.2(pid=14274): stderr: | (launched: 2022-12-12_18:42:41.568289) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14274): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14274) [trial-2380↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14274)] 18:42:42.695797 tst osmo-nitb_10.42.42.2(pid=14274): stdout: | (launched: 2022-12-12_18:42:41.524160) 18:42:42.815496 tst osmo-nitb_10.42.42.2(pid=14274): stderr: | (launched: 2022-12-12_18:42:41.568289) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:42:42.958379 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14274): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14274) [trial-2380↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14274)] [trial-2380↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 18:42:42.966894 tst assert_extension.py:12: Test FAILED (3.2 sec) 18:42:42.973778 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14273): Terminating (SIGTERM) 18:42:43.183451 --- ParallelTerminationStrategy: PID 14273 died... 18:42:43.204432 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14273): Terminated: ok {rc=0} 18:42:43.292146 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 ussd:nanobts+band-1900 --------------------------------------------------------------------- 18:42:44.463056 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:42:44.468086 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:42:44.492701 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 18:42:44.519760 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 18:42:44.555728 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:42:44.580471 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 18:42:44.607938 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 18:42:45.138517 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2380 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 18:42:45.144136 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:42:45.155538 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:42:45.196044 tst assert_extension.py: using LAC 30750 18:42:45.321426 tst assert_extension.py: using RAC 150 18:42:45.448501 tst assert_extension.py: using CellId 30750 18:42:45.573736 tst assert_extension.py: using BVCI 30751 18:42:45.690421 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:42:45.701786 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:42:45.712831 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:42:45.723900 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:42:45.734954 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:42:45.745928 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 18:42:45.865898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:46.376242 run create_hlr_db(pid=14278): Launched 18:42:46.536433 bus /sierra_2: Setting Powered False 18:42:47.596917 run create_hlr_db(pid=14278): Terminated: ok {rc=0} 18:42:48.049168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14280): Launched 18:42:48.371170 run osmo-hlr_10.42.42.2(pid=14281): Launched 18:42:48.494440 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:49.048454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Launched 18:42:49.369689 run osmo-stp_10.42.42.5(pid=14284): Launched 18:42:49.491630 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:50.071603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14286): Launched 18:42:50.394225 run osmo-msc_10.42.42.6(pid=14287): Launched 18:42:50.573482 run osmo-stp_10.42.42.5(pid=14284): ERR: Terminated: ERROR {rc=1} [trial-2380↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] 18:42:50.708343 run osmo-stp_10.42.42.5(pid=14284): stdout: | (launched: 2022-12-12_18:42:49.309289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:50.843577 run osmo-stp_10.42.42.5(pid=14284): stderr: | [0;m[38;5;43m20221212184249502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184249502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184249502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184249503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184249503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184249503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184249503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:50.978205 run osmo-stp_10.42.42.5(pid=14284): stdout: | (launched: 2022-12-12_18:42:49.309289) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:51.105520 run osmo-stp_10.42.42.5(pid=14284): stderr: | [0;m[38;5;43m20221212184249502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184249502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184249502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184249503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184249503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184249503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184249503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:51.257843 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14284): Process ended prematurely: osmo-stp_10.42.42.5(pid=14284) [trial-2380↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] [trial-2380↪ussd:nanobts+band-1900↪assert_extension.py:17] 18:42:51.266967 tst assert_extension.py:17: Test FAILED (6.1 sec) 18:42:51.294516 run osmo-hlr_10.42.42.2(pid=14281): ERR: Terminated: ERROR {rc=237} [trial-2380↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14281)] 18:42:51.345166 run osmo-hlr_10.42.42.2(pid=14281): stdout: | (launched: 2022-12-12_18:42:48.311601) 18:42:51.397640 run osmo-hlr_10.42.42.2(pid=14281): stderr: | [0;m[1;31m20221212184248508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184248509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184248509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184248509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184248509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184248509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184248521 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184248530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184248530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184248530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:42:51.470252 run osmo-msc_10.42.42.6(pid=14287): ERR: Terminated: ERROR {rc=2} [trial-2380↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14287)] 18:42:51.520599 run osmo-msc_10.42.42.6(pid=14287): stdout: | (launched: 2022-12-12_18:42:50.333871) 18:42:51.572707 run osmo-msc_10.42.42.6(pid=14287): stderr: | [0;m[38;5;43m20221212184250656 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184250656 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3915331c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184250656 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184250656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184250657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184250657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184250658 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184250659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184250659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184250659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:42:51.625533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14280): Terminating (SIGTERM) 18:42:51.667657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Terminating (SIGTERM) 18:42:51.709832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14286): Terminating (SIGTERM) 18:42:51.752130 --- ParallelTerminationStrategy: PID 14280 died... 18:42:51.772355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14280): Terminated: ok {rc=0} 18:42:51.819128 --- ParallelTerminationStrategy: PID 14283 died... 18:42:51.838999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14283): Terminated: ok {rc=0} 18:42:51.885327 --- ParallelTerminationStrategy: PID 14286 died... 18:42:51.905400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14286): Terminated: ok {rc=0} 18:42:51.994866 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:42:53.199887 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:42:53.208589 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:42:53.233690 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:42:53.261325 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:42:53.315865 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:42:53.341151 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:42:53.369163 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:42:53.920516 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:42:53.975225 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:42:53.987239 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:42:54.049661 tst mo_mt_call.py: using LAC 30751 18:42:54.177212 tst mo_mt_call.py: using RAC 151 18:42:54.304665 tst mo_mt_call.py: using CellId 30751 18:42:54.433379 tst mo_mt_call.py: using BVCI 30752 18:42:54.551043 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:42:54.562935 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:42:54.574613 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:42:54.586278 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:42:54.598046 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:42:54.609708 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:42:54.726909 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:42:54.845969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:42:55.318283 run create_hlr_db(pid=14292): Launched 18:42:55.438361 bus /sierra_2: Setting Powered False 18:42:56.499553 run create_hlr_db(pid=14292): Terminated: ok {rc=0} 18:42:56.945348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14294): Launched 18:42:57.272351 run osmo-hlr_10.42.42.2(pid=14295): Launched 18:42:57.399241 run osmo-stp_10.42.42.5: Starting osmo-stp 18:42:57.964835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14297): Launched 18:42:58.291626 run osmo-stp_10.42.42.5(pid=14298): Launched 18:42:58.415209 run osmo-msc_10.42.42.6: Starting osmo-msc 18:42:59.004082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14300): Launched 18:42:59.333920 run osmo-msc_10.42.42.6(pid=14301): Launched 18:42:59.518586 run osmo-stp_10.42.42.5(pid=14298): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14298)] 18:42:59.655058 run osmo-stp_10.42.42.5(pid=14298): stdout: | (launched: 2022-12-12_18:42:58.231159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:42:59.791846 run osmo-stp_10.42.42.5(pid=14298): stderr: | [0;m[38;5;43m20221212184258423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184258424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184258424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184258424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184258425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184258425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184258425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:42:59.927536 run osmo-stp_10.42.42.5(pid=14298): stdout: | (launched: 2022-12-12_18:42:58.231159) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:00.056742 run osmo-stp_10.42.42.5(pid=14298): stderr: | [0;m[38;5;43m20221212184258423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184258424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184258424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184258424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184258425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184258425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184258425 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:00.211403 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14298): Process ended prematurely: osmo-stp_10.42.42.5(pid=14298) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14298)] [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:43:00.221295 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:43:00.249463 run osmo-hlr_10.42.42.2(pid=14295): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14295)] 18:43:00.299472 run osmo-hlr_10.42.42.2(pid=14295): stdout: | (launched: 2022-12-12_18:42:57.211478) 18:43:00.351701 run osmo-hlr_10.42.42.2(pid=14295): stderr: | [0;m[1;31m20221212184257411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184257411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184257411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184257411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184257411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184257411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184257423 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184257432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184257432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184257432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:00.424312 run osmo-msc_10.42.42.6(pid=14301): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14301)] 18:43:00.474514 run osmo-msc_10.42.42.6(pid=14301): stdout: | (launched: 2022-12-12_18:42:59.272475) 18:43:00.526327 run osmo-msc_10.42.42.6(pid=14301): stderr: | [0;m[38;5;43m20221212184259599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184259599 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffb49947c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184259599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184259599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184259599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184259600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184259601 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184259602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184259602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184259602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:43:00.578642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14294): Terminating (SIGTERM) 18:43:00.620329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14297): Terminating (SIGTERM) 18:43:00.662149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14300): Terminating (SIGTERM) 18:43:00.704282 --- ParallelTerminationStrategy: PID 14294 died... 18:43:00.724514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14294): Terminated: ok {rc=0} 18:43:00.770709 --- ParallelTerminationStrategy: PID 14297 died... 18:43:00.790490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14297): Terminated: ok {rc=0} 18:43:00.843661 --- ParallelTerminationStrategy: PID 14300 died... 18:43:00.875548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14300): Terminated: ok {rc=0} 18:43:00.963555 bus /sierra_3: Setting Powered False 18:43:02.065433 bus /sierra_3: Setting Powered False 18:43:03.180882 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:43:04.331771 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:43:04.344341 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:43:04.406990 tst mo_mt_call_osmux.py: using LAC 30752 18:43:04.534177 tst mo_mt_call_osmux.py: using RAC 152 18:43:04.661208 tst mo_mt_call_osmux.py: using CellId 30752 18:43:04.787774 tst mo_mt_call_osmux.py: using BVCI 30753 18:43:04.905664 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:43:04.917553 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:43:04.929189 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:43:04.940706 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:43:04.952380 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:43:04.964055 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:43:05.085243 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:43:05.202812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:05.675844 run create_hlr_db(pid=14303): Launched 18:43:05.795510 bus /sierra_2: Setting Powered False 18:43:06.857059 run create_hlr_db(pid=14303): Terminated: ok {rc=0} 18:43:07.302868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14305): Launched 18:43:07.631918 run osmo-hlr_10.42.42.2(pid=14306): Launched 18:43:07.757647 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:08.318363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14308): Launched 18:43:08.646249 run osmo-stp_10.42.42.5(pid=14309): Launched 18:43:08.771571 run osmo-msc_10.42.42.6: Starting osmo-msc 18:43:09.361713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14311): Launched 18:43:09.690755 run osmo-msc_10.42.42.6(pid=14312): Launched 18:43:09.874232 run osmo-stp_10.42.42.5(pid=14309): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14309)] 18:43:10.009992 run osmo-stp_10.42.42.5(pid=14309): stdout: | (launched: 2022-12-12_18:43:08.585584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:10.146736 run osmo-stp_10.42.42.5(pid=14309): stderr: | [0;m[38;5;43m20221212184308777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184308777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184308777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184308778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184308778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184308778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184308779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:10.283011 run osmo-stp_10.42.42.5(pid=14309): stdout: | (launched: 2022-12-12_18:43:08.585584) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:10.412786 run osmo-stp_10.42.42.5(pid=14309): stderr: | [0;m[38;5;43m20221212184308777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184308777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184308777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184308778 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184308778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184308778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184308779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:10.567994 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14309): Process ended prematurely: osmo-stp_10.42.42.5(pid=14309) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14309)] [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:43:10.578001 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:43:10.606293 run osmo-hlr_10.42.42.2(pid=14306): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14306)] 18:43:10.656526 run osmo-hlr_10.42.42.2(pid=14306): stdout: | (launched: 2022-12-12_18:43:07.571490) 18:43:10.708530 run osmo-hlr_10.42.42.2(pid=14306): stderr: | [0;m[1;31m20221212184307770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184307770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184307770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184307770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184307770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184307770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184307785 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184307794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184307794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184307794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:10.781068 run osmo-msc_10.42.42.6(pid=14312): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14312)] 18:43:10.830940 run osmo-msc_10.42.42.6(pid=14312): stdout: | (launched: 2022-12-12_18:43:09.629854) 18:43:10.882962 run osmo-msc_10.42.42.6(pid=14312): stderr: | [0;m[38;5;43m20221212184309951 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184309952 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd948d4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184309952 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184309952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184309952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184309952 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184309954 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184309954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184309954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184309955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:43:10.934992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14305): Terminating (SIGTERM) 18:43:10.976647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14308): Terminating (SIGTERM) 18:43:11.018528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14311): Terminating (SIGTERM) 18:43:11.060724 --- ParallelTerminationStrategy: PID 14305 died... 18:43:11.080719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14305): Terminated: ok {rc=0} 18:43:11.126882 --- ParallelTerminationStrategy: PID 14308 died... 18:43:11.146500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14308): Terminated: ok {rc=0} 18:43:11.192497 --- ParallelTerminationStrategy: PID 14311 died... 18:43:11.212194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14311): Terminated: ok {rc=0} 18:43:11.300309 bus /sierra_3: Setting Powered False 18:43:12.401327 bus /sierra_3: Setting Powered False 18:43:13.519298 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:43:14.763794 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:43:14.771860 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:43:14.796707 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:43:14.823760 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:43:14.876115 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:43:14.899595 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:43:14.926282 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:43:15.479021 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:43:15.528256 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:43:15.539555 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:43:15.598441 tst mo_mt_call.py: using LAC 30753 18:43:15.716424 tst mo_mt_call.py: using RAC 153 18:43:15.834303 tst mo_mt_call.py: using CellId 30753 18:43:15.970017 tst mo_mt_call.py: using BVCI 30754 18:43:16.106240 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:43:16.119056 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:43:16.132038 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:43:16.144780 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:43:16.157764 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:43:16.170864 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:43:16.288633 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:43:16.405948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:16.888297 run create_hlr_db(pid=14317): Launched 18:43:17.046826 bus /sierra_2: Setting Powered False 18:43:18.107427 run create_hlr_db(pid=14317): Terminated: ok {rc=0} 18:43:18.553354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14319): Launched 18:43:18.881230 run osmo-hlr_10.42.42.2(pid=14320): Launched 18:43:19.006438 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:19.567321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14322): Launched 18:43:19.895843 run osmo-stp_10.42.42.5(pid=14323): Launched 18:43:20.021116 run osmo-msc_10.42.42.6: Starting osmo-msc 18:43:20.610206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14325): Launched 18:43:20.936154 run osmo-msc_10.42.42.6(pid=14326): Launched 18:43:21.119084 run osmo-stp_10.42.42.5(pid=14323): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14323)] 18:43:21.255591 run osmo-stp_10.42.42.5(pid=14323): stdout: | (launched: 2022-12-12_18:43:19.835423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:21.392647 run osmo-stp_10.42.42.5(pid=14323): stderr: | [0;m[38;5;43m20221212184320028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184320028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184320028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184320029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184320029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184320029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184320029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:21.528408 run osmo-stp_10.42.42.5(pid=14323): stdout: | (launched: 2022-12-12_18:43:19.835423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:21.658444 run osmo-stp_10.42.42.5(pid=14323): stderr: | [0;m[38;5;43m20221212184320028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184320028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184320028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184320029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184320029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184320029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184320029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:21.813592 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14323): Process ended prematurely: osmo-stp_10.42.42.5(pid=14323) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14323)] [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:43:21.823474 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:43:21.851886 run osmo-hlr_10.42.42.2(pid=14320): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14320)] 18:43:21.902104 run osmo-hlr_10.42.42.2(pid=14320): stdout: | (launched: 2022-12-12_18:43:18.820704) 18:43:21.953954 run osmo-hlr_10.42.42.2(pid=14320): stderr: | [0;m[1;31m20221212184319020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184319020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184319020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184319021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184319021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184319021 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184319037 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184319046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184319046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184319046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:22.026368 run osmo-msc_10.42.42.6(pid=14326): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14326)] 18:43:22.076465 run osmo-msc_10.42.42.6(pid=14326): stdout: | (launched: 2022-12-12_18:43:20.875569) 18:43:22.127955 run osmo-msc_10.42.42.6(pid=14326): stderr: | [0;m[38;5;43m20221212184321199 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184321199 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f88ca47ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184321199 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184321199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184321199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184321200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184321201 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184321202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184321202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184321202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:43:22.179760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14319): Terminating (SIGTERM) 18:43:22.221543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14322): Terminating (SIGTERM) 18:43:22.263491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14325): Terminating (SIGTERM) 18:43:22.305831 --- ParallelTerminationStrategy: PID 14319 died... 18:43:22.325608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14319): Terminated: ok {rc=0} 18:43:22.372203 --- ParallelTerminationStrategy: PID 14322 died... 18:43:22.391982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14322): Terminated: ok {rc=0} 18:43:22.438198 --- ParallelTerminationStrategy: PID 14325 died... 18:43:22.457861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14325): Terminated: ok {rc=0} 18:43:22.546371 bus /sierra_3: Setting Powered False 18:43:23.647271 bus /sierra_3: Setting Powered False 18:43:24.765082 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:43:25.909223 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:43:25.921342 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:43:25.980739 tst mo_mt_call_osmux.py: using LAC 30754 18:43:26.101615 tst mo_mt_call_osmux.py: using RAC 154 18:43:26.220659 tst mo_mt_call_osmux.py: using CellId 30754 18:43:26.341380 tst mo_mt_call_osmux.py: using BVCI 30755 18:43:26.454126 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:43:26.465515 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:43:26.476640 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:43:26.488057 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:43:26.499587 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:43:26.510926 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:43:26.628139 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:43:26.748367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:27.253805 run create_hlr_db(pid=14328): Launched 18:43:27.388817 bus /sierra_2: Setting Powered False 18:43:28.453141 run create_hlr_db(pid=14328): Terminated: ok {rc=0} 18:43:28.890522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14330): Launched 18:43:29.199925 run osmo-hlr_10.42.42.2(pid=14331): Launched 18:43:29.316810 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:29.842465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14333): Launched 18:43:30.150114 run osmo-stp_10.42.42.5(pid=14334): Launched 18:43:30.268224 run osmo-msc_10.42.42.6: Starting osmo-msc 18:43:30.822463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14336): Launched 18:43:31.149124 run osmo-msc_10.42.42.6(pid=14337): Launched 18:43:31.499944 run osmo-stp_10.42.42.5(pid=14334): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14334)] 18:43:31.663262 run osmo-stp_10.42.42.5(pid=14334): stdout: | (launched: 2022-12-12_18:43:30.092726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:31.950249 run osmo-stp_10.42.42.5(pid=14334): stderr: | [0;m[38;5;43m20221212184330264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184330264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184330264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184330264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184330265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184330265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184330265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:32.084766 run osmo-stp_10.42.42.5(pid=14334): stdout: | (launched: 2022-12-12_18:43:30.092726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:32.211456 run osmo-stp_10.42.42.5(pid=14334): stderr: | [0;m[38;5;43m20221212184330264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184330264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184330264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184330264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184330265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184330265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184330265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:32.362607 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14334): Process ended prematurely: osmo-stp_10.42.42.5(pid=14334) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14334)] [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:43:32.371989 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:43:32.399364 run osmo-hlr_10.42.42.2(pid=14331): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14331)] 18:43:32.448648 run osmo-hlr_10.42.42.2(pid=14331): stdout: | (launched: 2022-12-12_18:43:29.142175) 18:43:32.499178 run osmo-hlr_10.42.42.2(pid=14331): stderr: | [0;m[1;31m20221212184329317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184329317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184329318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184329318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184329318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184329318 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184329335 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184329346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184329346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184329346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:32.569822 run osmo-msc_10.42.42.6(pid=14337): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14337)] 18:43:32.618671 run osmo-msc_10.42.42.6(pid=14337): stdout: | (launched: 2022-12-12_18:43:31.090693) 18:43:32.669088 run osmo-msc_10.42.42.6(pid=14337): stderr: | [0;m[38;5;43m20221212184331688 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184331688 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f20cb747c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184331688 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184331688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184331690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184331692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184331696 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184331696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184331696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184331696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:43:32.719593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14330): Terminating (SIGTERM) 18:43:32.760792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14333): Terminating (SIGTERM) 18:43:32.801512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14336): Terminating (SIGTERM) 18:43:32.842734 --- ParallelTerminationStrategy: PID 14330 died... 18:43:32.862307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14330): Terminated: ok {rc=0} 18:43:32.907969 --- ParallelTerminationStrategy: PID 14333 died... 18:43:32.927166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14333): Terminated: ok {rc=0} 18:43:32.972701 --- ParallelTerminationStrategy: PID 14336 died... 18:43:32.991943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14336): Terminated: ok {rc=0} 18:43:33.080178 bus /sierra_3: Setting Powered False 18:43:34.180805 bus /sierra_3: Setting Powered False 18:43:35.296739 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:43:36.532288 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:43:36.539830 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:43:36.564851 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:43:36.591857 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:43:36.644457 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:43:36.668192 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:43:36.695193 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:43:37.251416 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:43:37.305049 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:43:37.317046 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:43:37.378517 tst mo_mt_call.py: using LAC 30755 18:43:37.505945 tst mo_mt_call.py: using RAC 155 18:43:37.633650 tst mo_mt_call.py: using CellId 30755 18:43:37.755055 tst mo_mt_call.py: using BVCI 30756 18:43:37.867952 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:43:37.879335 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:43:37.890506 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:43:37.901928 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:43:37.913450 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:43:37.924809 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:43:38.041650 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:43:38.161442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:38.667415 run create_hlr_db(pid=14343): Launched 18:43:38.802204 bus /sierra_2: Setting Powered False 18:43:39.866904 run create_hlr_db(pid=14343): Terminated: ok {rc=0} 18:43:40.304003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14345): Launched 18:43:40.613912 run osmo-hlr_10.42.42.2(pid=14346): Launched 18:43:40.730411 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:41.268415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14348): Launched 18:43:41.577119 run osmo-stp_10.42.42.5(pid=14349): Launched 18:43:41.694233 run osmo-msc_10.42.42.6: Starting osmo-msc 18:43:42.247548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14351): Launched 18:43:42.556228 run osmo-msc_10.42.42.6(pid=14352): Launched 18:43:42.729803 run osmo-stp_10.42.42.5(pid=14349): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14349)] 18:43:42.859226 run osmo-stp_10.42.42.5(pid=14349): stdout: | (launched: 2022-12-12_18:43:41.519875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:42.988155 run osmo-stp_10.42.42.5(pid=14349): stderr: | [0;m[38;5;43m20221212184341691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184341691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184341691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184341692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184341692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184341692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184341692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:43.115245 run osmo-stp_10.42.42.5(pid=14349): stdout: | (launched: 2022-12-12_18:43:41.519875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:43.236547 run osmo-stp_10.42.42.5(pid=14349): stderr: | [0;m[38;5;43m20221212184341691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184341691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184341691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184341692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184341692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184341692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184341692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:43.382474 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14349): Process ended prematurely: osmo-stp_10.42.42.5(pid=14349) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14349)] [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:43:43.391509 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 18:43:43.418565 run osmo-hlr_10.42.42.2(pid=14346): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14346)] 18:43:43.467165 run osmo-hlr_10.42.42.2(pid=14346): stdout: | (launched: 2022-12-12_18:43:40.556576) 18:43:43.516936 run osmo-hlr_10.42.42.2(pid=14346): stderr: | [0;m[1;31m20221212184340734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184340734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184340734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184340734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184340734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184340734 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184340746 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184340755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184340755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184340755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:43.586803 run osmo-msc_10.42.42.6(pid=14352): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14352)] 18:43:43.635032 run osmo-msc_10.42.42.6(pid=14352): stdout: | (launched: 2022-12-12_18:43:42.498187) 18:43:43.684669 run osmo-msc_10.42.42.6(pid=14352): stderr: | [0;m[38;5;43m20221212184342771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184342771 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f962bcbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184342771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184342771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184342772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184342772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184342774 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184342774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184342774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184342774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:43:43.734719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14345): Terminating (SIGTERM) 18:43:43.774542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14348): Terminating (SIGTERM) 18:43:43.814523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14351): Terminating (SIGTERM) 18:43:43.854797 --- ParallelTerminationStrategy: PID 14345 died... 18:43:43.874122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14345): Terminated: ok {rc=0} 18:43:43.918800 --- ParallelTerminationStrategy: PID 14348 died... 18:43:43.937460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14348): Terminated: ok {rc=0} 18:43:43.982356 --- ParallelTerminationStrategy: PID 14351 died... 18:43:44.000916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14351): Terminated: ok {rc=0} 18:43:44.087576 bus /sierra_3: Setting Powered False 18:43:45.187332 bus /sierra_3: Setting Powered False 18:43:46.316530 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:43:47.466420 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:43:47.478658 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:43:47.538886 tst mo_mt_call_osmux.py: using LAC 30756 18:43:47.657929 tst mo_mt_call_osmux.py: using RAC 156 18:43:47.776767 tst mo_mt_call_osmux.py: using CellId 30756 18:43:47.895701 tst mo_mt_call_osmux.py: using BVCI 30757 18:43:48.005617 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:43:48.016905 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:43:48.028111 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:43:48.039561 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:43:48.051175 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:43:48.062635 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:43:48.181863 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:43:48.303734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:48.811875 run create_hlr_db(pid=14354): Launched 18:43:48.947496 bus /sierra_2: Setting Powered False 18:43:50.012037 run create_hlr_db(pid=14354): Terminated: ok {rc=0} 18:43:50.449984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14356): Launched 18:43:50.757063 run osmo-hlr_10.42.42.2(pid=14357): Launched 18:43:50.873828 run osmo-stp_10.42.42.5: Starting osmo-stp 18:43:51.412770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14359): Launched 18:43:51.721452 run osmo-stp_10.42.42.5(pid=14360): Launched 18:43:51.839638 run osmo-msc_10.42.42.6: Starting osmo-msc 18:43:52.398991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14362): Launched 18:43:52.708735 run osmo-msc_10.42.42.6(pid=14363): Launched 18:43:52.882806 run osmo-stp_10.42.42.5(pid=14360): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14360)] 18:43:53.012563 run osmo-stp_10.42.42.5(pid=14360): stdout: | (launched: 2022-12-12_18:43:51.663785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:53.141985 run osmo-stp_10.42.42.5(pid=14360): stderr: | [0;m[38;5;43m20221212184351835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184351835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184351835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184351835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184351836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184351836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184351836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:53.268835 run osmo-stp_10.42.42.5(pid=14360): stdout: | (launched: 2022-12-12_18:43:51.663785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:43:53.391041 run osmo-stp_10.42.42.5(pid=14360): stderr: | [0;m[38;5;43m20221212184351835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184351835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184351835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184351835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184351836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184351836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184351836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:43:53.537288 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14360): Process ended prematurely: osmo-stp_10.42.42.5(pid=14360) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14360)] [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:43:53.546575 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:43:53.573669 run osmo-hlr_10.42.42.2(pid=14357): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14357)] 18:43:53.621732 run osmo-hlr_10.42.42.2(pid=14357): stdout: | (launched: 2022-12-12_18:43:50.699851) 18:43:53.671719 run osmo-hlr_10.42.42.2(pid=14357): stderr: | [0;m[1;31m20221212184350877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184350877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184350877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184350877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184350877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184350877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184350890 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184350899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184350899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184350899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:43:53.741258 run osmo-msc_10.42.42.6(pid=14363): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14363)] 18:43:53.789263 run osmo-msc_10.42.42.6(pid=14363): stdout: | (launched: 2022-12-12_18:43:52.651374) 18:43:53.839085 run osmo-msc_10.42.42.6(pid=14363): stderr: | [0;m[38;5;43m20221212184352924 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184352924 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0d3e6cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184352924 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184352924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184352924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184352924 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184352926 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184352926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184352927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184352927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:43:53.889306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14356): Terminating (SIGTERM) 18:43:53.929361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14359): Terminating (SIGTERM) 18:43:53.969337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14362): Terminating (SIGTERM) 18:43:54.009776 --- ParallelTerminationStrategy: PID 14356 died... 18:43:54.029128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14356): Terminated: ok {rc=0} 18:43:54.073890 --- ParallelTerminationStrategy: PID 14359 died... 18:43:54.092512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14359): Terminated: ok {rc=0} 18:43:54.137425 --- ParallelTerminationStrategy: PID 14362 died... 18:43:54.156175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14362): Terminated: ok {rc=0} 18:43:54.241623 bus /sierra_3: Setting Powered False 18:43:55.341380 bus /sierra_3: Setting Powered False 18:43:56.457531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:43:57.702745 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:43:57.711001 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:43:57.735554 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:43:57.763327 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:43:57.818528 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:43:57.843332 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:43:57.870455 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:43:58.425998 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:43:58.478299 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:43:58.490099 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:43:58.554380 tst mo_mt_call.py: using LAC 30757 18:43:58.681753 tst mo_mt_call.py: using RAC 157 18:43:58.807720 tst mo_mt_call.py: using CellId 30757 18:43:58.933752 tst mo_mt_call.py: using BVCI 30758 18:43:59.051833 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:43:59.063678 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:43:59.075360 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:43:59.087116 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:43:59.098994 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:43:59.110721 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:43:59.229630 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:43:59.351986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:43:59.860164 run create_hlr_db(pid=14369): Launched 18:43:59.994493 bus /sierra_2: Setting Powered False 18:44:01.058189 run create_hlr_db(pid=14369): Terminated: ok {rc=0} 18:44:01.525749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14371): Launched 18:44:01.856283 run osmo-hlr_10.42.42.2(pid=14372): Launched 18:44:02.095772 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:02.733566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14374): Launched 18:44:03.061702 run osmo-stp_10.42.42.5(pid=14375): Launched 18:44:03.185203 run osmo-msc_10.42.42.6: Starting osmo-msc 18:44:03.775017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14377): Launched 18:44:04.103575 run osmo-msc_10.42.42.6(pid=14378): Launched 18:44:04.286630 run osmo-stp_10.42.42.5(pid=14375): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14375)] 18:44:04.422939 run osmo-stp_10.42.42.5(pid=14375): stdout: | (launched: 2022-12-12_18:44:03.001340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:04.559492 run osmo-stp_10.42.42.5(pid=14375): stderr: | [0;m[38;5;43m20221212184403193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184403193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184403193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184403194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184403194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184403194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184403194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:04.695766 run osmo-stp_10.42.42.5(pid=14375): stdout: | (launched: 2022-12-12_18:44:03.001340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:04.825320 run osmo-stp_10.42.42.5(pid=14375): stderr: | [0;m[38;5;43m20221212184403193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184403193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184403193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184403194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184403194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184403194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184403194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:04.980217 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14375): Process ended prematurely: osmo-stp_10.42.42.5(pid=14375) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14375)] [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:44:04.990014 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 18:44:05.018202 run osmo-hlr_10.42.42.2(pid=14372): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14372)] 18:44:05.068532 run osmo-hlr_10.42.42.2(pid=14372): stdout: | (launched: 2022-12-12_18:44:01.796831) 18:44:05.120487 run osmo-hlr_10.42.42.2(pid=14372): stderr: | [0;m[1;31m20221212184402043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184402043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184402043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184402043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184402043 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184402044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184402066 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184402088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184402096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184402096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:05.192911 run osmo-msc_10.42.42.6(pid=14378): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14378)] 18:44:05.242964 run osmo-msc_10.42.42.6(pid=14378): stdout: | (launched: 2022-12-12_18:44:04.042907) 18:44:05.294614 run osmo-msc_10.42.42.6(pid=14378): stderr: | [0;m[38;5;43m20221212184404366 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184404366 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2de14f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184404366 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184404366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184404366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184404367 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184404368 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184404369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184404369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184404369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:44:05.346587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14371): Terminating (SIGTERM) 18:44:05.388391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14374): Terminating (SIGTERM) 18:44:05.430629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14377): Terminating (SIGTERM) 18:44:05.473065 --- ParallelTerminationStrategy: PID 14371 died... 18:44:05.493339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14371): Terminated: ok {rc=0} 18:44:05.539686 --- ParallelTerminationStrategy: PID 14374 died... 18:44:05.559273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14374): Terminated: ok {rc=0} 18:44:05.605590 --- ParallelTerminationStrategy: PID 14377 died... 18:44:05.625174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14377): Terminated: ok {rc=0} 18:44:05.712495 bus /sierra_3: Setting Powered False 18:44:06.812570 bus /sierra_3: Setting Powered False 18:44:07.930377 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:44:09.077412 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:44:09.089590 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:44:09.153111 tst mo_mt_call_osmux.py: using LAC 30758 18:44:09.272853 tst mo_mt_call_osmux.py: using RAC 158 18:44:09.390771 tst mo_mt_call_osmux.py: using CellId 30758 18:44:09.510458 tst mo_mt_call_osmux.py: using BVCI 30759 18:44:09.622902 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:44:09.634248 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:44:09.645442 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:44:09.656863 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:44:09.668367 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:44:09.679869 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:44:09.796606 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:44:09.916828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:10.423955 run create_hlr_db(pid=14380): Launched 18:44:10.558795 bus /sierra_2: Setting Powered False 18:44:11.623366 run create_hlr_db(pid=14380): Terminated: ok {rc=0} 18:44:12.076473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14382): Launched 18:44:12.405500 run osmo-hlr_10.42.42.2(pid=14383): Launched 18:44:12.529989 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:13.095183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14385): Launched 18:44:13.424471 run osmo-stp_10.42.42.5(pid=14386): Launched 18:44:13.549866 run osmo-msc_10.42.42.6: Starting osmo-msc 18:44:14.140532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14388): Launched 18:44:14.471073 run osmo-msc_10.42.42.6(pid=14389): Launched 18:44:14.655063 run osmo-stp_10.42.42.5(pid=14386): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14386)] 18:44:14.791596 run osmo-stp_10.42.42.5(pid=14386): stdout: | (launched: 2022-12-12_18:44:13.363387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:14.928888 run osmo-stp_10.42.42.5(pid=14386): stderr: | [0;m[38;5;43m20221212184413555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184413555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184413555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184413556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184413556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184413556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184413556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:15.065709 run osmo-stp_10.42.42.5(pid=14386): stdout: | (launched: 2022-12-12_18:44:13.363387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:15.195644 run osmo-stp_10.42.42.5(pid=14386): stderr: | [0;m[38;5;43m20221212184413555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184413555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184413555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184413556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184413556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184413556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184413556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:15.351473 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14386): Process ended prematurely: osmo-stp_10.42.42.5(pid=14386) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14386)] [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:44:15.361356 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:44:15.389100 run osmo-hlr_10.42.42.2(pid=14383): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14383)] 18:44:15.439488 run osmo-hlr_10.42.42.2(pid=14383): stdout: | (launched: 2022-12-12_18:44:12.344555) 18:44:15.491348 run osmo-hlr_10.42.42.2(pid=14383): stderr: | [0;m[1;31m20221212184412543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184412543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184412543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184412543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184412543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184412543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184412557 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184412567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184412567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184412567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:15.563697 run osmo-msc_10.42.42.6(pid=14389): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14389)] 18:44:15.613830 run osmo-msc_10.42.42.6(pid=14389): stdout: | (launched: 2022-12-12_18:44:14.409708) 18:44:15.665319 run osmo-msc_10.42.42.6(pid=14389): stderr: | [0;m[38;5;43m20221212184414734 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184414734 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f55a7732c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184414734 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184414734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184414735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184414735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184414736 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184414737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184414737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184414737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:44:15.717408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14382): Terminating (SIGTERM) 18:44:15.759054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14385): Terminating (SIGTERM) 18:44:15.800832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14388): Terminating (SIGTERM) 18:44:15.842853 --- ParallelTerminationStrategy: PID 14382 died... 18:44:15.864117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14382): Terminated: ok {rc=0} 18:44:15.915137 --- ParallelTerminationStrategy: PID 14385 died... 18:44:15.934913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14385): Terminated: ok {rc=0} 18:44:15.982817 --- ParallelTerminationStrategy: PID 14388 died... 18:44:16.003588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14388): Terminated: ok {rc=0} 18:44:16.093629 bus /sierra_3: Setting Powered False 18:44:17.207198 bus /sierra_3: Setting Powered False 18:44:18.325714 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:44:19.570805 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:44:19.579080 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:44:19.604163 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:44:19.632098 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:44:19.687528 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:44:19.711902 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:44:19.738861 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:44:20.295014 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:44:20.347337 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:44:20.359464 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:44:20.421872 tst mo_mt_call.py: using LAC 30759 18:44:20.548832 tst mo_mt_call.py: using RAC 159 18:44:20.675348 tst mo_mt_call.py: using CellId 30759 18:44:20.801865 tst mo_mt_call.py: using BVCI 30760 18:44:20.920640 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:44:20.932508 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:44:20.944101 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:44:20.955838 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:44:20.967537 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:44:20.979174 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:44:21.096599 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:44:21.214846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:21.687584 run create_hlr_db(pid=14394): Launched 18:44:21.807546 bus /sierra_2: Setting Powered False 18:44:22.868078 run create_hlr_db(pid=14394): Terminated: ok {rc=0} 18:44:23.314532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14396): Launched 18:44:23.644023 run osmo-hlr_10.42.42.2(pid=14397): Launched 18:44:23.770838 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:24.330830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14399): Launched 18:44:24.657692 run osmo-stp_10.42.42.5(pid=14400): Launched 18:44:24.782082 run osmo-msc_10.42.42.6: Starting osmo-msc 18:44:25.376848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14402): Launched 18:44:25.707514 run osmo-msc_10.42.42.6(pid=14403): Launched 18:44:25.889251 run osmo-stp_10.42.42.5(pid=14400): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14400)] 18:44:26.025844 run osmo-stp_10.42.42.5(pid=14400): stdout: | (launched: 2022-12-12_18:44:24.597218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:26.162992 run osmo-stp_10.42.42.5(pid=14400): stderr: | [0;m[38;5;43m20221212184424789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184424789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184424789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184424790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184424790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184424790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184424790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:26.298569 run osmo-stp_10.42.42.5(pid=14400): stdout: | (launched: 2022-12-12_18:44:24.597218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:26.428595 run osmo-stp_10.42.42.5(pid=14400): stderr: | [0;m[38;5;43m20221212184424789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184424789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184424789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184424790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184424790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184424790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184424790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:26.584056 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14400): Process ended prematurely: osmo-stp_10.42.42.5(pid=14400) [trial-2380↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14400)] [trial-2380↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:44:26.593912 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:44:26.621887 run osmo-hlr_10.42.42.2(pid=14397): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14397)] 18:44:26.671996 run osmo-hlr_10.42.42.2(pid=14397): stdout: | (launched: 2022-12-12_18:44:23.583161) 18:44:26.723872 run osmo-hlr_10.42.42.2(pid=14397): stderr: | [0;m[1;31m20221212184423780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184423780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184423780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184423780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184423780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184423780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184423792 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184423803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184423803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184423803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:26.796143 run osmo-msc_10.42.42.6(pid=14403): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14403)] 18:44:26.846138 run osmo-msc_10.42.42.6(pid=14403): stdout: | (launched: 2022-12-12_18:44:25.645984) 18:44:26.897590 run osmo-msc_10.42.42.6(pid=14403): stderr: | [0;m[38;5;43m20221212184425968 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184425969 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f738a120c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184425969 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184425969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184425969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184425969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184425971 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184425971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184425971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184425971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:44:26.949868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14396): Terminating (SIGTERM) 18:44:26.991641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14399): Terminating (SIGTERM) 18:44:27.033356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14402): Terminating (SIGTERM) 18:44:27.075333 --- ParallelTerminationStrategy: PID 14396 died... 18:44:27.095355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14396): Terminated: ok {rc=0} 18:44:27.141481 --- ParallelTerminationStrategy: PID 14399 died... 18:44:27.161108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14399): Terminated: ok {rc=0} 18:44:27.206920 --- ParallelTerminationStrategy: PID 14402 died... 18:44:27.226653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14402): Terminated: ok {rc=0} 18:44:27.314832 bus /sierra_3: Setting Powered False 18:44:28.415247 bus /sierra_3: Setting Powered False 18:44:29.532686 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:44:30.680189 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:44:30.692463 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:44:30.753829 tst mo_mt_call_osmux.py: using LAC 30760 18:44:30.890240 tst mo_mt_call_osmux.py: using RAC 160 18:44:31.037285 tst mo_mt_call_osmux.py: using CellId 30760 18:44:31.197531 tst mo_mt_call_osmux.py: using BVCI 30761 18:44:31.325700 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:44:31.338299 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:44:31.351127 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:44:31.363478 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:44:31.375992 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:44:31.389820 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:44:31.515802 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:44:31.664077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:32.196466 run create_hlr_db(pid=14405): Launched 18:44:32.353759 bus /sierra_2: Setting Powered False 18:44:33.414421 run create_hlr_db(pid=14405): Terminated: ok {rc=0} 18:44:33.863031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14407): Launched 18:44:34.191689 run osmo-hlr_10.42.42.2(pid=14408): Launched 18:44:34.316052 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:34.883350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14410): Launched 18:44:35.211505 run osmo-stp_10.42.42.5(pid=14411): Launched 18:44:35.337870 run osmo-msc_10.42.42.6: Starting osmo-msc 18:44:35.930666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14413): Launched 18:44:36.258091 run osmo-msc_10.42.42.6(pid=14414): Launched 18:44:36.440194 run osmo-stp_10.42.42.5(pid=14411): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14411)] 18:44:36.580900 run osmo-stp_10.42.42.5(pid=14411): stdout: | (launched: 2022-12-12_18:44:35.150350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:36.718152 run osmo-stp_10.42.42.5(pid=14411): stderr: | [0;m[38;5;43m20221212184435342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184435342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184435342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184435342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184435343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184435343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184435343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:36.853528 run osmo-stp_10.42.42.5(pid=14411): stdout: | (launched: 2022-12-12_18:44:35.150350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:36.983045 run osmo-stp_10.42.42.5(pid=14411): stderr: | [0;m[38;5;43m20221212184435342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184435342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184435342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184435342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184435343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184435343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184435343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:37.138484 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14411): Process ended prematurely: osmo-stp_10.42.42.5(pid=14411) [trial-2380↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14411)] [trial-2380↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:44:37.148360 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:44:37.176860 run osmo-hlr_10.42.42.2(pid=14408): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14408)] 18:44:37.227471 run osmo-hlr_10.42.42.2(pid=14408): stdout: | (launched: 2022-12-12_18:44:34.131004) 18:44:37.279386 run osmo-hlr_10.42.42.2(pid=14408): stderr: | [0;m[1;31m20221212184434332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184434332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184434332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184434332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184434332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184434332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184434345 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184434357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184434358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184434358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:37.352382 run osmo-msc_10.42.42.6(pid=14414): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14414)] 18:44:37.402685 run osmo-msc_10.42.42.6(pid=14414): stdout: | (launched: 2022-12-12_18:44:36.197266) 18:44:37.454751 run osmo-msc_10.42.42.6(pid=14414): stderr: | [0;m[38;5;43m20221212184436522 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184436523 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5b1f88cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184436523 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184436523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184436523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184436523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184436525 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184436525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184436525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184436525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:44:37.507527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14407): Terminating (SIGTERM) 18:44:37.549135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14410): Terminating (SIGTERM) 18:44:37.590961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14413): Terminating (SIGTERM) 18:44:37.633110 --- ParallelTerminationStrategy: PID 14407 died... 18:44:37.653226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14407): Terminated: ok {rc=0} 18:44:37.700069 --- ParallelTerminationStrategy: PID 14410 died... 18:44:37.719608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14410): Terminated: ok {rc=0} 18:44:37.766379 --- ParallelTerminationStrategy: PID 14413 died... 18:44:37.786253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14413): Terminated: ok {rc=0} 18:44:37.874601 bus /sierra_3: Setting Powered False 18:44:38.974479 bus /sierra_3: Setting Powered False 18:44:40.092909 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 emergency:nanobts+band-1900 --------------------------------------------------------------------- 18:44:41.333102 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:44:41.338604 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:44:41.363015 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 18:44:41.389663 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 18:44:41.474743 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:44:41.498542 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 18:44:41.525587 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 18:44:42.109516 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2380 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 18:44:42.114629 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:44:42.125738 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:44:42.165114 tst emergency_mo_mt_call.py: using LAC 30761 18:44:42.283639 tst emergency_mo_mt_call.py: using RAC 161 18:44:42.401359 tst emergency_mo_mt_call.py: using CellId 30761 18:44:42.517750 tst emergency_mo_mt_call.py: using BVCI 30762 18:44:42.627359 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:44:42.638266 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:44:42.649003 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:44:42.660045 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:44:42.671230 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:44:42.682269 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:44:42.801689 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:44:42.918589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:43.383879 run create_hlr_db(pid=14419): Launched 18:44:43.498658 bus /sierra_2: Setting Powered False 18:44:44.558672 run create_hlr_db(pid=14419): Terminated: ok {rc=0} 18:44:44.997284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14421): Launched 18:44:45.318648 run osmo-hlr_10.42.42.2(pid=14422): Launched 18:44:45.441904 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:46.020469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14424): Launched 18:44:46.369542 run osmo-stp_10.42.42.5(pid=14425): Launched 18:44:46.628306 tst emergency_mo_mt_call.py: using MSISDN 7909 18:44:46.843496 run osmo-msc_10.42.42.6: Starting osmo-msc 18:44:47.395872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14427): Launched 18:44:47.696862 run osmo-msc_10.42.42.6(pid=14428): Launched 18:44:47.866568 run osmo-stp_10.42.42.5(pid=14425): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14425)] 18:44:47.992776 run osmo-stp_10.42.42.5(pid=14425): stdout: | (launched: 2022-12-12_18:44:46.308855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:48.119621 run osmo-stp_10.42.42.5(pid=14425): stderr: | [0;m[38;5;43m20221212184446600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184446600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184446600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184446609 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184446609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184446609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184446609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:48.243829 run osmo-stp_10.42.42.5(pid=14425): stdout: | (launched: 2022-12-12_18:44:46.308855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:48.362556 run osmo-stp_10.42.42.5(pid=14425): stderr: | [0;m[38;5;43m20221212184446600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184446600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184446600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184446609 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184446609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184446609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184446609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:48.504847 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=14425): Process ended prematurely: osmo-stp_10.42.42.5(pid=14425) [trial-2380↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14425)] [trial-2380↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 18:44:48.513442 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 18:44:48.540149 run osmo-hlr_10.42.42.2(pid=14422): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14422)] 18:44:48.588555 run osmo-hlr_10.42.42.2(pid=14422): stdout: | (launched: 2022-12-12_18:44:45.258704) 18:44:48.638274 run osmo-hlr_10.42.42.2(pid=14422): stderr: | [0;m[1;31m20221212184445455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184445455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184445455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184445455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184445455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184445455 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184445468 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184445476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184445476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184445476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:48.707573 run osmo-msc_10.42.42.6(pid=14428): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14428)] 18:44:48.755984 run osmo-msc_10.42.42.6(pid=14428): stdout: | (launched: 2022-12-12_18:44:47.640307) 18:44:48.805482 run osmo-msc_10.42.42.6(pid=14428): stderr: | [0;m[38;5;43m20221212184447913 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184447914 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5a14e0fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184447914 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184447914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184447914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184447914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184447916 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184447916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184447917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184447917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:44:48.855598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14421): Terminating (SIGTERM) 18:44:48.895554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14424): Terminating (SIGTERM) 18:44:48.935474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14427): Terminating (SIGTERM) 18:44:48.975661 --- ParallelTerminationStrategy: PID 14421 died... 18:44:48.994890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14421): Terminated: ok {rc=0} 18:44:49.039345 --- ParallelTerminationStrategy: PID 14424 died... 18:44:49.057929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14424): Terminated: ok {rc=0} 18:44:49.102287 --- ParallelTerminationStrategy: PID 14427 died... 18:44:49.120867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14427): Terminated: ok {rc=0} 18:44:49.207511 bus /sierra_3: Setting Powered False 18:44:50.308063 bus /sierra_3: Setting Powered False 18:44:51.424207 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 18:44:52.512228 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:44:52.524191 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:44:52.568451 tst emergency_preemptive_call.py: using LAC 30762 18:44:52.702451 tst emergency_preemptive_call.py: using RAC 162 18:44:52.832392 tst emergency_preemptive_call.py: using CellId 30762 18:44:52.957617 tst emergency_preemptive_call.py: using BVCI 30763 18:44:53.075618 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:44:53.087353 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:44:53.098984 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:44:53.110493 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:44:53.122011 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 18:44:53.133468 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:44:53.250828 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:44:53.368265 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:44:53.489269 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:44:53.609765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:44:54.108128 run create_hlr_db(pid=14430): Launched 18:44:54.239979 bus /sierra_2: Setting Powered False 18:44:55.303068 run create_hlr_db(pid=14430): Terminated: ok {rc=0} 18:44:55.733346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14432): Launched 18:44:56.036005 run osmo-hlr_10.42.42.2(pid=14433): Launched 18:44:56.153015 run osmo-stp_10.42.42.5: Starting osmo-stp 18:44:56.668165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14435): Launched 18:44:56.971565 run osmo-stp_10.42.42.5(pid=14436): Launched 18:44:57.096900 tst emergency_preemptive_call.py: using MSISDN 7910 18:44:57.250004 run osmo-msc_10.42.42.6: Starting osmo-msc 18:44:57.789484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14438): Launched 18:44:58.091088 run osmo-msc_10.42.42.6(pid=14439): Launched 18:44:58.260359 run osmo-stp_10.42.42.5(pid=14436): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14436)] 18:44:58.387554 run osmo-stp_10.42.42.5(pid=14436): stdout: | (launched: 2022-12-12_18:44:56.914587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:58.515426 run osmo-stp_10.42.42.5(pid=14436): stderr: | [0;m[38;5;43m20221212184457085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184457085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184457086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184457086 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184457086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184457087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184457087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:58.640430 run osmo-stp_10.42.42.5(pid=14436): stdout: | (launched: 2022-12-12_18:44:56.914587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:44:58.759851 run osmo-stp_10.42.42.5(pid=14436): stderr: | [0;m[38;5;43m20221212184457085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184457085 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184457086 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184457086 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184457086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184457087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184457087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:44:58.902952 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14436): Process ended prematurely: osmo-stp_10.42.42.5(pid=14436) [trial-2380↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14436)] [trial-2380↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 18:44:58.911598 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 18:44:58.938525 run osmo-hlr_10.42.42.2(pid=14433): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14433)] 18:44:58.987201 run osmo-hlr_10.42.42.2(pid=14433): stdout: | (launched: 2022-12-12_18:44:55.979618) 18:44:59.037785 run osmo-hlr_10.42.42.2(pid=14433): stderr: | [0;m[1;31m20221212184456154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184456154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184456154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184456154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184456154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184456154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184456166 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184456174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184456174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184456174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:44:59.107622 run osmo-msc_10.42.42.6(pid=14439): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14439)] 18:44:59.155886 run osmo-msc_10.42.42.6(pid=14439): stdout: | (launched: 2022-12-12_18:44:58.034576) 18:44:59.205696 run osmo-msc_10.42.42.6(pid=14439): stderr: | [0;m[38;5;43m20221212184458307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184458308 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6ac805ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184458308 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184458308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184458308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184458308 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184458310 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184458311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184458311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184458311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:44:59.255825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14432): Terminating (SIGTERM) 18:44:59.296251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14435): Terminating (SIGTERM) 18:44:59.336702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14438): Terminating (SIGTERM) 18:44:59.377069 --- ParallelTerminationStrategy: PID 14432 died... 18:44:59.396302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14432): Terminated: ok {rc=0} 18:44:59.441323 --- ParallelTerminationStrategy: PID 14435 died... 18:44:59.459968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14435): Terminated: ok {rc=0} 18:44:59.504674 --- ParallelTerminationStrategy: PID 14438 died... 18:44:59.523832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14438): Terminated: ok {rc=0} 18:44:59.609996 bus /sierra_9: Setting Powered False 18:45:00.710276 bus /sierra_9: Setting Powered False 18:45:01.827956 bus /sierra_8: Setting Powered False 18:45:02.933191 bus /sierra_8: Setting Powered False 18:45:04.050267 bus /sierra_3: Setting Powered False 18:45:05.150066 bus /sierra_3: Setting Powered False 18:45:06.267496 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-1900 --------------------------------------------------------------------- 18:45:07.547549 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:45:07.553378 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 18:45:07.578054 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 18:45:07.617872 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 18:45:07.707403 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 18:45:07.731847 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 18:45:07.771242 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 18:45:08.367902 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 18:45:08.421193 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:08.432657 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:45:08.473141 tst cs_paging_gprs_active.py: using LAC 30763 18:45:08.602104 tst cs_paging_gprs_active.py: using RAC 163 18:45:08.733883 tst cs_paging_gprs_active.py: using CellId 30763 18:45:08.854272 tst cs_paging_gprs_active.py: using BVCI 30764 18:45:08.965906 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:08.976912 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:08.987730 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:08.999342 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:09.010950 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:09.022801 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:09.034557 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:09.046089 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:09.057855 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:45:09.179433 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:45:09.297454 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:45:09.519457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:09.848529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14447): Launched 18:45:10.135268 run iperf3-srv_10.42.42.10(pid=14448): Launched 18:45:10.259675 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:45:10.481480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:10.811344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14449): Launched 18:45:11.099260 run iperf3-srv_10.42.42.10(pid=14450): Launched 18:45:11.223423 tst cs_paging_gprs_active.py:38: start network... 18:45:11.444871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:11.954297 run create_hlr_db(pid=14451): Launched 18:45:12.087883 bus /sierra_2: Setting Powered False 18:45:13.152710 run create_hlr_db(pid=14451): Terminated: ok {rc=0} 18:45:13.590818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14453): Launched 18:45:13.900559 run osmo-hlr_10.42.42.2(pid=14454): Launched 18:45:14.019346 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:14.562998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14456): Launched 18:45:14.873503 run osmo-stp_10.42.42.5(pid=14457): Launched 18:45:14.992195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:15.522255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14459): Launched 18:45:15.640379 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:15.925390 run patchelf(pid=14460): Launched 18:45:16.119125 run osmo-stp_10.42.42.5(pid=14457): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14457)] 18:45:16.252819 run osmo-stp_10.42.42.5(pid=14457): stdout: | (launched: 2022-12-12_18:45:14.815684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:16.389063 run osmo-stp_10.42.42.5(pid=14457): stderr: | [0;m[38;5;43m20221212184514986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184514987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184514987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184514987 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184514989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184514989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184514989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:16.527388 run osmo-stp_10.42.42.5(pid=14457): stdout: | (launched: 2022-12-12_18:45:14.815684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:16.656459 run osmo-stp_10.42.42.5(pid=14457): stderr: | [0;m[38;5;43m20221212184514986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184514987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184514987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184514987 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184514989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184514989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184514989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:16.808722 run patchelf(pid=14460): Terminating (SIGINT) 18:45:16.985548 run patchelf(pid=14460): Terminated: ok {rc=0} 18:45:17.112671 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14457): Process ended prematurely: osmo-stp_10.42.42.5(pid=14457) [trial-2380↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14457)] [trial-2380↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 18:45:17.123251 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:45:17.152592 run osmo-hlr_10.42.42.2(pid=14454): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14454)] 18:45:17.202269 run osmo-hlr_10.42.42.2(pid=14454): stdout: | (launched: 2022-12-12_18:45:13.843124) 18:45:17.252552 run osmo-hlr_10.42.42.2(pid=14454): stderr: | [0;m[1;31m20221212184514019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184514019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184514019 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184514020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184514020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184514020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184514031 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184514040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184514040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184514040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:17.303619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14447): Terminating (SIGTERM) 18:45:17.344006 run iperf3-srv_10.42.42.10(pid=14448): Terminating (SIGTERM) 18:45:17.384418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14449): Terminating (SIGTERM) 18:45:17.425623 run iperf3-srv_10.42.42.10(pid=14450): Terminating (SIGTERM) 18:45:17.466115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14453): Terminating (SIGTERM) 18:45:17.506862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14456): Terminating (SIGTERM) 18:45:17.547299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14459): Terminating (SIGTERM) 18:45:17.588170 --- ParallelTerminationStrategy: PID 14447 died... 18:45:17.607645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14447): Terminated: ok {rc=0} 18:45:17.653216 --- ParallelTerminationStrategy: PID 14448 died... 18:45:17.672163 run iperf3-srv_10.42.42.10(pid=14448): Terminated {rc=256} 18:45:17.717171 --- ParallelTerminationStrategy: PID 14449 died... 18:45:17.736015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14449): Terminated: ok {rc=0} 18:45:17.781089 --- ParallelTerminationStrategy: PID 14450 died... 18:45:17.799937 run iperf3-srv_10.42.42.10(pid=14450): Terminated {rc=256} 18:45:17.844720 --- ParallelTerminationStrategy: PID 14453 died... 18:45:17.863607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14453): Terminated: ok {rc=0} 18:45:17.908489 --- ParallelTerminationStrategy: PID 14456 died... 18:45:17.927374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14456): Terminated: ok {rc=0} 18:45:17.972446 --- ParallelTerminationStrategy: PID 14459 died... 18:45:17.991566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14459): Terminated: ok {rc=0} 18:45:18.080302 bus /gobi_0: Setting Powered False 18:45:19.181447 bus /gobi_0: Setting Powered False 18:45:20.299181 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 18:45:21.448692 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:21.460561 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:45:21.505428 tst iperf3.py: using LAC 30764 18:45:21.625776 tst iperf3.py: using RAC 164 18:45:21.746027 tst iperf3.py: using CellId 30764 18:45:21.866043 tst iperf3.py: using BVCI 30765 18:45:21.979410 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:21.990409 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:22.001185 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:22.012116 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:22.022937 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:22.033812 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:22.044781 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:22.055766 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:22.066816 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:45:22.191906 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:45:22.396799 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:22.704291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14461): Launched 18:45:22.971871 run iperf3-srv_10.42.42.10(pid=14462): Launched 18:45:23.088098 tst iperf3.py:8: start network... 18:45:23.292136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:23.766614 run create_hlr_db(pid=14463): Launched 18:45:23.884932 bus /gobi_6: Setting Powered False 18:45:24.955804 run create_hlr_db(pid=14463): Terminated: ok {rc=0} 18:45:25.396694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14465): Launched 18:45:25.719130 run osmo-hlr_10.42.42.2(pid=14466): Launched 18:45:25.841958 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:26.398321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14468): Launched 18:45:26.721190 run osmo-stp_10.42.42.5(pid=14469): Launched 18:45:26.842158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:27.396773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14471): Launched 18:45:27.519929 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:27.792117 run patchelf(pid=14472): Launched 18:45:27.970442 run osmo-stp_10.42.42.5(pid=14469): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14469)] 18:45:28.105560 run osmo-stp_10.42.42.5(pid=14469): stdout: | (launched: 2022-12-12_18:45:26.661072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:28.242719 run osmo-stp_10.42.42.5(pid=14469): stderr: | [0;m[38;5;43m20221212184526850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184526851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184526851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184526851 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184526852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184526852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184526852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:28.379415 run osmo-stp_10.42.42.5(pid=14469): stdout: | (launched: 2022-12-12_18:45:26.661072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:28.510712 run osmo-stp_10.42.42.5(pid=14469): stderr: | [0;m[38;5;43m20221212184526850 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184526851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184526851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184526851 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184526852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184526852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184526852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:28.665580 run patchelf(pid=14472): Terminating (SIGINT) 18:45:28.844561 run patchelf(pid=14472): Terminated: ok {rc=0} 18:45:28.974123 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14469): Process ended prematurely: osmo-stp_10.42.42.5(pid=14469) [trial-2380↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14469)] [trial-2380↪gprs:nanobts+band-1900↪iperf3.py:8] 18:45:28.984250 tst iperf3.py:8: Test FAILED (7.6 sec) 18:45:29.012897 run osmo-hlr_10.42.42.2(pid=14466): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14466)] 18:45:29.062883 run osmo-hlr_10.42.42.2(pid=14466): stdout: | (launched: 2022-12-12_18:45:25.659221) 18:45:29.115250 run osmo-hlr_10.42.42.2(pid=14466): stderr: | [0;m[1;31m20221212184525854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184525854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184525854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184525854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184525854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184525854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184525866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184525875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184525875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184525875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:29.167252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14461): Terminating (SIGTERM) 18:45:29.209293 run iperf3-srv_10.42.42.10(pid=14462): Terminating (SIGTERM) 18:45:29.251098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14465): Terminating (SIGTERM) 18:45:29.293172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14468): Terminating (SIGTERM) 18:45:29.334970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14471): Terminating (SIGTERM) 18:45:29.377076 --- ParallelTerminationStrategy: PID 14461 died... 18:45:29.397055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14461): Terminated: ok {rc=0} 18:45:29.443888 --- ParallelTerminationStrategy: PID 14462 died... 18:45:29.463651 run iperf3-srv_10.42.42.10(pid=14462): Terminated {rc=256} 18:45:29.509639 --- ParallelTerminationStrategy: PID 14465 died... 18:45:29.529313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14465): Terminated: ok {rc=0} 18:45:29.575329 --- ParallelTerminationStrategy: PID 14468 died... 18:45:29.595407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14468): Terminated: ok {rc=0} 18:45:29.641745 --- ParallelTerminationStrategy: PID 14471 died... 18:45:29.661532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14471): Terminated: ok {rc=0} 18:45:29.750146 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 18:45:30.917924 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:30.930888 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:45:30.976608 tst iperf3m4.py: using LAC 30765 18:45:31.110502 tst iperf3m4.py: using RAC 165 18:45:31.274118 tst iperf3m4.py: using CellId 30765 18:45:31.402996 tst iperf3m4.py: using BVCI 30766 18:45:31.521457 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:31.533211 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:31.545503 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:31.557643 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:31.569249 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:31.580851 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:31.593843 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:31.605462 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:31.617292 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:45:31.738093 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:45:31.893625 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:45:32.019914 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:45:32.156051 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:45:32.382399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:32.687022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14474): Launched 18:45:32.950404 run iperf3-srv_10.42.42.10(pid=14475): Launched 18:45:33.063957 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:45:33.264149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:33.565710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14476): Launched 18:45:33.828141 run iperf3-srv_10.42.42.10(pid=14477): Launched 18:45:33.940851 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:45:34.140893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:34.442676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14478): Launched 18:45:34.704615 run iperf3-srv_10.42.42.10(pid=14479): Launched 18:45:34.817576 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:45:35.016352 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:45:35.319619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14480): Launched 18:45:35.578639 run iperf3-srv_10.42.42.10(pid=14481): Launched 18:45:35.689908 tst iperf3m4.py:8: start network... 18:45:35.886634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:36.344147 run create_hlr_db(pid=14482): Launched 18:45:36.459297 bus /gobi_6: Setting Powered False 18:45:37.518466 run create_hlr_db(pid=14482): Terminated: ok {rc=0} 18:45:37.931638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14484): Launched 18:45:38.229099 run osmo-hlr_10.42.42.2(pid=14485): Launched 18:45:38.343918 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:38.874560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14487): Launched 18:45:39.177894 run osmo-stp_10.42.42.5(pid=14488): Launched 18:45:39.293604 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:39.814563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14490): Launched 18:45:39.930860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:40.207189 run patchelf(pid=14491): Launched 18:45:40.391643 run osmo-stp_10.42.42.5(pid=14488): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14488)] 18:45:40.530223 run osmo-stp_10.42.42.5(pid=14488): stdout: | (launched: 2022-12-12_18:45:39.119876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:40.669468 run osmo-stp_10.42.42.5(pid=14488): stderr: | [0;m[38;5;43m20221212184539288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184539288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184539288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184539289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184539289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184539289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184539289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:40.808316 run osmo-stp_10.42.42.5(pid=14488): stdout: | (launched: 2022-12-12_18:45:39.119876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:40.941483 run osmo-stp_10.42.42.5(pid=14488): stderr: | [0;m[38;5;43m20221212184539288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184539288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184539288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184539289 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184539289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184539289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184539289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:41.099383 run patchelf(pid=14491): Terminating (SIGINT) 18:45:41.281975 run patchelf(pid=14491): Terminated: ok {rc=0} 18:45:41.413618 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14488): Process ended prematurely: osmo-stp_10.42.42.5(pid=14488) [trial-2380↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14488)] [trial-2380↪gprs:nanobts+band-1900↪iperf3m4.py:8] 18:45:41.423740 tst iperf3m4.py:8: Test FAILED (10.6 sec) 18:45:41.452691 run osmo-hlr_10.42.42.2(pid=14485): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14485)] 18:45:41.502608 run osmo-hlr_10.42.42.2(pid=14485): stdout: | (launched: 2022-12-12_18:45:38.173336) 18:45:41.554230 run osmo-hlr_10.42.42.2(pid=14485): stderr: | [0;m[1;31m20221212184538345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184538345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184538345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184538345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184538345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184538345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184538358 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184538366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184538367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184538367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:41.606365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14474): Terminating (SIGTERM) 18:45:41.647669 run iperf3-srv_10.42.42.10(pid=14475): Terminating (SIGTERM) 18:45:41.689033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14476): Terminating (SIGTERM) 18:45:41.730542 run iperf3-srv_10.42.42.10(pid=14477): Terminating (SIGTERM) 18:45:41.771723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14478): Terminating (SIGTERM) 18:45:41.813154 run iperf3-srv_10.42.42.10(pid=14479): Terminating (SIGTERM) 18:45:41.854443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14480): Terminating (SIGTERM) 18:45:41.895973 run iperf3-srv_10.42.42.10(pid=14481): Terminating (SIGTERM) 18:45:41.937215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14484): Terminating (SIGTERM) 18:45:41.978607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14487): Terminating (SIGTERM) 18:45:42.019990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14490): Terminating (SIGTERM) 18:45:42.062002 --- ParallelTerminationStrategy: PID 14474 died... 18:45:42.082158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14474): Terminated: ok {rc=0} 18:45:42.128759 --- ParallelTerminationStrategy: PID 14475 died... 18:45:42.148468 run iperf3-srv_10.42.42.10(pid=14475): Terminated {rc=256} 18:45:42.194721 --- ParallelTerminationStrategy: PID 14476 died... 18:45:42.214410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14476): Terminated: ok {rc=0} 18:45:42.260614 --- ParallelTerminationStrategy: PID 14477 died... 18:45:42.280268 run iperf3-srv_10.42.42.10(pid=14477): Terminated {rc=256} 18:45:42.326499 --- ParallelTerminationStrategy: PID 14478 died... 18:45:42.346194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14478): Terminated: ok {rc=0} 18:45:42.392456 --- ParallelTerminationStrategy: PID 14479 died... 18:45:42.412052 run iperf3-srv_10.42.42.10(pid=14479): Terminated {rc=256} 18:45:42.458308 --- ParallelTerminationStrategy: PID 14480 died... 18:45:42.478044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14480): Terminated: ok {rc=0} 18:45:42.524502 --- ParallelTerminationStrategy: PID 14481 died... 18:45:42.544021 run iperf3-srv_10.42.42.10(pid=14481): Terminated {rc=256} 18:45:42.590278 --- ParallelTerminationStrategy: PID 14484 died... 18:45:42.609942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14484): Terminated: ok {rc=0} 18:45:42.655958 --- ParallelTerminationStrategy: PID 14487 died... 18:45:42.675565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14487): Terminated: ok {rc=0} 18:45:42.721615 --- ParallelTerminationStrategy: PID 14490 died... 18:45:42.741343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14490): Terminated: ok {rc=0} 18:45:42.829449 bus /gobi_4: Setting Powered False 18:45:43.928484 bus /gobi_4: Setting Powered False 18:45:45.042849 bus /gobi_1: Setting Powered False 18:45:46.140322 bus /gobi_1: Setting Powered False 18:45:47.255405 bus /gobi_0: Setting Powered False 18:45:48.354442 bus /gobi_0: Setting Powered False 18:45:49.472608 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 18:45:50.575332 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:50.587413 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:45:50.630809 tst ping.py: using LAC 30766 18:45:50.746403 tst ping.py: using RAC 166 18:45:50.861118 tst ping.py: using CellId 30766 18:45:50.976026 tst ping.py: using BVCI 30767 18:45:51.083731 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:51.094767 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:51.105595 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:51.116549 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:51.127347 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:51.138143 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:51.149204 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:51.160046 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:45:51.278254 tst ping.py:19: start network... 18:45:51.495306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:45:51.992539 run create_hlr_db(pid=14492): Launched 18:45:52.124857 bus /gobi_6: Setting Powered False 18:45:53.188527 run create_hlr_db(pid=14492): Terminated: ok {rc=0} 18:45:53.635870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14494): Launched 18:45:53.959412 run osmo-hlr_10.42.42.2(pid=14495): Launched 18:45:54.082516 run osmo-stp_10.42.42.5: Starting osmo-stp 18:45:54.643860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14497): Launched 18:45:54.967020 run osmo-stp_10.42.42.5(pid=14498): Launched 18:45:55.090347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:45:55.648482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14500): Launched 18:45:55.770560 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:45:56.041745 run patchelf(pid=14501): Launched 18:45:56.221289 run osmo-stp_10.42.42.5(pid=14498): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14498)] 18:45:56.355749 run osmo-stp_10.42.42.5(pid=14498): stdout: | (launched: 2022-12-12_18:45:54.906709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:56.493718 run osmo-stp_10.42.42.5(pid=14498): stderr: | [0;m[38;5;43m20221212184555098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184555098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184555099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184555099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184555099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184555099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184555099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:56.630202 run osmo-stp_10.42.42.5(pid=14498): stdout: | (launched: 2022-12-12_18:45:54.906709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:45:56.761217 run osmo-stp_10.42.42.5(pid=14498): stderr: | [0;m[38;5;43m20221212184555098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184555098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184555099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184555099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184555099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184555099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184555099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:45:56.915818 run patchelf(pid=14501): Terminating (SIGINT) 18:45:57.094830 run patchelf(pid=14501): Terminated: ok {rc=0} 18:45:57.223441 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14498): Process ended prematurely: osmo-stp_10.42.42.5(pid=14498) [trial-2380↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14498)] [trial-2380↪gprs:nanobts+band-1900↪ping.py:22] 18:45:57.232894 tst ping.py:22: Test FAILED (6.7 sec) 18:45:57.261341 run osmo-hlr_10.42.42.2(pid=14495): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14495)] 18:45:57.311442 run osmo-hlr_10.42.42.2(pid=14495): stdout: | (launched: 2022-12-12_18:45:53.899337) 18:45:57.363472 run osmo-hlr_10.42.42.2(pid=14495): stderr: | [0;m[1;31m20221212184554097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184554097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184554097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184554097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184554098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184554098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184554110 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184554119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184554119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184554119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:45:57.415696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14494): Terminating (SIGTERM) 18:45:57.458678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14497): Terminating (SIGTERM) 18:45:57.500916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14500): Terminating (SIGTERM) 18:45:57.543264 --- ParallelTerminationStrategy: PID 14494 died... 18:45:57.563493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14494): Terminated: ok {rc=0} 18:45:57.610013 --- ParallelTerminationStrategy: PID 14497 died... 18:45:57.629823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14497): Terminated: ok {rc=0} 18:45:57.675976 --- ParallelTerminationStrategy: PID 14500 died... 18:45:57.695641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14500): Terminated: ok {rc=0} 18:45:57.785254 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 18:45:58.874558 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:58.887255 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 18:45:58.929513 tst ping_idle_ping.py: using LAC 30767 18:45:59.056906 tst ping_idle_ping.py: using RAC 167 18:45:59.181461 tst ping_idle_ping.py: using CellId 30767 18:45:59.300107 tst ping_idle_ping.py: using BVCI 30768 18:45:59.410509 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:59.421542 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:59.432339 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:59.443591 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:59.454750 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:59.465626 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:59.476640 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 18:45:59.487680 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 18:45:59.607779 tst ping_idle_ping.py:24: start network... 18:45:59.822642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:00.321247 run create_hlr_db(pid=14502): Launched 18:46:00.453594 bus /gobi_6: Setting Powered False 18:46:01.516582 run create_hlr_db(pid=14502): Terminated: ok {rc=0} 18:46:01.978071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14504): Launched 18:46:02.302844 run osmo-hlr_10.42.42.2(pid=14505): Launched 18:46:02.424082 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:02.951832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14507): Launched 18:46:03.253452 run osmo-stp_10.42.42.5(pid=14508): Launched 18:46:03.369417 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:03.887600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14510): Launched 18:46:04.004643 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:04.259597 run patchelf(pid=14511): Launched 18:46:04.429839 run osmo-stp_10.42.42.5(pid=14508): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14508)] 18:46:04.557579 run osmo-stp_10.42.42.5(pid=14508): stdout: | (launched: 2022-12-12_18:46:03.197362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:04.686635 run osmo-stp_10.42.42.5(pid=14508): stderr: | [0;m[38;5;43m20221212184603363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184603363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184603363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184603364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184603364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184603364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184603364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:04.815709 run osmo-stp_10.42.42.5(pid=14508): stdout: | (launched: 2022-12-12_18:46:03.197362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:04.939832 run osmo-stp_10.42.42.5(pid=14508): stderr: | [0;m[38;5;43m20221212184603363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184603363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184603363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184603364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184603364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184603364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184603364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:05.085731 run patchelf(pid=14511): Terminating (SIGINT) 18:46:05.255030 run patchelf(pid=14511): Terminated: ok {rc=0} 18:46:05.376427 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14508): Process ended prematurely: osmo-stp_10.42.42.5(pid=14508) [trial-2380↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14508)] [trial-2380↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 18:46:05.385718 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:46:05.413277 run osmo-hlr_10.42.42.2(pid=14505): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14505)] 18:46:05.460877 run osmo-hlr_10.42.42.2(pid=14505): stdout: | (launched: 2022-12-12_18:46:02.246743) 18:46:05.510879 run osmo-hlr_10.42.42.2(pid=14505): stderr: | [0;m[1;31m20221212184602418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184602418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184602418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184602418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184602418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184602418 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184602429 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184602438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184602438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184602438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:05.561268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14504): Terminating (SIGTERM) 18:46:05.601628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14507): Terminating (SIGTERM) 18:46:05.642131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14510): Terminating (SIGTERM) 18:46:05.682832 --- ParallelTerminationStrategy: PID 14504 died... 18:46:05.701891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14504): Terminated: ok {rc=0} 18:46:05.746685 --- ParallelTerminationStrategy: PID 14507 died... 18:46:05.765590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14507): Terminated: ok {rc=0} 18:46:05.810273 --- ParallelTerminationStrategy: PID 14510 died... 18:46:05.829176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14510): Terminated: ok {rc=0} 18:46:05.917008 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 18:46:07.222740 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:46:07.229990 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:46:07.254983 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:46:07.294528 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:46:07.385210 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:46:07.410473 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:46:07.450291 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:46:08.042795 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:46:08.094418 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:08.105833 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:46:08.147538 tst cs_paging_gprs_active.py: using LAC 30768 18:46:08.277354 tst cs_paging_gprs_active.py: using RAC 168 18:46:08.404682 tst cs_paging_gprs_active.py: using CellId 30768 18:46:08.533127 tst cs_paging_gprs_active.py: using BVCI 30769 18:46:08.652518 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:08.664170 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:08.675570 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:08.686941 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:08.698166 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:08.709540 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:08.721070 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:08.732237 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:08.743709 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:46:08.860597 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:46:08.981153 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:46:09.200822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:09.528553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14516): Launched 18:46:09.812841 run iperf3-srv_10.42.42.10(pid=14517): Launched 18:46:09.935130 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:46:10.154658 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:10.482954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14518): Launched 18:46:10.767398 run iperf3-srv_10.42.42.10(pid=14519): Launched 18:46:10.889549 tst cs_paging_gprs_active.py:38: start network... 18:46:11.108725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:11.614628 run create_hlr_db(pid=14520): Launched 18:46:11.748487 bus /gobi_6: Setting Powered False 18:46:12.814766 run create_hlr_db(pid=14520): Terminated: ok {rc=0} 18:46:13.251331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14522): Launched 18:46:13.559172 run osmo-hlr_10.42.42.2(pid=14523): Launched 18:46:13.676399 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:14.215854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14525): Launched 18:46:14.546252 run osmo-stp_10.42.42.5(pid=14526): Launched 18:46:14.670823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:15.231612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14528): Launched 18:46:15.356186 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:15.633626 run patchelf(pid=14529): Launched 18:46:15.815175 run osmo-stp_10.42.42.5(pid=14526): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14526)] 18:46:15.962402 run osmo-stp_10.42.42.5(pid=14526): stdout: | (launched: 2022-12-12_18:46:14.485089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:16.104809 run osmo-stp_10.42.42.5(pid=14526): stderr: | [0;m[38;5;43m20221212184614677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184614677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184614677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184614678 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184614678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184614678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184614678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:16.247221 run osmo-stp_10.42.42.5(pid=14526): stdout: | (launched: 2022-12-12_18:46:14.485089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:16.383621 run osmo-stp_10.42.42.5(pid=14526): stderr: | [0;m[38;5;43m20221212184614677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184614677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184614677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184614678 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184614678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184614678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184614678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:16.545741 run patchelf(pid=14529): Terminating (SIGINT) 18:46:16.731079 run patchelf(pid=14529): Terminated: ok {rc=0} 18:46:16.864751 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14526): Process ended prematurely: osmo-stp_10.42.42.5(pid=14526) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14526)] [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:46:16.876422 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 18:46:16.906836 run osmo-hlr_10.42.42.2(pid=14523): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14523)] 18:46:16.958021 run osmo-hlr_10.42.42.2(pid=14523): stdout: | (launched: 2022-12-12_18:46:13.501811) 18:46:17.010750 run osmo-hlr_10.42.42.2(pid=14523): stderr: | [0;m[1;31m20221212184613675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184613675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184613675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184613675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184613675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184613675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184613688 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184613698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184613698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184613698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:17.064000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14516): Terminating (SIGTERM) 18:46:17.107258 run iperf3-srv_10.42.42.10(pid=14517): Terminating (SIGTERM) 18:46:17.151536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14518): Terminating (SIGTERM) 18:46:17.193890 run iperf3-srv_10.42.42.10(pid=14519): Terminating (SIGTERM) 18:46:17.235276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14522): Terminating (SIGTERM) 18:46:17.277182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14525): Terminating (SIGTERM) 18:46:17.318717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14528): Terminating (SIGTERM) 18:46:17.360453 --- ParallelTerminationStrategy: PID 14516 died... 18:46:17.380504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14516): Terminated: ok {rc=0} 18:46:17.427227 --- ParallelTerminationStrategy: PID 14517 died... 18:46:17.446786 run iperf3-srv_10.42.42.10(pid=14517): Terminated {rc=256} 18:46:17.492796 --- ParallelTerminationStrategy: PID 14518 died... 18:46:17.512849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14518): Terminated: ok {rc=0} 18:46:17.559109 --- ParallelTerminationStrategy: PID 14519 died... 18:46:17.578473 run iperf3-srv_10.42.42.10(pid=14519): Terminated {rc=256} 18:46:17.624174 --- ParallelTerminationStrategy: PID 14522 died... 18:46:17.643656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14522): Terminated: ok {rc=0} 18:46:17.689570 --- ParallelTerminationStrategy: PID 14525 died... 18:46:17.709172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14525): Terminated: ok {rc=0} 18:46:17.754814 --- ParallelTerminationStrategy: PID 14528 died... 18:46:17.774333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14528): Terminated: ok {rc=0} 18:46:17.862436 bus /gobi_0: Setting Powered False 18:46:18.963053 bus /gobi_0: Setting Powered False 18:46:20.078754 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:46:21.230234 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:21.242440 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:46:21.287471 tst iperf3.py: using LAC 30769 18:46:21.415686 tst iperf3.py: using RAC 169 18:46:21.543172 tst iperf3.py: using CellId 30769 18:46:21.671828 tst iperf3.py: using BVCI 30770 18:46:21.789723 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:21.801397 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:21.812595 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:21.824009 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:21.835341 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:21.846628 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:21.858153 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:21.869419 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:21.880876 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:46:21.997048 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:46:22.203438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:22.510937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14530): Launched 18:46:22.780623 run iperf3-srv_10.42.42.10(pid=14531): Launched 18:46:22.896761 tst iperf3.py:8: start network... 18:46:23.102564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:23.577364 run create_hlr_db(pid=14532): Launched 18:46:23.695345 bus /gobi_6: Setting Powered False 18:46:24.756125 run create_hlr_db(pid=14532): Terminated: ok {rc=0} 18:46:25.202394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14534): Launched 18:46:25.531355 run osmo-hlr_10.42.42.2(pid=14535): Launched 18:46:25.656518 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:26.219824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14537): Launched 18:46:26.548894 run osmo-stp_10.42.42.5(pid=14538): Launched 18:46:26.675609 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:27.238714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14540): Launched 18:46:27.363154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:27.640127 run patchelf(pid=14541): Launched 18:46:27.823049 run osmo-stp_10.42.42.5(pid=14538): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14538)] 18:46:27.960725 run osmo-stp_10.42.42.5(pid=14538): stdout: | (launched: 2022-12-12_18:46:26.488262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:28.099717 run osmo-stp_10.42.42.5(pid=14538): stderr: | [0;m[38;5;43m20221212184626679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184626679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184626679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184626679 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184626680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184626680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184626680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:28.239645 run osmo-stp_10.42.42.5(pid=14538): stdout: | (launched: 2022-12-12_18:46:26.488262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:28.372923 run osmo-stp_10.42.42.5(pid=14538): stderr: | [0;m[38;5;43m20221212184626679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184626679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184626679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184626679 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184626680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184626680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184626680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:28.531446 run patchelf(pid=14541): Terminating (SIGINT) 18:46:28.714870 run patchelf(pid=14541): Terminated: ok {rc=0} 18:46:28.846320 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14538): Process ended prematurely: osmo-stp_10.42.42.5(pid=14538) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14538)] [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 18:46:28.856601 tst iperf3.py:8: Test FAILED (7.7 sec) 18:46:28.885541 run osmo-hlr_10.42.42.2(pid=14535): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14535)] 18:46:28.935701 run osmo-hlr_10.42.42.2(pid=14535): stdout: | (launched: 2022-12-12_18:46:25.470763) 18:46:28.987626 run osmo-hlr_10.42.42.2(pid=14535): stderr: | [0;m[1;31m20221212184625666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184625667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184625667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184625667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184625667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184625667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184625679 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184625690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184625690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184625690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:29.039824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14530): Terminating (SIGTERM) 18:46:29.081961 run iperf3-srv_10.42.42.10(pid=14531): Terminating (SIGTERM) 18:46:29.124245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14534): Terminating (SIGTERM) 18:46:29.166304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14537): Terminating (SIGTERM) 18:46:29.208291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14540): Terminating (SIGTERM) 18:46:29.250661 --- ParallelTerminationStrategy: PID 14530 died... 18:46:29.270807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14530): Terminated: ok {rc=0} 18:46:29.317290 --- ParallelTerminationStrategy: PID 14531 died... 18:46:29.337062 run iperf3-srv_10.42.42.10(pid=14531): Terminated {rc=256} 18:46:29.383612 --- ParallelTerminationStrategy: PID 14534 died... 18:46:29.403354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14534): Terminated: ok {rc=0} 18:46:29.449766 --- ParallelTerminationStrategy: PID 14537 died... 18:46:29.469878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14537): Terminated: ok {rc=0} 18:46:29.516238 --- ParallelTerminationStrategy: PID 14540 died... 18:46:29.535981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14540): Terminated: ok {rc=0} 18:46:29.624373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:46:30.777176 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:30.789485 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:46:30.837293 tst iperf3m4.py: using LAC 30770 18:46:30.992432 tst iperf3m4.py: using RAC 170 18:46:31.115526 tst iperf3m4.py: using CellId 30770 18:46:31.285922 tst iperf3m4.py: using BVCI 30771 18:46:31.438728 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:31.453931 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:31.471245 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:31.484515 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:31.496725 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:31.508608 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:31.521023 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:31.534388 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:31.546765 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:46:31.671068 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:46:31.810817 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:46:31.929787 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:46:32.057281 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:46:32.281899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:32.613768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14543): Launched 18:46:32.900497 run iperf3-srv_10.42.42.10(pid=14544): Launched 18:46:33.023364 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:46:33.242900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:33.573045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14545): Launched 18:46:33.858031 run iperf3-srv_10.42.42.10(pid=14546): Launched 18:46:33.982484 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:46:34.201992 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:34.530177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14547): Launched 18:46:34.817481 run iperf3-srv_10.42.42.10(pid=14548): Launched 18:46:34.940339 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:46:35.160422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:46:35.488905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14549): Launched 18:46:35.775526 run iperf3-srv_10.42.42.10(pid=14550): Launched 18:46:35.899452 tst iperf3m4.py:8: start network... 18:46:36.118967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:36.627607 run create_hlr_db(pid=14551): Launched 18:46:36.763269 bus /gobi_6: Setting Powered False 18:46:37.828642 run create_hlr_db(pid=14551): Terminated: ok {rc=0} 18:46:38.267067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14553): Launched 18:46:38.574644 run osmo-hlr_10.42.42.2(pid=14554): Launched 18:46:38.693187 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:39.232912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14556): Launched 18:46:39.541680 run osmo-stp_10.42.42.5(pid=14557): Launched 18:46:39.658915 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:40.187012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14559): Launched 18:46:40.305709 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:40.565611 run patchelf(pid=14560): Launched 18:46:40.736698 run osmo-stp_10.42.42.5(pid=14557): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14557)] 18:46:40.865947 run osmo-stp_10.42.42.5(pid=14557): stdout: | (launched: 2022-12-12_18:46:39.484403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:40.996822 run osmo-stp_10.42.42.5(pid=14557): stderr: | [0;m[38;5;43m20221212184639655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184639655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184639656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184639656 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184639656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184639657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184639657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:41.127983 run osmo-stp_10.42.42.5(pid=14557): stdout: | (launched: 2022-12-12_18:46:39.484403) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:41.252765 run osmo-stp_10.42.42.5(pid=14557): stderr: | [0;m[38;5;43m20221212184639655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184639655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184639656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184639656 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184639656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184639657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184639657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:41.401344 run patchelf(pid=14560): Terminating (SIGINT) 18:46:41.573418 run patchelf(pid=14560): Terminated: ok {rc=0} 18:46:41.697618 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14557): Process ended prematurely: osmo-stp_10.42.42.5(pid=14557) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14557)] [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 18:46:41.707240 tst iperf3m4.py:8: Test FAILED (11.0 sec) 18:46:41.735200 run osmo-hlr_10.42.42.2(pid=14554): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14554)] 18:46:41.783447 run osmo-hlr_10.42.42.2(pid=14554): stdout: | (launched: 2022-12-12_18:46:38.517346) 18:46:41.833257 run osmo-hlr_10.42.42.2(pid=14554): stderr: | [0;m[1;31m20221212184638692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184638692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184638692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184638692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184638692 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184638693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184638705 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184638713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184638713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184638713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:41.883759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14543): Terminating (SIGTERM) 18:46:41.924063 run iperf3-srv_10.42.42.10(pid=14544): Terminating (SIGTERM) 18:46:41.964217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14545): Terminating (SIGTERM) 18:46:42.004524 run iperf3-srv_10.42.42.10(pid=14546): Terminating (SIGTERM) 18:46:42.044366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14547): Terminating (SIGTERM) 18:46:42.084329 run iperf3-srv_10.42.42.10(pid=14548): Terminating (SIGTERM) 18:46:42.124150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14549): Terminating (SIGTERM) 18:46:42.164268 run iperf3-srv_10.42.42.10(pid=14550): Terminating (SIGTERM) 18:46:42.204394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14553): Terminating (SIGTERM) 18:46:42.244745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14556): Terminating (SIGTERM) 18:46:42.284780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14559): Terminating (SIGTERM) 18:46:42.325216 --- ParallelTerminationStrategy: PID 14543 died... 18:46:42.344364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14543): Terminated: ok {rc=0} 18:46:42.388911 --- ParallelTerminationStrategy: PID 14544 died... 18:46:42.408209 run iperf3-srv_10.42.42.10(pid=14544): Terminated {rc=256} 18:46:42.452408 --- ParallelTerminationStrategy: PID 14545 died... 18:46:42.471176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14545): Terminated: ok {rc=0} 18:46:42.515501 --- ParallelTerminationStrategy: PID 14546 died... 18:46:42.534108 run iperf3-srv_10.42.42.10(pid=14546): Terminated {rc=256} 18:46:42.578121 --- ParallelTerminationStrategy: PID 14547 died... 18:46:42.596861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14547): Terminated: ok {rc=0} 18:46:42.641309 --- ParallelTerminationStrategy: PID 14548 died... 18:46:42.660000 run iperf3-srv_10.42.42.10(pid=14548): Terminated {rc=256} 18:46:42.705129 --- ParallelTerminationStrategy: PID 14549 died... 18:46:42.723845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14549): Terminated: ok {rc=0} 18:46:42.768688 --- ParallelTerminationStrategy: PID 14550 died... 18:46:42.787510 run iperf3-srv_10.42.42.10(pid=14550): Terminated {rc=256} 18:46:42.831990 --- ParallelTerminationStrategy: PID 14553 died... 18:46:42.850904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14553): Terminated: ok {rc=0} 18:46:42.895396 --- ParallelTerminationStrategy: PID 14556 died... 18:46:42.914339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14556): Terminated: ok {rc=0} 18:46:42.959155 --- ParallelTerminationStrategy: PID 14559 died... 18:46:42.977994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14559): Terminated: ok {rc=0} 18:46:43.063466 bus /gobi_4: Setting Powered False 18:46:44.163137 bus /gobi_4: Setting Powered False 18:46:45.282305 bus /gobi_1: Setting Powered False 18:46:46.398909 bus /gobi_1: Setting Powered False 18:46:47.525604 bus /gobi_0: Setting Powered False 18:46:48.624703 bus /gobi_0: Setting Powered False 18:46:49.742835 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 18:46:50.846431 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:50.858692 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:46:50.900184 tst ping.py: using LAC 30771 18:46:51.026056 tst ping.py: using RAC 171 18:46:51.152128 tst ping.py: using CellId 30771 18:46:51.276043 tst ping.py: using BVCI 30772 18:46:51.393147 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:51.404873 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:51.416312 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:51.427732 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:51.438988 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:51.450269 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:51.461793 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:51.473060 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:46:51.591874 tst ping.py:19: start network... 18:46:51.805454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:46:52.298916 run create_hlr_db(pid=14561): Launched 18:46:52.420789 bus /gobi_6: Setting Powered False 18:46:53.483106 run create_hlr_db(pid=14561): Terminated: ok {rc=0} 18:46:53.911247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14563): Launched 18:46:54.211646 run osmo-hlr_10.42.42.2(pid=14564): Launched 18:46:54.326379 run osmo-stp_10.42.42.5: Starting osmo-stp 18:46:54.845997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14566): Launched 18:46:55.147857 run osmo-stp_10.42.42.5(pid=14567): Launched 18:46:55.262404 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:46:55.778939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14569): Launched 18:46:55.893572 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:46:56.146907 run patchelf(pid=14570): Launched 18:46:56.314963 run osmo-stp_10.42.42.5(pid=14567): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14567)] 18:46:56.440791 run osmo-stp_10.42.42.5(pid=14567): stdout: | (launched: 2022-12-12_18:46:55.091871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:56.568587 run osmo-stp_10.42.42.5(pid=14567): stderr: | [0;m[38;5;43m20221212184655260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184655260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184655260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184655261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184655261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184655261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184655261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:56.696430 run osmo-stp_10.42.42.5(pid=14567): stdout: | (launched: 2022-12-12_18:46:55.091871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:46:56.818732 run osmo-stp_10.42.42.5(pid=14567): stderr: | [0;m[38;5;43m20221212184655260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184655260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184655260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184655261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184655261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184655261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184655261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:46:56.963928 run patchelf(pid=14570): Terminating (SIGINT) 18:46:57.131409 run patchelf(pid=14570): Terminated: ok {rc=0} 18:46:57.252062 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14567): Process ended prematurely: osmo-stp_10.42.42.5(pid=14567) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14567)] [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 18:46:57.261245 tst ping.py:22: Test FAILED (6.4 sec) 18:46:57.288657 run osmo-hlr_10.42.42.2(pid=14564): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14564)] 18:46:57.336690 run osmo-hlr_10.42.42.2(pid=14564): stdout: | (launched: 2022-12-12_18:46:54.155978) 18:46:57.386401 run osmo-hlr_10.42.42.2(pid=14564): stderr: | [0;m[1;31m20221212184654328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184654328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184654328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184654328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184654328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184654328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184654340 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184654351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184654351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184654351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:46:57.436604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14563): Terminating (SIGTERM) 18:46:57.476598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14566): Terminating (SIGTERM) 18:46:57.516581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14569): Terminating (SIGTERM) 18:46:57.557223 --- ParallelTerminationStrategy: PID 14563 died... 18:46:57.576434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14563): Terminated: ok {rc=0} 18:46:57.621013 --- ParallelTerminationStrategy: PID 14566 died... 18:46:57.639647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14566): Terminated: ok {rc=0} 18:46:57.683849 --- ParallelTerminationStrategy: PID 14569 died... 18:46:57.702597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14569): Terminated: ok {rc=0} 18:46:57.789974 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:46:58.878845 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:58.890809 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:46:58.938465 tst ping_idle_ping.py: using LAC 30772 18:46:59.055213 tst ping_idle_ping.py: using RAC 172 18:46:59.171407 tst ping_idle_ping.py: using CellId 30772 18:46:59.287628 tst ping_idle_ping.py: using BVCI 30773 18:46:59.395976 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:59.407155 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:59.418146 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:59.429557 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:59.440678 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:59.451773 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:59.463205 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:46:59.474439 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:46:59.593224 tst ping_idle_ping.py:24: start network... 18:46:59.809080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:00.313459 run create_hlr_db(pid=14571): Launched 18:47:00.437453 bus /gobi_6: Setting Powered False 18:47:01.500681 run create_hlr_db(pid=14571): Terminated: ok {rc=0} 18:47:01.957365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14573): Launched 18:47:02.293411 run osmo-hlr_10.42.42.2(pid=14574): Launched 18:47:02.418990 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:02.973155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14576): Launched 18:47:03.296059 run osmo-stp_10.42.42.5(pid=14577): Launched 18:47:03.420641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:03.974205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14579): Launched 18:47:04.099647 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:04.371479 run patchelf(pid=14580): Launched 18:47:04.551546 run osmo-stp_10.42.42.5(pid=14577): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14577)] 18:47:04.686190 run osmo-stp_10.42.42.5(pid=14577): stdout: | (launched: 2022-12-12_18:47:03.236745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:04.822057 run osmo-stp_10.42.42.5(pid=14577): stderr: | [0;m[38;5;43m20221212184703428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184703428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184703428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184703429 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184703429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184703429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184703429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:04.958952 run osmo-stp_10.42.42.5(pid=14577): stdout: | (launched: 2022-12-12_18:47:03.236745) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:05.089183 run osmo-stp_10.42.42.5(pid=14577): stderr: | [0;m[38;5;43m20221212184703428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184703428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184703428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184703429 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184703429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184703429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184703429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:05.244043 run patchelf(pid=14580): Terminating (SIGINT) 18:47:05.422890 run patchelf(pid=14580): Terminated: ok {rc=0} 18:47:05.552055 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14577): Process ended prematurely: osmo-stp_10.42.42.5(pid=14577) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14577)] [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 18:47:05.561718 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:47:05.589693 run osmo-hlr_10.42.42.2(pid=14574): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14574)] 18:47:05.639355 run osmo-hlr_10.42.42.2(pid=14574): stdout: | (launched: 2022-12-12_18:47:02.233937) 18:47:05.690808 run osmo-hlr_10.42.42.2(pid=14574): stderr: | [0;m[1;31m20221212184702429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184702429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184702429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184702429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184702429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184702429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184702440 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184702450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184702450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184702450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:05.742541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14573): Terminating (SIGTERM) 18:47:05.784052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14576): Terminating (SIGTERM) 18:47:05.825658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14579): Terminating (SIGTERM) 18:47:05.867493 --- ParallelTerminationStrategy: PID 14573 died... 18:47:05.887314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14573): Terminated: ok {rc=0} 18:47:05.934111 --- ParallelTerminationStrategy: PID 14576 died... 18:47:05.953599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14576): Terminated: ok {rc=0} 18:47:05.999431 --- ParallelTerminationStrategy: PID 14579 died... 18:47:06.018990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14579): Terminated: ok {rc=0} 18:47:06.106932 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:47:07.402757 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:47:07.410015 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:47:07.435764 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:47:07.476838 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:47:07.566463 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:47:07.591069 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:47:07.630829 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:47:08.230410 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:47:08.282806 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.294503 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:47:08.355824 tst cs_paging_gprs_active.py: using LAC 30773 18:47:08.482807 tst cs_paging_gprs_active.py: using RAC 173 18:47:08.611030 tst cs_paging_gprs_active.py: using CellId 30773 18:47:08.737272 tst cs_paging_gprs_active.py: using BVCI 30774 18:47:08.849759 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.861216 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.872318 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.883733 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.895010 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.906366 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.917843 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.928907 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:08.940445 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:47:09.062030 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:47:09.184051 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:47:09.403630 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:09.731040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14584): Launched 18:47:10.015159 run iperf3-srv_10.42.42.10(pid=14585): Launched 18:47:10.138885 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:47:10.357439 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:10.685413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14586): Launched 18:47:10.971035 run iperf3-srv_10.42.42.10(pid=14587): Launched 18:47:11.095163 tst cs_paging_gprs_active.py:38: start network... 18:47:11.314672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:11.822216 run create_hlr_db(pid=14588): Launched 18:47:11.955795 bus /gobi_6: Setting Powered False 18:47:13.021308 run create_hlr_db(pid=14588): Terminated: ok {rc=0} 18:47:13.458241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14590): Launched 18:47:13.766604 run osmo-hlr_10.42.42.2(pid=14591): Launched 18:47:13.884016 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:14.423344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14593): Launched 18:47:14.730479 run osmo-stp_10.42.42.5(pid=14594): Launched 18:47:14.847688 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:15.373544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14596): Launched 18:47:15.490729 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:15.749280 run patchelf(pid=14597): Launched 18:47:15.951344 run osmo-stp_10.42.42.5(pid=14594): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14594)] 18:47:16.092688 run osmo-stp_10.42.42.5(pid=14594): stdout: | (launched: 2022-12-12_18:47:14.673653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:16.235607 run osmo-stp_10.42.42.5(pid=14594): stderr: | [0;m[38;5;43m20221212184714842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184714842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184714842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184714843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184714843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184714843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184714843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:16.379286 run osmo-stp_10.42.42.5(pid=14594): stdout: | (launched: 2022-12-12_18:47:14.673653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:16.517902 run osmo-stp_10.42.42.5(pid=14594): stderr: | [0;m[38;5;43m20221212184714842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184714842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184714842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184714843 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184714843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184714843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184714843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:16.683111 run patchelf(pid=14597): Terminating (SIGINT) 18:47:16.870220 run patchelf(pid=14597): Terminated: ok {rc=0} 18:47:17.004558 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14594): Process ended prematurely: osmo-stp_10.42.42.5(pid=14594) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14594)] [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:47:17.015813 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 18:47:17.045834 run osmo-hlr_10.42.42.2(pid=14591): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14591)] 18:47:17.101720 run osmo-hlr_10.42.42.2(pid=14591): stdout: | (launched: 2022-12-12_18:47:13.708787) 18:47:17.155003 run osmo-hlr_10.42.42.2(pid=14591): stderr: | [0;m[1;31m20221212184713885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184713885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184713885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184713885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184713885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184713885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184713896 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184713905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184713905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184713905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:17.207651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14584): Terminating (SIGTERM) 18:47:17.248556 run iperf3-srv_10.42.42.10(pid=14585): Terminating (SIGTERM) 18:47:17.289445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14586): Terminating (SIGTERM) 18:47:17.330461 run iperf3-srv_10.42.42.10(pid=14587): Terminating (SIGTERM) 18:47:17.371351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14590): Terminating (SIGTERM) 18:47:17.412326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14593): Terminating (SIGTERM) 18:47:17.453129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14596): Terminating (SIGTERM) 18:47:17.494173 --- ParallelTerminationStrategy: PID 14584 died... 18:47:17.513714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14584): Terminated: ok {rc=0} 18:47:17.559819 --- ParallelTerminationStrategy: PID 14585 died... 18:47:17.578688 run iperf3-srv_10.42.42.10(pid=14585): Terminated {rc=256} 18:47:17.624699 --- ParallelTerminationStrategy: PID 14586 died... 18:47:17.643439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14586): Terminated: ok {rc=0} 18:47:17.689229 --- ParallelTerminationStrategy: PID 14587 died... 18:47:17.707912 run iperf3-srv_10.42.42.10(pid=14587): Terminated {rc=256} 18:47:17.753553 --- ParallelTerminationStrategy: PID 14590 died... 18:47:17.772339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14590): Terminated: ok {rc=0} 18:47:17.818546 --- ParallelTerminationStrategy: PID 14593 died... 18:47:17.837420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14593): Terminated: ok {rc=0} 18:47:17.883310 --- ParallelTerminationStrategy: PID 14596 died... 18:47:17.902021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14596): Terminated: ok {rc=0} 18:47:17.990379 bus /gobi_0: Setting Powered False 18:47:19.091160 bus /gobi_0: Setting Powered False 18:47:20.208191 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:47:21.357810 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:21.370338 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:47:21.435830 tst iperf3.py: using LAC 30774 18:47:21.562732 tst iperf3.py: using RAC 174 18:47:21.689215 tst iperf3.py: using CellId 30774 18:47:21.815566 tst iperf3.py: using BVCI 30775 18:47:21.933071 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:21.944738 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:21.956137 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:21.967491 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:21.978781 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:21.990246 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:22.001776 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:22.013050 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:22.024469 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:47:22.143995 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:47:22.349150 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:22.655911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14598): Launched 18:47:22.923175 run iperf3-srv_10.42.42.10(pid=14599): Launched 18:47:23.038679 tst iperf3.py:8: start network... 18:47:23.242226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:23.713663 run create_hlr_db(pid=14600): Launched 18:47:23.830470 bus /gobi_6: Setting Powered False 18:47:24.891442 run create_hlr_db(pid=14600): Terminated: ok {rc=0} 18:47:25.335550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14602): Launched 18:47:25.662543 run osmo-hlr_10.42.42.2(pid=14603): Launched 18:47:25.787293 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:26.348152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14605): Launched 18:47:26.676157 run osmo-stp_10.42.42.5(pid=14606): Launched 18:47:26.801765 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:27.363573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14608): Launched 18:47:27.490609 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:27.766191 run patchelf(pid=14609): Launched 18:47:27.947744 run osmo-stp_10.42.42.5(pid=14606): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14606)] 18:47:28.085175 run osmo-stp_10.42.42.5(pid=14606): stdout: | (launched: 2022-12-12_18:47:26.615856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:28.224093 run osmo-stp_10.42.42.5(pid=14606): stderr: | [0;m[38;5;43m20221212184726805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184726805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184726805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184726806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184726806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184726806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184726806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:28.363037 run osmo-stp_10.42.42.5(pid=14606): stdout: | (launched: 2022-12-12_18:47:26.615856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:28.496467 run osmo-stp_10.42.42.5(pid=14606): stderr: | [0;m[38;5;43m20221212184726805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184726805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184726805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184726806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184726806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184726806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184726806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:28.654046 run patchelf(pid=14609): Terminating (SIGINT) 18:47:28.836147 run patchelf(pid=14609): Terminated: ok {rc=0} 18:47:28.967798 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14606): Process ended prematurely: osmo-stp_10.42.42.5(pid=14606) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14606)] [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 18:47:28.978430 tst iperf3.py:8: Test FAILED (7.7 sec) 18:47:29.007359 run osmo-hlr_10.42.42.2(pid=14603): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14603)] 18:47:29.057415 run osmo-hlr_10.42.42.2(pid=14603): stdout: | (launched: 2022-12-12_18:47:25.602120) 18:47:29.109257 run osmo-hlr_10.42.42.2(pid=14603): stderr: | [0;m[1;31m20221212184725798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184725798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184725798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184725798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184725798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184725798 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184725811 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184725821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184725822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184725822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:29.161574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14598): Terminating (SIGTERM) 18:47:29.203580 run iperf3-srv_10.42.42.10(pid=14599): Terminating (SIGTERM) 18:47:29.245764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14602): Terminating (SIGTERM) 18:47:29.287817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14605): Terminating (SIGTERM) 18:47:29.329930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14608): Terminating (SIGTERM) 18:47:29.372192 --- ParallelTerminationStrategy: PID 14598 died... 18:47:29.392433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14598): Terminated: ok {rc=0} 18:47:29.438752 --- ParallelTerminationStrategy: PID 14599 died... 18:47:29.458377 run iperf3-srv_10.42.42.10(pid=14599): Terminated {rc=256} 18:47:29.504624 --- ParallelTerminationStrategy: PID 14602 died... 18:47:29.524133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14602): Terminated: ok {rc=0} 18:47:29.569988 --- ParallelTerminationStrategy: PID 14605 died... 18:47:29.590307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14605): Terminated: ok {rc=0} 18:47:29.636261 --- ParallelTerminationStrategy: PID 14608 died... 18:47:29.656105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14608): Terminated: ok {rc=0} 18:47:29.744427 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:47:30.910116 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:30.923889 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:47:30.990347 tst iperf3m4.py: using LAC 30775 18:47:31.128133 tst iperf3m4.py: using RAC 175 18:47:31.280908 tst iperf3m4.py: using CellId 30775 18:47:31.401055 tst iperf3m4.py: using BVCI 30776 18:47:31.514843 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:31.527030 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:31.538809 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:31.551262 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:31.563847 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:31.577453 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:31.590238 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:31.602797 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:31.616125 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:47:31.739253 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:47:31.888671 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:47:32.014812 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:47:32.138776 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:47:32.362402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:32.689551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14610): Launched 18:47:32.973499 run iperf3-srv_10.42.42.10(pid=14611): Launched 18:47:33.095586 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:47:33.314610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:33.642098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14612): Launched 18:47:33.927644 run iperf3-srv_10.42.42.10(pid=14613): Launched 18:47:34.051451 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:47:34.269605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:34.598003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14614): Launched 18:47:34.883624 run iperf3-srv_10.42.42.10(pid=14615): Launched 18:47:35.005882 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:47:35.223965 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:47:35.551051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14616): Launched 18:47:35.835046 run iperf3-srv_10.42.42.10(pid=14617): Launched 18:47:35.958635 tst iperf3m4.py:8: start network... 18:47:36.177004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:36.682155 run create_hlr_db(pid=14618): Launched 18:47:36.815698 bus /gobi_6: Setting Powered False 18:47:37.881175 run create_hlr_db(pid=14618): Terminated: ok {rc=0} 18:47:38.335368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14620): Launched 18:47:38.662233 run osmo-hlr_10.42.42.2(pid=14621): Launched 18:47:38.787394 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:39.351755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14623): Launched 18:47:39.680049 run osmo-stp_10.42.42.5(pid=14624): Launched 18:47:39.803884 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:40.365415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14626): Launched 18:47:40.489884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:40.766885 run patchelf(pid=14627): Launched 18:47:40.949149 run osmo-stp_10.42.42.5(pid=14624): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14624)] 18:47:41.086155 run osmo-stp_10.42.42.5(pid=14624): stdout: | (launched: 2022-12-12_18:47:39.619420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:41.225693 run osmo-stp_10.42.42.5(pid=14624): stderr: | [0;m[38;5;43m20221212184739808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184739808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184739808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184739808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184739809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184739809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184739809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:41.364329 run osmo-stp_10.42.42.5(pid=14624): stdout: | (launched: 2022-12-12_18:47:39.619420) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:41.497454 run osmo-stp_10.42.42.5(pid=14624): stderr: | [0;m[38;5;43m20221212184739808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184739808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184739808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184739808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184739809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184739809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184739809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:41.655178 run patchelf(pid=14627): Terminating (SIGINT) 18:47:41.836634 run patchelf(pid=14627): Terminated: ok {rc=0} 18:47:41.968134 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14624): Process ended prematurely: osmo-stp_10.42.42.5(pid=14624) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14624)] [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:47:41.978614 tst iperf3m4.py:8: Test FAILED (11.1 sec) 18:47:42.007676 run osmo-hlr_10.42.42.2(pid=14621): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14621)] 18:47:42.057419 run osmo-hlr_10.42.42.2(pid=14621): stdout: | (launched: 2022-12-12_18:47:38.601927) 18:47:42.109222 run osmo-hlr_10.42.42.2(pid=14621): stderr: | [0;m[1;31m20221212184738797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184738797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184738797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184738797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184738797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184738797 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184738809 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184738820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184738821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184738821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:42.161543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14610): Terminating (SIGTERM) 18:47:42.203459 run iperf3-srv_10.42.42.10(pid=14611): Terminating (SIGTERM) 18:47:42.245384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14612): Terminating (SIGTERM) 18:47:42.287033 run iperf3-srv_10.42.42.10(pid=14613): Terminating (SIGTERM) 18:47:42.328645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14614): Terminating (SIGTERM) 18:47:42.370901 run iperf3-srv_10.42.42.10(pid=14615): Terminating (SIGTERM) 18:47:42.412467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14616): Terminating (SIGTERM) 18:47:42.454056 run iperf3-srv_10.42.42.10(pid=14617): Terminating (SIGTERM) 18:47:42.495476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14620): Terminating (SIGTERM) 18:47:42.537446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14623): Terminating (SIGTERM) 18:47:42.579129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14626): Terminating (SIGTERM) 18:47:42.620939 --- ParallelTerminationStrategy: PID 14610 died... 18:47:42.640868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14610): Terminated: ok {rc=0} 18:47:42.687426 --- ParallelTerminationStrategy: PID 14611 died... 18:47:42.707109 run iperf3-srv_10.42.42.10(pid=14611): Terminated {rc=256} 18:47:42.753279 --- ParallelTerminationStrategy: PID 14612 died... 18:47:42.772768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14612): Terminated: ok {rc=0} 18:47:42.818849 --- ParallelTerminationStrategy: PID 14613 died... 18:47:42.838580 run iperf3-srv_10.42.42.10(pid=14613): Terminated {rc=256} 18:47:42.884278 --- ParallelTerminationStrategy: PID 14614 died... 18:47:42.904035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14614): Terminated: ok {rc=0} 18:47:42.950067 --- ParallelTerminationStrategy: PID 14615 died... 18:47:42.969732 run iperf3-srv_10.42.42.10(pid=14615): Terminated {rc=256} 18:47:43.015612 --- ParallelTerminationStrategy: PID 14616 died... 18:47:43.035361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14616): Terminated: ok {rc=0} 18:47:43.081316 --- ParallelTerminationStrategy: PID 14617 died... 18:47:43.100594 run iperf3-srv_10.42.42.10(pid=14617): Terminated {rc=256} 18:47:43.146684 --- ParallelTerminationStrategy: PID 14620 died... 18:47:43.166443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14620): Terminated: ok {rc=0} 18:47:43.212660 --- ParallelTerminationStrategy: PID 14623 died... 18:47:43.232644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14623): Terminated: ok {rc=0} 18:47:43.278697 --- ParallelTerminationStrategy: PID 14626 died... 18:47:43.298532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14626): Terminated: ok {rc=0} 18:47:43.386900 bus /gobi_4: Setting Powered False 18:47:44.487439 bus /gobi_4: Setting Powered False 18:47:45.606543 bus /gobi_1: Setting Powered False 18:47:46.704904 bus /gobi_1: Setting Powered False 18:47:47.824841 bus /gobi_0: Setting Powered False 18:47:48.924234 bus /gobi_0: Setting Powered False 18:47:50.040897 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:47:51.145551 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:51.158079 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:47:51.221006 tst ping.py: using LAC 30776 18:47:51.346762 tst ping.py: using RAC 176 18:47:51.473205 tst ping.py: using CellId 30776 18:47:51.598874 tst ping.py: using BVCI 30777 18:47:51.708323 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:51.719779 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:51.731029 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:51.742886 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:51.754672 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:51.766499 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:51.778370 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:51.790134 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:47:51.907813 tst ping.py:19: start network... 18:47:52.107911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:47:52.571963 run create_hlr_db(pid=14628): Launched 18:47:52.688834 bus /gobi_6: Setting Powered False 18:47:53.748593 run create_hlr_db(pid=14628): Terminated: ok {rc=0} 18:47:54.187687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14630): Launched 18:47:54.512050 run osmo-hlr_10.42.42.2(pid=14631): Launched 18:47:54.636688 run osmo-stp_10.42.42.5: Starting osmo-stp 18:47:55.200796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14633): Launched 18:47:55.524326 run osmo-stp_10.42.42.5(pid=14634): Launched 18:47:55.648612 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:47:56.201250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14636): Launched 18:47:56.324239 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:47:56.595643 run patchelf(pid=14637): Launched 18:47:56.774175 run osmo-stp_10.42.42.5(pid=14634): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14634)] 18:47:56.908495 run osmo-stp_10.42.42.5(pid=14634): stdout: | (launched: 2022-12-12_18:47:55.464128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:57.044061 run osmo-stp_10.42.42.5(pid=14634): stderr: | [0;m[38;5;43m20221212184755655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184755656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184755656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184755656 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184755657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184755657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184755657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:57.179779 run osmo-stp_10.42.42.5(pid=14634): stdout: | (launched: 2022-12-12_18:47:55.464128) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:47:57.310163 run osmo-stp_10.42.42.5(pid=14634): stderr: | [0;m[38;5;43m20221212184755655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184755656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184755656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184755656 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184755657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184755657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184755657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:47:57.464846 run patchelf(pid=14637): Terminating (SIGINT) 18:47:57.643611 run patchelf(pid=14637): Terminated: ok {rc=0} 18:47:57.771782 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14634): Process ended prematurely: osmo-stp_10.42.42.5(pid=14634) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14634)] [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 18:47:57.781612 tst ping.py:22: Test FAILED (6.6 sec) 18:47:57.809754 run osmo-hlr_10.42.42.2(pid=14631): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14631)] 18:47:57.859371 run osmo-hlr_10.42.42.2(pid=14631): stdout: | (launched: 2022-12-12_18:47:54.451896) 18:47:57.910776 run osmo-hlr_10.42.42.2(pid=14631): stderr: | [0;m[1;31m20221212184754649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184754649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184754649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184754649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184754649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184754649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184754661 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184754672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184754672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184754672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:47:57.963078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14630): Terminating (SIGTERM) 18:47:58.004819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14633): Terminating (SIGTERM) 18:47:58.046539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14636): Terminating (SIGTERM) 18:47:58.088443 --- ParallelTerminationStrategy: PID 14630 died... 18:47:58.108654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14630): Terminated: ok {rc=0} 18:47:58.154756 --- ParallelTerminationStrategy: PID 14633 died... 18:47:58.174338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14633): Terminated: ok {rc=0} 18:47:58.220413 --- ParallelTerminationStrategy: PID 14636 died... 18:47:58.239990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14636): Terminated: ok {rc=0} 18:47:58.328249 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:47:59.415654 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:59.428454 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:47:59.492743 tst ping_idle_ping.py: using LAC 30777 18:47:59.617298 tst ping_idle_ping.py: using RAC 177 18:47:59.744395 tst ping_idle_ping.py: using CellId 30777 18:47:59.869068 tst ping_idle_ping.py: using BVCI 30778 18:47:59.983915 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:47:59.995524 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:48:00.007285 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:48:00.018787 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:48:00.030150 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:48:00.041580 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:48:00.052940 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:48:00.064348 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:48:00.182966 tst ping_idle_ping.py:24: start network... 18:48:00.384267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:00.856206 run create_hlr_db(pid=14638): Launched 18:48:01.013562 bus /gobi_6: Setting Powered False 18:48:02.082101 run create_hlr_db(pid=14638): Terminated: ok {rc=0} 18:48:02.572009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14640): Launched 18:48:02.893742 run osmo-hlr_10.42.42.2(pid=14641): Launched 18:48:03.017323 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:03.568527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14643): Launched 18:48:03.890447 run osmo-stp_10.42.42.5(pid=14644): Launched 18:48:04.013785 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:48:04.566197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14646): Launched 18:48:04.690045 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:48:04.960533 run patchelf(pid=14647): Launched 18:48:05.139809 run osmo-stp_10.42.42.5(pid=14644): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14644)] 18:48:05.274510 run osmo-stp_10.42.42.5(pid=14644): stdout: | (launched: 2022-12-12_18:48:03.830768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:05.411175 run osmo-stp_10.42.42.5(pid=14644): stderr: | [0;m[38;5;43m20221212184804021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184804021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184804021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184804022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184804022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184804022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184804023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:05.548806 run osmo-stp_10.42.42.5(pid=14644): stdout: | (launched: 2022-12-12_18:48:03.830768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:05.679572 run osmo-stp_10.42.42.5(pid=14644): stderr: | [0;m[38;5;43m20221212184804021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184804021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184804021 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184804022 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184804022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184804022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184804023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:05.834553 run patchelf(pid=14647): Terminating (SIGINT) 18:48:06.013390 run patchelf(pid=14647): Terminated: ok {rc=0} 18:48:06.141982 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14644): Process ended prematurely: osmo-stp_10.42.42.5(pid=14644) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14644)] [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:48:06.151746 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 18:48:06.180230 run osmo-hlr_10.42.42.2(pid=14641): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14641)] 18:48:06.230459 run osmo-hlr_10.42.42.2(pid=14641): stdout: | (launched: 2022-12-12_18:48:02.833915) 18:48:06.282170 run osmo-hlr_10.42.42.2(pid=14641): stderr: | [0;m[1;31m20221212184803031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184803031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184803031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184803031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184803031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184803031 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184803044 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184803052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184803052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184803052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:06.334175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14640): Terminating (SIGTERM) 18:48:06.375879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14643): Terminating (SIGTERM) 18:48:06.417865 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14646): Terminating (SIGTERM) 18:48:06.460488 --- ParallelTerminationStrategy: PID 14640 died... 18:48:06.480607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14640): Terminated: ok {rc=0} 18:48:06.527182 --- ParallelTerminationStrategy: PID 14643 died... 18:48:06.547216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14643): Terminated: ok {rc=0} 18:48:06.593408 --- ParallelTerminationStrategy: PID 14646 died... 18:48:06.613049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14646): Terminated: ok {rc=0} 18:48:06.700577 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 18:48:08.004112 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:48:08.014299 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:48:08.042410 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:48:08.077933 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:48:08.135284 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:48:08.160384 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:48:08.199716 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:48:08.756433 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:48:08.762248 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:08.774507 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:48:08.836419 tst switch_tch_pdch.py: using LAC 30778 18:48:08.962875 tst switch_tch_pdch.py: using RAC 178 18:48:09.089378 tst switch_tch_pdch.py: using CellId 30778 18:48:09.214325 tst switch_tch_pdch.py: using BVCI 30779 18:48:09.331405 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:09.343579 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:09.355527 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:09.367483 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:09.379410 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:09.391285 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:09.403298 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:48:09.415324 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:48:09.533157 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:48:09.650505 tst switch_tch_pdch.py:51: start network... 18:48:09.852731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:10.317682 run create_hlr_db(pid=14652): Launched 18:48:10.433912 bus /gobi_6: Setting Powered False 18:48:11.493992 run create_hlr_db(pid=14652): Terminated: ok {rc=0} 18:48:11.933541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14654): Launched 18:48:12.255437 run osmo-hlr_10.42.42.2(pid=14655): Launched 18:48:12.379938 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:12.937262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14657): Launched 18:48:13.257579 run osmo-stp_10.42.42.5(pid=14658): Launched 18:48:13.381239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:48:13.934833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14660): Launched 18:48:14.058383 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:48:14.329347 run patchelf(pid=14661): Launched 18:48:14.508346 run osmo-stp_10.42.42.5(pid=14658): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14658)] 18:48:14.643405 run osmo-stp_10.42.42.5(pid=14658): stdout: | (launched: 2022-12-12_18:48:13.197873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:14.779871 run osmo-stp_10.42.42.5(pid=14658): stderr: | [0;m[38;5;43m20221212184813387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184813387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184813387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184813388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184813388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184813389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184813389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:14.916093 run osmo-stp_10.42.42.5(pid=14658): stdout: | (launched: 2022-12-12_18:48:13.197873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:15.046858 run osmo-stp_10.42.42.5(pid=14658): stderr: | [0;m[38;5;43m20221212184813387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184813387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184813387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184813388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184813388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184813389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184813389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:15.201773 run patchelf(pid=14661): Terminating (SIGINT) 18:48:15.380233 run patchelf(pid=14661): Terminated: ok {rc=0} 18:48:15.509557 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14658): Process ended prematurely: osmo-stp_10.42.42.5(pid=14658) [trial-2380↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14658)] [trial-2380↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:48:15.519640 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 18:48:15.548036 run osmo-hlr_10.42.42.2(pid=14655): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14655)] 18:48:15.598304 run osmo-hlr_10.42.42.2(pid=14655): stdout: | (launched: 2022-12-12_18:48:12.195421) 18:48:15.649883 run osmo-hlr_10.42.42.2(pid=14655): stderr: | [0;m[1;31m20221212184812391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184812391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184812391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184812391 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184812392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184812392 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184812405 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184812413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184812413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184812413 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:15.702282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14654): Terminating (SIGTERM) 18:48:15.744156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14657): Terminating (SIGTERM) 18:48:15.785971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14660): Terminating (SIGTERM) 18:48:15.827991 --- ParallelTerminationStrategy: PID 14654 died... 18:48:15.848215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14654): Terminated: ok {rc=0} 18:48:15.904776 --- ParallelTerminationStrategy: PID 14657 died... 18:48:15.925160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14657): Terminated: ok {rc=0} 18:48:15.971786 --- ParallelTerminationStrategy: PID 14660 died... 18:48:15.992028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14660): Terminated: ok {rc=0} 18:48:16.087130 bus /gobi_0: Setting Powered False 18:48:17.198225 bus /gobi_0: Setting Powered False 18:48:18.315021 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 sms:nanobts+band-900 --------------------------------------------------------------------- 18:48:19.560262 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:48:19.565284 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:48:19.597980 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 18:48:19.624718 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 18:48:19.677680 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:48:19.710983 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 18:48:19.738232 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 18:48:20.287055 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 18:48:20.292246 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:48:20.303489 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 18:48:20.351052 tst mo_mt_sms.py: using LAC 30779 18:48:20.476934 tst mo_mt_sms.py: using RAC 179 18:48:20.602479 tst mo_mt_sms.py: using CellId 30779 18:48:20.729123 tst mo_mt_sms.py: using BVCI 30780 18:48:20.844191 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:48:20.855415 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:48:20.866506 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:48:20.877517 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:48:20.888474 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:48:20.899507 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 18:48:21.016202 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 18:48:21.131458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:21.597438 run create_hlr_db(pid=14666): Launched 18:48:21.713423 bus /gobi_6: Setting Powered False 18:48:22.774252 run create_hlr_db(pid=14666): Terminated: ok {rc=0} 18:48:23.192790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14668): Launched 18:48:23.494068 run osmo-hlr_10.42.42.2(pid=14669): Launched 18:48:23.610483 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:24.127783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14671): Launched 18:48:24.428357 run osmo-stp_10.42.42.5(pid=14672): Launched 18:48:24.544078 run osmo-msc_10.42.42.6: Starting osmo-msc 18:48:25.084488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14674): Launched 18:48:25.385659 run osmo-msc_10.42.42.6(pid=14675): Launched 18:48:25.556029 run osmo-stp_10.42.42.5(pid=14672): ERR: Terminated: ERROR {rc=1} [trial-2380↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14672)] 18:48:25.682720 run osmo-stp_10.42.42.5(pid=14672): stdout: | (launched: 2022-12-12_18:48:24.372234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:25.808740 run osmo-stp_10.42.42.5(pid=14672): stderr: | [0;m[38;5;43m20221212184824540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184824541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184824541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184824541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184824542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184824542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184824542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:25.933228 run osmo-stp_10.42.42.5(pid=14672): stdout: | (launched: 2022-12-12_18:48:24.372234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:26.051837 run osmo-stp_10.42.42.5(pid=14672): stderr: | [0;m[38;5;43m20221212184824540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184824541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184824541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184824541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184824542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184824542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184824542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:26.194357 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14672): Process ended prematurely: osmo-stp_10.42.42.5(pid=14672) [trial-2380↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14672)] [trial-2380↪sms:nanobts+band-900↪mo_mt_sms.py:16] 18:48:26.202873 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 18:48:26.229403 run osmo-hlr_10.42.42.2(pid=14669): ERR: Terminated: ERROR {rc=237} [trial-2380↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14669)] 18:48:26.277723 run osmo-hlr_10.42.42.2(pid=14669): stdout: | (launched: 2022-12-12_18:48:23.437768) 18:48:26.327238 run osmo-hlr_10.42.42.2(pid=14669): stderr: | [0;m[1;31m20221212184823612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184823612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184823612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184823612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184823612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184823612 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184823625 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184823634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184823634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184823634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:26.396379 run osmo-msc_10.42.42.6(pid=14675): ERR: Terminated: ERROR {rc=2} [trial-2380↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14675)] 18:48:26.444210 run osmo-msc_10.42.42.6(pid=14675): stdout: | (launched: 2022-12-12_18:48:25.329454) 18:48:26.493602 run osmo-msc_10.42.42.6(pid=14675): stderr: | [0;m[38;5;43m20221212184825601 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184825601 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8ea95c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184825601 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184825601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184825601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184825601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184825603 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184825603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184825604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184825604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:48:26.543653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14668): Terminating (SIGTERM) 18:48:26.583578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14671): Terminating (SIGTERM) 18:48:26.623153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14674): Terminating (SIGTERM) 18:48:26.663629 --- ParallelTerminationStrategy: PID 14668 died... 18:48:26.682792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14668): Terminated: ok {rc=0} 18:48:26.727231 --- ParallelTerminationStrategy: PID 14671 died... 18:48:26.745806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14671): Terminated: ok {rc=0} 18:48:26.790255 --- ParallelTerminationStrategy: PID 14674 died... 18:48:26.808836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14674): Terminated: ok {rc=0} 18:48:26.896005 bus /sierra_3: Setting Powered False 18:48:27.996169 bus /sierra_3: Setting Powered False 18:48:29.111919 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 18:48:30.344279 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:48:30.349151 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:48:30.382071 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 18:48:30.388762 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 18:48:30.424383 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:48:30.456387 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 18:48:30.463027 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 18:48:30.997599 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2380 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 18:48:31.002735 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 18:48:31.014838 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 18:48:31.066486 tst assert_extension.py: using LAC 30780 18:48:31.211505 tst assert_extension.py: using RAC 180 18:48:31.369978 tst assert_extension.py: using CellId 30780 18:48:31.501065 tst assert_extension.py: using BVCI 30781 18:48:31.625136 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 18:48:31.744935 tst assert_extension.py:10: start nitb and bts... 18:48:31.967808 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:48:32.629159 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14681): Launched 18:48:32.951033 run osmo-nitb_10.42.42.2(pid=14682): Launched 18:48:33.130115 run osmo-nitb_10.42.42.2(pid=14682): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14682)] 18:48:33.272353 run osmo-nitb_10.42.42.2(pid=14682): stdout: | (launched: 2022-12-12_18:48:32.891012) 18:48:33.416309 run osmo-nitb_10.42.42.2(pid=14682): stderr: | (launched: 2022-12-12_18:48:32.938769) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:48:33.560774 run osmo-nitb_10.42.42.2(pid=14682): stdout: | (launched: 2022-12-12_18:48:32.891012) 18:48:33.699710 run osmo-nitb_10.42.42.2(pid=14682): stderr: | (launched: 2022-12-12_18:48:32.938769) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14682): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14682) [trial-2380↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14682)] 18:48:34.073851 tst osmo-nitb_10.42.42.2(pid=14682): stdout: | (launched: 2022-12-12_18:48:32.891012) 18:48:34.202587 tst osmo-nitb_10.42.42.2(pid=14682): stderr: | (launched: 2022-12-12_18:48:32.938769) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:48:34.355188 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14682): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14682) [trial-2380↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14682)] [trial-2380↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 18:48:34.364400 tst assert_extension.py:12: Test FAILED (3.4 sec) 18:48:34.371798 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14681): Terminating (SIGTERM) 18:48:34.582608 --- ParallelTerminationStrategy: PID 14681 died... 18:48:34.604573 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14681): Terminated: ok {rc=0} 18:48:34.692512 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 ussd:nanobts+band-900 --------------------------------------------------------------------- 18:48:35.873305 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:48:35.879355 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:48:35.913157 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 18:48:35.940544 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 18:48:35.978573 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:48:36.011662 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 18:48:36.038969 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 18:48:36.568880 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2380 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 18:48:36.574491 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:48:36.585823 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 18:48:36.633805 tst assert_extension.py: using LAC 30781 18:48:36.761144 tst assert_extension.py: using RAC 181 18:48:36.878470 tst assert_extension.py: using CellId 30781 18:48:36.996910 tst assert_extension.py: using BVCI 30782 18:48:37.113644 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:48:37.125208 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:48:37.136456 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:48:37.147906 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:48:37.159244 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:48:37.170351 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 18:48:37.285905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:37.750517 run create_hlr_db(pid=14686): Launched 18:48:37.867213 bus /sierra_2: Setting Powered False 18:48:38.928883 run create_hlr_db(pid=14686): Terminated: ok {rc=0} 18:48:39.375092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14688): Launched 18:48:39.699050 run osmo-hlr_10.42.42.2(pid=14689): Launched 18:48:39.823074 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:40.380176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14691): Launched 18:48:40.702330 run osmo-stp_10.42.42.5(pid=14692): Launched 18:48:40.826245 run osmo-msc_10.42.42.6: Starting osmo-msc 18:48:41.405632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14694): Launched 18:48:41.729175 run osmo-msc_10.42.42.6(pid=14695): Launched 18:48:41.908926 run osmo-stp_10.42.42.5(pid=14692): ERR: Terminated: ERROR {rc=1} [trial-2380↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14692)] 18:48:42.043913 run osmo-stp_10.42.42.5(pid=14692): stdout: | (launched: 2022-12-12_18:48:40.642500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:42.178831 run osmo-stp_10.42.42.5(pid=14692): stderr: | [0;m[38;5;43m20221212184840833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184840834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184840834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184840834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184840835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184840835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184840835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:42.312161 run osmo-stp_10.42.42.5(pid=14692): stdout: | (launched: 2022-12-12_18:48:40.642500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:42.439786 run osmo-stp_10.42.42.5(pid=14692): stderr: | [0;m[38;5;43m20221212184840833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184840834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184840834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184840834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184840835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184840835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184840835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:42.593033 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14692): Process ended prematurely: osmo-stp_10.42.42.5(pid=14692) [trial-2380↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14692)] [trial-2380↪ussd:nanobts+band-900↪assert_extension.py:17] 18:48:42.602259 tst assert_extension.py:17: Test FAILED (6.0 sec) 18:48:42.630087 run osmo-hlr_10.42.42.2(pid=14689): ERR: Terminated: ERROR {rc=237} [trial-2380↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14689)] 18:48:42.680608 run osmo-hlr_10.42.42.2(pid=14689): stdout: | (launched: 2022-12-12_18:48:39.638697) 18:48:42.732597 run osmo-hlr_10.42.42.2(pid=14689): stderr: | [0;m[1;31m20221212184839835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184839836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184839836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184839836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184839836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184839836 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184839848 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184839856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184839857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184839857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:42.805225 run osmo-msc_10.42.42.6(pid=14695): ERR: Terminated: ERROR {rc=2} [trial-2380↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14695)] 18:48:42.855477 run osmo-msc_10.42.42.6(pid=14695): stdout: | (launched: 2022-12-12_18:48:41.668928) 18:48:42.907478 run osmo-msc_10.42.42.6(pid=14695): stderr: | [0;m[38;5;43m20221212184841988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184841989 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb454bfcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184841989 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184841989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184841990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184841990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184841992 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184841992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184841992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184841992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:48:42.959830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14688): Terminating (SIGTERM) 18:48:43.001816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14691): Terminating (SIGTERM) 18:48:43.043985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14694): Terminating (SIGTERM) 18:48:43.086862 --- ParallelTerminationStrategy: PID 14688 died... 18:48:43.107293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14688): Terminated: ok {rc=0} 18:48:43.154548 --- ParallelTerminationStrategy: PID 14691 died... 18:48:43.174655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14691): Terminated: ok {rc=0} 18:48:43.221514 --- ParallelTerminationStrategy: PID 14694 died... 18:48:43.241553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14694): Terminated: ok {rc=0} 18:48:43.330661 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 18:48:44.548426 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:48:44.556486 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 18:48:44.591865 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 18:48:44.618366 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 18:48:44.671469 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 18:48:44.705823 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 18:48:44.733465 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 18:48:45.286900 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 18:48:45.339907 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:45.352012 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:48:45.419778 tst mo_mt_call.py: using LAC 30782 18:48:45.546338 tst mo_mt_call.py: using RAC 182 18:48:45.672216 tst mo_mt_call.py: using CellId 30782 18:48:45.798540 tst mo_mt_call.py: using BVCI 30783 18:48:45.919803 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:45.932501 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:45.944927 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:45.957727 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:45.970033 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:45.982584 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:48:46.118275 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:48:46.244179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:46.785079 run create_hlr_db(pid=14700): Launched 18:48:46.951514 bus /sierra_2: Setting Powered False 18:48:48.016835 run create_hlr_db(pid=14700): Terminated: ok {rc=0} 18:48:48.452634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14702): Launched 18:48:48.760171 run osmo-hlr_10.42.42.2(pid=14703): Launched 18:48:48.876152 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:49.400315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14705): Launched 18:48:49.708223 run osmo-stp_10.42.42.5(pid=14706): Launched 18:48:49.827438 run osmo-msc_10.42.42.6: Starting osmo-msc 18:48:50.382551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14708): Launched 18:48:50.690445 run osmo-msc_10.42.42.6(pid=14709): Launched 18:48:50.864083 run osmo-stp_10.42.42.5(pid=14706): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14706)] 18:48:50.992906 run osmo-stp_10.42.42.5(pid=14706): stdout: | (launched: 2022-12-12_18:48:49.650960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:51.122166 run osmo-stp_10.42.42.5(pid=14706): stderr: | [0;m[38;5;43m20221212184849821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184849821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184849822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184849822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184849823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184849823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184849823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:51.249164 run osmo-stp_10.42.42.5(pid=14706): stdout: | (launched: 2022-12-12_18:48:49.650960) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:48:51.370583 run osmo-stp_10.42.42.5(pid=14706): stderr: | [0;m[38;5;43m20221212184849821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184849821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184849822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184849822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184849823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184849823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184849823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:48:51.515919 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14706): Process ended prematurely: osmo-stp_10.42.42.5(pid=14706) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14706)] [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 18:48:51.525251 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 18:48:51.552391 run osmo-hlr_10.42.42.2(pid=14703): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14703)] 18:48:51.601089 run osmo-hlr_10.42.42.2(pid=14703): stdout: | (launched: 2022-12-12_18:48:48.702995) 18:48:51.650761 run osmo-hlr_10.42.42.2(pid=14703): stderr: | [0;m[1;31m20221212184848878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184848878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184848878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184848878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184848878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184848878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184848890 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184848899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184848900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184848900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:48:51.720340 run osmo-msc_10.42.42.6(pid=14709): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14709)] 18:48:51.768619 run osmo-msc_10.42.42.6(pid=14709): stdout: | (launched: 2022-12-12_18:48:50.632927) 18:48:51.818469 run osmo-msc_10.42.42.6(pid=14709): stderr: | [0;m[38;5;43m20221212184850902 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184850902 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb0cc5f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184850902 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184850902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184850902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184850902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184850904 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184850905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184850905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184850905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:48:51.868715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14702): Terminating (SIGTERM) 18:48:51.908926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14705): Terminating (SIGTERM) 18:48:51.949046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14708): Terminating (SIGTERM) 18:48:51.989671 --- ParallelTerminationStrategy: PID 14702 died... 18:48:52.008876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14702): Terminated: ok {rc=0} 18:48:52.053666 --- ParallelTerminationStrategy: PID 14705 died... 18:48:52.072564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14705): Terminated: ok {rc=0} 18:48:52.117422 --- ParallelTerminationStrategy: PID 14708 died... 18:48:52.136072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14708): Terminated: ok {rc=0} 18:48:52.222990 bus /sierra_3: Setting Powered False 18:48:53.323047 bus /sierra_3: Setting Powered False 18:48:54.440337 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 18:48:55.587988 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:55.600323 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 18:48:55.670951 tst mo_mt_call_osmux.py: using LAC 30783 18:48:55.788573 tst mo_mt_call_osmux.py: using RAC 183 18:48:55.906603 tst mo_mt_call_osmux.py: using CellId 30783 18:48:56.026129 tst mo_mt_call_osmux.py: using BVCI 30784 18:48:56.138808 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:56.150174 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:56.161567 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:56.172938 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:56.184427 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 18:48:56.195889 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:48:56.314084 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 18:48:56.435640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:48:56.943111 run create_hlr_db(pid=14711): Launched 18:48:57.077874 bus /sierra_2: Setting Powered False 18:48:58.143108 run create_hlr_db(pid=14711): Terminated: ok {rc=0} 18:48:58.580404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14713): Launched 18:48:58.887962 run osmo-hlr_10.42.42.2(pid=14714): Launched 18:48:59.006942 run osmo-stp_10.42.42.5: Starting osmo-stp 18:48:59.534470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14716): Launched 18:48:59.843848 run osmo-stp_10.42.42.5(pid=14717): Launched 18:48:59.963338 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:00.517313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14719): Launched 18:49:00.825514 run osmo-msc_10.42.42.6(pid=14720): Launched 18:49:01.177548 run osmo-stp_10.42.42.5(pid=14717): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14717)] 18:49:01.446245 run osmo-stp_10.42.42.5(pid=14717): stdout: | (launched: 2022-12-12_18:48:59.785924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:01.635510 run osmo-stp_10.42.42.5(pid=14717): stderr: | [0;m[38;5;43m20221212184859954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184859955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184859955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184859955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184859956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184859956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184859956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:01.768132 run osmo-stp_10.42.42.5(pid=14717): stdout: | (launched: 2022-12-12_18:48:59.785924) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:01.893819 run osmo-stp_10.42.42.5(pid=14717): stderr: | [0;m[38;5;43m20221212184859954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184859955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184859955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184859955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184859956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184859956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184859956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:02.043798 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14717): Process ended prematurely: osmo-stp_10.42.42.5(pid=14717) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14717)] [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 18:49:02.053367 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:49:02.082752 run osmo-hlr_10.42.42.2(pid=14714): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14714)] 18:49:02.132390 run osmo-hlr_10.42.42.2(pid=14714): stdout: | (launched: 2022-12-12_18:48:58.830975) 18:49:02.183362 run osmo-hlr_10.42.42.2(pid=14714): stderr: | [0;m[1;31m20221212184859005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184859005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184859005 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184859006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184859006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184859006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184859018 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184859026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184859026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184859026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:02.255058 run osmo-msc_10.42.42.6(pid=14720): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14720)] 18:49:02.304690 run osmo-msc_10.42.42.6(pid=14720): stdout: | (launched: 2022-12-12_18:49:00.768242) 18:49:02.356037 run osmo-msc_10.42.42.6(pid=14720): stderr: | [0;m[38;5;43m20221212184901170 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184901170 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbf264adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184901171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184901171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184901171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184901171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184901175 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184901176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184901176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184901176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:02.408473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14713): Terminating (SIGTERM) 18:49:02.449638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14716): Terminating (SIGTERM) 18:49:02.490767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14719): Terminating (SIGTERM) 18:49:02.532034 --- ParallelTerminationStrategy: PID 14713 died... 18:49:02.551597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14713): Terminated: ok {rc=0} 18:49:02.597508 --- ParallelTerminationStrategy: PID 14716 died... 18:49:02.616346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14716): Terminated: ok {rc=0} 18:49:02.662391 --- ParallelTerminationStrategy: PID 14719 died... 18:49:02.681712 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14719): Terminated: ok {rc=0} 18:49:02.771012 bus /sierra_3: Setting Powered False 18:49:03.872357 bus /sierra_3: Setting Powered False 18:49:04.989705 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 18:49:06.246140 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:49:06.255731 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 18:49:06.289332 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 18:49:06.317172 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 18:49:06.371275 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 18:49:06.404286 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 18:49:06.431573 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 18:49:06.985737 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 18:49:07.037797 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:07.049677 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:49:07.118442 tst mo_mt_call.py: using LAC 30784 18:49:07.246427 tst mo_mt_call.py: using RAC 184 18:49:07.374746 tst mo_mt_call.py: using CellId 30784 18:49:07.503409 tst mo_mt_call.py: using BVCI 30785 18:49:07.623163 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:07.635001 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:07.646584 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:07.658180 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:07.669890 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:07.681539 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:49:07.798983 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:49:07.916132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:08.387890 run create_hlr_db(pid=14725): Launched 18:49:08.504855 bus /sierra_2: Setting Powered False 18:49:09.566475 run create_hlr_db(pid=14725): Terminated: ok {rc=0} 18:49:10.013155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14727): Launched 18:49:10.342553 run osmo-hlr_10.42.42.2(pid=14728): Launched 18:49:10.470043 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:11.033229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14730): Launched 18:49:11.361762 run osmo-stp_10.42.42.5(pid=14731): Launched 18:49:11.485477 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:12.076881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14733): Launched 18:49:12.405862 run osmo-msc_10.42.42.6(pid=14734): Launched 18:49:12.589847 run osmo-stp_10.42.42.5(pid=14731): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14731)] 18:49:12.725890 run osmo-stp_10.42.42.5(pid=14731): stdout: | (launched: 2022-12-12_18:49:11.301196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:12.862338 run osmo-stp_10.42.42.5(pid=14731): stderr: | [0;m[38;5;43m20221212184911492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184911493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184911493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184911493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184911494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184911494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184911494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:12.997618 run osmo-stp_10.42.42.5(pid=14731): stdout: | (launched: 2022-12-12_18:49:11.301196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:13.126800 run osmo-stp_10.42.42.5(pid=14731): stderr: | [0;m[38;5;43m20221212184911492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184911493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184911493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184911493 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184911494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184911494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184911494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:13.281683 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14731): Process ended prematurely: osmo-stp_10.42.42.5(pid=14731) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14731)] [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 18:49:13.291683 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:49:13.319835 run osmo-hlr_10.42.42.2(pid=14728): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14728)] 18:49:13.370126 run osmo-hlr_10.42.42.2(pid=14728): stdout: | (launched: 2022-12-12_18:49:10.281815) 18:49:13.421848 run osmo-hlr_10.42.42.2(pid=14728): stderr: | [0;m[1;31m20221212184910478 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184910479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184910479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184910479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184910479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184910479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184910491 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184910499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184910500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184910500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:13.494210 run osmo-msc_10.42.42.6(pid=14734): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14734)] 18:49:13.544862 run osmo-msc_10.42.42.6(pid=14734): stdout: | (launched: 2022-12-12_18:49:12.345232) 18:49:13.596926 run osmo-msc_10.42.42.6(pid=14734): stderr: | [0;m[38;5;43m20221212184912669 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184912670 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f063e398c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184912670 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184912670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184912670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184912670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184912672 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184912672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184912672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184912672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:13.649184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14727): Terminating (SIGTERM) 18:49:13.690990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14730): Terminating (SIGTERM) 18:49:13.732880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14733): Terminating (SIGTERM) 18:49:13.775411 --- ParallelTerminationStrategy: PID 14727 died... 18:49:13.795620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14727): Terminated: ok {rc=0} 18:49:13.842334 --- ParallelTerminationStrategy: PID 14730 died... 18:49:13.862054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14730): Terminated: ok {rc=0} 18:49:13.908503 --- ParallelTerminationStrategy: PID 14733 died... 18:49:13.928444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14733): Terminated: ok {rc=0} 18:49:14.017980 bus /sierra_3: Setting Powered False 18:49:15.117864 bus /sierra_3: Setting Powered False 18:49:16.233893 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 18:49:17.385718 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:17.398191 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 18:49:17.472182 tst mo_mt_call_osmux.py: using LAC 30785 18:49:17.599922 tst mo_mt_call_osmux.py: using RAC 185 18:49:17.731655 tst mo_mt_call_osmux.py: using CellId 30785 18:49:17.858445 tst mo_mt_call_osmux.py: using BVCI 30786 18:49:17.970810 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:17.982535 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:17.993727 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:18.005318 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:18.017050 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 18:49:18.028493 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:49:18.149519 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 18:49:18.269667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:18.776468 run create_hlr_db(pid=14736): Launched 18:49:18.910967 bus /sierra_2: Setting Powered False 18:49:19.975711 run create_hlr_db(pid=14736): Terminated: ok {rc=0} 18:49:20.413537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14738): Launched 18:49:20.722050 run osmo-hlr_10.42.42.2(pid=14739): Launched 18:49:20.840529 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:21.365728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14741): Launched 18:49:21.673168 run osmo-stp_10.42.42.5(pid=14742): Launched 18:49:21.790526 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:22.342992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14744): Launched 18:49:22.651573 run osmo-msc_10.42.42.6(pid=14745): Launched 18:49:22.824168 run osmo-stp_10.42.42.5(pid=14742): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14742)] 18:49:22.953493 run osmo-stp_10.42.42.5(pid=14742): stdout: | (launched: 2022-12-12_18:49:21.616102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:23.082212 run osmo-stp_10.42.42.5(pid=14742): stderr: | [0;m[38;5;43m20221212184921785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184921785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184921785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184921786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184921786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184921786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184921786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:23.208791 run osmo-stp_10.42.42.5(pid=14742): stdout: | (launched: 2022-12-12_18:49:21.616102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:23.330374 run osmo-stp_10.42.42.5(pid=14742): stderr: | [0;m[38;5;43m20221212184921785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184921785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184921785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184921786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184921786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184921786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184921786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:23.476107 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14742): Process ended prematurely: osmo-stp_10.42.42.5(pid=14742) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14742)] [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 18:49:23.485250 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:49:23.512424 run osmo-hlr_10.42.42.2(pid=14739): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14739)] 18:49:23.561210 run osmo-hlr_10.42.42.2(pid=14739): stdout: | (launched: 2022-12-12_18:49:20.665075) 18:49:23.611024 run osmo-hlr_10.42.42.2(pid=14739): stderr: | [0;m[1;31m20221212184920838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184920838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184920838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184920838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184920838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184920838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184920850 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184920858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184920858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184920858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:23.680450 run osmo-msc_10.42.42.6(pid=14745): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14745)] 18:49:23.728216 run osmo-msc_10.42.42.6(pid=14745): stdout: | (launched: 2022-12-12_18:49:22.594516) 18:49:23.777721 run osmo-msc_10.42.42.6(pid=14745): stderr: | [0;m[38;5;43m20221212184922866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184922867 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb57b4c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184922867 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184922867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184922867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184922867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184922869 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184922869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184922869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184922870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:23.827690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14738): Terminating (SIGTERM) 18:49:23.867494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14741): Terminating (SIGTERM) 18:49:23.907229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14744): Terminating (SIGTERM) 18:49:23.947323 --- ParallelTerminationStrategy: PID 14738 died... 18:49:23.966449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14738): Terminated: ok {rc=0} 18:49:24.011216 --- ParallelTerminationStrategy: PID 14741 died... 18:49:24.029954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14741): Terminated: ok {rc=0} 18:49:24.074439 --- ParallelTerminationStrategy: PID 14744 died... 18:49:24.093034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14744): Terminated: ok {rc=0} 18:49:24.177486 bus /sierra_3: Setting Powered False 18:49:25.275675 bus /sierra_3: Setting Powered False 18:49:26.393669 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 18:49:27.649156 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:49:27.657901 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 18:49:27.691130 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 18:49:27.718875 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 18:49:27.772408 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 18:49:27.805734 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 18:49:27.833493 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 18:49:28.386809 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 18:49:28.439181 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:49:28.450922 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:49:28.519526 tst mo_mt_call.py: using LAC 30786 18:49:28.647627 tst mo_mt_call.py: using RAC 186 18:49:28.776424 tst mo_mt_call.py: using CellId 30786 18:49:28.904681 tst mo_mt_call.py: using BVCI 30787 18:49:29.015780 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:49:29.027325 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:49:29.038668 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:49:29.050272 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:49:29.061973 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:49:29.073396 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:49:29.189286 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:49:29.308924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:29.815202 run create_hlr_db(pid=14750): Launched 18:49:29.949797 bus /sierra_2: Setting Powered False 18:49:31.013373 run create_hlr_db(pid=14750): Terminated: ok {rc=0} 18:49:31.475837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14752): Launched 18:49:31.819231 run osmo-hlr_10.42.42.2(pid=14753): Launched 18:49:32.064029 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:32.601348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14755): Launched 18:49:32.910100 run osmo-stp_10.42.42.5(pid=14756): Launched 18:49:33.029346 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:33.580089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14758): Launched 18:49:33.888772 run osmo-msc_10.42.42.6(pid=14759): Launched 18:49:34.062000 run osmo-stp_10.42.42.5(pid=14756): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14756)] 18:49:34.191179 run osmo-stp_10.42.42.5(pid=14756): stdout: | (launched: 2022-12-12_18:49:32.852780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:34.319746 run osmo-stp_10.42.42.5(pid=14756): stderr: | [0;m[38;5;43m20221212184933022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184933022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184933022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184933023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184933023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184933023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184933023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:34.448872 run osmo-stp_10.42.42.5(pid=14756): stdout: | (launched: 2022-12-12_18:49:32.852780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:34.570859 run osmo-stp_10.42.42.5(pid=14756): stderr: | [0;m[38;5;43m20221212184933022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184933022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184933022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184933023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184933023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184933023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184933023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:34.716379 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14756): Process ended prematurely: osmo-stp_10.42.42.5(pid=14756) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14756)] [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 18:49:34.725461 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:49:34.752621 run osmo-hlr_10.42.42.2(pid=14753): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14753)] 18:49:34.801192 run osmo-hlr_10.42.42.2(pid=14753): stdout: | (launched: 2022-12-12_18:49:31.758533) 18:49:34.851115 run osmo-hlr_10.42.42.2(pid=14753): stderr: | [0;m[1;31m20221212184932066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184932066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184932066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184932066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184932066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184932066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184932078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184932086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184932086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184932086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:34.921194 run osmo-msc_10.42.42.6(pid=14759): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14759)] 18:49:34.969471 run osmo-msc_10.42.42.6(pid=14759): stdout: | (launched: 2022-12-12_18:49:33.831539) 18:49:35.019225 run osmo-msc_10.42.42.6(pid=14759): stderr: | [0;m[38;5;43m20221212184934102 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184934102 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1510f96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184934103 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184934103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184934103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184934103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184934105 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184934105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184934105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184934106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:35.069820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14752): Terminating (SIGTERM) 18:49:35.109527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14755): Terminating (SIGTERM) 18:49:35.149326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14758): Terminating (SIGTERM) 18:49:35.189698 --- ParallelTerminationStrategy: PID 14752 died... 18:49:35.208664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14752): Terminated: ok {rc=0} 18:49:35.253306 --- ParallelTerminationStrategy: PID 14755 died... 18:49:35.271954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14755): Terminated: ok {rc=0} 18:49:35.316358 --- ParallelTerminationStrategy: PID 14758 died... 18:49:35.334985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14758): Terminated: ok {rc=0} 18:49:35.422226 bus /sierra_3: Setting Powered False 18:49:36.521930 bus /sierra_3: Setting Powered False 18:49:37.640121 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 18:49:38.786468 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:49:38.798537 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 18:49:38.865930 tst mo_mt_call_osmux.py: using LAC 30787 18:49:38.987231 tst mo_mt_call_osmux.py: using RAC 187 18:49:39.109107 tst mo_mt_call_osmux.py: using CellId 30787 18:49:39.237513 tst mo_mt_call_osmux.py: using BVCI 30788 18:49:39.357012 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:49:39.369051 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:49:39.380872 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:49:39.393559 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:49:39.406610 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 18:49:39.418278 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:49:39.536552 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 18:49:39.660452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:40.149389 run create_hlr_db(pid=14762): Launched 18:49:40.283869 bus /sierra_2: Setting Powered False 18:49:41.348184 run create_hlr_db(pid=14762): Terminated: ok {rc=0} 18:49:41.784511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14764): Launched 18:49:42.093611 run osmo-hlr_10.42.42.2(pid=14765): Launched 18:49:42.211466 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:42.747857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14767): Launched 18:49:43.055996 run osmo-stp_10.42.42.5(pid=14768): Launched 18:49:43.173489 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:43.725842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14770): Launched 18:49:44.033700 run osmo-msc_10.42.42.6(pid=14771): Launched 18:49:44.206726 run osmo-stp_10.42.42.5(pid=14768): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14768)] 18:49:44.336511 run osmo-stp_10.42.42.5(pid=14768): stdout: | (launched: 2022-12-12_18:49:42.999070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:44.466342 run osmo-stp_10.42.42.5(pid=14768): stderr: | [0;m[38;5;43m20221212184943169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184943169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184943169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184943170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184943170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184943170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184943170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:44.593737 run osmo-stp_10.42.42.5(pid=14768): stdout: | (launched: 2022-12-12_18:49:42.999070) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:44.715989 run osmo-stp_10.42.42.5(pid=14768): stderr: | [0;m[38;5;43m20221212184943169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184943169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184943169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184943170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184943170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184943170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184943170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:44.861969 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14768): Process ended prematurely: osmo-stp_10.42.42.5(pid=14768) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14768)] [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 18:49:44.871014 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 18:49:44.897810 run osmo-hlr_10.42.42.2(pid=14765): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14765)] 18:49:44.946088 run osmo-hlr_10.42.42.2(pid=14765): stdout: | (launched: 2022-12-12_18:49:42.036341) 18:49:44.995587 run osmo-hlr_10.42.42.2(pid=14765): stderr: | [0;m[1;31m20221212184942213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184942213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184942213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184942213 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184942214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184942214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184942226 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184942235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184942235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184942235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:45.064637 run osmo-msc_10.42.42.6(pid=14771): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14771)] 18:49:45.112403 run osmo-msc_10.42.42.6(pid=14771): stdout: | (launched: 2022-12-12_18:49:43.976342) 18:49:45.161961 run osmo-msc_10.42.42.6(pid=14771): stderr: | [0;m[38;5;43m20221212184944246 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184944246 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd83b7fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184944246 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184944246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184944246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184944246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184944248 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184944249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184944249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184944249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:45.212100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14764): Terminating (SIGTERM) 18:49:45.252293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14767): Terminating (SIGTERM) 18:49:45.292313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14770): Terminating (SIGTERM) 18:49:45.332509 --- ParallelTerminationStrategy: PID 14764 died... 18:49:45.351472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14764): Terminated: ok {rc=0} 18:49:45.396448 --- ParallelTerminationStrategy: PID 14767 died... 18:49:45.414884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14767): Terminated: ok {rc=0} 18:49:45.459712 --- ParallelTerminationStrategy: PID 14770 died... 18:49:45.478244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14770): Terminated: ok {rc=0} 18:49:45.564763 bus /sierra_3: Setting Powered False 18:49:46.675602 bus /sierra_3: Setting Powered False 18:49:47.806191 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 18:49:49.057591 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:49:49.064933 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 18:49:49.097834 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 18:49:49.124161 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 18:49:49.178662 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 18:49:49.211015 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 18:49:49.237208 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 18:49:49.788272 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 18:49:49.837562 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:49.848721 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:49:49.915168 tst mo_mt_call.py: using LAC 30788 18:49:50.034123 tst mo_mt_call.py: using RAC 188 18:49:50.154894 tst mo_mt_call.py: using CellId 30788 18:49:50.274170 tst mo_mt_call.py: using BVCI 30789 18:49:50.384145 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:50.395388 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:50.406598 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:50.418077 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:50.429587 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:49:50.440872 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:49:50.559082 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:49:50.681063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:49:51.184527 run create_hlr_db(pid=14776): Launched 18:49:51.318409 bus /sierra_2: Setting Powered False 18:49:52.382822 run create_hlr_db(pid=14776): Terminated: ok {rc=0} 18:49:52.835363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14778): Launched 18:49:53.163478 run osmo-hlr_10.42.42.2(pid=14779): Launched 18:49:53.289302 run osmo-stp_10.42.42.5: Starting osmo-stp 18:49:53.849735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14781): Launched 18:49:54.177900 run osmo-stp_10.42.42.5(pid=14782): Launched 18:49:54.302983 run osmo-msc_10.42.42.6: Starting osmo-msc 18:49:54.893139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14784): Launched 18:49:55.221414 run osmo-msc_10.42.42.6(pid=14785): Launched 18:49:55.403624 run osmo-stp_10.42.42.5(pid=14782): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14782)] 18:49:55.540942 run osmo-stp_10.42.42.5(pid=14782): stdout: | (launched: 2022-12-12_18:49:54.117251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:55.678327 run osmo-stp_10.42.42.5(pid=14782): stderr: | [0;m[38;5;43m20221212184954309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184954309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184954310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184954310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184954310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184954310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184954311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:55.813487 run osmo-stp_10.42.42.5(pid=14782): stdout: | (launched: 2022-12-12_18:49:54.117251) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:49:55.942989 run osmo-stp_10.42.42.5(pid=14782): stderr: | [0;m[38;5;43m20221212184954309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212184954309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212184954310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212184954310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212184954310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212184954310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212184954311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:49:56.097989 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14782): Process ended prematurely: osmo-stp_10.42.42.5(pid=14782) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14782)] [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 18:49:56.107881 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:49:56.135859 run osmo-hlr_10.42.42.2(pid=14779): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14779)] 18:49:56.185986 run osmo-hlr_10.42.42.2(pid=14779): stdout: | (launched: 2022-12-12_18:49:53.102976) 18:49:56.237747 run osmo-hlr_10.42.42.2(pid=14779): stderr: | [0;m[1;31m20221212184953299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212184953299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212184953299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212184953299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212184953300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212184953300 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212184953319 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212184953328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212184953329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212184953329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:49:56.310262 run osmo-msc_10.42.42.6(pid=14785): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14785)] 18:49:56.360075 run osmo-msc_10.42.42.6(pid=14785): stdout: | (launched: 2022-12-12_18:49:55.160600) 18:49:56.411474 run osmo-msc_10.42.42.6(pid=14785): stderr: | [0;m[38;5;43m20221212184955482 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212184955482 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3ef4696c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212184955482 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212184955482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212184955482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212184955483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212184955484 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212184955485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212184955485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212184955485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:49:56.463249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14778): Terminating (SIGTERM) 18:49:56.505063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14781): Terminating (SIGTERM) 18:49:56.546920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14784): Terminating (SIGTERM) 18:49:56.589646 --- ParallelTerminationStrategy: PID 14778 died... 18:49:56.609832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14778): Terminated: ok {rc=0} 18:49:56.656160 --- ParallelTerminationStrategy: PID 14781 died... 18:49:56.675973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14781): Terminated: ok {rc=0} 18:49:56.721938 --- ParallelTerminationStrategy: PID 14784 died... 18:49:56.741645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14784): Terminated: ok {rc=0} 18:49:56.830497 bus /sierra_3: Setting Powered False 18:49:57.930810 bus /sierra_3: Setting Powered False 18:49:59.048046 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 18:50:00.197637 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:00.210215 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 18:50:00.280011 tst mo_mt_call_osmux.py: using LAC 30789 18:50:00.407908 tst mo_mt_call_osmux.py: using RAC 189 18:50:00.535628 tst mo_mt_call_osmux.py: using CellId 30789 18:50:00.663165 tst mo_mt_call_osmux.py: using BVCI 30790 18:50:00.780541 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:00.792363 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:00.804047 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:00.816238 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:00.828156 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 18:50:00.854685 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:50:00.992812 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 18:50:01.122332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:01.697053 run create_hlr_db(pid=14791): Launched 18:50:01.852569 bus /sierra_2: Setting Powered False 18:50:02.914010 run create_hlr_db(pid=14791): Terminated: ok {rc=0} 18:50:03.361747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14799): Launched 18:50:03.692212 run osmo-hlr_10.42.42.2(pid=14800): Launched 18:50:03.818189 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:04.390160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14802): Launched 18:50:04.719930 run osmo-stp_10.42.42.5(pid=14803): Launched 18:50:04.846082 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:05.436176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14805): Launched 18:50:05.765911 run osmo-msc_10.42.42.6(pid=14806): Launched 18:50:05.947638 run osmo-stp_10.42.42.5(pid=14803): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14803)] 18:50:06.084038 run osmo-stp_10.42.42.5(pid=14803): stdout: | (launched: 2022-12-12_18:50:04.659239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:06.221208 run osmo-stp_10.42.42.5(pid=14803): stderr: | [0;m[38;5;43m20221212185004851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185004851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185004851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185004852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185004852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185004852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185004853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:06.357227 run osmo-stp_10.42.42.5(pid=14803): stdout: | (launched: 2022-12-12_18:50:04.659239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:06.487512 run osmo-stp_10.42.42.5(pid=14803): stderr: | [0;m[38;5;43m20221212185004851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185004851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185004851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185004852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185004852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185004852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185004853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:06.643499 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14803): Process ended prematurely: osmo-stp_10.42.42.5(pid=14803) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14803)] [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 18:50:06.653681 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 18:50:06.682148 run osmo-hlr_10.42.42.2(pid=14800): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14800)] 18:50:06.732732 run osmo-hlr_10.42.42.2(pid=14800): stdout: | (launched: 2022-12-12_18:50:03.631469) 18:50:06.785142 run osmo-hlr_10.42.42.2(pid=14800): stderr: | [0;m[1;31m20221212185003830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185003830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185003830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185003830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185003830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185003830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185003844 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185003853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185003853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185003853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:06.857677 run osmo-msc_10.42.42.6(pid=14806): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14806)] 18:50:06.907790 run osmo-msc_10.42.42.6(pid=14806): stdout: | (launched: 2022-12-12_18:50:05.705277) 18:50:06.959321 run osmo-msc_10.42.42.6(pid=14806): stderr: | [0;m[38;5;43m20221212185006027 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185006027 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fea8f9e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185006027 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185006027 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185006028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185006028 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185006030 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185006030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185006030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185006030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:07.011294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14799): Terminating (SIGTERM) 18:50:07.053321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14802): Terminating (SIGTERM) 18:50:07.095567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14805): Terminating (SIGTERM) 18:50:07.138023 --- ParallelTerminationStrategy: PID 14799 died... 18:50:07.158190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14799): Terminated: ok {rc=0} 18:50:07.204865 --- ParallelTerminationStrategy: PID 14802 died... 18:50:07.225056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14802): Terminated: ok {rc=0} 18:50:07.271402 --- ParallelTerminationStrategy: PID 14805 died... 18:50:07.291196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14805): Terminated: ok {rc=0} 18:50:07.380186 bus /sierra_3: Setting Powered False 18:50:08.480783 bus /sierra_3: Setting Powered False 18:50:09.597531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 18:50:10.850519 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:50:10.858247 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:50:10.891732 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 18:50:10.918178 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:50:10.973453 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:50:11.006515 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 18:50:11.033341 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:50:11.582326 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 18:50:11.631681 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:50:11.643062 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:50:11.709962 tst mo_mt_call.py: using LAC 30790 18:50:11.828820 tst mo_mt_call.py: using RAC 190 18:50:11.947476 tst mo_mt_call.py: using CellId 30790 18:50:12.067634 tst mo_mt_call.py: using BVCI 30791 18:50:12.177609 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:50:12.188899 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:50:12.200241 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:50:12.211751 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:50:12.223264 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:50:12.234649 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:50:12.351626 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:50:12.476362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:12.962662 run create_hlr_db(pid=14871): Launched 18:50:13.129074 bus /sierra_2: Setting Powered False 18:50:14.193277 run create_hlr_db(pid=14871): Terminated: ok {rc=0} 18:50:14.628173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15164): Launched 18:50:14.935031 run osmo-hlr_10.42.42.2(pid=15165): Launched 18:50:15.052874 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:15.577237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15167): Launched 18:50:15.901792 run osmo-stp_10.42.42.5(pid=15168): Launched 18:50:16.080644 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:16.679777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15170): Launched 18:50:17.009697 run osmo-msc_10.42.42.6(pid=15171): Launched 18:50:17.316442 run osmo-stp_10.42.42.5(pid=15168): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15168)] 18:50:17.485601 run osmo-stp_10.42.42.5(pid=15168): stdout: | (launched: 2022-12-12_18:50:15.828219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:17.626427 run osmo-stp_10.42.42.5(pid=15168): stderr: | [0;m[38;5;43m20221212185016160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185016160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185016160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185016161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185016164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185016164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185016164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:17.762642 run osmo-stp_10.42.42.5(pid=15168): stdout: | (launched: 2022-12-12_18:50:15.828219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:17.892085 run osmo-stp_10.42.42.5(pid=15168): stderr: | [0;m[38;5;43m20221212185016160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185016160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185016160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185016161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185016164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185016164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185016164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:18.047209 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15168): Process ended prematurely: osmo-stp_10.42.42.5(pid=15168) [trial-2380↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15168)] [trial-2380↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 18:50:18.057223 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 18:50:18.085250 run osmo-hlr_10.42.42.2(pid=15165): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15165)] 18:50:18.135783 run osmo-hlr_10.42.42.2(pid=15165): stdout: | (launched: 2022-12-12_18:50:14.877929) 18:50:18.187516 run osmo-hlr_10.42.42.2(pid=15165): stderr: | [0;m[1;31m20221212185015051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185015051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185015051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185015051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185015051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185015051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185015085 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185015094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185015095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185015095 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:18.259820 run osmo-msc_10.42.42.6(pid=15171): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15171)] 18:50:18.309753 run osmo-msc_10.42.42.6(pid=15171): stdout: | (launched: 2022-12-12_18:50:16.947242) 18:50:18.361485 run osmo-msc_10.42.42.6(pid=15171): stderr: | [0;m[38;5;43m20221212185017444 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185017444 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa306417c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185017444 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185017444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185017444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185017444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185017446 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185017447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185017447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185017447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:18.413863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15164): Terminating (SIGTERM) 18:50:18.456267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15167): Terminating (SIGTERM) 18:50:18.498453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15170): Terminating (SIGTERM) 18:50:18.541289 --- ParallelTerminationStrategy: PID 15164 died... 18:50:18.561583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15164): Terminated: ok {rc=0} 18:50:18.609070 --- ParallelTerminationStrategy: PID 15167 died... 18:50:18.629225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15167): Terminated: ok {rc=0} 18:50:18.675726 --- ParallelTerminationStrategy: PID 15170 died... 18:50:18.695579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15170): Terminated: ok {rc=0} 18:50:18.783791 bus /sierra_3: Setting Powered False 18:50:19.884829 bus /sierra_3: Setting Powered False 18:50:21.001852 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 18:50:22.152172 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:50:22.165101 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:50:22.235858 tst mo_mt_call_osmux.py: using LAC 30791 18:50:22.363094 tst mo_mt_call_osmux.py: using RAC 191 18:50:22.490689 tst mo_mt_call_osmux.py: using CellId 30791 18:50:22.611840 tst mo_mt_call_osmux.py: using BVCI 30792 18:50:22.725513 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:50:22.736906 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:50:22.748855 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:50:22.761040 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:50:22.773756 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 18:50:22.786716 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:50:22.909363 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:50:23.030053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:23.554101 run create_hlr_db(pid=15270): Launched 18:50:23.714877 bus /sierra_2: Setting Powered False 18:50:24.781539 run create_hlr_db(pid=15270): Terminated: ok {rc=0} 18:50:25.243666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15350): Launched 18:50:25.587792 run osmo-hlr_10.42.42.2(pid=15351): Launched 18:50:25.841859 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:26.499383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15353): Launched 18:50:26.846624 run osmo-stp_10.42.42.5(pid=15354): Launched 18:50:27.093875 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:27.773614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15356): Launched 18:50:28.099500 run osmo-msc_10.42.42.6(pid=15357): Launched 18:50:28.451971 run osmo-stp_10.42.42.5(pid=15354): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15354)] 18:50:28.751199 run osmo-stp_10.42.42.5(pid=15354): stdout: | (launched: 2022-12-12_18:50:26.784736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:28.928097 run osmo-stp_10.42.42.5(pid=15354): stderr: | [0;m[38;5;43m20221212185027077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185027077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185027078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185027078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185027078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185027079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185027079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:29.055074 run osmo-stp_10.42.42.5(pid=15354): stdout: | (launched: 2022-12-12_18:50:26.784736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:29.176646 run osmo-stp_10.42.42.5(pid=15354): stderr: | [0;m[38;5;43m20221212185027077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185027077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185027078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185027078 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185027078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185027079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185027079 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:29.322597 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15354): Process ended prematurely: osmo-stp_10.42.42.5(pid=15354) [trial-2380↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15354)] [trial-2380↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 18:50:29.331793 tst mo_mt_call_osmux.py:8: Test FAILED (7.2 sec) 18:50:29.359314 run osmo-hlr_10.42.42.2(pid=15351): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15351)] 18:50:29.408182 run osmo-hlr_10.42.42.2(pid=15351): stdout: | (launched: 2022-12-12_18:50:25.526846) 18:50:29.457917 run osmo-hlr_10.42.42.2(pid=15351): stderr: | [0;m[1;31m20221212185025832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185025832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185025832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185025833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185025833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185025833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185025851 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185025865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185025865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185025865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:29.527444 run osmo-msc_10.42.42.6(pid=15357): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15357)] 18:50:29.575755 run osmo-msc_10.42.42.6(pid=15357): stdout: | (launched: 2022-12-12_18:50:28.039963) 18:50:29.625650 run osmo-msc_10.42.42.6(pid=15357): stderr: | [0;m[38;5;43m20221212185028646 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185028646 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61fd1d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185028646 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185028646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185028646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185028646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185028648 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185028657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185028657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185028657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:29.675980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15350): Terminating (SIGTERM) 18:50:29.716554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15353): Terminating (SIGTERM) 18:50:29.756550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15356): Terminating (SIGTERM) 18:50:29.798206 --- ParallelTerminationStrategy: PID 15350 died... 18:50:29.817595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15350): Terminated: ok {rc=0} 18:50:29.862579 --- ParallelTerminationStrategy: PID 15353 died... 18:50:29.881491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15353): Terminated: ok {rc=0} 18:50:29.926317 --- ParallelTerminationStrategy: PID 15356 died... 18:50:29.945283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15356): Terminated: ok {rc=0} 18:50:30.032119 bus /sierra_3: Setting Powered False 18:50:31.145443 bus /sierra_3: Setting Powered False 18:50:32.273315 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 18:50:33.528908 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:50:33.536611 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 18:50:33.572416 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 18:50:33.599329 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 18:50:33.651882 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 18:50:33.684579 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 18:50:33.711552 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 18:50:34.269781 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 18:50:34.323902 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:50:34.335892 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:50:34.389816 tst mo_mt_call.py: using LAC 30792 18:50:34.511933 tst mo_mt_call.py: using RAC 192 18:50:34.630682 tst mo_mt_call.py: using CellId 30792 18:50:34.748173 tst mo_mt_call.py: using BVCI 30793 18:50:34.858672 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:50:34.870275 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:50:34.881579 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:50:34.893198 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:50:34.904768 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:50:34.916364 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:50:35.037425 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:50:35.156602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:35.631948 run create_hlr_db(pid=15363): Launched 18:50:35.751405 bus /sierra_2: Setting Powered False 18:50:36.812340 run create_hlr_db(pid=15363): Terminated: ok {rc=0} 18:50:37.259987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15365): Launched 18:50:37.590788 run osmo-hlr_10.42.42.2(pid=15366): Launched 18:50:37.717492 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:38.277866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15368): Launched 18:50:38.608075 run osmo-stp_10.42.42.5(pid=15369): Launched 18:50:38.733813 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:39.324284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15371): Launched 18:50:39.655009 run osmo-msc_10.42.42.6(pid=15372): Launched 18:50:39.838264 run osmo-stp_10.42.42.5(pid=15369): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15369)] 18:50:39.976171 run osmo-stp_10.42.42.5(pid=15369): stdout: | (launched: 2022-12-12_18:50:38.546822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:40.113421 run osmo-stp_10.42.42.5(pid=15369): stderr: | [0;m[38;5;43m20221212185038742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185038742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185038742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185038742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185038743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185038743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185038743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:40.249038 run osmo-stp_10.42.42.5(pid=15369): stdout: | (launched: 2022-12-12_18:50:38.546822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:40.378847 run osmo-stp_10.42.42.5(pid=15369): stderr: | [0;m[38;5;43m20221212185038742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185038742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185038742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185038742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185038743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185038743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185038743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:40.534303 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15369): Process ended prematurely: osmo-stp_10.42.42.5(pid=15369) [trial-2380↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15369)] [trial-2380↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 18:50:40.544000 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 18:50:40.572220 run osmo-hlr_10.42.42.2(pid=15366): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15366)] 18:50:40.623044 run osmo-hlr_10.42.42.2(pid=15366): stdout: | (launched: 2022-12-12_18:50:37.529973) 18:50:40.675330 run osmo-hlr_10.42.42.2(pid=15366): stderr: | [0;m[1;31m20221212185037727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185037727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185037727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185037727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185037727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185037727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185037739 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185037750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185037750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185037750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:40.747403 run osmo-msc_10.42.42.6(pid=15372): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15372)] 18:50:40.797387 run osmo-msc_10.42.42.6(pid=15372): stdout: | (launched: 2022-12-12_18:50:39.593311) 18:50:40.848905 run osmo-msc_10.42.42.6(pid=15372): stderr: | [0;m[38;5;43m20221212185039917 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185039917 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4124908c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185039917 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185039917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185039917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185039918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185039919 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185039920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185039920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185039920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:40.900893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15365): Terminating (SIGTERM) 18:50:40.942743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15368): Terminating (SIGTERM) 18:50:40.984620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15371): Terminating (SIGTERM) 18:50:41.027336 --- ParallelTerminationStrategy: PID 15365 died... 18:50:41.047750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15365): Terminated: ok {rc=0} 18:50:41.094575 --- ParallelTerminationStrategy: PID 15368 died... 18:50:41.114429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15368): Terminated: ok {rc=0} 18:50:41.161028 --- ParallelTerminationStrategy: PID 15371 died... 18:50:41.180851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15371): Terminated: ok {rc=0} 18:50:41.269902 bus /sierra_3: Setting Powered False 18:50:42.370855 bus /sierra_3: Setting Powered False 18:50:43.489434 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 18:50:44.635940 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:50:44.648365 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:50:44.700690 tst mo_mt_call_osmux.py: using LAC 30793 18:50:44.821943 tst mo_mt_call_osmux.py: using RAC 193 18:50:44.941878 tst mo_mt_call_osmux.py: using CellId 30793 18:50:45.061461 tst mo_mt_call_osmux.py: using BVCI 30794 18:50:45.173360 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:50:45.184868 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:50:45.196299 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:50:45.208261 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:50:45.220076 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 18:50:45.231717 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:50:45.352080 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 18:50:45.470767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:45.981683 run create_hlr_db(pid=15375): Launched 18:50:46.119539 bus /sierra_2: Setting Powered False 18:50:47.196749 run create_hlr_db(pid=15375): Terminated: ok {rc=0} 18:50:47.654598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15377): Launched 18:50:47.983726 run osmo-hlr_10.42.42.2(pid=15378): Launched 18:50:48.109734 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:48.672143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15380): Launched 18:50:49.001631 run osmo-stp_10.42.42.5(pid=15381): Launched 18:50:49.126488 run osmo-msc_10.42.42.6: Starting osmo-msc 18:50:49.717287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15383): Launched 18:50:50.046730 run osmo-msc_10.42.42.6(pid=15384): Launched 18:50:50.229552 run osmo-stp_10.42.42.5(pid=15381): ERR: Terminated: ERROR {rc=1} [trial-2380↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15381)] 18:50:50.369940 run osmo-stp_10.42.42.5(pid=15381): stdout: | (launched: 2022-12-12_18:50:48.940444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:50.509709 run osmo-stp_10.42.42.5(pid=15381): stderr: | [0;m[38;5;43m20221212185049132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185049132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185049133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185049133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185049133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185049134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185049134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:50.645732 run osmo-stp_10.42.42.5(pid=15381): stdout: | (launched: 2022-12-12_18:50:48.940444) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:50:50.776154 run osmo-stp_10.42.42.5(pid=15381): stderr: | [0;m[38;5;43m20221212185049132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185049132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185049133 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185049133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185049133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185049134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185049134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:50:50.931964 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15381): Process ended prematurely: osmo-stp_10.42.42.5(pid=15381) [trial-2380↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15381)] [trial-2380↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 18:50:50.941795 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 18:50:50.969978 run osmo-hlr_10.42.42.2(pid=15378): ERR: Terminated: ERROR {rc=237} [trial-2380↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15378)] 18:50:51.020086 run osmo-hlr_10.42.42.2(pid=15378): stdout: | (launched: 2022-12-12_18:50:47.922783) 18:50:51.071861 run osmo-hlr_10.42.42.2(pid=15378): stderr: | [0;m[1;31m20221212185048120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185048120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185048120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185048120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185048120 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185048121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185048133 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185048142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185048142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185048142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:50:51.144393 run osmo-msc_10.42.42.6(pid=15384): ERR: Terminated: ERROR {rc=2} [trial-2380↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15384)] 18:50:51.194347 run osmo-msc_10.42.42.6(pid=15384): stdout: | (launched: 2022-12-12_18:50:49.985736) 18:50:51.245998 run osmo-msc_10.42.42.6(pid=15384): stderr: | [0;m[38;5;43m20221212185050308 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185050309 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f24cde23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185050309 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185050309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185050309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185050309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185050311 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185050311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185050311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185050312 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:50:51.298157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15377): Terminating (SIGTERM) 18:50:51.340047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15380): Terminating (SIGTERM) 18:50:51.382066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15383): Terminating (SIGTERM) 18:50:51.424183 --- ParallelTerminationStrategy: PID 15377 died... 18:50:51.444201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15377): Terminated: ok {rc=0} 18:50:51.491176 --- ParallelTerminationStrategy: PID 15380 died... 18:50:51.511237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15380): Terminated: ok {rc=0} 18:50:51.558194 --- ParallelTerminationStrategy: PID 15383 died... 18:50:51.577997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15383): Terminated: ok {rc=0} 18:50:51.666926 bus /sierra_3: Setting Powered False 18:50:52.766991 bus /sierra_3: Setting Powered False 18:50:53.883848 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 emergency:nanobts+band-900 --------------------------------------------------------------------- 18:50:55.140437 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:50:55.145769 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:50:55.178487 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 18:50:55.204786 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 18:50:55.287795 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:50:55.319641 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 18:50:55.345719 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 18:50:55.936744 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2380 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 18:50:55.942170 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:50:55.952918 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 18:50:56.004154 tst emergency_mo_mt_call.py: using LAC 30794 18:50:56.124422 tst emergency_mo_mt_call.py: using RAC 194 18:50:56.241772 tst emergency_mo_mt_call.py: using CellId 30794 18:50:56.359558 tst emergency_mo_mt_call.py: using BVCI 30795 18:50:56.467869 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:50:56.478777 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:50:56.489393 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:50:56.500244 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:50:56.511067 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:50:56.522186 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:50:56.641564 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:50:56.761877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:50:57.228418 run create_hlr_db(pid=15389): Launched 18:50:57.342955 bus /sierra_2: Setting Powered False 18:50:58.402981 run create_hlr_db(pid=15389): Terminated: ok {rc=0} 18:50:58.845012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15391): Launched 18:50:59.169198 run osmo-hlr_10.42.42.2(pid=15392): Launched 18:50:59.291790 run osmo-stp_10.42.42.5: Starting osmo-stp 18:50:59.871536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15394): Launched 18:51:00.194500 run osmo-stp_10.42.42.5(pid=15395): Launched 18:51:00.326629 tst emergency_mo_mt_call.py: using MSISDN 7911 18:51:00.490003 run osmo-msc_10.42.42.6: Starting osmo-msc 18:51:01.078844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15397): Launched 18:51:01.415098 run osmo-msc_10.42.42.6(pid=15398): Launched 18:51:01.859165 run osmo-stp_10.42.42.5(pid=15395): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15395)] 18:51:02.159678 run osmo-stp_10.42.42.5(pid=15395): stdout: | (launched: 2022-12-12_18:51:00.134589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:02.304907 run osmo-stp_10.42.42.5(pid=15395): stderr: | [0;m[38;5;43m20221212185100326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185100327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185100327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185100327 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185100328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185100328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185100328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:02.442109 run osmo-stp_10.42.42.5(pid=15395): stdout: | (launched: 2022-12-12_18:51:00.134589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:02.570265 run osmo-stp_10.42.42.5(pid=15395): stderr: | [0;m[38;5;43m20221212185100326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185100327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185100327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185100327 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185100328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185100328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185100328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:02.724348 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15395): Process ended prematurely: osmo-stp_10.42.42.5(pid=15395) [trial-2380↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15395)] [trial-2380↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 18:51:02.733642 tst emergency_mo_mt_call.py:19: Test FAILED (6.8 sec) 18:51:02.761561 run osmo-hlr_10.42.42.2(pid=15392): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15392)] 18:51:02.812528 run osmo-hlr_10.42.42.2(pid=15392): stdout: | (launched: 2022-12-12_18:50:59.109074) 18:51:02.865188 run osmo-hlr_10.42.42.2(pid=15392): stderr: | [0;m[1;31m20221212185059306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185059306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185059306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185059306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185059306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185059306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185059319 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185059327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185059327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185059327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:02.938116 run osmo-msc_10.42.42.6(pid=15398): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15398)] 18:51:02.988625 run osmo-msc_10.42.42.6(pid=15398): stdout: | (launched: 2022-12-12_18:51:01.355200) 18:51:03.040899 run osmo-msc_10.42.42.6(pid=15398): stderr: | [0;m[38;5;43m20221212185101839 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185101845 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f988b3f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185101845 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185101845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185101845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185101846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185101847 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185101848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185101848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185101848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:51:03.093610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15391): Terminating (SIGTERM) 18:51:03.135856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15394): Terminating (SIGTERM) 18:51:03.178157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15397): Terminating (SIGTERM) 18:51:03.221008 --- ParallelTerminationStrategy: PID 15391 died... 18:51:03.241165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15391): Terminated: ok {rc=0} 18:51:03.287658 --- ParallelTerminationStrategy: PID 15394 died... 18:51:03.307631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15394): Terminated: ok {rc=0} 18:51:03.354158 --- ParallelTerminationStrategy: PID 15397 died... 18:51:03.373880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15397): Terminated: ok {rc=0} 18:51:03.462208 bus /sierra_3: Setting Powered False 18:51:04.562392 bus /sierra_3: Setting Powered False 18:51:05.682510 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 18:51:06.770526 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:51:06.782048 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 18:51:06.837166 tst emergency_preemptive_call.py: using LAC 30795 18:51:06.966097 tst emergency_preemptive_call.py: using RAC 195 18:51:07.093664 tst emergency_preemptive_call.py: using CellId 30795 18:51:07.218492 tst emergency_preemptive_call.py: using BVCI 30796 18:51:07.336673 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:51:07.348419 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:51:07.359708 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:51:07.371061 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:51:07.382392 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 18:51:07.393681 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:51:07.509692 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:51:07.629479 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:51:07.749524 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 18:51:07.864436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:08.334544 run create_hlr_db(pid=15400): Launched 18:51:08.452012 bus /sierra_2: Setting Powered False 18:51:09.512938 run create_hlr_db(pid=15400): Terminated: ok {rc=0} 18:51:09.953843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15402): Launched 18:51:10.277039 run osmo-hlr_10.42.42.2(pid=15403): Launched 18:51:10.398878 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:10.952189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15405): Launched 18:51:11.282153 run osmo-stp_10.42.42.5(pid=15406): Launched 18:51:11.415026 tst emergency_preemptive_call.py: using MSISDN 7912 18:51:11.580201 run osmo-msc_10.42.42.6: Starting osmo-msc 18:51:12.159607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15408): Launched 18:51:12.483285 run osmo-msc_10.42.42.6(pid=15409): Launched 18:51:12.665060 run osmo-stp_10.42.42.5(pid=15406): ERR: Terminated: ERROR {rc=1} [trial-2380↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15406)] 18:51:12.801279 run osmo-stp_10.42.42.5(pid=15406): stdout: | (launched: 2022-12-12_18:51:11.222060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:12.937885 run osmo-stp_10.42.42.5(pid=15406): stderr: | [0;m[38;5;43m20221212185111413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185111413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185111413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185111414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185111414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185111414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185111414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:13.072753 run osmo-stp_10.42.42.5(pid=15406): stdout: | (launched: 2022-12-12_18:51:11.222060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:13.200937 run osmo-stp_10.42.42.5(pid=15406): stderr: | [0;m[38;5;43m20221212185111413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185111413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185111413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185111414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185111414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185111414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185111414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:13.354695 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15406): Process ended prematurely: osmo-stp_10.42.42.5(pid=15406) [trial-2380↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15406)] [trial-2380↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 18:51:13.363884 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 18:51:13.391703 run osmo-hlr_10.42.42.2(pid=15403): ERR: Terminated: ERROR {rc=237} [trial-2380↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15403)] 18:51:13.442134 run osmo-hlr_10.42.42.2(pid=15403): stdout: | (launched: 2022-12-12_18:51:10.216825) 18:51:13.494256 run osmo-hlr_10.42.42.2(pid=15403): stderr: | [0;m[1;31m20221212185110412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185110412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185110412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185110412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185110412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185110412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185110425 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185110433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185110433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185110433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:13.566968 run osmo-msc_10.42.42.6(pid=15409): ERR: Terminated: ERROR {rc=2} [trial-2380↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15409)] 18:51:13.617800 run osmo-msc_10.42.42.6(pid=15409): stdout: | (launched: 2022-12-12_18:51:12.423107) 18:51:13.670119 run osmo-msc_10.42.42.6(pid=15409): stderr: | [0;m[38;5;43m20221212185112746 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185112746 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd3170bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185112746 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185112746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185112746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185112747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185112748 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185112749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185112749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185112749 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:51:13.722570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15402): Terminating (SIGTERM) 18:51:13.764924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15405): Terminating (SIGTERM) 18:51:13.807506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15408): Terminating (SIGTERM) 18:51:13.850137 --- ParallelTerminationStrategy: PID 15402 died... 18:51:13.870479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15402): Terminated: ok {rc=0} 18:51:13.917457 --- ParallelTerminationStrategy: PID 15405 died... 18:51:13.937505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15405): Terminated: ok {rc=0} 18:51:13.983919 --- ParallelTerminationStrategy: PID 15408 died... 18:51:14.003881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15408): Terminated: ok {rc=0} 18:51:14.092539 bus /sierra_9: Setting Powered False 18:51:15.191547 bus /sierra_9: Setting Powered False 18:51:16.315420 bus /sierra_8: Setting Powered False 18:51:17.431072 bus /sierra_8: Setting Powered False 18:51:18.547692 bus /sierra_3: Setting Powered False 18:51:19.647433 bus /sierra_3: Setting Powered False 18:51:20.766451 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-900 --------------------------------------------------------------------- 18:51:22.058259 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:51:22.064135 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 18:51:22.097451 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 18:51:22.137275 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 18:51:22.226987 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 18:51:22.260235 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 18:51:22.299673 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 18:51:22.893525 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 18:51:22.946745 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:22.958577 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:51:23.007692 tst cs_paging_gprs_active.py: using LAC 30796 18:51:23.130821 tst cs_paging_gprs_active.py: using RAC 196 18:51:23.251615 tst cs_paging_gprs_active.py: using CellId 30796 18:51:23.371746 tst cs_paging_gprs_active.py: using BVCI 30797 18:51:23.484798 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:23.495859 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:23.506598 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:23.517957 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:23.529135 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:23.540363 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:23.551490 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:23.562458 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:23.573738 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:51:23.690702 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:51:23.814251 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:51:24.037318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:24.367450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15414): Launched 18:51:24.655342 run iperf3-srv_10.42.42.10(pid=15415): Launched 18:51:24.780580 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:51:25.001847 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:25.332556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15416): Launched 18:51:25.619723 run iperf3-srv_10.42.42.10(pid=15417): Launched 18:51:25.742963 tst cs_paging_gprs_active.py:38: start network... 18:51:25.963404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:26.471759 run create_hlr_db(pid=15418): Launched 18:51:26.607397 bus /sierra_2: Setting Powered False 18:51:27.669620 run create_hlr_db(pid=15418): Terminated: ok {rc=0} 18:51:28.104450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15420): Launched 18:51:28.411736 run osmo-hlr_10.42.42.2(pid=15421): Launched 18:51:28.530714 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:29.069325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15423): Launched 18:51:29.379268 run osmo-stp_10.42.42.5(pid=15424): Launched 18:51:29.498392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:51:30.025523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15426): Launched 18:51:30.143398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:51:30.403598 run patchelf(pid=15427): Launched 18:51:30.576473 run osmo-stp_10.42.42.5(pid=15424): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15424)] 18:51:30.705835 run osmo-stp_10.42.42.5(pid=15424): stdout: | (launched: 2022-12-12_18:51:29.321946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:30.840598 run osmo-stp_10.42.42.5(pid=15424): stderr: | [0;m[38;5;43m20221212185129491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185129491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185129491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185129492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185129492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185129492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185129492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:30.989678 run osmo-stp_10.42.42.5(pid=15424): stdout: | (launched: 2022-12-12_18:51:29.321946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:31.127229 run osmo-stp_10.42.42.5(pid=15424): stderr: | [0;m[38;5;43m20221212185129491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185129491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185129491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185129492 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185129492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185129492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185129492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:31.289791 run patchelf(pid=15427): Terminating (SIGINT) 18:51:31.477680 run patchelf(pid=15427): Terminated: ok {rc=0} 18:51:31.613978 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15424): Process ended prematurely: osmo-stp_10.42.42.5(pid=15424) [trial-2380↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15424)] [trial-2380↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 18:51:31.626213 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:51:31.656487 run osmo-hlr_10.42.42.2(pid=15421): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15421)] 18:51:31.707841 run osmo-hlr_10.42.42.2(pid=15421): stdout: | (launched: 2022-12-12_18:51:28.354266) 18:51:31.761530 run osmo-hlr_10.42.42.2(pid=15421): stderr: | [0;m[1;31m20221212185128529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185128529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185128529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185128529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185128529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185128529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185128550 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185128560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185128560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185128560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:31.814640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15414): Terminating (SIGTERM) 18:51:31.858832 run iperf3-srv_10.42.42.10(pid=15415): Terminating (SIGTERM) 18:51:31.904126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15416): Terminating (SIGTERM) 18:51:31.946885 run iperf3-srv_10.42.42.10(pid=15417): Terminating (SIGTERM) 18:51:31.989257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15420): Terminating (SIGTERM) 18:51:32.033680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15423): Terminating (SIGTERM) 18:51:32.078707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15426): Terminating (SIGTERM) 18:51:32.123147 --- ParallelTerminationStrategy: PID 15414 died... 18:51:32.144173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15414): Terminated: ok {rc=0} 18:51:32.192730 --- ParallelTerminationStrategy: PID 15415 died... 18:51:32.212281 run iperf3-srv_10.42.42.10(pid=15415): Terminated {rc=256} 18:51:32.259487 --- ParallelTerminationStrategy: PID 15416 died... 18:51:32.279190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15416): Terminated: ok {rc=0} 18:51:32.325422 --- ParallelTerminationStrategy: PID 15417 died... 18:51:32.345067 run iperf3-srv_10.42.42.10(pid=15417): Terminated {rc=256} 18:51:32.391205 --- ParallelTerminationStrategy: PID 15420 died... 18:51:32.411168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15420): Terminated: ok {rc=0} 18:51:32.457597 --- ParallelTerminationStrategy: PID 15423 died... 18:51:32.477315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15423): Terminated: ok {rc=0} 18:51:32.523821 --- ParallelTerminationStrategy: PID 15426 died... 18:51:32.543695 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15426): Terminated: ok {rc=0} 18:51:32.632621 bus /gobi_0: Setting Powered False 18:51:33.732071 bus /gobi_0: Setting Powered False 18:51:34.845741 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 18:51:35.995877 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:36.008066 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:51:36.064336 tst iperf3.py: using LAC 30797 18:51:36.192113 tst iperf3.py: using RAC 197 18:51:36.321785 tst iperf3.py: using CellId 30797 18:51:36.453381 tst iperf3.py: using BVCI 30798 18:51:36.573501 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:36.584822 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:36.595927 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:36.607120 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:36.618602 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:36.629693 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:36.640891 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:36.651936 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:36.663243 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:51:36.783229 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:51:37.003445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:37.332118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15428): Launched 18:51:37.620260 run iperf3-srv_10.42.42.10(pid=15429): Launched 18:51:37.745009 tst iperf3.py:8: start network... 18:51:37.965383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:38.474487 run create_hlr_db(pid=15430): Launched 18:51:38.609571 bus /gobi_6: Setting Powered False 18:51:39.675188 run create_hlr_db(pid=15430): Terminated: ok {rc=0} 18:51:40.114523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15432): Launched 18:51:40.424531 run osmo-hlr_10.42.42.2(pid=15433): Launched 18:51:40.542108 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:41.082412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15435): Launched 18:51:41.392096 run osmo-stp_10.42.42.5(pid=15436): Launched 18:51:41.511230 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:51:42.038859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15438): Launched 18:51:42.157635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:51:42.416617 run patchelf(pid=15439): Launched 18:51:42.589081 run osmo-stp_10.42.42.5(pid=15436): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15436)] 18:51:42.717901 run osmo-stp_10.42.42.5(pid=15436): stdout: | (launched: 2022-12-12_18:51:41.334861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:42.848642 run osmo-stp_10.42.42.5(pid=15436): stderr: | [0;m[38;5;43m20221212185141505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185141505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185141505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185141506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185141506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185141506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185141506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:42.979173 run osmo-stp_10.42.42.5(pid=15436): stdout: | (launched: 2022-12-12_18:51:41.334861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:43.104064 run osmo-stp_10.42.42.5(pid=15436): stderr: | [0;m[38;5;43m20221212185141505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185141505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185141505 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185141506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185141506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185141506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185141506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:43.252062 run patchelf(pid=15439): Terminating (SIGINT) 18:51:43.423051 run patchelf(pid=15439): Terminated: ok {rc=0} 18:51:43.546178 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15436): Process ended prematurely: osmo-stp_10.42.42.5(pid=15436) [trial-2380↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15436)] [trial-2380↪gprs:nanobts+band-900↪iperf3.py:8] 18:51:43.555861 tst iperf3.py:8: Test FAILED (7.6 sec) 18:51:43.583878 run osmo-hlr_10.42.42.2(pid=15433): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15433)] 18:51:43.631876 run osmo-hlr_10.42.42.2(pid=15433): stdout: | (launched: 2022-12-12_18:51:40.367154) 18:51:43.681576 run osmo-hlr_10.42.42.2(pid=15433): stderr: | [0;m[1;31m20221212185140542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185140542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185140542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185140542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185140542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185140542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185140556 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185140567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185140568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185140568 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:43.731870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15428): Terminating (SIGTERM) 18:51:43.771994 run iperf3-srv_10.42.42.10(pid=15429): Terminating (SIGTERM) 18:51:43.812018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15432): Terminating (SIGTERM) 18:51:43.852379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15435): Terminating (SIGTERM) 18:51:43.892576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15438): Terminating (SIGTERM) 18:51:43.933058 --- ParallelTerminationStrategy: PID 15428 died... 18:51:43.952404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15428): Terminated: ok {rc=0} 18:51:43.997293 --- ParallelTerminationStrategy: PID 15429 died... 18:51:44.015846 run iperf3-srv_10.42.42.10(pid=15429): Terminated {rc=256} 18:51:44.060449 --- ParallelTerminationStrategy: PID 15432 died... 18:51:44.079142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15432): Terminated: ok {rc=0} 18:51:44.123509 --- ParallelTerminationStrategy: PID 15435 died... 18:51:44.142172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15435): Terminated: ok {rc=0} 18:51:44.186618 --- ParallelTerminationStrategy: PID 15438 died... 18:51:44.205838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15438): Terminated: ok {rc=0} 18:51:44.292580 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 18:51:45.439312 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:45.451020 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:51:45.500318 tst iperf3m4.py: using LAC 30798 18:51:45.621051 tst iperf3m4.py: using RAC 198 18:51:45.741060 tst iperf3m4.py: using CellId 30798 18:51:45.875042 tst iperf3m4.py: using BVCI 30799 18:51:46.015577 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:46.029590 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:46.042152 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:46.054253 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:46.066737 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:46.080877 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:46.094209 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:46.106431 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:51:46.119679 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:51:46.253744 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:51:46.378577 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:51:46.497679 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:51:46.619186 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:51:46.830223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:47.145719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15441): Launched 18:51:47.430615 run iperf3-srv_10.42.42.10(pid=15442): Launched 18:51:47.548835 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:51:47.755116 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:48.064795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15443): Launched 18:51:48.335353 run iperf3-srv_10.42.42.10(pid=15444): Launched 18:51:48.452414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:51:48.657199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:48.966053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15445): Launched 18:51:49.235439 run iperf3-srv_10.42.42.10(pid=15446): Launched 18:51:49.352638 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:51:49.557827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:51:49.866765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15447): Launched 18:51:50.137153 run iperf3-srv_10.42.42.10(pid=15448): Launched 18:51:50.252704 tst iperf3m4.py:8: start network... 18:51:50.457807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:51:50.934052 run create_hlr_db(pid=15449): Launched 18:51:51.053802 bus /gobi_6: Setting Powered False 18:51:52.115537 run create_hlr_db(pid=15449): Terminated: ok {rc=0} 18:51:52.543411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15451): Launched 18:51:52.853763 run osmo-hlr_10.42.42.2(pid=15452): Launched 18:51:52.972764 run osmo-stp_10.42.42.5: Starting osmo-stp 18:51:53.501632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15454): Launched 18:51:53.809897 run osmo-stp_10.42.42.5(pid=15455): Launched 18:51:53.928784 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:51:54.457507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15457): Launched 18:51:54.576683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:51:54.837674 run patchelf(pid=15458): Launched 18:51:55.009311 run osmo-stp_10.42.42.5(pid=15455): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15455)] 18:51:55.139988 run osmo-stp_10.42.42.5(pid=15455): stdout: | (launched: 2022-12-12_18:51:53.752238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:55.272105 run osmo-stp_10.42.42.5(pid=15455): stderr: | [0;m[38;5;43m20221212185153921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185153921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185153921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185153922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185153922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185153922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185153922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:55.403959 run osmo-stp_10.42.42.5(pid=15455): stdout: | (launched: 2022-12-12_18:51:53.752238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:51:55.529972 run osmo-stp_10.42.42.5(pid=15455): stderr: | [0;m[38;5;43m20221212185153921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185153921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185153921 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185153922 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185153922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185153922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185153922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:51:55.679304 run patchelf(pid=15458): Terminating (SIGINT) 18:51:55.851174 run patchelf(pid=15458): Terminated: ok {rc=0} 18:51:55.974867 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15455): Process ended prematurely: osmo-stp_10.42.42.5(pid=15455) [trial-2380↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15455)] [trial-2380↪gprs:nanobts+band-900↪iperf3m4.py:8] 18:51:55.984592 tst iperf3m4.py:8: Test FAILED (10.6 sec) 18:51:56.013151 run osmo-hlr_10.42.42.2(pid=15452): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15452)] 18:51:56.061609 run osmo-hlr_10.42.42.2(pid=15452): stdout: | (launched: 2022-12-12_18:51:52.795843) 18:51:56.111891 run osmo-hlr_10.42.42.2(pid=15452): stderr: | [0;m[1;31m20221212185152969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185152969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185152969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185152969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185152969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185152969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185152982 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185152990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185152990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185152990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:51:56.162575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15441): Terminating (SIGTERM) 18:51:56.203312 run iperf3-srv_10.42.42.10(pid=15442): Terminating (SIGTERM) 18:51:56.243795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15443): Terminating (SIGTERM) 18:51:56.284401 run iperf3-srv_10.42.42.10(pid=15444): Terminating (SIGTERM) 18:51:56.324695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15445): Terminating (SIGTERM) 18:51:56.364872 run iperf3-srv_10.42.42.10(pid=15446): Terminating (SIGTERM) 18:51:56.405302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15447): Terminating (SIGTERM) 18:51:56.445956 run iperf3-srv_10.42.42.10(pid=15448): Terminating (SIGTERM) 18:51:56.486186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15451): Terminating (SIGTERM) 18:51:56.526452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15454): Terminating (SIGTERM) 18:51:56.566780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15457): Terminating (SIGTERM) 18:51:56.607558 --- ParallelTerminationStrategy: PID 15441 died... 18:51:56.627042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15441): Terminated: ok {rc=0} 18:51:56.672346 --- ParallelTerminationStrategy: PID 15442 died... 18:51:56.691166 run iperf3-srv_10.42.42.10(pid=15442): Terminated {rc=256} 18:51:56.735931 --- ParallelTerminationStrategy: PID 15443 died... 18:51:56.754776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15443): Terminated: ok {rc=0} 18:51:56.799453 --- ParallelTerminationStrategy: PID 15444 died... 18:51:56.818309 run iperf3-srv_10.42.42.10(pid=15444): Terminated {rc=256} 18:51:56.862924 --- ParallelTerminationStrategy: PID 15445 died... 18:51:56.881830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15445): Terminated: ok {rc=0} 18:51:56.926538 --- ParallelTerminationStrategy: PID 15446 died... 18:51:56.945293 run iperf3-srv_10.42.42.10(pid=15446): Terminated {rc=256} 18:51:56.989905 --- ParallelTerminationStrategy: PID 15447 died... 18:51:57.008697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15447): Terminated: ok {rc=0} 18:51:57.053558 --- ParallelTerminationStrategy: PID 15448 died... 18:51:57.072333 run iperf3-srv_10.42.42.10(pid=15448): Terminated {rc=256} 18:51:57.117341 --- ParallelTerminationStrategy: PID 15451 died... 18:51:57.136185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15451): Terminated: ok {rc=0} 18:51:57.181056 --- ParallelTerminationStrategy: PID 15454 died... 18:51:57.199661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15454): Terminated: ok {rc=0} 18:51:57.244619 --- ParallelTerminationStrategy: PID 15457 died... 18:51:57.263707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15457): Terminated: ok {rc=0} 18:51:57.348192 bus /gobi_4: Setting Powered False 18:51:58.447392 bus /gobi_4: Setting Powered False 18:51:59.567730 bus /gobi_1: Setting Powered False 18:52:00.667622 bus /gobi_1: Setting Powered False 18:52:01.783184 bus /gobi_0: Setting Powered False 18:52:02.884685 bus /gobi_0: Setting Powered False 18:52:04.000233 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900 ping.py ---------------------------------------------- 18:52:05.102065 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:05.113659 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:52:05.161537 tst ping.py: using LAC 30799 18:52:05.290608 tst ping.py: using RAC 199 18:52:05.416909 tst ping.py: using CellId 30799 18:52:05.542747 tst ping.py: using BVCI 30800 18:52:05.662138 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:05.673768 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:05.685115 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:05.696315 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:05.707511 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:05.718660 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:05.729923 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:05.741152 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:52:05.861084 tst ping.py:19: start network... 18:52:06.077268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:06.575264 run create_hlr_db(pid=15459): Launched 18:52:06.707933 bus /gobi_6: Setting Powered False 18:52:07.770786 run create_hlr_db(pid=15459): Terminated: ok {rc=0} 18:52:08.202644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15461): Launched 18:52:08.528786 run osmo-hlr_10.42.42.2(pid=15462): Launched 18:52:08.652662 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:09.212838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15464): Launched 18:52:09.535550 run osmo-stp_10.42.42.5(pid=15465): Launched 18:52:09.658923 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:10.214603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15467): Launched 18:52:10.338773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:10.611442 run patchelf(pid=15468): Launched 18:52:10.792564 run osmo-stp_10.42.42.5(pid=15465): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15465)] 18:52:10.927844 run osmo-stp_10.42.42.5(pid=15465): stdout: | (launched: 2022-12-12_18:52:09.475567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:11.065089 run osmo-stp_10.42.42.5(pid=15465): stderr: | [0;m[38;5;43m20221212185209666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185209666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185209666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185209667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185209667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185209667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185209667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:11.202600 run osmo-stp_10.42.42.5(pid=15465): stdout: | (launched: 2022-12-12_18:52:09.475567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:11.333519 run osmo-stp_10.42.42.5(pid=15465): stderr: | [0;m[38;5;43m20221212185209666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185209666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185209666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185209667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185209667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185209667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185209667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:11.489805 run patchelf(pid=15468): Terminating (SIGINT) 18:52:11.669428 run patchelf(pid=15468): Terminated: ok {rc=0} 18:52:11.798449 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15465): Process ended prematurely: osmo-stp_10.42.42.5(pid=15465) [trial-2380↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15465)] [trial-2380↪gprs:nanobts+band-900↪ping.py:22] 18:52:11.808111 tst ping.py:22: Test FAILED (6.7 sec) 18:52:11.836511 run osmo-hlr_10.42.42.2(pid=15462): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15462)] 18:52:11.886466 run osmo-hlr_10.42.42.2(pid=15462): stdout: | (launched: 2022-12-12_18:52:08.468641) 18:52:11.938285 run osmo-hlr_10.42.42.2(pid=15462): stderr: | [0;m[1;31m20221212185208666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185208666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185208667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185208667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185208667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185208667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185208679 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185208687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185208688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185208688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:11.990380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15461): Terminating (SIGTERM) 18:52:12.032168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15464): Terminating (SIGTERM) 18:52:12.074171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15467): Terminating (SIGTERM) 18:52:12.116333 --- ParallelTerminationStrategy: PID 15461 died... 18:52:12.136678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15461): Terminated: ok {rc=0} 18:52:12.183169 --- ParallelTerminationStrategy: PID 15464 died... 18:52:12.203029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15464): Terminated: ok {rc=0} 18:52:12.249272 --- ParallelTerminationStrategy: PID 15467 died... 18:52:12.268904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15467): Terminated: ok {rc=0} 18:52:12.357154 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 18:52:13.444909 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:13.457214 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 18:52:13.507782 tst ping_idle_ping.py: using LAC 30800 18:52:13.635922 tst ping_idle_ping.py: using RAC 200 18:52:13.761575 tst ping_idle_ping.py: using CellId 30800 18:52:13.887566 tst ping_idle_ping.py: using BVCI 30801 18:52:14.004066 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:14.015521 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:14.026924 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:14.038247 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:14.049609 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:14.060771 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:14.072051 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 18:52:14.083439 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 18:52:14.203738 tst ping_idle_ping.py:24: start network... 18:52:14.419807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:14.923152 run create_hlr_db(pid=15469): Launched 18:52:15.056999 bus /gobi_6: Setting Powered False 18:52:16.119285 run create_hlr_db(pid=15469): Terminated: ok {rc=0} 18:52:16.574057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15471): Launched 18:52:16.917756 run osmo-hlr_10.42.42.2(pid=15472): Launched 18:52:17.065909 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:17.676235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15474): Launched 18:52:17.999853 run osmo-stp_10.42.42.5(pid=15475): Launched 18:52:18.124202 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:18.682096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15477): Launched 18:52:18.807023 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:19.080761 run patchelf(pid=15478): Launched 18:52:19.261339 run osmo-stp_10.42.42.5(pid=15475): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15475)] 18:52:19.396573 run osmo-stp_10.42.42.5(pid=15475): stdout: | (launched: 2022-12-12_18:52:17.939485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:19.534334 run osmo-stp_10.42.42.5(pid=15475): stderr: | [0;m[38;5;43m20221212185218131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185218131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185218131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185218132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185218132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185218132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185218132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:19.671940 run osmo-stp_10.42.42.5(pid=15475): stdout: | (launched: 2022-12-12_18:52:17.939485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:19.803653 run osmo-stp_10.42.42.5(pid=15475): stderr: | [0;m[38;5;43m20221212185218131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185218131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185218131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185218132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185218132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185218132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185218132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:19.959634 run patchelf(pid=15478): Terminating (SIGINT) 18:52:20.139397 run patchelf(pid=15478): Terminated: ok {rc=0} 18:52:20.269414 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15475): Process ended prematurely: osmo-stp_10.42.42.5(pid=15475) [trial-2380↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15475)] [trial-2380↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 18:52:20.279356 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 18:52:20.307929 run osmo-hlr_10.42.42.2(pid=15472): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15472)] 18:52:20.358189 run osmo-hlr_10.42.42.2(pid=15472): stdout: | (launched: 2022-12-12_18:52:16.851323) 18:52:20.410003 run osmo-hlr_10.42.42.2(pid=15472): stderr: | [0;m[1;31m20221212185217176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185217176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185217176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185217176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185217176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185217176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185217191 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185217208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185217208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185217208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:20.462247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15471): Terminating (SIGTERM) 18:52:20.504077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15474): Terminating (SIGTERM) 18:52:20.546340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15477): Terminating (SIGTERM) 18:52:20.588690 --- ParallelTerminationStrategy: PID 15471 died... 18:52:20.609084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15471): Terminated: ok {rc=0} 18:52:20.655826 --- ParallelTerminationStrategy: PID 15474 died... 18:52:20.675742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15474): Terminated: ok {rc=0} 18:52:20.722577 --- ParallelTerminationStrategy: PID 15477 died... 18:52:20.742353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15477): Terminated: ok {rc=0} 18:52:20.831011 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 18:52:22.139654 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:52:22.146616 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 18:52:22.180107 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 18:52:22.220059 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 18:52:22.309936 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 18:52:22.343084 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 18:52:22.382717 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 18:52:22.982803 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 18:52:23.032908 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:23.044079 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:52:23.092935 tst cs_paging_gprs_active.py: using LAC 30801 18:52:23.213950 tst cs_paging_gprs_active.py: using RAC 201 18:52:23.335468 tst cs_paging_gprs_active.py: using CellId 30801 18:52:23.456565 tst cs_paging_gprs_active.py: using BVCI 30802 18:52:23.576313 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:23.588146 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:23.599718 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:23.611379 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:23.623673 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:23.635204 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:23.647061 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:23.658381 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:23.670019 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:23.787824 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:23.909376 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:52:24.131094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:24.461200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15482): Launched 18:52:24.747784 run iperf3-srv_10.42.42.10(pid=15483): Launched 18:52:24.873121 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:52:25.093445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:25.423953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15484): Launched 18:52:25.712016 run iperf3-srv_10.42.42.10(pid=15485): Launched 18:52:25.835410 tst cs_paging_gprs_active.py:38: start network... 18:52:26.056430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:26.566914 run create_hlr_db(pid=15486): Launched 18:52:26.702823 bus /gobi_6: Setting Powered False 18:52:27.768031 run create_hlr_db(pid=15486): Terminated: ok {rc=0} 18:52:28.224733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15488): Launched 18:52:28.556068 run osmo-hlr_10.42.42.2(pid=15489): Launched 18:52:28.683009 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:29.251684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15491): Launched 18:52:29.584322 run osmo-stp_10.42.42.5(pid=15492): Launched 18:52:29.711610 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:30.281429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15494): Launched 18:52:30.408741 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:30.688294 run patchelf(pid=15495): Launched 18:52:30.887018 run osmo-stp_10.42.42.5(pid=15492): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15492)] 18:52:31.040919 run osmo-stp_10.42.42.5(pid=15492): stdout: | (launched: 2022-12-12_18:52:29.522713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:31.183545 run osmo-stp_10.42.42.5(pid=15492): stderr: | [0;m[38;5;43m20221212185229714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185229715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185229715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185229715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185229716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185229716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185229716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:31.325735 run osmo-stp_10.42.42.5(pid=15492): stdout: | (launched: 2022-12-12_18:52:29.522713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:31.461894 run osmo-stp_10.42.42.5(pid=15492): stderr: | [0;m[38;5;43m20221212185229714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185229715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185229715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185229715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185229716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185229716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185229716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:31.623943 run patchelf(pid=15495): Terminating (SIGINT) 18:52:31.810858 run patchelf(pid=15495): Terminated: ok {rc=0} 18:52:31.945698 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15492): Process ended prematurely: osmo-stp_10.42.42.5(pid=15492) [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15492)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 18:52:31.957409 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 18:52:31.988421 run osmo-hlr_10.42.42.2(pid=15489): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15489)] 18:52:32.040227 run osmo-hlr_10.42.42.2(pid=15489): stdout: | (launched: 2022-12-12_18:52:28.495114) 18:52:32.093292 run osmo-hlr_10.42.42.2(pid=15489): stderr: | [0;m[1;31m20221212185228693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185228693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185228693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185228693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185228693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185228693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185228705 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185228714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185228715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185228715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:32.146455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15482): Terminating (SIGTERM) 18:52:32.189256 run iperf3-srv_10.42.42.10(pid=15483): Terminating (SIGTERM) 18:52:32.231350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15484): Terminating (SIGTERM) 18:52:32.273620 run iperf3-srv_10.42.42.10(pid=15485): Terminating (SIGTERM) 18:52:32.315543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15488): Terminating (SIGTERM) 18:52:32.357780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15491): Terminating (SIGTERM) 18:52:32.400243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15494): Terminating (SIGTERM) 18:52:32.442869 --- ParallelTerminationStrategy: PID 15482 died... 18:52:32.463223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15482): Terminated: ok {rc=0} 18:52:32.509730 --- ParallelTerminationStrategy: PID 15483 died... 18:52:32.529532 run iperf3-srv_10.42.42.10(pid=15483): Terminated {rc=256} 18:52:32.575687 --- ParallelTerminationStrategy: PID 15484 died... 18:52:32.595425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15484): Terminated: ok {rc=0} 18:52:32.642185 --- ParallelTerminationStrategy: PID 15485 died... 18:52:32.662111 run iperf3-srv_10.42.42.10(pid=15485): Terminated {rc=256} 18:52:32.708454 --- ParallelTerminationStrategy: PID 15488 died... 18:52:32.728153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15488): Terminated: ok {rc=0} 18:52:32.774602 --- ParallelTerminationStrategy: PID 15491 died... 18:52:32.794475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15491): Terminated: ok {rc=0} 18:52:32.840623 --- ParallelTerminationStrategy: PID 15494 died... 18:52:32.860360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15494): Terminated: ok {rc=0} 18:52:32.949061 bus /gobi_0: Setting Powered False 18:52:34.049584 bus /gobi_0: Setting Powered False 18:52:35.167272 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 18:52:36.317786 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:36.330354 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:52:36.384429 tst iperf3.py: using LAC 30802 18:52:36.514645 tst iperf3.py: using RAC 202 18:52:36.644691 tst iperf3.py: using CellId 30802 18:52:36.774659 tst iperf3.py: using BVCI 30803 18:52:36.895265 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:36.907091 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:36.918472 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:36.929826 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:36.941073 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:36.952381 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:36.963909 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:36.975164 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:36.986957 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:37.104742 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:52:37.312108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:37.621794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15496): Launched 18:52:37.893285 run iperf3-srv_10.42.42.10(pid=15497): Launched 18:52:38.010758 tst iperf3.py:8: start network... 18:52:38.216451 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:38.693353 run create_hlr_db(pid=15498): Launched 18:52:38.811879 bus /gobi_6: Setting Powered False 18:52:39.874030 run create_hlr_db(pid=15498): Terminated: ok {rc=0} 18:52:40.304668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15500): Launched 18:52:40.615811 run osmo-hlr_10.42.42.2(pid=15501): Launched 18:52:40.735151 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:41.278742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15503): Launched 18:52:41.589337 run osmo-stp_10.42.42.5(pid=15504): Launched 18:52:41.707756 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:42.237770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15506): Launched 18:52:42.355167 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:42.615387 run patchelf(pid=15507): Launched 18:52:42.788059 run osmo-stp_10.42.42.5(pid=15504): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15504)] 18:52:42.917870 run osmo-stp_10.42.42.5(pid=15504): stdout: | (launched: 2022-12-12_18:52:41.531409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:43.048701 run osmo-stp_10.42.42.5(pid=15504): stderr: | [0;m[38;5;43m20221212185241702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185241702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185241702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185241703 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185241703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185241703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185241703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:43.179980 run osmo-stp_10.42.42.5(pid=15504): stdout: | (launched: 2022-12-12_18:52:41.531409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:43.304794 run osmo-stp_10.42.42.5(pid=15504): stderr: | [0;m[38;5;43m20221212185241702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185241702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185241702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185241703 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185241703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185241703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185241703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:43.452826 run patchelf(pid=15507): Terminating (SIGINT) 18:52:43.625097 run patchelf(pid=15507): Terminated: ok {rc=0} 18:52:43.749117 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15504): Process ended prematurely: osmo-stp_10.42.42.5(pid=15504) [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15504)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 18:52:43.758844 tst iperf3.py:8: Test FAILED (7.5 sec) 18:52:43.786967 run osmo-hlr_10.42.42.2(pid=15501): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15501)] 18:52:43.835391 run osmo-hlr_10.42.42.2(pid=15501): stdout: | (launched: 2022-12-12_18:52:40.558169) 18:52:43.885076 run osmo-hlr_10.42.42.2(pid=15501): stderr: | [0;m[1;31m20221212185240735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185240735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185240735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185240735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185240735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185240735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185240747 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185240755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185240755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185240755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:43.935321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15496): Terminating (SIGTERM) 18:52:43.975497 run iperf3-srv_10.42.42.10(pid=15497): Terminating (SIGTERM) 18:52:44.015572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15500): Terminating (SIGTERM) 18:52:44.055680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15503): Terminating (SIGTERM) 18:52:44.095746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15506): Terminating (SIGTERM) 18:52:44.136557 --- ParallelTerminationStrategy: PID 15496 died... 18:52:44.156052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15496): Terminated: ok {rc=0} 18:52:44.201903 --- ParallelTerminationStrategy: PID 15497 died... 18:52:44.220472 run iperf3-srv_10.42.42.10(pid=15497): Terminated {rc=256} 18:52:44.265192 --- ParallelTerminationStrategy: PID 15500 died... 18:52:44.283936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15500): Terminated: ok {rc=0} 18:52:44.328575 --- ParallelTerminationStrategy: PID 15503 died... 18:52:44.347574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15503): Terminated: ok {rc=0} 18:52:44.392342 --- ParallelTerminationStrategy: PID 15506 died... 18:52:44.411157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15506): Terminated: ok {rc=0} 18:52:44.498224 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 18:52:45.647063 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:45.659155 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:52:45.709833 tst iperf3m4.py: using LAC 30803 18:52:45.832184 tst iperf3m4.py: using RAC 203 18:52:45.974233 tst iperf3m4.py: using CellId 30803 18:52:46.145802 tst iperf3m4.py: using BVCI 30804 18:52:46.293522 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:46.309379 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:46.326064 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:46.341704 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:46.356903 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:46.372046 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:46.389095 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:46.404155 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:52:46.419945 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:46.575424 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:46.725893 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:46.860800 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:52:46.986265 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:52:47.231850 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:47.568042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15508): Launched 18:52:47.859430 run iperf3-srv_10.42.42.10(pid=15509): Launched 18:52:47.983984 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:52:48.205153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:48.534863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15510): Launched 18:52:48.822189 run iperf3-srv_10.42.42.10(pid=15511): Launched 18:52:48.947174 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:52:49.167156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:49.496444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15512): Launched 18:52:49.785796 run iperf3-srv_10.42.42.10(pid=15513): Launched 18:52:49.910567 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:52:50.131266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:52:50.460911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15514): Launched 18:52:50.749373 run iperf3-srv_10.42.42.10(pid=15515): Launched 18:52:50.873640 tst iperf3m4.py:8: start network... 18:52:51.093825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:52:51.606270 run create_hlr_db(pid=15516): Launched 18:52:51.742646 bus /gobi_6: Setting Powered False 18:52:52.807480 run create_hlr_db(pid=15516): Terminated: ok {rc=0} 18:52:53.264679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15518): Launched 18:52:53.595643 run osmo-hlr_10.42.42.2(pid=15519): Launched 18:52:53.722710 run osmo-stp_10.42.42.5: Starting osmo-stp 18:52:54.287594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15521): Launched 18:52:54.618010 run osmo-stp_10.42.42.5(pid=15522): Launched 18:52:54.743389 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:52:55.307807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15524): Launched 18:52:55.433072 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:52:55.712412 run patchelf(pid=15525): Launched 18:52:55.896168 run osmo-stp_10.42.42.5(pid=15522): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15522)] 18:52:56.034377 run osmo-stp_10.42.42.5(pid=15522): stdout: | (launched: 2022-12-12_18:52:54.556643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:56.174156 run osmo-stp_10.42.42.5(pid=15522): stderr: | [0;m[38;5;43m20221212185254746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185254746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185254747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185254747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185254747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185254747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185254747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:56.313745 run osmo-stp_10.42.42.5(pid=15522): stdout: | (launched: 2022-12-12_18:52:54.556643) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:52:56.447568 run osmo-stp_10.42.42.5(pid=15522): stderr: | [0;m[38;5;43m20221212185254746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185254746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185254747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185254747 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185254747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185254747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185254747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:52:56.606163 run patchelf(pid=15525): Terminating (SIGINT) 18:52:56.789963 run patchelf(pid=15525): Terminated: ok {rc=0} 18:52:56.922205 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15522): Process ended prematurely: osmo-stp_10.42.42.5(pid=15522) [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15522)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 18:52:56.932606 tst iperf3m4.py:8: Test FAILED (11.3 sec) 18:52:56.961962 run osmo-hlr_10.42.42.2(pid=15519): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15519)] 18:52:57.012170 run osmo-hlr_10.42.42.2(pid=15519): stdout: | (launched: 2022-12-12_18:52:53.534219) 18:52:57.064439 run osmo-hlr_10.42.42.2(pid=15519): stderr: | [0;m[1;31m20221212185253732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185253732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185253732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185253732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185253732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185253732 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185253745 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185253756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185253756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185253756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:52:57.117209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15508): Terminating (SIGTERM) 18:52:57.159263 run iperf3-srv_10.42.42.10(pid=15509): Terminating (SIGTERM) 18:52:57.201473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15510): Terminating (SIGTERM) 18:52:57.243570 run iperf3-srv_10.42.42.10(pid=15511): Terminating (SIGTERM) 18:52:57.285745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15512): Terminating (SIGTERM) 18:52:57.327790 run iperf3-srv_10.42.42.10(pid=15513): Terminating (SIGTERM) 18:52:57.369742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15514): Terminating (SIGTERM) 18:52:57.411694 run iperf3-srv_10.42.42.10(pid=15515): Terminating (SIGTERM) 18:52:57.453580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15518): Terminating (SIGTERM) 18:52:57.495724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15521): Terminating (SIGTERM) 18:52:57.537975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15524): Terminating (SIGTERM) 18:52:57.580638 --- ParallelTerminationStrategy: PID 15508 died... 18:52:57.601148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15508): Terminated: ok {rc=0} 18:52:57.647780 --- ParallelTerminationStrategy: PID 15509 died... 18:52:57.667829 run iperf3-srv_10.42.42.10(pid=15509): Terminated {rc=256} 18:52:57.715152 --- ParallelTerminationStrategy: PID 15510 died... 18:52:57.735127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15510): Terminated: ok {rc=0} 18:52:57.782982 --- ParallelTerminationStrategy: PID 15511 died... 18:52:57.802129 run iperf3-srv_10.42.42.10(pid=15511): Terminated {rc=256} 18:52:57.847311 --- ParallelTerminationStrategy: PID 15512 died... 18:52:57.866337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15512): Terminated: ok {rc=0} 18:52:57.911655 --- ParallelTerminationStrategy: PID 15513 died... 18:52:57.931238 run iperf3-srv_10.42.42.10(pid=15513): Terminated {rc=256} 18:52:57.976482 --- ParallelTerminationStrategy: PID 15514 died... 18:52:57.995488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15514): Terminated: ok {rc=0} 18:52:58.041987 --- ParallelTerminationStrategy: PID 15515 died... 18:52:58.061111 run iperf3-srv_10.42.42.10(pid=15515): Terminated {rc=256} 18:52:58.105978 --- ParallelTerminationStrategy: PID 15518 died... 18:52:58.125005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15518): Terminated: ok {rc=0} 18:52:58.170129 --- ParallelTerminationStrategy: PID 15521 died... 18:52:58.189320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15521): Terminated: ok {rc=0} 18:52:58.235078 --- ParallelTerminationStrategy: PID 15524 died... 18:52:58.254170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15524): Terminated: ok {rc=0} 18:52:58.342098 bus /gobi_4: Setting Powered False 18:52:59.444349 bus /gobi_4: Setting Powered False 18:53:00.562108 bus /gobi_1: Setting Powered False 18:53:01.664655 bus /gobi_1: Setting Powered False 18:53:02.786139 bus /gobi_0: Setting Powered False 18:53:03.890751 bus /gobi_0: Setting Powered False 18:53:05.008911 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 18:53:06.114743 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:06.127174 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:53:06.182705 tst ping.py: using LAC 30804 18:53:06.309290 tst ping.py: using RAC 204 18:53:06.437488 tst ping.py: using CellId 30804 18:53:06.562291 tst ping.py: using BVCI 30805 18:53:06.679434 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:06.691100 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:06.702523 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:06.714065 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:06.725327 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:06.736525 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:06.748039 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:06.759327 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:53:06.878520 tst ping.py:19: start network... 18:53:07.093711 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:07.593483 run create_hlr_db(pid=15527): Launched 18:53:07.724617 bus /gobi_6: Setting Powered False 18:53:08.788556 run create_hlr_db(pid=15527): Terminated: ok {rc=0} 18:53:09.220563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15529): Launched 18:53:09.523306 run osmo-hlr_10.42.42.2(pid=15530): Launched 18:53:09.641427 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:10.177901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15532): Launched 18:53:10.481118 run osmo-stp_10.42.42.5(pid=15533): Launched 18:53:10.597390 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:11.117914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15535): Launched 18:53:11.234104 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:11.489757 run patchelf(pid=15536): Launched 18:53:11.658013 run osmo-stp_10.42.42.5(pid=15533): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15533)] 18:53:11.784796 run osmo-stp_10.42.42.5(pid=15533): stdout: | (launched: 2022-12-12_18:53:10.424195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:11.914383 run osmo-stp_10.42.42.5(pid=15533): stderr: | [0;m[38;5;43m20221212185310593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185310593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185310593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185310594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185310594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185310594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185310594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:12.042992 run osmo-stp_10.42.42.5(pid=15533): stdout: | (launched: 2022-12-12_18:53:10.424195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:12.166018 run osmo-stp_10.42.42.5(pid=15533): stderr: | [0;m[38;5;43m20221212185310593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185310593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185310593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185310594 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185310594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185310594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185310594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:12.311712 run patchelf(pid=15536): Terminating (SIGINT) 18:53:12.480052 run patchelf(pid=15536): Terminated: ok {rc=0} 18:53:12.601331 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15533): Process ended prematurely: osmo-stp_10.42.42.5(pid=15533) [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15533)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 18:53:12.610333 tst ping.py:22: Test FAILED (6.5 sec) 18:53:12.638056 run osmo-hlr_10.42.42.2(pid=15530): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15530)] 18:53:12.686639 run osmo-hlr_10.42.42.2(pid=15530): stdout: | (launched: 2022-12-12_18:53:09.466603) 18:53:12.736382 run osmo-hlr_10.42.42.2(pid=15530): stderr: | [0;m[1;31m20221212185309641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185309641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185309641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185309641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185309641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185309642 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185309654 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185309665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185309665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185309665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:12.786771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15529): Terminating (SIGTERM) 18:53:12.827085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15532): Terminating (SIGTERM) 18:53:12.867216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15535): Terminating (SIGTERM) 18:53:12.908111 --- ParallelTerminationStrategy: PID 15529 died... 18:53:12.927574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15529): Terminated: ok {rc=0} 18:53:12.972798 --- ParallelTerminationStrategy: PID 15532 died... 18:53:12.992100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15532): Terminated: ok {rc=0} 18:53:13.036723 --- ParallelTerminationStrategy: PID 15535 died... 18:53:13.055561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15535): Terminated: ok {rc=0} 18:53:13.143043 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 18:53:14.233581 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:14.245942 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 18:53:14.310060 tst ping_idle_ping.py: using LAC 30805 18:53:14.430203 tst ping_idle_ping.py: using RAC 205 18:53:14.549376 tst ping_idle_ping.py: using CellId 30805 18:53:14.669314 tst ping_idle_ping.py: using BVCI 30806 18:53:14.778239 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:14.789530 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:14.800536 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:14.811857 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:14.823109 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:14.834295 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:14.845679 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 18:53:14.856926 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 18:53:14.974172 tst ping_idle_ping.py:24: start network... 18:53:15.175952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:15.648435 run create_hlr_db(pid=15537): Launched 18:53:15.766605 bus /gobi_6: Setting Powered False 18:53:16.848302 run create_hlr_db(pid=15537): Terminated: ok {rc=0} 18:53:17.378202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15539): Launched 18:53:17.704603 run osmo-hlr_10.42.42.2(pid=15540): Launched 18:53:17.830778 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:18.390125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15542): Launched 18:53:18.717879 run osmo-stp_10.42.42.5(pid=15543): Launched 18:53:18.837700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:19.365842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15545): Launched 18:53:19.482222 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:19.740196 run patchelf(pid=15546): Launched 18:53:19.912228 run osmo-stp_10.42.42.5(pid=15543): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15543)] 18:53:20.040406 run osmo-stp_10.42.42.5(pid=15543): stdout: | (launched: 2022-12-12_18:53:18.656705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:20.169650 run osmo-stp_10.42.42.5(pid=15543): stderr: | [0;m[38;5;43m20221212185318832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185318832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185318832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185318833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185318833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185318833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185318833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:20.298427 run osmo-stp_10.42.42.5(pid=15543): stdout: | (launched: 2022-12-12_18:53:18.656705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:20.421749 run osmo-stp_10.42.42.5(pid=15543): stderr: | [0;m[38;5;43m20221212185318832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185318832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185318832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185318833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185318833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185318833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185318833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:20.567535 run patchelf(pid=15546): Terminating (SIGINT) 18:53:20.737179 run patchelf(pid=15546): Terminated: ok {rc=0} 18:53:20.858790 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15543): Process ended prematurely: osmo-stp_10.42.42.5(pid=15543) [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15543)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 18:53:20.867779 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 18:53:20.895150 run osmo-hlr_10.42.42.2(pid=15540): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15540)] 18:53:20.943104 run osmo-hlr_10.42.42.2(pid=15540): stdout: | (launched: 2022-12-12_18:53:17.643732) 18:53:20.992739 run osmo-hlr_10.42.42.2(pid=15540): stderr: | [0;m[1;31m20221212185317841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185317841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185317841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185317841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185317841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185317841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185317853 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185317862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185317862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185317862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:21.042749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15539): Terminating (SIGTERM) 18:53:21.083724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15542): Terminating (SIGTERM) 18:53:21.123979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15545): Terminating (SIGTERM) 18:53:21.164477 --- ParallelTerminationStrategy: PID 15539 died... 18:53:21.183906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15539): Terminated: ok {rc=0} 18:53:21.228775 --- ParallelTerminationStrategy: PID 15542 died... 18:53:21.247747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15542): Terminated: ok {rc=0} 18:53:21.292587 --- ParallelTerminationStrategy: PID 15545 died... 18:53:21.311515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15545): Terminated: ok {rc=0} 18:53:21.397195 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 18:53:22.709830 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:53:22.718053 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 18:53:22.751889 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 18:53:22.792435 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 18:53:22.880716 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 18:53:22.913935 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 18:53:22.954011 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 18:53:23.553980 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 18:53:23.606088 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:23.617413 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:53:23.685095 tst cs_paging_gprs_active.py: using LAC 30806 18:53:23.806396 tst cs_paging_gprs_active.py: using RAC 206 18:53:23.927397 tst cs_paging_gprs_active.py: using CellId 30806 18:53:24.052322 tst cs_paging_gprs_active.py: using BVCI 30807 18:53:24.165081 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:24.176058 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:24.186937 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:24.198259 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:24.209724 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:24.220872 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:24.232289 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:24.243640 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:24.255137 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:24.375947 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:24.493686 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:53:24.699646 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:25.007590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15550): Launched 18:53:25.278330 run iperf3-srv_10.42.42.10(pid=15551): Launched 18:53:25.395940 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:53:25.601048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:25.910241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15552): Launched 18:53:26.180792 run iperf3-srv_10.42.42.10(pid=15553): Launched 18:53:26.298119 tst cs_paging_gprs_active.py:38: start network... 18:53:26.502834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:26.978909 run create_hlr_db(pid=15554): Launched 18:53:27.099188 bus /gobi_6: Setting Powered False 18:53:28.160616 run create_hlr_db(pid=15554): Terminated: ok {rc=0} 18:53:28.590017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15556): Launched 18:53:28.898752 run osmo-hlr_10.42.42.2(pid=15557): Launched 18:53:29.018011 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:29.559443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15559): Launched 18:53:29.871382 run osmo-stp_10.42.42.5(pid=15560): Launched 18:53:29.991223 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:30.520795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15562): Launched 18:53:30.640292 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:30.929780 run patchelf(pid=15563): Launched 18:53:31.147011 run osmo-stp_10.42.42.5(pid=15560): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15560)] 18:53:31.279048 run osmo-stp_10.42.42.5(pid=15560): stdout: | (launched: 2022-12-12_18:53:29.813750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:31.413609 run osmo-stp_10.42.42.5(pid=15560): stderr: | [0;m[38;5;43m20221212185329982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185329983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185329983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185329983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185329984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185329984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185329984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:31.547936 run osmo-stp_10.42.42.5(pid=15560): stdout: | (launched: 2022-12-12_18:53:29.813750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:31.676173 run osmo-stp_10.42.42.5(pid=15560): stderr: | [0;m[38;5;43m20221212185329982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185329983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185329983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185329983 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185329984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185329984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185329984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:31.872906 run patchelf(pid=15563): Terminating (SIGINT) 18:53:32.092068 run patchelf(pid=15563): Terminated: ok {rc=0} 18:53:32.228222 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15560): Process ended prematurely: osmo-stp_10.42.42.5(pid=15560) [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15560)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 18:53:32.239920 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 18:53:32.270833 run osmo-hlr_10.42.42.2(pid=15557): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15557)] 18:53:32.322741 run osmo-hlr_10.42.42.2(pid=15557): stdout: | (launched: 2022-12-12_18:53:28.840844) 18:53:32.377574 run osmo-hlr_10.42.42.2(pid=15557): stderr: | [0;m[1;31m20221212185329013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185329014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185329014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185329014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185329014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185329014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185329027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185329036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185329036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185329036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:32.431397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15550): Terminating (SIGTERM) 18:53:32.473911 run iperf3-srv_10.42.42.10(pid=15551): Terminating (SIGTERM) 18:53:32.517435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15552): Terminating (SIGTERM) 18:53:32.559531 run iperf3-srv_10.42.42.10(pid=15553): Terminating (SIGTERM) 18:53:32.599484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15556): Terminating (SIGTERM) 18:53:32.639400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15559): Terminating (SIGTERM) 18:53:32.679192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15562): Terminating (SIGTERM) 18:53:32.719324 --- ParallelTerminationStrategy: PID 15550 died... 18:53:32.738771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15550): Terminated: ok {rc=0} 18:53:32.784157 --- ParallelTerminationStrategy: PID 15551 died... 18:53:32.802963 run iperf3-srv_10.42.42.10(pid=15551): Terminated {rc=256} 18:53:32.847820 --- ParallelTerminationStrategy: PID 15552 died... 18:53:32.866735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15552): Terminated: ok {rc=0} 18:53:32.911315 --- ParallelTerminationStrategy: PID 15553 died... 18:53:32.930161 run iperf3-srv_10.42.42.10(pid=15553): Terminated {rc=256} 18:53:32.974855 --- ParallelTerminationStrategy: PID 15556 died... 18:53:32.993535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15556): Terminated: ok {rc=0} 18:53:33.038746 --- ParallelTerminationStrategy: PID 15559 died... 18:53:33.057713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15559): Terminated: ok {rc=0} 18:53:33.102899 --- ParallelTerminationStrategy: PID 15562 died... 18:53:33.121810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15562): Terminated: ok {rc=0} 18:53:33.208407 bus /gobi_0: Setting Powered False 18:53:34.308886 bus /gobi_0: Setting Powered False 18:53:35.425252 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 18:53:36.572602 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:36.584434 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:53:36.655063 tst iperf3.py: using LAC 30807 18:53:36.775203 tst iperf3.py: using RAC 207 18:53:36.896271 tst iperf3.py: using CellId 30807 18:53:37.022323 tst iperf3.py: using BVCI 30808 18:53:37.134564 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.145670 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.156667 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.168619 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.179880 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.191008 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.202463 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.213818 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:37.225294 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:37.340871 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:53:37.547981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:37.858695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15564): Launched 18:53:38.128457 run iperf3-srv_10.42.42.10(pid=15565): Launched 18:53:38.246323 tst iperf3.py:8: start network... 18:53:38.451720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:38.927294 run create_hlr_db(pid=15566): Launched 18:53:39.046988 bus /gobi_6: Setting Powered False 18:53:40.108774 run create_hlr_db(pid=15566): Terminated: ok {rc=0} 18:53:40.558712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15568): Launched 18:53:40.888061 run osmo-hlr_10.42.42.2(pid=15569): Launched 18:53:41.014733 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:41.579433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15571): Launched 18:53:41.908001 run osmo-stp_10.42.42.5(pid=15572): Launched 18:53:42.031752 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:42.597792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15574): Launched 18:53:42.724716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:43.003029 run patchelf(pid=15575): Launched 18:53:43.185577 run osmo-stp_10.42.42.5(pid=15572): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15572)] 18:53:43.323514 run osmo-stp_10.42.42.5(pid=15572): stdout: | (launched: 2022-12-12_18:53:41.846471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:43.463692 run osmo-stp_10.42.42.5(pid=15572): stderr: | [0;m[38;5;43m20221212185342039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185342039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185342039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185342039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185342040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185342040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185342040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:43.603309 run osmo-stp_10.42.42.5(pid=15572): stdout: | (launched: 2022-12-12_18:53:41.846471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:43.737345 run osmo-stp_10.42.42.5(pid=15572): stderr: | [0;m[38;5;43m20221212185342039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185342039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185342039 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185342039 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185342040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185342040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185342040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:43.895718 run patchelf(pid=15575): Terminating (SIGINT) 18:53:44.079197 run patchelf(pid=15575): Terminated: ok {rc=0} 18:53:44.211660 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15572): Process ended prematurely: osmo-stp_10.42.42.5(pid=15572) [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15572)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 18:53:44.222026 tst iperf3.py:8: Test FAILED (7.7 sec) 18:53:44.251206 run osmo-hlr_10.42.42.2(pid=15569): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15569)] 18:53:44.301827 run osmo-hlr_10.42.42.2(pid=15569): stdout: | (launched: 2022-12-12_18:53:40.827242) 18:53:44.354038 run osmo-hlr_10.42.42.2(pid=15569): stderr: | [0;m[1;31m20221212185341022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185341022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185341022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185341022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185341022 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185341023 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185341036 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185341045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185341045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185341045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:44.406317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15564): Terminating (SIGTERM) 18:53:44.448270 run iperf3-srv_10.42.42.10(pid=15565): Terminating (SIGTERM) 18:53:44.490164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15568): Terminating (SIGTERM) 18:53:44.532177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15571): Terminating (SIGTERM) 18:53:44.574175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15574): Terminating (SIGTERM) 18:53:44.616297 --- ParallelTerminationStrategy: PID 15564 died... 18:53:44.636647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15564): Terminated: ok {rc=0} 18:53:44.683469 --- ParallelTerminationStrategy: PID 15565 died... 18:53:44.703191 run iperf3-srv_10.42.42.10(pid=15565): Terminated {rc=256} 18:53:44.749657 --- ParallelTerminationStrategy: PID 15568 died... 18:53:44.769443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15568): Terminated: ok {rc=0} 18:53:44.816102 --- ParallelTerminationStrategy: PID 15571 died... 18:53:44.835977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15571): Terminated: ok {rc=0} 18:53:44.882750 --- ParallelTerminationStrategy: PID 15574 died... 18:53:44.902646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15574): Terminated: ok {rc=0} 18:53:44.991057 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 18:53:46.182009 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:46.202998 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:53:46.320509 tst iperf3m4.py: using LAC 30808 18:53:46.491415 tst iperf3m4.py: using RAC 208 18:53:46.657944 tst iperf3m4.py: using CellId 30808 18:53:46.814589 tst iperf3m4.py: using BVCI 30809 18:53:46.978199 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:46.995752 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:47.008800 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:47.023247 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:47.037723 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:47.055403 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:47.093648 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:47.137262 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:53:47.170752 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:47.374738 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:47.558214 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:47.723656 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:53:47.875611 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:53:48.219315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:48.621338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15748): Launched 18:53:48.979249 run iperf3-srv_10.42.42.10(pid=15794): Launched 18:53:49.144818 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:53:49.385484 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:49.717660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15847): Launched 18:53:50.016663 run iperf3-srv_10.42.42.10(pid=15848): Launched 18:53:50.155569 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:53:50.382563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:50.720257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15849): Launched 18:53:51.020835 run iperf3-srv_10.42.42.10(pid=15850): Launched 18:53:51.159828 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:53:51.385968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:53:51.721100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15852): Launched 18:53:52.011226 run iperf3-srv_10.42.42.10(pid=15854): Launched 18:53:52.149639 tst iperf3m4.py:8: start network... 18:53:52.377205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:53:52.892775 run create_hlr_db(pid=15855): Launched 18:53:53.060680 bus /gobi_6: Setting Powered False 18:53:54.126325 run create_hlr_db(pid=15855): Terminated: ok {rc=0} 18:53:54.594536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15857): Launched 18:53:54.944129 run osmo-hlr_10.42.42.2(pid=15858): Launched 18:53:55.198759 run osmo-stp_10.42.42.5: Starting osmo-stp 18:53:55.885715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15860): Launched 18:53:56.236232 run osmo-stp_10.42.42.5(pid=15861): Launched 18:53:56.487787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:53:57.154847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15863): Launched 18:53:57.295058 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:53:57.615530 run patchelf(pid=15876): Launched 18:53:57.817252 run osmo-stp_10.42.42.5(pid=15861): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15861)] 18:53:57.961557 run osmo-stp_10.42.42.5(pid=15861): stdout: | (launched: 2022-12-12_18:53:56.172881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:58.106280 run osmo-stp_10.42.42.5(pid=15861): stderr: | [0;m[38;5;43m20221212185356476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185356476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185356476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185356477 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185356477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185356477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185356477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:58.250615 run osmo-stp_10.42.42.5(pid=15861): stdout: | (launched: 2022-12-12_18:53:56.172881) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:53:58.389290 run osmo-stp_10.42.42.5(pid=15861): stderr: | [0;m[38;5;43m20221212185356476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185356476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185356476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185356477 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185356477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185356477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185356477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:53:58.554006 run patchelf(pid=15876): Terminating (SIGINT) 18:53:58.746765 run patchelf(pid=15876): Terminated: ok {rc=0} 18:53:58.884359 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15861): Process ended prematurely: osmo-stp_10.42.42.5(pid=15861) [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15861)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 18:53:58.895949 tst iperf3m4.py:8: Test FAILED (12.8 sec) 18:53:58.927344 run osmo-hlr_10.42.42.2(pid=15858): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15858)] 18:53:58.980441 run osmo-hlr_10.42.42.2(pid=15858): stdout: | (launched: 2022-12-12_18:53:54.882834) 18:53:59.035049 run osmo-hlr_10.42.42.2(pid=15858): stderr: | [0;m[1;31m20221212185355192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185355192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185355192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185355192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185355192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185355192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185355213 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185355226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185355226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185355226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:53:59.093480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15748): Terminating (SIGTERM) 18:53:59.137868 run iperf3-srv_10.42.42.10(pid=15794): Terminating (SIGTERM) 18:53:59.184876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15847): Terminating (SIGTERM) 18:53:59.230162 run iperf3-srv_10.42.42.10(pid=15848): Terminating (SIGTERM) 18:53:59.278180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15849): Terminating (SIGTERM) 18:53:59.323004 run iperf3-srv_10.42.42.10(pid=15850): Terminating (SIGTERM) 18:53:59.370536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15852): Terminating (SIGTERM) 18:53:59.415425 run iperf3-srv_10.42.42.10(pid=15854): Terminating (SIGTERM) 18:53:59.462197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15857): Terminating (SIGTERM) 18:53:59.508474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15860): Terminating (SIGTERM) 18:53:59.554967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15863): Terminating (SIGTERM) 18:53:59.601756 --- ParallelTerminationStrategy: PID 15748 died... 18:53:59.623606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15748): Terminated: ok {rc=0} 18:53:59.673986 --- ParallelTerminationStrategy: PID 15794 died... 18:53:59.696559 run iperf3-srv_10.42.42.10(pid=15794): Terminated {rc=256} 18:53:59.745452 --- ParallelTerminationStrategy: PID 15847 died... 18:53:59.766556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15847): Terminated: ok {rc=0} 18:53:59.815293 --- ParallelTerminationStrategy: PID 15848 died... 18:53:59.836267 run iperf3-srv_10.42.42.10(pid=15848): Terminated {rc=256} 18:53:59.886418 --- ParallelTerminationStrategy: PID 15849 died... 18:53:59.907495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15849): Terminated: ok {rc=0} 18:53:59.956379 --- ParallelTerminationStrategy: PID 15850 died... 18:53:59.977443 run iperf3-srv_10.42.42.10(pid=15850): Terminated {rc=256} 18:54:00.026297 --- ParallelTerminationStrategy: PID 15852 died... 18:54:00.047334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15852): Terminated: ok {rc=0} 18:54:00.097095 --- ParallelTerminationStrategy: PID 15854 died... 18:54:00.118073 run iperf3-srv_10.42.42.10(pid=15854): Terminated {rc=256} 18:54:00.166290 --- ParallelTerminationStrategy: PID 15857 died... 18:54:00.187316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15857): Terminated: ok {rc=0} 18:54:00.240371 --- ParallelTerminationStrategy: PID 15860 died... 18:54:00.261785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15860): Terminated: ok {rc=0} 18:54:00.311320 --- ParallelTerminationStrategy: PID 15863 died... 18:54:00.332504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15863): Terminated: ok {rc=0} 18:54:00.425082 bus /gobi_4: Setting Powered False 18:54:01.543319 bus /gobi_4: Setting Powered False 18:54:02.666179 bus /gobi_1: Setting Powered False 18:54:03.769201 bus /gobi_1: Setting Powered False 18:54:04.891798 bus /gobi_0: Setting Powered False 18:54:05.994085 bus /gobi_0: Setting Powered False 18:54:07.113467 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 18:54:08.221481 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:08.234747 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:54:08.309228 tst ping.py: using LAC 30809 18:54:08.433443 tst ping.py: using RAC 209 18:54:08.558489 tst ping.py: using CellId 30809 18:54:08.684504 tst ping.py: using BVCI 30810 18:54:08.801488 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:08.814097 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:08.826245 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:08.839632 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:08.854163 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:08.868074 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:08.882855 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:08.896167 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:54:09.016098 tst ping.py:19: start network... 18:54:09.227113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:09.717674 run create_hlr_db(pid=15877): Launched 18:54:09.882281 bus /gobi_6: Setting Powered False 18:54:10.945620 run create_hlr_db(pid=15877): Terminated: ok {rc=0} 18:54:11.396169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15880): Launched 18:54:11.723822 run osmo-hlr_10.42.42.2(pid=15881): Launched 18:54:11.847998 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:12.408596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15883): Launched 18:54:12.734614 run osmo-stp_10.42.42.5(pid=15884): Launched 18:54:12.859073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:13.418100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15886): Launched 18:54:13.543137 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:13.818212 run patchelf(pid=15887): Launched 18:54:13.997864 run osmo-stp_10.42.42.5(pid=15884): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15884)] 18:54:14.134204 run osmo-stp_10.42.42.5(pid=15884): stdout: | (launched: 2022-12-12_18:54:12.673433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:14.272000 run osmo-stp_10.42.42.5(pid=15884): stderr: | [0;m[38;5;43m20221212185412867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185412867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185412867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185412868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185412868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185412868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185412868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:14.410790 run osmo-stp_10.42.42.5(pid=15884): stdout: | (launched: 2022-12-12_18:54:12.673433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:14.543226 run osmo-stp_10.42.42.5(pid=15884): stderr: | [0;m[38;5;43m20221212185412867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185412867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185412867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185412868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185412868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185412868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185412868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:14.700073 run patchelf(pid=15887): Terminating (SIGINT) 18:54:14.880477 run patchelf(pid=15887): Terminated: ok {rc=0} 18:54:15.009956 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15884): Process ended prematurely: osmo-stp_10.42.42.5(pid=15884) [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15884)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 18:54:15.019734 tst ping.py:22: Test FAILED (6.8 sec) 18:54:15.048482 run osmo-hlr_10.42.42.2(pid=15881): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15881)] 18:54:15.098397 run osmo-hlr_10.42.42.2(pid=15881): stdout: | (launched: 2022-12-12_18:54:11.662312) 18:54:15.150194 run osmo-hlr_10.42.42.2(pid=15881): stderr: | [0;m[1;31m20221212185411860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185411860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185411860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185411860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185411860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185411860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185411873 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185411883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185411883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185411883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:15.202106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15880): Terminating (SIGTERM) 18:54:15.243879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15883): Terminating (SIGTERM) 18:54:15.285828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15886): Terminating (SIGTERM) 18:54:15.328413 --- ParallelTerminationStrategy: PID 15880 died... 18:54:15.348703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15880): Terminated: ok {rc=0} 18:54:15.395137 --- ParallelTerminationStrategy: PID 15883 died... 18:54:15.414982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15883): Terminated: ok {rc=0} 18:54:15.461346 --- ParallelTerminationStrategy: PID 15886 died... 18:54:15.481161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15886): Terminated: ok {rc=0} 18:54:15.570538 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 18:54:16.657915 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:16.671072 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 18:54:16.744436 tst ping_idle_ping.py: using LAC 30810 18:54:16.880607 tst ping_idle_ping.py: using RAC 210 18:54:17.007159 tst ping_idle_ping.py: using CellId 30810 18:54:17.137333 tst ping_idle_ping.py: using BVCI 30811 18:54:17.250908 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:17.262224 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:17.273283 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:17.287352 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:17.299380 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:17.310940 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:17.322671 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 18:54:17.334395 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 18:54:17.454958 tst ping_idle_ping.py:24: start network... 18:54:17.672408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:18.178992 run create_hlr_db(pid=15888): Launched 18:54:18.311999 bus /gobi_6: Setting Powered False 18:54:19.377273 run create_hlr_db(pid=15888): Terminated: ok {rc=0} 18:54:19.811750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15890): Launched 18:54:20.118952 run osmo-hlr_10.42.42.2(pid=15891): Launched 18:54:20.237408 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:20.763916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15893): Launched 18:54:21.069551 run osmo-stp_10.42.42.5(pid=15894): Launched 18:54:21.186915 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:21.709275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15896): Launched 18:54:21.824741 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:22.082226 run patchelf(pid=15897): Launched 18:54:22.251959 run osmo-stp_10.42.42.5(pid=15894): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15894)] 18:54:22.379775 run osmo-stp_10.42.42.5(pid=15894): stdout: | (launched: 2022-12-12_18:54:21.012137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:22.509771 run osmo-stp_10.42.42.5(pid=15894): stderr: | [0;m[38;5;43m20221212185421181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185421182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185421182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185421182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185421183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185421183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185421183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:22.638947 run osmo-stp_10.42.42.5(pid=15894): stdout: | (launched: 2022-12-12_18:54:21.012137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:22.763290 run osmo-stp_10.42.42.5(pid=15894): stderr: | [0;m[38;5;43m20221212185421181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185421182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185421182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185421182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185421183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185421183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185421183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:22.910129 run patchelf(pid=15897): Terminating (SIGINT) 18:54:23.079701 run patchelf(pid=15897): Terminated: ok {rc=0} 18:54:23.201587 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15894): Process ended prematurely: osmo-stp_10.42.42.5(pid=15894) [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15894)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 18:54:23.210733 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 18:54:23.237858 run osmo-hlr_10.42.42.2(pid=15891): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15891)] 18:54:23.286278 run osmo-hlr_10.42.42.2(pid=15891): stdout: | (launched: 2022-12-12_18:54:20.061549) 18:54:23.335919 run osmo-hlr_10.42.42.2(pid=15891): stderr: | [0;m[1;31m20221212185420237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185420237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185420237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185420237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185420237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185420237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185420250 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185420258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185420258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185420258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:23.385921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15890): Terminating (SIGTERM) 18:54:23.425800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15893): Terminating (SIGTERM) 18:54:23.466066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15896): Terminating (SIGTERM) 18:54:23.506459 --- ParallelTerminationStrategy: PID 15890 died... 18:54:23.525866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15890): Terminated: ok {rc=0} 18:54:23.570564 --- ParallelTerminationStrategy: PID 15893 died... 18:54:23.589407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15893): Terminated: ok {rc=0} 18:54:23.633832 --- ParallelTerminationStrategy: PID 15896 died... 18:54:23.652571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15896): Terminated: ok {rc=0} 18:54:23.736762 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 18:54:25.055801 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:54:25.064329 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 18:54:25.099277 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 18:54:25.137874 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 18:54:25.225338 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 18:54:25.257513 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 18:54:25.295490 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 18:54:25.902734 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 18:54:25.957037 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:25.969126 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:54:26.020882 tst cs_paging_gprs_active.py: using LAC 30811 18:54:26.149487 tst cs_paging_gprs_active.py: using RAC 211 18:54:26.278785 tst cs_paging_gprs_active.py: using CellId 30811 18:54:26.408216 tst cs_paging_gprs_active.py: using BVCI 30812 18:54:26.529088 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:26.541115 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:26.552803 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:26.565321 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:26.577632 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:26.590049 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:26.602425 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:26.614645 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:26.627134 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:54:26.748846 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:54:26.871892 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 18:54:27.078937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:27.387072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15901): Launched 18:54:27.657632 run iperf3-srv_10.42.42.10(pid=15902): Launched 18:54:27.773541 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 18:54:27.978379 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:28.286693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15903): Launched 18:54:28.555377 run iperf3-srv_10.42.42.10(pid=15904): Launched 18:54:28.670477 tst cs_paging_gprs_active.py:38: start network... 18:54:28.875282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:29.352799 run create_hlr_db(pid=15905): Launched 18:54:29.471296 bus /gobi_6: Setting Powered False 18:54:30.532246 run create_hlr_db(pid=15905): Terminated: ok {rc=0} 18:54:30.963296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15907): Launched 18:54:31.318103 run osmo-hlr_10.42.42.2(pid=15908): Launched 18:54:31.476916 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:32.156932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15910): Launched 18:54:32.500635 run osmo-stp_10.42.42.5(pid=15911): Launched 18:54:32.627626 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:33.190859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15913): Launched 18:54:33.315538 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:33.591662 run patchelf(pid=15914): Launched 18:54:33.774951 run osmo-stp_10.42.42.5(pid=15911): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15911)] 18:54:33.911918 run osmo-stp_10.42.42.5(pid=15911): stdout: | (launched: 2022-12-12_18:54:32.439500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:34.050997 run osmo-stp_10.42.42.5(pid=15911): stderr: | [0;m[38;5;43m20221212185432631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185432632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185432632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185432632 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185432633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185432633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185432633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:34.190162 run osmo-stp_10.42.42.5(pid=15911): stdout: | (launched: 2022-12-12_18:54:32.439500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:34.322984 run osmo-stp_10.42.42.5(pid=15911): stderr: | [0;m[38;5;43m20221212185432631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185432632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185432632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185432632 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185432633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185432633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185432633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:34.482303 run patchelf(pid=15914): Terminating (SIGINT) 18:54:34.666567 run patchelf(pid=15914): Terminated: ok {rc=0} 18:54:34.798239 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15911): Process ended prematurely: osmo-stp_10.42.42.5(pid=15911) [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15911)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 18:54:34.808920 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 18:54:34.837907 run osmo-hlr_10.42.42.2(pid=15908): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15908)] 18:54:34.888294 run osmo-hlr_10.42.42.2(pid=15908): stdout: | (launched: 2022-12-12_18:54:31.253169) 18:54:34.940228 run osmo-hlr_10.42.42.2(pid=15908): stderr: | [0;m[1;31m20221212185431611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185431611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185431611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185431611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185431611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185431611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185431631 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185431653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185431653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185431653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:34.992447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15901): Terminating (SIGTERM) 18:54:35.034454 run iperf3-srv_10.42.42.10(pid=15902): Terminating (SIGTERM) 18:54:35.076276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15903): Terminating (SIGTERM) 18:54:35.118430 run iperf3-srv_10.42.42.10(pid=15904): Terminating (SIGTERM) 18:54:35.160300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15907): Terminating (SIGTERM) 18:54:35.202695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15910): Terminating (SIGTERM) 18:54:35.244880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15913): Terminating (SIGTERM) 18:54:35.287183 --- ParallelTerminationStrategy: PID 15901 died... 18:54:35.307412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15901): Terminated: ok {rc=0} 18:54:35.353672 --- ParallelTerminationStrategy: PID 15902 died... 18:54:35.373120 run iperf3-srv_10.42.42.10(pid=15902): Terminated {rc=256} 18:54:35.419162 --- ParallelTerminationStrategy: PID 15903 died... 18:54:35.439173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15903): Terminated: ok {rc=0} 18:54:35.485445 --- ParallelTerminationStrategy: PID 15904 died... 18:54:35.504834 run iperf3-srv_10.42.42.10(pid=15904): Terminated {rc=256} 18:54:35.551075 --- ParallelTerminationStrategy: PID 15907 died... 18:54:35.570778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15907): Terminated: ok {rc=0} 18:54:35.616757 --- ParallelTerminationStrategy: PID 15910 died... 18:54:35.636360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15910): Terminated: ok {rc=0} 18:54:35.682559 --- ParallelTerminationStrategy: PID 15913 died... 18:54:35.702441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15913): Terminated: ok {rc=0} 18:54:35.791417 bus /gobi_0: Setting Powered False 18:54:36.891820 bus /gobi_0: Setting Powered False 18:54:38.011486 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 18:54:39.158775 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:39.171129 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:54:39.221521 tst iperf3.py: using LAC 30812 18:54:39.348603 tst iperf3.py: using RAC 212 18:54:39.474996 tst iperf3.py: using CellId 30812 18:54:39.603344 tst iperf3.py: using BVCI 30813 18:54:39.722714 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:39.734989 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:39.746773 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:39.758775 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:39.770645 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:39.782484 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:39.794393 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:39.806219 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:39.818254 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:54:39.937603 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 18:54:40.142576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:40.448919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15915): Launched 18:54:40.715948 run iperf3-srv_10.42.42.10(pid=15916): Launched 18:54:40.830623 tst iperf3.py:8: start network... 18:54:41.032858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:41.504938 run create_hlr_db(pid=15917): Launched 18:54:41.625096 bus /gobi_6: Setting Powered False 18:54:42.685938 run create_hlr_db(pid=15917): Terminated: ok {rc=0} 18:54:43.111032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15919): Launched 18:54:43.416361 run osmo-hlr_10.42.42.2(pid=15920): Launched 18:54:43.534748 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:44.074005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15922): Launched 18:54:44.380585 run osmo-stp_10.42.42.5(pid=15923): Launched 18:54:44.498418 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:45.025319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15925): Launched 18:54:45.143001 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:45.402371 run patchelf(pid=15926): Launched 18:54:45.572475 run osmo-stp_10.42.42.5(pid=15923): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15923)] 18:54:45.701429 run osmo-stp_10.42.42.5(pid=15923): stdout: | (launched: 2022-12-12_18:54:44.322760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:45.840472 run osmo-stp_10.42.42.5(pid=15923): stderr: | [0;m[38;5;43m20221212185444493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185444494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185444494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185444494 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185444495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185444495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185444495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:46.003356 run osmo-stp_10.42.42.5(pid=15923): stdout: | (launched: 2022-12-12_18:54:44.322760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:46.139477 run osmo-stp_10.42.42.5(pid=15923): stderr: | [0;m[38;5;43m20221212185444493 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185444494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185444494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185444494 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185444495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185444495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185444495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:46.302545 run patchelf(pid=15926): Terminating (SIGINT) 18:54:46.490260 run patchelf(pid=15926): Terminated: ok {rc=0} 18:54:46.625549 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15923): Process ended prematurely: osmo-stp_10.42.42.5(pid=15923) [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15923)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 18:54:46.636796 tst iperf3.py:8: Test FAILED (7.5 sec) 18:54:46.667591 run osmo-hlr_10.42.42.2(pid=15920): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15920)] 18:54:46.728431 run osmo-hlr_10.42.42.2(pid=15920): stdout: | (launched: 2022-12-12_18:54:43.359299) 18:54:46.793449 run osmo-hlr_10.42.42.2(pid=15920): stderr: | [0;m[1;31m20221212185443535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185443535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185443535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185443536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185443536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185443536 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185443547 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185443555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185443555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185443555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:46.858685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15915): Terminating (SIGTERM) 18:54:46.909458 run iperf3-srv_10.42.42.10(pid=15916): Terminating (SIGTERM) 18:54:46.960883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15919): Terminating (SIGTERM) 18:54:47.013641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15922): Terminating (SIGTERM) 18:54:47.064671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15925): Terminating (SIGTERM) 18:54:47.114818 --- ParallelTerminationStrategy: PID 15915 died... 18:54:47.134432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15915): Terminated: ok {rc=0} 18:54:47.182493 --- ParallelTerminationStrategy: PID 15916 died... 18:54:47.202209 run iperf3-srv_10.42.42.10(pid=15916): Terminated {rc=256} 18:54:47.247150 --- ParallelTerminationStrategy: PID 15919 died... 18:54:47.265985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15919): Terminated: ok {rc=0} 18:54:47.310767 --- ParallelTerminationStrategy: PID 15922 died... 18:54:47.329571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15922): Terminated: ok {rc=0} 18:54:47.374542 --- ParallelTerminationStrategy: PID 15925 died... 18:54:47.393360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15925): Terminated: ok {rc=0} 18:54:47.477287 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 18:54:48.629253 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:48.642115 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:54:48.696550 tst iperf3m4.py: using LAC 30813 18:54:48.825295 tst iperf3m4.py: using RAC 213 18:54:48.952420 tst iperf3m4.py: using CellId 30813 18:54:49.072366 tst iperf3m4.py: using BVCI 30814 18:54:49.183152 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:49.195010 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:49.206479 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:49.218186 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:49.230084 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:49.241719 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:49.253585 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:49.265030 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:54:49.276769 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:54:49.395606 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:54:49.520019 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:54:49.642581 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:54:49.763504 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 18:54:49.984639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:50.313535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15927): Launched 18:54:50.599895 run iperf3-srv_10.42.42.10(pid=15928): Launched 18:54:50.725436 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 18:54:50.944374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:51.270752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15929): Launched 18:54:51.554957 run iperf3-srv_10.42.42.10(pid=15930): Launched 18:54:51.677949 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 18:54:51.897368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:52.224538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15931): Launched 18:54:52.509897 run iperf3-srv_10.42.42.10(pid=15932): Launched 18:54:52.632162 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 18:54:52.851922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 18:54:53.179098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15933): Launched 18:54:53.464754 run iperf3-srv_10.42.42.10(pid=15934): Launched 18:54:53.588296 tst iperf3m4.py:8: start network... 18:54:53.806962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:54:54.311788 run create_hlr_db(pid=15935): Launched 18:54:54.445162 bus /gobi_6: Setting Powered False 18:54:55.509579 run create_hlr_db(pid=15935): Terminated: ok {rc=0} 18:54:55.962991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15937): Launched 18:54:56.289688 run osmo-hlr_10.42.42.2(pid=15938): Launched 18:54:56.415272 run osmo-stp_10.42.42.5: Starting osmo-stp 18:54:56.981982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15940): Launched 18:54:57.310522 run osmo-stp_10.42.42.5(pid=15941): Launched 18:54:57.435875 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:54:58.005871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15943): Launched 18:54:58.131433 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:54:58.408065 run patchelf(pid=15944): Launched 18:54:58.591131 run osmo-stp_10.42.42.5(pid=15941): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15941)] 18:54:58.729348 run osmo-stp_10.42.42.5(pid=15941): stdout: | (launched: 2022-12-12_18:54:57.249667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:58.868142 run osmo-stp_10.42.42.5(pid=15941): stderr: | [0;m[38;5;43m20221212185457441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185457441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185457441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185457442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185457442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185457442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185457442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:59.006953 run osmo-stp_10.42.42.5(pid=15941): stdout: | (launched: 2022-12-12_18:54:57.249667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:54:59.139705 run osmo-stp_10.42.42.5(pid=15941): stderr: | [0;m[38;5;43m20221212185457441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185457441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185457441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185457442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185457442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185457442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185457442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:54:59.297498 run patchelf(pid=15944): Terminating (SIGINT) 18:54:59.479047 run patchelf(pid=15944): Terminated: ok {rc=0} 18:54:59.610200 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15941): Process ended prematurely: osmo-stp_10.42.42.5(pid=15941) [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15941)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 18:54:59.620612 tst iperf3m4.py:8: Test FAILED (11.0 sec) 18:54:59.649714 run osmo-hlr_10.42.42.2(pid=15938): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15938)] 18:54:59.699787 run osmo-hlr_10.42.42.2(pid=15938): stdout: | (launched: 2022-12-12_18:54:56.229213) 18:54:59.751706 run osmo-hlr_10.42.42.2(pid=15938): stderr: | [0;m[1;31m20221212185456427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185456427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185456427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185456427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185456427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185456427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185456440 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185456449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185456449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185456449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:54:59.803787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15927): Terminating (SIGTERM) 18:54:59.845713 run iperf3-srv_10.42.42.10(pid=15928): Terminating (SIGTERM) 18:54:59.887561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15929): Terminating (SIGTERM) 18:54:59.929981 run iperf3-srv_10.42.42.10(pid=15930): Terminating (SIGTERM) 18:54:59.971689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15931): Terminating (SIGTERM) 18:55:00.013648 run iperf3-srv_10.42.42.10(pid=15932): Terminating (SIGTERM) 18:55:00.055320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15933): Terminating (SIGTERM) 18:55:00.097177 run iperf3-srv_10.42.42.10(pid=15934): Terminating (SIGTERM) 18:55:00.138763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15937): Terminating (SIGTERM) 18:55:00.180772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15940): Terminating (SIGTERM) 18:55:00.222552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15943): Terminating (SIGTERM) 18:55:00.264551 --- ParallelTerminationStrategy: PID 15927 died... 18:55:00.284553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15927): Terminated: ok {rc=0} 18:55:00.331001 --- ParallelTerminationStrategy: PID 15928 died... 18:55:00.350620 run iperf3-srv_10.42.42.10(pid=15928): Terminated {rc=256} 18:55:00.396659 --- ParallelTerminationStrategy: PID 15929 died... 18:55:00.416256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15929): Terminated: ok {rc=0} 18:55:00.462339 --- ParallelTerminationStrategy: PID 15930 died... 18:55:00.482071 run iperf3-srv_10.42.42.10(pid=15930): Terminated {rc=256} 18:55:00.528011 --- ParallelTerminationStrategy: PID 15931 died... 18:55:00.547613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15931): Terminated: ok {rc=0} 18:55:00.593659 --- ParallelTerminationStrategy: PID 15932 died... 18:55:00.613291 run iperf3-srv_10.42.42.10(pid=15932): Terminated {rc=256} 18:55:00.659062 --- ParallelTerminationStrategy: PID 15933 died... 18:55:00.678649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15933): Terminated: ok {rc=0} 18:55:00.726255 --- ParallelTerminationStrategy: PID 15934 died... 18:55:00.745875 run iperf3-srv_10.42.42.10(pid=15934): Terminated {rc=256} 18:55:00.791926 --- ParallelTerminationStrategy: PID 15937 died... 18:55:00.811535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15937): Terminated: ok {rc=0} 18:55:00.878794 --- ParallelTerminationStrategy: PID 15940 died... 18:55:00.902524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15940): Terminated: ok {rc=0} 18:55:00.954275 --- ParallelTerminationStrategy: PID 15943 died... 18:55:00.974705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15943): Terminated: ok {rc=0} 18:55:01.066050 bus /gobi_4: Setting Powered False 18:55:02.173670 bus /gobi_4: Setting Powered False 18:55:03.294556 bus /gobi_1: Setting Powered False 18:55:04.390642 bus /gobi_1: Setting Powered False 18:55:05.505028 bus /gobi_0: Setting Powered False 18:55:06.603794 bus /gobi_0: Setting Powered False 18:55:07.721521 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 18:55:08.823956 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:08.836172 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:55:08.886208 tst ping.py: using LAC 30814 18:55:09.004879 tst ping.py: using RAC 214 18:55:09.121215 tst ping.py: using CellId 30814 18:55:09.238875 tst ping.py: using BVCI 30815 18:55:09.348205 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:09.359813 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:09.371199 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:09.382925 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:09.394266 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:09.405737 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:09.417080 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:09.428820 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:55:09.548877 tst ping.py:19: start network... 18:55:09.765714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:10.263267 run create_hlr_db(pid=15949): Launched 18:55:10.396510 bus /gobi_6: Setting Powered False 18:55:11.460355 run create_hlr_db(pid=15949): Terminated: ok {rc=0} 18:55:11.891728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15951): Launched 18:55:12.193556 run osmo-hlr_10.42.42.2(pid=15952): Launched 18:55:12.310295 run osmo-stp_10.42.42.5: Starting osmo-stp 18:55:12.848329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15954): Launched 18:55:13.150270 run osmo-stp_10.42.42.5(pid=15955): Launched 18:55:13.267367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:55:13.786519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15957): Launched 18:55:13.903008 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:55:14.157357 run patchelf(pid=15958): Launched 18:55:14.324742 run osmo-stp_10.42.42.5(pid=15955): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15955)] 18:55:14.451235 run osmo-stp_10.42.42.5(pid=15955): stdout: | (launched: 2022-12-12_18:55:13.093873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:14.579316 run osmo-stp_10.42.42.5(pid=15955): stderr: | [0;m[38;5;43m20221212185513263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185513263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185513264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185513264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185513265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185513265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185513265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:14.707635 run osmo-stp_10.42.42.5(pid=15955): stdout: | (launched: 2022-12-12_18:55:13.093873) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:14.830638 run osmo-stp_10.42.42.5(pid=15955): stderr: | [0;m[38;5;43m20221212185513263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185513263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185513264 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185513264 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185513265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185513265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185513265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:14.975925 run patchelf(pid=15958): Terminating (SIGINT) 18:55:15.144001 run patchelf(pid=15958): Terminated: ok {rc=0} 18:55:15.264790 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15955): Process ended prematurely: osmo-stp_10.42.42.5(pid=15955) [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15955)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 18:55:15.273935 tst ping.py:22: Test FAILED (6.4 sec) 18:55:15.301309 run osmo-hlr_10.42.42.2(pid=15952): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15952)] 18:55:15.350026 run osmo-hlr_10.42.42.2(pid=15952): stdout: | (launched: 2022-12-12_18:55:12.136885) 18:55:15.400082 run osmo-hlr_10.42.42.2(pid=15952): stderr: | [0;m[1;31m20221212185512313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185512313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185512313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185512313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185512313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185512314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185512326 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185512335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185512335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185512335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:15.450614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15951): Terminating (SIGTERM) 18:55:15.490873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15954): Terminating (SIGTERM) 18:55:15.531409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15957): Terminating (SIGTERM) 18:55:15.571866 --- ParallelTerminationStrategy: PID 15951 died... 18:55:15.591331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15951): Terminated: ok {rc=0} 18:55:15.636564 --- ParallelTerminationStrategy: PID 15954 died... 18:55:15.655246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15954): Terminated: ok {rc=0} 18:55:15.700015 --- ParallelTerminationStrategy: PID 15957 died... 18:55:15.718678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15957): Terminated: ok {rc=0} 18:55:15.805903 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 18:55:16.907038 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:16.922387 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 18:55:16.979057 tst ping_idle_ping.py: using LAC 30815 18:55:17.109424 tst ping_idle_ping.py: using RAC 215 18:55:17.246724 tst ping_idle_ping.py: using CellId 30815 18:55:17.365654 tst ping_idle_ping.py: using BVCI 30816 18:55:17.476501 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:17.488211 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:17.499720 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:17.511378 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:17.523042 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:17.534741 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:17.546552 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 18:55:17.558312 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 18:55:17.674611 tst ping_idle_ping.py:24: start network... 18:55:17.876833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:18.347259 run create_hlr_db(pid=15959): Launched 18:55:18.463327 bus /gobi_6: Setting Powered False 18:55:19.523506 run create_hlr_db(pid=15959): Terminated: ok {rc=0} 18:55:19.944903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15961): Launched 18:55:20.248749 run osmo-hlr_10.42.42.2(pid=15962): Launched 18:55:20.364595 run osmo-stp_10.42.42.5: Starting osmo-stp 18:55:20.885994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15964): Launched 18:55:21.186957 run osmo-stp_10.42.42.5(pid=15965): Launched 18:55:21.303811 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:55:21.822368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15967): Launched 18:55:21.938753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:55:22.193359 run patchelf(pid=15968): Launched 18:55:22.361307 run osmo-stp_10.42.42.5(pid=15965): ERR: Terminated: ERROR {rc=1} [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15965)] 18:55:22.488176 run osmo-stp_10.42.42.5(pid=15965): stdout: | (launched: 2022-12-12_18:55:21.130496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:22.616551 run osmo-stp_10.42.42.5(pid=15965): stderr: | [0;m[38;5;43m20221212185521298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185521299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185521299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185521299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185521300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185521300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185521300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:22.745455 run osmo-stp_10.42.42.5(pid=15965): stdout: | (launched: 2022-12-12_18:55:21.130496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:22.868595 run osmo-stp_10.42.42.5(pid=15965): stderr: | [0;m[38;5;43m20221212185521298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185521299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185521299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185521299 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185521300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185521300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185521300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:23.014586 run patchelf(pid=15968): Terminating (SIGINT) 18:55:23.183076 run patchelf(pid=15968): Terminated: ok {rc=0} 18:55:23.304171 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15965): Process ended prematurely: osmo-stp_10.42.42.5(pid=15965) [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15965)] [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 18:55:23.313569 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 18:55:23.341074 run osmo-hlr_10.42.42.2(pid=15962): ERR: Terminated: ERROR {rc=237} [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15962)] 18:55:23.389125 run osmo-hlr_10.42.42.2(pid=15962): stdout: | (launched: 2022-12-12_18:55:20.192221) 18:55:23.438609 run osmo-hlr_10.42.42.2(pid=15962): stderr: | [0;m[1;31m20221212185520368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185520368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185520368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185520368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185520368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185520369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185520381 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185520390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185520390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185520390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:23.488685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15961): Terminating (SIGTERM) 18:55:23.528650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15964): Terminating (SIGTERM) 18:55:23.568691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15967): Terminating (SIGTERM) 18:55:23.609093 --- ParallelTerminationStrategy: PID 15961 died... 18:55:23.628176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15961): Terminated: ok {rc=0} 18:55:23.672765 --- ParallelTerminationStrategy: PID 15964 died... 18:55:23.691418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15964): Terminated: ok {rc=0} 18:55:23.736231 --- ParallelTerminationStrategy: PID 15967 died... 18:55:23.754763 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15967): Terminated: ok {rc=0} 18:55:23.839312 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 18:55:25.156061 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:55:25.164032 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 18:55:25.196771 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 18:55:25.231608 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 18:55:25.285062 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 18:55:25.317099 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 18:55:25.351312 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 18:55:25.913200 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2380 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 18:55:25.918237 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:55:25.929889 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 18:55:25.998737 tst switch_tch_pdch.py: using LAC 30816 18:55:26.122133 tst switch_tch_pdch.py: using RAC 216 18:55:26.238977 tst switch_tch_pdch.py: using CellId 30816 18:55:26.354277 tst switch_tch_pdch.py: using BVCI 30817 18:55:26.462170 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:55:26.473810 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:55:26.485280 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:55:26.496927 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:55:26.508667 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:55:26.520459 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:55:26.532315 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 18:55:26.544022 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:55:26.665618 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 18:55:26.788501 tst switch_tch_pdch.py:51: start network... 18:55:27.004683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:27.502929 run create_hlr_db(pid=15973): Launched 18:55:27.636495 bus /gobi_6: Setting Powered False 18:55:28.700261 run create_hlr_db(pid=15973): Terminated: ok {rc=0} 18:55:29.148050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15975): Launched 18:55:29.470975 run osmo-hlr_10.42.42.2(pid=15976): Launched 18:55:29.595616 run osmo-stp_10.42.42.5: Starting osmo-stp 18:55:30.147343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15978): Launched 18:55:30.469554 run osmo-stp_10.42.42.5(pid=15979): Launched 18:55:30.593893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 18:55:31.172399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15981): Launched 18:55:31.305385 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 18:55:31.570801 run patchelf(pid=15982): Launched 18:55:31.751843 run osmo-stp_10.42.42.5(pid=15979): ERR: Terminated: ERROR {rc=1} [trial-2380↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15979)] 18:55:31.889199 run osmo-stp_10.42.42.5(pid=15979): stdout: | (launched: 2022-12-12_18:55:30.410000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:32.028449 run osmo-stp_10.42.42.5(pid=15979): stderr: | [0;m[38;5;43m20221212185530600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185530600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185530600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185530601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185530601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185530601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185530601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:32.167299 run osmo-stp_10.42.42.5(pid=15979): stdout: | (launched: 2022-12-12_18:55:30.410000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:55:32.299507 run osmo-stp_10.42.42.5(pid=15979): stderr: | [0;m[38;5;43m20221212185530600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185530600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185530600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185530601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185530601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185530601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185530601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:55:32.455407 run patchelf(pid=15982): Terminating (SIGINT) 18:55:32.635893 run patchelf(pid=15982): Terminated: ok {rc=0} 18:55:32.766134 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15979): Process ended prematurely: osmo-stp_10.42.42.5(pid=15979) [trial-2380↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15979)] [trial-2380↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 18:55:32.776507 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 18:55:32.805206 run osmo-hlr_10.42.42.2(pid=15976): ERR: Terminated: ERROR {rc=237} [trial-2380↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15976)] 18:55:32.855812 run osmo-hlr_10.42.42.2(pid=15976): stdout: | (launched: 2022-12-12_18:55:29.411335) 18:55:32.908394 run osmo-hlr_10.42.42.2(pid=15976): stderr: | [0;m[1;31m20221212185529609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185529610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185529610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185529610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185529610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185529610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185529623 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185529631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185529632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185529632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:32.961778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15975): Terminating (SIGTERM) 18:55:33.004479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15978): Terminating (SIGTERM) 18:55:33.047072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15981): Terminating (SIGTERM) 18:55:33.089689 --- ParallelTerminationStrategy: PID 15975 died... 18:55:33.110228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15975): Terminated: ok {rc=0} 18:55:33.157483 --- ParallelTerminationStrategy: PID 15978 died... 18:55:33.177510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15978): Terminated: ok {rc=0} 18:55:33.224232 --- ParallelTerminationStrategy: PID 15981 died... 18:55:33.244088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15981): Terminated: ok {rc=0} 18:55:33.333670 bus /gobi_0: Setting Powered False 18:55:34.433835 bus /gobi_0: Setting Powered False 18:55:35.549415 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2380 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 nitb_smpp --------------------------------------------------------------------- 18:55:36.812703 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:55:36.815578 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 18:55:36.837009 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 18:55:36.844351 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 18:55:36.879235 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 18:55:36.900678 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 18:55:36.907798 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 18:55:37.427384 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2380 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 18:55:37.432574 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 18:55:37.454413 tst esme_connect_policy_acceptall.py: using MSISDN 7913 18:55:37.598239 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:55:38.210254 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15986): Launched 18:55:38.538298 run osmo-nitb_10.42.42.2(pid=15987): Launched 18:55:38.721169 run osmo-nitb_10.42.42.2(pid=15987): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15987)] 18:55:38.866795 run osmo-nitb_10.42.42.2(pid=15987): stdout: | (launched: 2022-12-12_18:55:38.477586) 18:55:39.014000 run osmo-nitb_10.42.42.2(pid=15987): stderr: | (launched: 2022-12-12_18:55:38.526140) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:55:39.160774 run osmo-nitb_10.42.42.2(pid=15987): stdout: | (launched: 2022-12-12_18:55:38.477586) 18:55:39.301999 run osmo-nitb_10.42.42.2(pid=15987): stderr: | (launched: 2022-12-12_18:55:38.526140) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15987): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15987) [trial-2380↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15987)] 18:55:39.664035 tst osmo-nitb_10.42.42.2(pid=15987): stdout: | (launched: 2022-12-12_18:55:38.477586) 18:55:39.796714 tst osmo-nitb_10.42.42.2(pid=15987): stderr: | (launched: 2022-12-12_18:55:38.526140) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:55:39.952556 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=15987): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15987) [trial-2380↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15987)] [trial-2380↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 18:55:39.961821 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 18:55:39.969298 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15986): Terminating (SIGTERM) 18:55:40.179889 --- ParallelTerminationStrategy: PID 15986 died... 18:55:40.201455 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15986): Terminated: ok {rc=0} ---------------------------------------------- trial-2380 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 18:55:40.252598 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 18:55:40.275447 tst esme_connect_policy_closed.py: using MSISDN 7914 18:55:40.404896 tst esme_connect_policy_closed.py: using MSISDN 7915 18:55:40.522765 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:55:41.134379 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15988): Launched 18:55:41.463239 run osmo-nitb_10.42.42.2(pid=15989): Launched 18:55:41.641980 run osmo-nitb_10.42.42.2(pid=15989): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15989)] 18:55:41.777313 run osmo-nitb_10.42.42.2(pid=15989): stdout: | (launched: 2022-12-12_18:55:41.402450) 18:55:41.937881 run osmo-nitb_10.42.42.2(pid=15989): stderr: | (launched: 2022-12-12_18:55:41.451145) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:55:42.074046 run osmo-nitb_10.42.42.2(pid=15989): stdout: | (launched: 2022-12-12_18:55:41.402450) 18:55:42.204889 run osmo-nitb_10.42.42.2(pid=15989): stderr: | (launched: 2022-12-12_18:55:41.451145) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:55:42.361083 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=15989): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15989) [trial-2380↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15989)] [trial-2380↪nitb_smpp↪esme_connect_policy_closed.py:24] 18:55:42.370248 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 18:55:42.377375 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15988): Terminating (SIGTERM) 18:55:42.587644 --- ParallelTerminationStrategy: PID 15988 died... 18:55:42.608874 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15988): Terminated: ok {rc=0} ---------------------------------------------- trial-2380 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 18:55:42.659636 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 18:55:42.671448 tst nitb_smpp: Using 1 x bts (candidates: 1) 18:55:42.708484 tst esme_ms_sms_storeforward.py: using LAC 30817 18:55:42.839091 tst esme_ms_sms_storeforward.py: using RAC 217 18:55:42.969134 tst esme_ms_sms_storeforward.py: using CellId 30817 18:55:43.100751 tst esme_ms_sms_storeforward.py: using BVCI 30818 18:55:43.221426 tst nitb_smpp: Using 1 x modem (candidates: 1) 18:55:43.348696 tst esme_ms_sms_storeforward.py: using MSISDN 7916 18:55:43.460859 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 18:55:43.667927 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:55:44.298707 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15990): Launched 18:55:44.611041 run osmo-nitb_10.42.42.2(pid=15991): Launched 18:55:44.780835 run osmo-nitb_10.42.42.2(pid=15991): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15991)] 18:55:44.908606 run osmo-nitb_10.42.42.2(pid=15991): stdout: | (launched: 2022-12-12_18:55:44.553223) 18:55:45.037901 run osmo-nitb_10.42.42.2(pid=15991): stderr: | (launched: 2022-12-12_18:55:44.599030) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:55:45.166835 run osmo-nitb_10.42.42.2(pid=15991): stdout: | (launched: 2022-12-12_18:55:44.553223) 18:55:45.289999 run osmo-nitb_10.42.42.2(pid=15991): stderr: | (launched: 2022-12-12_18:55:44.599030) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:55:45.437540 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=15991): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15991) [trial-2380↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15991)] [trial-2380↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 18:55:45.445938 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.8 sec) 18:55:45.452639 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15990): Terminating (SIGTERM) 18:55:45.662101 --- ParallelTerminationStrategy: PID 15990 died... 18:55:45.683089 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15990): Terminated: ok {rc=0} 18:55:45.770797 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 18:55:46.858006 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 18:55:46.870768 tst nitb_smpp: Using 1 x bts (candidates: 1) 18:55:46.913839 tst esme_ms_sms_transaction.py: using LAC 30818 18:55:47.082573 tst esme_ms_sms_transaction.py: using RAC 218 18:55:47.231383 tst esme_ms_sms_transaction.py: using CellId 30818 18:55:47.362707 tst esme_ms_sms_transaction.py: using BVCI 30819 18:55:47.482625 tst nitb_smpp: Using 1 x modem (candidates: 1) 18:55:47.614398 tst esme_ms_sms_transaction.py: using MSISDN 7917 18:55:47.728456 tst esme_ms_sms_transaction.py:18: start nitb and bts... 18:55:47.935958 run osmo-nitb_10.42.42.2: Starting osmo-nitb 18:55:48.561972 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15992): Launched 18:55:48.871896 run osmo-nitb_10.42.42.2(pid=15993): Launched 18:55:49.043816 run osmo-nitb_10.42.42.2(pid=15993): ERR: Terminated: ERROR {rc=2} [trial-2380↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15993)] 18:55:49.182211 run osmo-nitb_10.42.42.2(pid=15993): stdout: | (launched: 2022-12-12_18:55:48.814483) 18:55:49.321794 run osmo-nitb_10.42.42.2(pid=15993): stderr: | (launched: 2022-12-12_18:55:48.860076) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:55:49.461277 run osmo-nitb_10.42.42.2(pid=15993): stdout: | (launched: 2022-12-12_18:55:48.814483) 18:55:49.595664 run osmo-nitb_10.42.42.2(pid=15993): stderr: | (launched: 2022-12-12_18:55:48.860076) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f310f819268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15993): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15993) [trial-2380↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15993)] 18:55:49.989496 tst osmo-nitb_10.42.42.2(pid=15993): stdout: | (launched: 2022-12-12_18:55:48.814483) 18:55:50.115410 tst osmo-nitb_10.42.42.2(pid=15993): stderr: | (launched: 2022-12-12_18:55:48.860076) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 18:55:50.262465 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=15993): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15993) [trial-2380↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15993)] [trial-2380↪nitb_smpp↪esme_ms_sms_transaction.py:21] 18:55:50.270993 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 18:55:50.277718 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15992): Terminating (SIGTERM) 18:55:50.487895 --- ParallelTerminationStrategy: PID 15992 died... 18:55:50.508627 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15992): Terminated: ok {rc=0} 18:55:50.596325 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 smpp --------------------------------------------------------------------- 18:55:51.767521 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:55:51.770685 tst smpp: Verifying 1 x bts (candidates: 11) 18:55:51.792466 tst smpp: Verifying 6 x ip_address (candidates: 9) 18:55:51.821141 tst smpp: Verifying 1 x modem (candidates: 12) 18:55:51.858290 tst smpp: Reserving 1 x bts (candidates: 11) 18:55:51.879215 tst smpp: Reserving 6 x ip_address (candidates: 9) 18:55:51.906661 tst smpp: Reserving 1 x modem (candidates: 12) 18:55:52.434936 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2380 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 18:55:52.440408 tst smpp: Using 1 x ip_address (candidates: 6) 18:55:52.451625 tst smpp: Using 1 x ip_address (candidates: 6) 18:55:52.462786 tst smpp: Using 1 x ip_address (candidates: 6) 18:55:52.473859 tst smpp: Using 1 x ip_address (candidates: 6) 18:55:52.493888 tst esme_connect_policy_acceptall.py: using MSISDN 7918 18:55:52.615668 run osmo-stp_10.42.42.4: Starting osmo-stp 18:55:53.179233 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15997): Launched 18:55:53.511162 run osmo-stp_10.42.42.4(pid=15998): Launched 18:55:53.638909 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:55:54.152035 run create_hlr_db(pid=15999): Launched 18:55:54.286842 bus /sierra_2: Setting Powered False 18:55:55.351501 run create_hlr_db(pid=15999): Terminated: ok {rc=0} 18:55:55.793537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16001): Launched 18:55:56.104876 run osmo-hlr_10.42.42.2(pid=16002): Launched 18:55:56.224504 run osmo-msc_10.42.42.5: Starting osmo-msc 18:55:56.800518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16004): Launched 18:55:57.113841 run osmo-msc_10.42.42.5(pid=16005): Launched 18:55:57.289858 run osmo-hlr_10.42.42.2(pid=16002): ERR: Terminated: ERROR {rc=237} [trial-2380↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16002)] 18:55:57.425671 run osmo-hlr_10.42.42.2(pid=16002): stdout: | (launched: 2022-12-12_18:55:56.047000) 18:55:57.567716 run osmo-hlr_10.42.42.2(pid=16002): stderr: | [0;m[1;31m20221212185556223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185556223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185556223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185556223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185556223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185556223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185556235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185556244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185556244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185556244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:57.707331 run osmo-hlr_10.42.42.2(pid=16002): stdout: | (launched: 2022-12-12_18:55:56.047000) 18:55:57.839717 run osmo-hlr_10.42.42.2(pid=16002): stderr: | [0;m[1;31m20221212185556223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185556223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185556223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185556223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185556223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185556223 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185556235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185556244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185556244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185556244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:55:57.997260 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=16002): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16002) [trial-2380↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16002)] [trial-2380↪smpp↪esme_connect_policy_acceptall.py:23] 18:55:58.006422 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.6 sec) 18:55:58.033798 run osmo-msc_10.42.42.5(pid=16005): ERR: Terminated: ERROR {rc=9} [trial-2380↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=16005)] 18:55:58.084374 run osmo-msc_10.42.42.5(pid=16005): stdout: | (launched: 2022-12-12_18:55:57.055256) 18:55:58.136469 run osmo-msc_10.42.42.5(pid=16005): stderr: | [0;m[38;5;43m20221212185557374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221212185557374 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221212185557375 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221212185557375 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221212185557375 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221212185557375 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221212185557375 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221212185557375 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221212185557375 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 18:55:58.188895 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15997): Terminating (SIGTERM) 18:55:58.231146 run osmo-stp_10.42.42.4(pid=15998): Terminating (SIGTERM) 18:55:58.273167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16001): Terminating (SIGTERM) 18:55:58.316710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16004): Terminating (SIGTERM) 18:55:58.362404 --- ParallelTerminationStrategy: PID 15997 died... 18:55:58.383381 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15997): Terminated: ok {rc=0} 18:55:58.431758 --- ParallelTerminationStrategy: PID 15998 died... 18:55:58.451301 run osmo-stp_10.42.42.4(pid=15998): Terminated: ok {rc=0} 18:55:58.497332 --- ParallelTerminationStrategy: PID 16001 died... 18:55:58.516785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16001): Terminated: ok {rc=0} 18:55:58.563173 --- ParallelTerminationStrategy: PID 16004 died... 18:55:58.582815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16004): Terminated: ok {rc=0} ---------------------------------------------- trial-2380 smpp esme_connect_policy_closed.py ---------------------------------------------- 18:55:58.634823 tst smpp: Using 1 x ip_address (candidates: 6) 18:55:58.646529 tst smpp: Using 1 x bts (candidates: 1) 18:55:58.682571 tst esme_connect_policy_closed.py: using LAC 30819 18:55:58.813482 tst esme_connect_policy_closed.py: using RAC 219 18:55:58.942575 tst esme_connect_policy_closed.py: using CellId 30819 18:55:59.073347 tst esme_connect_policy_closed.py: using BVCI 30820 18:55:59.194678 tst smpp: Using 1 x ip_address (candidates: 6) 18:55:59.205783 tst smpp: Using 1 x ip_address (candidates: 6) 18:55:59.216629 tst smpp: Using 1 x ip_address (candidates: 6) 18:55:59.237968 tst esme_connect_policy_closed.py: using MSISDN 7919 18:55:59.360778 tst esme_connect_policy_closed.py: using MSISDN 7920 18:55:59.475187 run osmo-stp_10.42.42.4: Starting osmo-stp 18:56:00.004669 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16008): Launched 18:56:00.316582 run osmo-stp_10.42.42.4(pid=16009): Launched 18:56:00.436504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:00.937758 run create_hlr_db(pid=16010): Launched 18:56:02.184345 run create_hlr_db(pid=16010): Terminated: ok {rc=0} 18:56:02.538610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16012): Launched 18:56:02.871861 run osmo-hlr_10.42.42.2(pid=16013): Launched 18:56:02.999153 run osmo-msc_10.42.42.5: Starting osmo-msc 18:56:03.601790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16015): Launched 18:56:03.936509 run osmo-msc_10.42.42.5(pid=16016): Launched 18:56:04.122064 run osmo-hlr_10.42.42.2(pid=16013): ERR: Terminated: ERROR {rc=237} [trial-2380↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16013)] 18:56:04.262151 run osmo-hlr_10.42.42.2(pid=16013): stdout: | (launched: 2022-12-12_18:56:02.810150) 18:56:04.401739 run osmo-hlr_10.42.42.2(pid=16013): stderr: | [0;m[1;31m20221212185603008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185603008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185603008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185603008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185603008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185603008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185603021 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185603031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185603032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185603032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:04.540324 run osmo-hlr_10.42.42.2(pid=16013): stdout: | (launched: 2022-12-12_18:56:02.810150) 18:56:04.671812 run osmo-hlr_10.42.42.2(pid=16013): stderr: | [0;m[1;31m20221212185603008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185603008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185603008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185603008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185603008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185603008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185603021 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185603031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185603032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185603032 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:04.829683 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=16013): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16013) [trial-2380↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16013)] [trial-2380↪smpp↪esme_connect_policy_closed.py:31] 18:56:04.838752 tst esme_connect_policy_closed.py:31: Test FAILED (6.2 sec) 18:56:04.866339 run osmo-msc_10.42.42.5(pid=16016): ERR: Terminated: ERROR {rc=9} [trial-2380↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=16016)] 18:56:04.917449 run osmo-msc_10.42.42.5(pid=16016): stdout: | (launched: 2022-12-12_18:56:03.874709) 18:56:04.969875 run osmo-msc_10.42.42.5(pid=16016): stderr: | [0;m[38;5;43m20221212185604241 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221212185604241 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221212185604241 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221212185604241 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221212185604241 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221212185604242 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221212185604242 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221212185604242 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221212185604242 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 18:56:05.022609 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16008): Terminating (SIGTERM) 18:56:05.064795 run osmo-stp_10.42.42.4(pid=16009): Terminating (SIGTERM) 18:56:05.106952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16012): Terminating (SIGTERM) 18:56:05.150654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16015): Terminating (SIGTERM) 18:56:05.195960 --- ParallelTerminationStrategy: PID 16008 died... 18:56:05.217276 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16008): Terminated: ok {rc=0} 18:56:05.266481 --- ParallelTerminationStrategy: PID 16009 died... 18:56:05.286282 run osmo-stp_10.42.42.4(pid=16009): Terminated: ok {rc=0} 18:56:05.333547 --- ParallelTerminationStrategy: PID 16012 died... 18:56:05.353439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16012): Terminated: ok {rc=0} 18:56:05.400055 --- ParallelTerminationStrategy: PID 16015 died... 18:56:05.419889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16015): Terminated: ok {rc=0} ---------------------------------------------- trial-2380 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 18:56:05.471855 tst smpp: Using 1 x ip_address (candidates: 6) 18:56:05.483702 tst smpp: Using 1 x bts (candidates: 1) 18:56:05.520132 tst esme_ms_sms_storeforward.py: using LAC 30820 18:56:05.650663 tst esme_ms_sms_storeforward.py: using RAC 220 18:56:05.782221 tst esme_ms_sms_storeforward.py: using CellId 30820 18:56:05.911804 tst esme_ms_sms_storeforward.py: using BVCI 30821 18:56:06.033823 tst smpp: Using 1 x ip_address (candidates: 6) 18:56:06.044693 tst smpp: Using 1 x ip_address (candidates: 6) 18:56:06.055593 tst smpp: Using 1 x ip_address (candidates: 6) 18:56:06.066466 tst smpp: Using 1 x ip_address (candidates: 6) 18:56:06.077371 tst smpp: Using 1 x ip_address (candidates: 6) 18:56:06.088285 tst smpp: Using 1 x modem (candidates: 1) 18:56:06.218349 tst esme_ms_sms_storeforward.py: using MSISDN 7921 18:56:06.338958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:06.854845 run create_hlr_db(pid=16019): Launched 18:56:08.047892 run create_hlr_db(pid=16019): Terminated: ok {rc=0} 18:56:08.398994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16021): Launched 18:56:08.732608 run osmo-hlr_10.42.42.2(pid=16022): Launched 18:56:08.862614 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:09.438708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16024): Launched 18:56:09.772929 run osmo-stp_10.42.42.5(pid=16025): Launched 18:56:09.901473 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:10.505658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16027): Launched 18:56:10.839077 run osmo-msc_10.42.42.6(pid=16028): Launched 18:56:11.025263 run osmo-stp_10.42.42.5(pid=16025): ERR: Terminated: ERROR {rc=1} [trial-2380↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16025)] 18:56:11.164118 run osmo-stp_10.42.42.5(pid=16025): stdout: | (launched: 2022-12-12_18:56:09.710596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:11.304192 run osmo-stp_10.42.42.5(pid=16025): stderr: | [0;m[38;5;43m20221212185609907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185609907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185609907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185609907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185609908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185609908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185609908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:11.442422 run osmo-stp_10.42.42.5(pid=16025): stdout: | (launched: 2022-12-12_18:56:09.710596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:11.573899 run osmo-stp_10.42.42.5(pid=16025): stderr: | [0;m[38;5;43m20221212185609907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185609907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185609907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185609907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185609908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185609908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185609908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:11.731576 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=16025): Process ended prematurely: osmo-stp_10.42.42.5(pid=16025) [trial-2380↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16025)] [trial-2380↪smpp↪esme_ms_sms_storeforward.py:30] 18:56:11.740601 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.3 sec) 18:56:11.768585 run osmo-hlr_10.42.42.2(pid=16022): ERR: Terminated: ERROR {rc=237} [trial-2380↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16022)] 18:56:11.819521 run osmo-hlr_10.42.42.2(pid=16022): stdout: | (launched: 2022-12-12_18:56:08.670735) 18:56:11.871910 run osmo-hlr_10.42.42.2(pid=16022): stderr: | [0;m[1;31m20221212185608869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185608869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185608869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185608869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185608869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185608869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185608882 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185608891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185608891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185608891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:11.944722 run osmo-msc_10.42.42.6(pid=16028): ERR: Terminated: ERROR {rc=2} [trial-2380↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16028)] 18:56:11.995253 run osmo-msc_10.42.42.6(pid=16028): stdout: | (launched: 2022-12-12_18:56:10.777016) 18:56:12.047239 run osmo-msc_10.42.42.6(pid=16028): stderr: | [0;m[38;5;43m20221212185611102 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185611102 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3d63a4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185611103 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185611103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185611103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185611103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185611105 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185611105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185611105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185611106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:12.099972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16021): Terminating (SIGTERM) 18:56:12.141989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16024): Terminating (SIGTERM) 18:56:12.184008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16027): Terminating (SIGTERM) 18:56:12.226563 --- ParallelTerminationStrategy: PID 16021 died... 18:56:12.246936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16021): Terminated: ok {rc=0} 18:56:12.293738 --- ParallelTerminationStrategy: PID 16024 died... 18:56:12.313661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16024): Terminated: ok {rc=0} 18:56:12.360177 --- ParallelTerminationStrategy: PID 16027 died... 18:56:12.379997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16027): Terminated: ok {rc=0} 18:56:12.469346 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 smpp esme_ms_sms_transaction.py ---------------------------------------------- 18:56:13.558605 tst smpp: Using 1 x ip_address (candidates: 6) 18:56:13.570402 tst smpp: Using 1 x bts (candidates: 1) 18:56:13.608780 tst esme_ms_sms_transaction.py: using LAC 30821 18:56:13.734203 tst esme_ms_sms_transaction.py: using RAC 221 18:56:13.855782 tst esme_ms_sms_transaction.py: using CellId 30821 18:56:13.976738 tst esme_ms_sms_transaction.py: using BVCI 30822 18:56:14.091091 tst smpp: Using 1 x ip_address (candidates: 6) 18:56:14.101715 tst smpp: Using 1 x ip_address (candidates: 6) 18:56:14.112072 tst smpp: Using 1 x ip_address (candidates: 6) 18:56:14.123221 tst smpp: Using 1 x ip_address (candidates: 6) 18:56:14.134436 tst smpp: Using 1 x ip_address (candidates: 6) 18:56:14.145694 tst smpp: Using 1 x modem (candidates: 1) 18:56:14.274527 tst esme_ms_sms_transaction.py: using MSISDN 7922 18:56:14.388223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:14.870582 run create_hlr_db(pid=16030): Launched 18:56:14.991528 bus /sierra_2: Setting Powered False 18:56:16.073428 run create_hlr_db(pid=16030): Terminated: ok {rc=0} 18:56:16.529810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16032): Launched 18:56:16.860836 run osmo-hlr_10.42.42.2(pid=16033): Launched 18:56:17.037410 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:17.659970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16035): Launched 18:56:17.972919 run osmo-stp_10.42.42.5(pid=16036): Launched 18:56:18.093628 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:18.654240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16038): Launched 18:56:18.967449 run osmo-msc_10.42.42.6(pid=16039): Launched 18:56:19.143211 run osmo-stp_10.42.42.5(pid=16036): ERR: Terminated: ERROR {rc=1} [trial-2380↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16036)] 18:56:19.274796 run osmo-stp_10.42.42.5(pid=16036): stdout: | (launched: 2022-12-12_18:56:17.914913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:19.406527 run osmo-stp_10.42.42.5(pid=16036): stderr: | [0;m[38;5;43m20221212185618087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185618087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185618087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185618087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185618088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185618088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185618088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:19.535332 run osmo-stp_10.42.42.5(pid=16036): stdout: | (launched: 2022-12-12_18:56:17.914913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:19.658524 run osmo-stp_10.42.42.5(pid=16036): stderr: | [0;m[38;5;43m20221212185618087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185618087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185618087 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185618087 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185618088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185618088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185618088 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:19.806487 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=16036): Process ended prematurely: osmo-stp_10.42.42.5(pid=16036) [trial-2380↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16036)] [trial-2380↪smpp↪esme_ms_sms_transaction.py:28] 18:56:19.814894 tst esme_ms_sms_transaction.py:28: Test FAILED (6.2 sec) 18:56:19.841822 run osmo-hlr_10.42.42.2(pid=16033): ERR: Terminated: ERROR {rc=237} [trial-2380↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16033)] 18:56:19.890779 run osmo-hlr_10.42.42.2(pid=16033): stdout: | (launched: 2022-12-12_18:56:16.801016) 18:56:19.941218 run osmo-hlr_10.42.42.2(pid=16033): stderr: | [0;m[1;31m20221212185617177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185617177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185617177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185617177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185617177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185617177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185617194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185617207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185617207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185617207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:20.011559 run osmo-msc_10.42.42.6(pid=16039): ERR: Terminated: ERROR {rc=2} [trial-2380↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16039)] 18:56:20.060357 run osmo-msc_10.42.42.6(pid=16039): stdout: | (launched: 2022-12-12_18:56:18.909182) 18:56:20.110742 run osmo-msc_10.42.42.6(pid=16039): stderr: | [0;m[38;5;43m20221212185619185 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185619185 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1aefe09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185619185 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185619186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185619186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185619186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185619188 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185619188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185619188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185619188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:20.161531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16032): Terminating (SIGTERM) 18:56:20.202025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16035): Terminating (SIGTERM) 18:56:20.242383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16038): Terminating (SIGTERM) 18:56:20.283115 --- ParallelTerminationStrategy: PID 16032 died... 18:56:20.302517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16032): Terminated: ok {rc=0} 18:56:20.347772 --- ParallelTerminationStrategy: PID 16035 died... 18:56:20.366544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16035): Terminated: ok {rc=0} 18:56:20.411434 --- ParallelTerminationStrategy: PID 16038 died... 18:56:20.430318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16038): Terminated: ok {rc=0} 18:56:20.517831 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 encryption --------------------------------------------------------------------- 18:56:21.718134 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:56:21.721296 tst encryption: Verifying 1 x bts (candidates: 11) 18:56:21.742439 tst encryption: Verifying 6 x ip_address (candidates: 9) 18:56:21.770356 tst encryption: Verifying 1 x modem (candidates: 12) 18:56:21.804809 tst encryption: Reserving 1 x bts (candidates: 11) 18:56:21.825983 tst encryption: Reserving 6 x ip_address (candidates: 9) 18:56:21.853650 tst encryption: Reserving 1 x modem (candidates: 12) 18:56:22.382614 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2380 encryption register_a5_0_authopt.py ---------------------------------------------- 18:56:22.435979 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:22.446831 tst encryption: Using 1 x bts (candidates: 1) 18:56:22.480419 tst register_a5_0_authopt.py: using LAC 30822 18:56:22.602901 tst register_a5_0_authopt.py: using RAC 222 18:56:22.725373 tst register_a5_0_authopt.py: using CellId 30822 18:56:22.847354 tst register_a5_0_authopt.py: using BVCI 30823 18:56:22.963001 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:22.973828 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:22.984428 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:22.994972 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:23.006786 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:23.017957 tst encryption: Using 1 x modem (candidates: 1) 18:56:23.140506 tst register_a5_0_authopt.py:8: start network... 18:56:23.368110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:23.888032 run create_hlr_db(pid=16044): Launched 18:56:24.025874 bus /sierra_2: Setting Powered False 18:56:25.091577 run create_hlr_db(pid=16044): Terminated: ok {rc=0} 18:56:25.539053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16046): Launched 18:56:25.855921 run osmo-hlr_10.42.42.2(pid=16047): Launched 18:56:25.977226 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:26.531069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16049): Launched 18:56:26.846742 run osmo-stp_10.42.42.5(pid=16050): Launched 18:56:26.968143 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:27.531853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16052): Launched 18:56:27.848414 run osmo-msc_10.42.42.6(pid=16053): Launched 18:56:28.024058 run osmo-stp_10.42.42.5(pid=16050): ERR: Terminated: ERROR {rc=1} [trial-2380↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16050)] 18:56:28.155906 run osmo-stp_10.42.42.5(pid=16050): stdout: | (launched: 2022-12-12_18:56:26.787885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:28.287489 run osmo-stp_10.42.42.5(pid=16050): stderr: | [0;m[38;5;43m20221212185626959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185626960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185626960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185626960 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185626961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185626961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185626961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:28.417103 run osmo-stp_10.42.42.5(pid=16050): stdout: | (launched: 2022-12-12_18:56:26.787885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:28.541331 run osmo-stp_10.42.42.5(pid=16050): stderr: | [0;m[38;5;43m20221212185626959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185626960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185626960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185626960 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185626961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185626961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185626961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:28.690044 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16050): Process ended prematurely: osmo-stp_10.42.42.5(pid=16050) [trial-2380↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16050)] [trial-2380↪encryption↪register_a5_0_authopt.py:8] 18:56:28.699107 tst register_a5_0_authopt.py:8: Test FAILED (6.3 sec) 18:56:28.726457 run osmo-hlr_10.42.42.2(pid=16047): ERR: Terminated: ERROR {rc=237} [trial-2380↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16047)] 18:56:28.774978 run osmo-hlr_10.42.42.2(pid=16047): stdout: | (launched: 2022-12-12_18:56:25.797221) 18:56:28.825247 run osmo-hlr_10.42.42.2(pid=16047): stderr: | [0;m[1;31m20221212185625978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185625978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185625978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185625978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185625978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185625978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185625992 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185626002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185626002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185626002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:28.894681 run osmo-msc_10.42.42.6(pid=16053): ERR: Terminated: ERROR {rc=2} [trial-2380↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16053)] 18:56:28.942908 run osmo-msc_10.42.42.6(pid=16053): stdout: | (launched: 2022-12-12_18:56:27.789514) 18:56:28.992807 run osmo-msc_10.42.42.6(pid=16053): stderr: | [0;m[38;5;43m20221212185628066 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185628066 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5dad9bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185628066 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185628066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185628066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185628066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185628068 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185628068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185628069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185628069 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:29.042940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16046): Terminating (SIGTERM) 18:56:29.082886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16049): Terminating (SIGTERM) 18:56:29.123304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16052): Terminating (SIGTERM) 18:56:29.163689 --- ParallelTerminationStrategy: PID 16046 died... 18:56:29.182981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16046): Terminated: ok {rc=0} 18:56:29.227862 --- ParallelTerminationStrategy: PID 16049 died... 18:56:29.246704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16049): Terminated: ok {rc=0} 18:56:29.291382 --- ParallelTerminationStrategy: PID 16052 died... 18:56:29.310168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16052): Terminated: ok {rc=0} 18:56:29.394917 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 encryption register_a5_0_authreq.py ---------------------------------------------- 18:56:30.547218 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:30.559327 tst encryption: Using 1 x bts (candidates: 1) 18:56:30.598551 tst register_a5_0_authreq.py: using LAC 30823 18:56:30.722246 tst register_a5_0_authreq.py: using RAC 223 18:56:30.852813 tst register_a5_0_authreq.py: using CellId 30823 18:56:30.983217 tst register_a5_0_authreq.py: using BVCI 30824 18:56:31.124835 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:31.136889 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:31.149087 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:31.161589 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:31.174201 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:31.187295 tst encryption: Using 1 x modem (candidates: 1) 18:56:31.308865 tst register_a5_0_authreq.py:8: start network... 18:56:31.531706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:32.068865 run create_hlr_db(pid=16055): Launched 18:56:32.230896 bus /sierra_2: Setting Powered False 18:56:33.292566 run create_hlr_db(pid=16055): Terminated: ok {rc=0} 18:56:33.728133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16057): Launched 18:56:34.044388 run osmo-hlr_10.42.42.2(pid=16058): Launched 18:56:34.165463 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:34.720112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16060): Launched 18:56:35.034525 run osmo-stp_10.42.42.5(pid=16061): Launched 18:56:35.155905 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:35.720627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16063): Launched 18:56:36.036726 run osmo-msc_10.42.42.6(pid=16064): Launched 18:56:36.214048 run osmo-stp_10.42.42.5(pid=16061): ERR: Terminated: ERROR {rc=1} [trial-2380↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16061)] 18:56:36.346117 run osmo-stp_10.42.42.5(pid=16061): stdout: | (launched: 2022-12-12_18:56:34.975993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:36.477693 run osmo-stp_10.42.42.5(pid=16061): stderr: | [0;m[38;5;43m20221212185635147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185635147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185635148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185635148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185635149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185635149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185635149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:36.607510 run osmo-stp_10.42.42.5(pid=16061): stdout: | (launched: 2022-12-12_18:56:34.975993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:36.732088 run osmo-stp_10.42.42.5(pid=16061): stderr: | [0;m[38;5;43m20221212185635147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185635147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185635148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185635148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185635149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185635149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185635149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:36.881178 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16061): Process ended prematurely: osmo-stp_10.42.42.5(pid=16061) [trial-2380↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16061)] [trial-2380↪encryption↪register_a5_0_authreq.py:8] 18:56:36.890378 tst register_a5_0_authreq.py:8: Test FAILED (6.4 sec) 18:56:36.917706 run osmo-hlr_10.42.42.2(pid=16058): ERR: Terminated: ERROR {rc=237} [trial-2380↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16058)] 18:56:36.966288 run osmo-hlr_10.42.42.2(pid=16058): stdout: | (launched: 2022-12-12_18:56:33.985705) 18:56:37.016282 run osmo-hlr_10.42.42.2(pid=16058): stderr: | [0;m[1;31m20221212185634166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185634166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185634166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185634166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185634166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185634166 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185634178 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185634186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185634187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185634187 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:37.085968 run osmo-msc_10.42.42.6(pid=16064): ERR: Terminated: ERROR {rc=2} [trial-2380↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16064)] 18:56:37.134211 run osmo-msc_10.42.42.6(pid=16064): stdout: | (launched: 2022-12-12_18:56:35.977841) 18:56:37.184268 run osmo-msc_10.42.42.6(pid=16064): stderr: | [0;m[38;5;43m20221212185636254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185636254 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f40beca8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185636254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185636254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185636254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185636255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185636256 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185636257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185636257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185636257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:37.234890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16057): Terminating (SIGTERM) 18:56:37.275505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16060): Terminating (SIGTERM) 18:56:37.316245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16063): Terminating (SIGTERM) 18:56:37.357273 --- ParallelTerminationStrategy: PID 16057 died... 18:56:37.376551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16057): Terminated: ok {rc=0} 18:56:37.421858 --- ParallelTerminationStrategy: PID 16060 died... 18:56:37.440716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16060): Terminated: ok {rc=0} 18:56:37.486591 --- ParallelTerminationStrategy: PID 16063 died... 18:56:37.505623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16063): Terminated: ok {rc=0} 18:56:37.594330 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 encryption register_a5_1_authreq.py ---------------------------------------------- 18:56:38.744639 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:38.756258 tst encryption: Using 1 x bts (candidates: 1) 18:56:38.793426 tst register_a5_1_authreq.py: using LAC 30824 18:56:38.925574 tst register_a5_1_authreq.py: using RAC 224 18:56:39.056878 tst register_a5_1_authreq.py: using CellId 30824 18:56:39.189916 tst register_a5_1_authreq.py: using BVCI 30825 18:56:39.311507 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:39.322911 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:39.334106 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:39.345954 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:39.357695 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:39.369203 tst encryption: Using 1 x modem (candidates: 1) 18:56:39.488266 tst register_a5_1_authreq.py:8: start network... 18:56:39.700243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:40.187334 run create_hlr_db(pid=16066): Launched 18:56:40.309831 bus /sierra_2: Setting Powered False 18:56:41.371648 run create_hlr_db(pid=16066): Terminated: ok {rc=0} 18:56:41.829643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16068): Launched 18:56:42.167870 run osmo-hlr_10.42.42.2(pid=16069): Launched 18:56:42.298317 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:42.878609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16071): Launched 18:56:43.216071 run osmo-stp_10.42.42.5(pid=16072): Launched 18:56:43.345254 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:43.948001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16074): Launched 18:56:44.283946 run osmo-msc_10.42.42.6(pid=16075): Launched 18:56:44.473317 run osmo-stp_10.42.42.5(pid=16072): ERR: Terminated: ERROR {rc=1} [trial-2380↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16072)] 18:56:44.614815 run osmo-stp_10.42.42.5(pid=16072): stdout: | (launched: 2022-12-12_18:56:43.153766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:44.756553 run osmo-stp_10.42.42.5(pid=16072): stderr: | [0;m[38;5;43m20221212185643351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185643352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185643352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185643352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185643353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185643353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185643353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:44.895995 run osmo-stp_10.42.42.5(pid=16072): stdout: | (launched: 2022-12-12_18:56:43.153766) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:45.029476 run osmo-stp_10.42.42.5(pid=16072): stderr: | [0;m[38;5;43m20221212185643351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185643352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185643352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185643352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185643353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185643353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185643353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:45.188908 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16072): Process ended prematurely: osmo-stp_10.42.42.5(pid=16072) [trial-2380↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16072)] [trial-2380↪encryption↪register_a5_1_authreq.py:8] 18:56:45.198831 tst register_a5_1_authreq.py:8: Test FAILED (6.5 sec) 18:56:45.226840 run osmo-hlr_10.42.42.2(pid=16069): ERR: Terminated: ERROR {rc=237} [trial-2380↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16069)] 18:56:45.276930 run osmo-hlr_10.42.42.2(pid=16069): stdout: | (launched: 2022-12-12_18:56:42.105433) 18:56:45.329145 run osmo-hlr_10.42.42.2(pid=16069): stderr: | [0;m[1;31m20221212185642306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185642306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185642306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185642306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185642306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185642306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185642318 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185642327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185642327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185642327 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:45.401798 run osmo-msc_10.42.42.6(pid=16075): ERR: Terminated: ERROR {rc=2} [trial-2380↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16075)] 18:56:45.451968 run osmo-msc_10.42.42.6(pid=16075): stdout: | (launched: 2022-12-12_18:56:44.221510) 18:56:45.503969 run osmo-msc_10.42.42.6(pid=16075): stderr: | [0;m[38;5;43m20221212185644545 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185644545 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb2c6c72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185644545 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185644546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185644546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185644546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185644548 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185644548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185644548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185644548 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:45.556621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16068): Terminating (SIGTERM) 18:56:45.598492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16071): Terminating (SIGTERM) 18:56:45.640377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16074): Terminating (SIGTERM) 18:56:45.682677 --- ParallelTerminationStrategy: PID 16068 died... 18:56:45.702884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16068): Terminated: ok {rc=0} 18:56:45.749670 --- ParallelTerminationStrategy: PID 16071 died... 18:56:45.769826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16071): Terminated: ok {rc=0} 18:56:45.816013 --- ParallelTerminationStrategy: PID 16074 died... 18:56:45.839903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16074): Terminated: ok {rc=0} 18:56:45.949690 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2380 encryption register_a5_3_authreq.py ---------------------------------------------- 18:56:47.131577 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:47.148086 tst encryption: Using 1 x bts (candidates: 1) 18:56:47.193375 tst register_a5_3_authreq.py: using LAC 30825 18:56:47.319126 tst register_a5_3_authreq.py: using RAC 225 18:56:47.442475 tst register_a5_3_authreq.py: using CellId 30825 18:56:47.568026 tst register_a5_3_authreq.py: using BVCI 30826 18:56:47.682147 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:47.692920 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:47.703420 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:47.714665 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:47.725986 tst encryption: Using 1 x ip_address (candidates: 6) 18:56:47.737275 tst encryption: Using 1 x modem (candidates: 1) 18:56:47.866405 tst register_a5_3_authreq.py:8: start network... 18:56:48.078484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:56:48.563370 run create_hlr_db(pid=16077): Launched 18:56:48.683745 bus /sierra_2: Setting Powered False 18:56:49.745632 run create_hlr_db(pid=16077): Terminated: ok {rc=0} 18:56:50.202387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16079): Launched 18:56:50.539515 run osmo-hlr_10.42.42.2(pid=16080): Launched 18:56:50.669556 run osmo-stp_10.42.42.5: Starting osmo-stp 18:56:51.251267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16082): Launched 18:56:51.588234 run osmo-stp_10.42.42.5(pid=16083): Launched 18:56:51.717600 run osmo-msc_10.42.42.6: Starting osmo-msc 18:56:52.323046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16085): Launched 18:56:52.660484 run osmo-msc_10.42.42.6(pid=16086): Launched 18:56:52.853221 run osmo-stp_10.42.42.5(pid=16083): ERR: Terminated: ERROR {rc=1} [trial-2380↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16083)] 18:56:52.993222 run osmo-stp_10.42.42.5(pid=16083): stdout: | (launched: 2022-12-12_18:56:51.525747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:53.133412 run osmo-stp_10.42.42.5(pid=16083): stderr: | [0;m[38;5;43m20221212185651722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185651722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185651722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185651722 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185651723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185651723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185651723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:53.272589 run osmo-stp_10.42.42.5(pid=16083): stdout: | (launched: 2022-12-12_18:56:51.525747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:56:53.406239 run osmo-stp_10.42.42.5(pid=16083): stderr: | [0;m[38;5;43m20221212185651722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185651722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185651722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185651722 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185651723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185651723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185651723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:56:53.566051 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16083): Process ended prematurely: osmo-stp_10.42.42.5(pid=16083) [trial-2380↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16083)] [trial-2380↪encryption↪register_a5_3_authreq.py:8] 18:56:53.575993 tst register_a5_3_authreq.py:8: Test FAILED (6.5 sec) 18:56:53.605216 run osmo-hlr_10.42.42.2(pid=16080): ERR: Terminated: ERROR {rc=237} [trial-2380↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16080)] 18:56:53.655937 run osmo-hlr_10.42.42.2(pid=16080): stdout: | (launched: 2022-12-12_18:56:50.477073) 18:56:53.708199 run osmo-hlr_10.42.42.2(pid=16080): stderr: | [0;m[1;31m20221212185650679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185650679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185650679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185650679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185650679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185650679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185650692 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185650701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185650701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185650701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:56:53.780624 run osmo-msc_10.42.42.6(pid=16086): ERR: Terminated: ERROR {rc=2} [trial-2380↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16086)] 18:56:53.830954 run osmo-msc_10.42.42.6(pid=16086): stdout: | (launched: 2022-12-12_18:56:52.598078) 18:56:53.883121 run osmo-msc_10.42.42.6(pid=16086): stderr: | [0;m[38;5;43m20221212185652925 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185652926 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efd7b298c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185652926 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185652926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185652926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185652926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185652928 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185652928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185652928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185652928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:56:53.935570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16079): Terminating (SIGTERM) 18:56:53.977898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16082): Terminating (SIGTERM) 18:56:54.020184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16085): Terminating (SIGTERM) 18:56:54.062660 --- ParallelTerminationStrategy: PID 16079 died... 18:56:54.082603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16079): Terminated: ok {rc=0} 18:56:54.129371 --- ParallelTerminationStrategy: PID 16082 died... 18:56:54.149085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16082): Terminated: ok {rc=0} 18:56:54.195719 --- ParallelTerminationStrategy: PID 16085 died... 18:56:54.215527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16085): Terminated: ok {rc=0} 18:56:54.304857 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 18:56:55.513890 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:56:55.518937 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 18:56:55.537190 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 18:56:55.564713 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 18:56:55.593243 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 18:56:55.613127 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 18:56:55.641112 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 18:56:56.149380 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2380 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 18:56:56.154243 tst handover.py:11: TEST_CONFIG: {} 18:56:56.363053 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:56:56.379108 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:56:56.402642 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:56:56.457494 tst handover.py: using MSISDN 7923 18:56:56.572569 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7923', subscriber_id=0} 18:56:56.682009 run srsepc_10.42.42.118: Starting srsepc 18:56:58.553177 run rm-remote-dir(pid=16091): Launched 18:56:58.677218 bus /sierra_2: Setting Powered False 18:56:59.743476 run rm-remote-dir(pid=16091): Terminated: ok {rc=0} 18:57:00.216096 run mk-remote-dir(pid=16092): Launched 18:57:01.411315 run mk-remote-dir(pid=16092): Terminated: ok {rc=0} 18:57:01.792577 run scp-inst-to-remote(pid=16093): Launched 18:57:04.047247 run scp-inst-to-remote(pid=16093): Terminated: ok {rc=0} 18:57:04.389474 run rm-remote-dir(pid=16095): Launched 18:57:05.572549 run rm-remote-dir(pid=16095): Terminated: ok {rc=0} 18:57:05.916269 run mk-remote-dir(pid=16096): Launched 18:57:07.099449 run mk-remote-dir(pid=16096): Terminated: ok {rc=0} 18:57:07.392136 run scp-cfg-to-remote(pid=16097): Launched 18:57:08.574110 run scp-cfg-to-remote(pid=16097): Terminated: ok {rc=0} 18:57:08.864113 run scp-db-to-remote(pid=16099): Launched 18:57:10.046998 run scp-db-to-remote(pid=16099): Terminated: ok {rc=0} 18:57:10.180924 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:57:10.495578 run patchelf(pid=16101): Launched 18:57:11.676862 run patchelf(pid=16101): Terminated: ok {rc=0} 18:57:11.811906 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:57:12.127923 run setcap-netadm(pid=16102): Launched 18:57:13.309275 run setcap-netadm(pid=16102): Terminated: ok {rc=0} 18:57:13.639144 run srsepc(pid=16103): Launched 18:57:13.758095 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:57:14.886675 run rm-remote-dir(pid=16104): Launched 18:57:15.066795 run srsepc(pid=16103): ERR: Terminated: ERROR {rc=127} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16103)] 18:57:15.204864 run srsepc(pid=16103): stdout: | (launched: 2022-12-12_18:57:13.580143) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:57:15.341912 run srsepc(pid=16103): stderr: | (launched: 2022-12-12_18:57:13.626635) | Connection to 10.42.42.116 closed. 18:57:15.478816 run srsepc(pid=16103): stdout: | (launched: 2022-12-12_18:57:13.580143) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:57:15.610105 run srsepc(pid=16103): stderr: | (launched: 2022-12-12_18:57:13.626635) | Connection to 10.42.42.116 closed. 18:57:15.766466 run rm-remote-dir(pid=16104): Terminating (SIGINT) 18:57:15.953485 run rm-remote-dir(pid=16104): Terminated: ok {rc=0} 18:57:16.086548 tst handover.py:37: ERR: Error: srsepc(pid=16103): Process ended prematurely: srsepc(pid=16103) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16103)] [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 18:57:16.097384 tst handover.py:37: Test FAILED (19.9 sec) 18:57:16.178501 run scp-back-log(pid=16105): Launched 18:57:17.327725 run scp-back-log(pid=16105): ERR: Terminated: ERROR {rc=1} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16105)] 18:57:17.393676 run scp-back-log(pid=16105): stdout: | (launched: 2022-12-12_18:57:16.146045) 18:57:17.460760 run scp-back-log(pid=16105): stderr: | (launched: 2022-12-12_18:57:16.166113) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:57:17.537375 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16105): launch_sync(): local process exited with status 1 [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16105)]') ---------------------------------------------- trial-2380 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 18:57:17.586591 tst iperf3_bidir.py:13: Number of physical ue: 1 18:57:17.813359 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:57:17.860699 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 18:57:18.086130 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:57:18.102854 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:57:18.135698 tst iperf3_bidir.py: using MSISDN 7924 18:57:18.256889 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7924', subscriber_id=0} 18:57:18.374345 run srsepc_10.42.42.118: Starting srsepc 18:57:19.059377 run rm-remote-dir(pid=16107): Launched 18:57:20.255628 run rm-remote-dir(pid=16107): Terminated: ok {rc=0} 18:57:20.620864 run mk-remote-dir(pid=16108): Launched 18:57:21.818608 run mk-remote-dir(pid=16108): Terminated: ok {rc=0} 18:57:22.130591 run scp-inst-to-remote(pid=16109): Launched 18:57:24.322014 run scp-inst-to-remote(pid=16109): Terminated: ok {rc=0} 18:57:24.663821 run rm-remote-dir(pid=16111): Launched 18:57:25.848759 run rm-remote-dir(pid=16111): Terminated: ok {rc=0} 18:57:26.191392 run mk-remote-dir(pid=16112): Launched 18:57:27.375891 run mk-remote-dir(pid=16112): Terminated: ok {rc=0} 18:57:27.667615 run scp-cfg-to-remote(pid=16113): Launched 18:57:28.848787 run scp-cfg-to-remote(pid=16113): Terminated: ok {rc=0} 18:57:29.137996 run scp-db-to-remote(pid=16115): Launched 18:57:30.319552 run scp-db-to-remote(pid=16115): Terminated: ok {rc=0} 18:57:30.452100 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:57:30.766179 run patchelf(pid=16117): Launched 18:57:32.022546 run patchelf(pid=16117): Terminated: ok {rc=0} 18:57:32.168314 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:57:32.506839 run setcap-netadm(pid=16118): Launched 18:57:33.702003 run setcap-netadm(pid=16118): Terminated: ok {rc=0} 18:57:34.054646 run srsepc(pid=16119): Launched 18:57:34.181683 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:57:35.381679 run rm-remote-dir(pid=16120): Launched 18:57:35.574717 run srsepc(pid=16119): ERR: Terminated: ERROR {rc=127} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16119)] 18:57:35.722284 run srsepc(pid=16119): stdout: | (launched: 2022-12-12_18:57:33.992187) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:57:35.869547 run srsepc(pid=16119): stderr: | (launched: 2022-12-12_18:57:34.042020) | Connection to 10.42.42.116 closed. 18:57:36.016712 run srsepc(pid=16119): stdout: | (launched: 2022-12-12_18:57:33.992187) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:57:36.156733 run srsepc(pid=16119): stderr: | (launched: 2022-12-12_18:57:34.042020) | Connection to 10.42.42.116 closed. 18:57:36.323146 run rm-remote-dir(pid=16120): Terminating (SIGINT) 18:57:36.515834 run rm-remote-dir(pid=16120): Terminated: ok {rc=0} 18:57:36.654622 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=16119): Process ended prematurely: srsepc(pid=16119) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16119)] [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 18:57:36.666025 tst iperf3_bidir.py:42: Test FAILED (19.1 sec) 18:57:36.748647 run scp-back-log(pid=16121): Launched 18:57:37.833755 run scp-back-log(pid=16121): ERR: Terminated: ERROR {rc=1} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16121)] 18:57:37.898497 run scp-back-log(pid=16121): stdout: | (launched: 2022-12-12_18:57:36.715181) 18:57:37.964750 run scp-back-log(pid=16121): stderr: | (launched: 2022-12-12_18:57:36.735921) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:57:38.039587 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16121): launch_sync(): local process exited with status 1 [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16121)]') ---------------------------------------------- trial-2380 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 18:57:38.088850 tst iperf3_dl.py:13: Number of physical ue: 1 18:57:38.315865 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:57:38.361442 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 18:57:38.584896 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:57:38.601754 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:57:38.635818 tst iperf3_dl.py: using MSISDN 7925 18:57:38.748351 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7925', subscriber_id=0} 18:57:38.857031 run srsepc_10.42.42.118: Starting srsepc 18:57:39.492467 run rm-remote-dir(pid=16123): Launched 18:57:40.674887 run rm-remote-dir(pid=16123): Terminated: ok {rc=0} 18:57:41.015450 run mk-remote-dir(pid=16124): Launched 18:57:42.197613 run mk-remote-dir(pid=16124): Terminated: ok {rc=0} 18:57:42.487679 run scp-inst-to-remote(pid=16125): Launched 18:57:44.668366 run scp-inst-to-remote(pid=16125): Terminated: ok {rc=0} 18:57:45.007030 run rm-remote-dir(pid=16127): Launched 18:57:46.192549 run rm-remote-dir(pid=16127): Terminated: ok {rc=0} 18:57:46.566487 run mk-remote-dir(pid=16128): Launched 18:57:47.798381 run mk-remote-dir(pid=16128): Terminated: ok {rc=0} 18:57:48.108863 run scp-cfg-to-remote(pid=16129): Launched 18:57:49.302457 run scp-cfg-to-remote(pid=16129): Terminated: ok {rc=0} 18:57:49.610598 run scp-db-to-remote(pid=16131): Launched 18:57:50.804392 run scp-db-to-remote(pid=16131): Terminated: ok {rc=0} 18:57:50.946357 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:57:51.281642 run patchelf(pid=16133): Launched 18:57:52.475750 run patchelf(pid=16133): Terminated: ok {rc=0} 18:57:52.617875 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:57:52.954362 run setcap-netadm(pid=16134): Launched 18:57:54.147357 run setcap-netadm(pid=16134): Terminated: ok {rc=0} 18:57:54.498637 run srsepc(pid=16135): Launched 18:57:54.624069 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:57:55.760105 run rm-remote-dir(pid=16136): Launched 18:57:55.941418 run srsepc(pid=16135): ERR: Terminated: ERROR {rc=127} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16135)] 18:57:56.077636 run srsepc(pid=16135): stdout: | (launched: 2022-12-12_18:57:54.436276) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:57:56.214304 run srsepc(pid=16135): stderr: | (launched: 2022-12-12_18:57:54.485955) | Connection to 10.42.42.116 closed. 18:57:56.350522 run srsepc(pid=16135): stdout: | (launched: 2022-12-12_18:57:54.436276) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:57:56.480854 run srsepc(pid=16135): stderr: | (launched: 2022-12-12_18:57:54.485955) | Connection to 10.42.42.116 closed. 18:57:56.635291 run rm-remote-dir(pid=16136): Terminating (SIGINT) 18:57:56.814529 run rm-remote-dir(pid=16136): Terminated: ok {rc=0} 18:57:56.944475 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=16135): Process ended prematurely: srsepc(pid=16135) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16135)] [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 18:57:56.954643 tst iperf3_dl.py:42: Test FAILED (18.9 sec) 18:57:57.035183 run scp-back-log(pid=16137): Launched 18:57:58.113878 run scp-back-log(pid=16137): ERR: Terminated: ERROR {rc=1} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16137)] 18:57:58.175269 run scp-back-log(pid=16137): stdout: | (launched: 2022-12-12_18:57:57.002132) 18:57:58.238217 run scp-back-log(pid=16137): stderr: | (launched: 2022-12-12_18:57:57.021969) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:57:58.309107 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16137): launch_sync(): local process exited with status 1 [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16137)]') ---------------------------------------------- trial-2380 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 18:57:58.355404 tst iperf3_ul.py:13: Number of physical ue: 1 18:57:58.564824 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:57:58.607526 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 18:57:58.813478 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:57:58.829750 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:57:58.862564 tst iperf3_ul.py: using MSISDN 7926 18:57:58.984836 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7926', subscriber_id=0} 18:57:59.102247 run srsepc_10.42.42.118: Starting srsepc 18:57:59.787833 run rm-remote-dir(pid=16139): Launched 18:58:01.001658 run rm-remote-dir(pid=16139): Terminated: ok {rc=0} 18:58:01.469730 run mk-remote-dir(pid=16140): Launched 18:58:02.702277 run mk-remote-dir(pid=16140): Terminated: ok {rc=0} 18:58:02.996337 run scp-inst-to-remote(pid=16141): Launched 18:58:05.180814 run scp-inst-to-remote(pid=16141): Terminated: ok {rc=0} 18:58:05.523660 run rm-remote-dir(pid=16143): Launched 18:58:06.708677 run rm-remote-dir(pid=16143): Terminated: ok {rc=0} 18:58:07.052871 run mk-remote-dir(pid=16144): Launched 18:58:08.239309 run mk-remote-dir(pid=16144): Terminated: ok {rc=0} 18:58:08.533242 run scp-cfg-to-remote(pid=16145): Launched 18:58:09.712793 run scp-cfg-to-remote(pid=16145): Terminated: ok {rc=0} 18:58:10.004375 run scp-db-to-remote(pid=16147): Launched 18:58:11.187576 run scp-db-to-remote(pid=16147): Terminated: ok {rc=0} 18:58:11.321483 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:58:11.639854 run patchelf(pid=16149): Launched 18:58:12.823096 run patchelf(pid=16149): Terminated: ok {rc=0} 18:58:12.957424 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:58:13.275554 run setcap-netadm(pid=16150): Launched 18:58:14.457199 run setcap-netadm(pid=16150): Terminated: ok {rc=0} 18:58:14.792528 run srsepc(pid=16151): Launched 18:58:14.911298 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:58:16.103387 run rm-remote-dir(pid=16152): Launched 18:58:16.405109 run srsepc(pid=16151): ERR: Terminated: ERROR {rc=127} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16151)] 18:58:16.553752 run srsepc(pid=16151): stdout: | (launched: 2022-12-12_18:58:14.733160) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:58:16.695899 run srsepc(pid=16151): stderr: | (launched: 2022-12-12_18:58:14.780067) | Connection to 10.42.42.116 closed. 18:58:16.838192 run srsepc(pid=16151): stdout: | (launched: 2022-12-12_18:58:14.733160) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:58:16.974470 run srsepc(pid=16151): stderr: | (launched: 2022-12-12_18:58:14.780067) | Connection to 10.42.42.116 closed. 18:58:17.135833 run rm-remote-dir(pid=16152): Terminating (SIGINT) 18:58:17.331055 run rm-remote-dir(pid=16152): Terminated: ok {rc=0} 18:58:17.462145 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=16151): Process ended prematurely: srsepc(pid=16151) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16151)] [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 18:58:17.472561 tst iperf3_ul.py:42: Test FAILED (19.1 sec) 18:58:17.553296 run scp-back-log(pid=16153): Launched 18:58:18.633891 run scp-back-log(pid=16153): ERR: Terminated: ERROR {rc=1} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16153)] 18:58:18.695619 run scp-back-log(pid=16153): stdout: | (launched: 2022-12-12_18:58:17.520744) 18:58:18.758874 run scp-back-log(pid=16153): stderr: | (launched: 2022-12-12_18:58:17.540751) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:58:18.830190 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16153): launch_sync(): local process exited with status 1 [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16153)]') ---------------------------------------------- trial-2380 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 18:58:18.877636 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:58:18.894729 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:58:18.918255 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:58:18.967979 tst ping.py: using MSISDN 7927 18:58:19.085600 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7927', subscriber_id=0} 18:58:19.195841 run srsepc_10.42.42.118: Starting srsepc 18:58:19.840412 run rm-remote-dir(pid=16155): Launched 18:58:21.025962 run rm-remote-dir(pid=16155): Terminated: ok {rc=0} 18:58:21.369573 run mk-remote-dir(pid=16156): Launched 18:58:22.552556 run mk-remote-dir(pid=16156): Terminated: ok {rc=0} 18:58:22.846081 run scp-inst-to-remote(pid=16157): Launched 18:58:25.032501 run scp-inst-to-remote(pid=16157): Terminated: ok {rc=0} 18:58:25.396591 run rm-remote-dir(pid=16159): Launched 18:58:26.594186 run rm-remote-dir(pid=16159): Terminated: ok {rc=0} 18:58:26.960438 run mk-remote-dir(pid=16160): Launched 18:58:28.157275 run mk-remote-dir(pid=16160): Terminated: ok {rc=0} 18:58:28.469326 run scp-cfg-to-remote(pid=16161): Launched 18:58:29.663174 run scp-cfg-to-remote(pid=16161): Terminated: ok {rc=0} 18:58:29.972937 run scp-db-to-remote(pid=16163): Launched 18:58:31.197200 run scp-db-to-remote(pid=16163): Terminated: ok {rc=0} 18:58:31.392067 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:58:31.731466 run patchelf(pid=16165): Launched 18:58:32.989549 run patchelf(pid=16165): Terminated: ok {rc=0} 18:58:33.123294 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:58:33.439470 run setcap-netadm(pid=16166): Launched 18:58:34.621496 run setcap-netadm(pid=16166): Terminated: ok {rc=0} 18:58:34.951953 run srsepc(pid=16167): Launched 18:58:35.070951 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:58:36.274181 run rm-remote-dir(pid=16168): Launched 18:58:36.468754 run srsepc(pid=16167): ERR: Terminated: ERROR {rc=127} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16167)] 18:58:36.615886 run srsepc(pid=16167): stdout: | (launched: 2022-12-12_18:58:34.893202) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:58:36.762119 run srsepc(pid=16167): stderr: | (launched: 2022-12-12_18:58:34.939452) | Connection to 10.42.42.116 closed. 18:58:36.908724 run srsepc(pid=16167): stdout: | (launched: 2022-12-12_18:58:34.893202) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:58:37.048524 run srsepc(pid=16167): stderr: | (launched: 2022-12-12_18:58:34.939452) | Connection to 10.42.42.116 closed. 18:58:37.214583 run rm-remote-dir(pid=16168): Terminating (SIGINT) 18:58:37.406427 run rm-remote-dir(pid=16168): Terminated: ok {rc=0} 18:58:37.545877 tst ping.py:16: ERR: Error: srsepc(pid=16167): Process ended prematurely: srsepc(pid=16167) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16167)] [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 18:58:37.556716 tst ping.py:16: Test FAILED (18.7 sec) 18:58:37.640021 run scp-back-log(pid=16169): Launched 18:58:38.724012 run scp-back-log(pid=16169): ERR: Terminated: ERROR {rc=1} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16169)] 18:58:38.788570 run scp-back-log(pid=16169): stdout: | (launched: 2022-12-12_18:58:37.606257) 18:58:38.854739 run scp-back-log(pid=16169): stderr: | (launched: 2022-12-12_18:58:37.627183) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:58:38.928574 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16169): launch_sync(): local process exited with status 1 [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16169)]') ---------------------------------------------- trial-2380 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 18:58:38.977417 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:58:38.995078 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:58:39.019238 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:58:39.078787 tst rrc_idle_mo_ping.py: using MSISDN 7928 18:58:39.195299 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7928', subscriber_id=0} 18:58:39.305604 run srsepc_10.42.42.118: Starting srsepc 18:58:39.947405 run rm-remote-dir(pid=16171): Launched 18:58:41.131263 run rm-remote-dir(pid=16171): Terminated: ok {rc=0} 18:58:41.474504 run mk-remote-dir(pid=16172): Launched 18:58:42.657263 run mk-remote-dir(pid=16172): Terminated: ok {rc=0} 18:58:42.950908 run scp-inst-to-remote(pid=16173): Launched 18:58:45.133550 run scp-inst-to-remote(pid=16173): Terminated: ok {rc=0} 18:58:45.476179 run rm-remote-dir(pid=16175): Launched 18:58:46.657657 run rm-remote-dir(pid=16175): Terminated: ok {rc=0} 18:58:47.014357 run mk-remote-dir(pid=16176): Launched 18:58:48.221959 run mk-remote-dir(pid=16176): Terminated: ok {rc=0} 18:58:48.515796 run scp-cfg-to-remote(pid=16177): Launched 18:58:49.696828 run scp-cfg-to-remote(pid=16177): Terminated: ok {rc=0} 18:58:49.988620 run scp-db-to-remote(pid=16179): Launched 18:58:51.170067 run scp-db-to-remote(pid=16179): Terminated: ok {rc=0} 18:58:51.303535 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:58:51.619562 run patchelf(pid=16181): Launched 18:58:52.801147 run patchelf(pid=16181): Terminated: ok {rc=0} 18:58:52.935226 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:58:53.251695 run setcap-netadm(pid=16182): Launched 18:58:54.432689 run setcap-netadm(pid=16182): Terminated: ok {rc=0} 18:58:54.764378 run srsepc(pid=16183): Launched 18:58:54.882780 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:58:56.013886 run rm-remote-dir(pid=16184): Launched 18:58:56.194387 run srsepc(pid=16183): ERR: Terminated: ERROR {rc=127} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16183)] 18:58:56.331407 run srsepc(pid=16183): stdout: | (launched: 2022-12-12_18:58:54.705548) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:58:56.469311 run srsepc(pid=16183): stderr: | (launched: 2022-12-12_18:58:54.751886) | Connection to 10.42.42.116 closed. 18:58:56.607566 run srsepc(pid=16183): stdout: | (launched: 2022-12-12_18:58:54.705548) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:58:56.739283 run srsepc(pid=16183): stderr: | (launched: 2022-12-12_18:58:54.751886) | Connection to 10.42.42.116 closed. 18:58:56.895562 run rm-remote-dir(pid=16184): Terminating (SIGINT) 18:58:57.076675 run rm-remote-dir(pid=16184): Terminated: ok {rc=0} 18:58:57.208196 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=16183): Process ended prematurely: srsepc(pid=16183) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16183)] [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 18:58:57.218631 tst rrc_idle_mo_ping.py:16: Test FAILED (18.2 sec) 18:58:57.299017 run scp-back-log(pid=16185): Launched 18:58:58.379672 run scp-back-log(pid=16185): ERR: Terminated: ERROR {rc=1} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16185)] 18:58:58.442615 run scp-back-log(pid=16185): stdout: | (launched: 2022-12-12_18:58:57.266466) 18:58:58.506280 run scp-back-log(pid=16185): stderr: | (launched: 2022-12-12_18:58:57.286622) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:58:58.578155 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16185): launch_sync(): local process exited with status 1 [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16185)]') ---------------------------------------------- trial-2380 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 18:58:58.625608 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 18:58:58.642685 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 18:58:58.666017 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 18:58:58.720624 tst rrc_idle_mt_ping.py: using MSISDN 7929 18:58:58.837735 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7929', subscriber_id=0} 18:58:58.947969 run srsepc_10.42.42.118: Starting srsepc 18:58:59.590876 run rm-remote-dir(pid=16187): Launched 18:59:00.776421 run rm-remote-dir(pid=16187): Terminated: ok {rc=0} 18:59:01.141717 run mk-remote-dir(pid=16188): Launched 18:59:02.415404 run mk-remote-dir(pid=16188): Terminated: ok {rc=0} 18:59:02.709837 run scp-inst-to-remote(pid=16189): Launched 18:59:04.891867 run scp-inst-to-remote(pid=16189): Terminated: ok {rc=0} 18:59:05.235162 run rm-remote-dir(pid=16191): Launched 18:59:06.419793 run rm-remote-dir(pid=16191): Terminated: ok {rc=0} 18:59:06.764705 run mk-remote-dir(pid=16192): Launched 18:59:07.950693 run mk-remote-dir(pid=16192): Terminated: ok {rc=0} 18:59:08.244562 run scp-cfg-to-remote(pid=16193): Launched 18:59:09.426062 run scp-cfg-to-remote(pid=16193): Terminated: ok {rc=0} 18:59:09.717214 run scp-db-to-remote(pid=16195): Launched 18:59:10.899687 run scp-db-to-remote(pid=16195): Terminated: ok {rc=0} 18:59:11.033244 run srsepc_10.42.42.118: Setting RPATH for srsepc 18:59:11.350201 run patchelf(pid=16197): Launched 18:59:12.533112 run patchelf(pid=16197): Terminated: ok {rc=0} 18:59:12.667528 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 18:59:12.985588 run setcap-netadm(pid=16198): Launched 18:59:14.166357 run setcap-netadm(pid=16198): Terminated: ok {rc=0} 18:59:14.498580 run srsepc(pid=16199): Launched 18:59:14.617232 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 18:59:15.815206 run rm-remote-dir(pid=16200): Launched 18:59:16.154293 run srsepc(pid=16199): ERR: Terminated: ERROR {rc=127} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16199)] 18:59:16.312882 run srsepc(pid=16199): stdout: | (launched: 2022-12-12_18:59:14.439564) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:59:16.462469 run srsepc(pid=16199): stderr: | (launched: 2022-12-12_18:59:14.486040) | Connection to 10.42.42.116 closed. 18:59:16.612169 run srsepc(pid=16199): stdout: | (launched: 2022-12-12_18:59:14.439564) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 18:59:16.755067 run srsepc(pid=16199): stderr: | (launched: 2022-12-12_18:59:14.486040) | Connection to 10.42.42.116 closed. 18:59:16.924858 run rm-remote-dir(pid=16200): Terminating (SIGINT) 18:59:17.119992 run rm-remote-dir(pid=16200): Terminated: ok {rc=0} 18:59:17.260808 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=16199): Process ended prematurely: srsepc(pid=16199) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16199)] [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 18:59:17.272006 tst rrc_idle_mt_ping.py:16: Test FAILED (18.6 sec) 18:59:17.356418 run scp-back-log(pid=16201): Launched 18:59:18.438522 run scp-back-log(pid=16201): ERR: Terminated: ERROR {rc=1} [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16201)] 18:59:18.503164 run scp-back-log(pid=16201): stdout: | (launched: 2022-12-12_18:59:17.322148) 18:59:18.569499 run scp-back-log(pid=16201): stderr: | (launched: 2022-12-12_18:59:17.343318) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 18:59:18.644094 tst srsepc_10.42.42.118: Error('scp-back-log(pid=16201): launch_sync(): local process exited with status 1 [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=16201)]') --------------------------------------------------------------------- trial-2380 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 18:59:18.780772 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:59:18.786889 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 18:59:18.829247 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 18:59:18.857260 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 18:59:18.911902 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 18:59:18.955748 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 18:59:18.983210 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 18:59:19.532567 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 18:59:19.538249 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:59:19.549592 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 18:59:19.588232 tst handover.py: using LAC 30826 18:59:19.722299 tst handover.py: using RAC 226 18:59:19.850819 tst handover.py: using CellId 30826 18:59:19.971185 tst handover.py: using BVCI 30827 18:59:20.084701 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 18:59:20.118885 tst handover.py: using LAC 30827 18:59:20.238776 tst handover.py: using RAC 227 18:59:20.359691 tst handover.py: using CellId 30827 18:59:20.478988 tst handover.py: using BVCI 30828 18:59:20.592232 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:59:20.603199 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:59:20.614113 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:59:20.625187 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:59:20.636191 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 18:59:20.647167 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 18:59:20.763881 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 18:59:20.884147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:21.396001 run create_hlr_db(pid=16208): Launched 18:59:22.581820 run create_hlr_db(pid=16208): Terminated: ok {rc=0} 18:59:22.928451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16210): Launched 18:59:23.259348 run osmo-hlr_10.42.42.2(pid=16211): Launched 18:59:23.386432 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:23.954889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16213): Launched 18:59:24.283829 run osmo-stp_10.42.42.5(pid=16214): Launched 18:59:24.411633 run osmo-msc_10.42.42.6: Starting osmo-msc 18:59:25.006617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16217): Launched 18:59:25.336109 run osmo-msc_10.42.42.6(pid=16218): Launched 18:59:25.521147 run osmo-stp_10.42.42.5(pid=16214): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16214)] 18:59:25.661989 run osmo-stp_10.42.42.5(pid=16214): stdout: | (launched: 2022-12-12_18:59:24.222417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:25.800905 run osmo-stp_10.42.42.5(pid=16214): stderr: | [0;m[38;5;43m20221212185924416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185924416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185924416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185924417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185924417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185924417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185924418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:25.937461 run osmo-stp_10.42.42.5(pid=16214): stdout: | (launched: 2022-12-12_18:59:24.222417) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:26.067465 run osmo-stp_10.42.42.5(pid=16214): stderr: | [0;m[38;5;43m20221212185924416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185924416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185924416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185924417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185924417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185924417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185924418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:26.223153 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16214): Process ended prematurely: osmo-stp_10.42.42.5(pid=16214) [trial-2380↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16214)] [trial-2380↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 18:59:26.232193 tst handover.py:18: Test FAILED (6.7 sec) 18:59:26.259888 run osmo-hlr_10.42.42.2(pid=16211): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16211)] 18:59:26.310290 run osmo-hlr_10.42.42.2(pid=16211): stdout: | (launched: 2022-12-12_18:59:23.198306) 18:59:26.362108 run osmo-hlr_10.42.42.2(pid=16211): stderr: | [0;m[1;31m20221212185923398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185923398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185923398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185923398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185923398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185923398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185923410 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185923419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185923419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185923419 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:26.434401 run osmo-msc_10.42.42.6(pid=16218): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16218)] 18:59:26.484450 run osmo-msc_10.42.42.6(pid=16218): stdout: | (launched: 2022-12-12_18:59:25.274687) 18:59:26.536297 run osmo-msc_10.42.42.6(pid=16218): stderr: | [0;m[38;5;43m20221212185925599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185925599 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc50359cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185925599 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185925599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185925599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185925600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185925601 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185925602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185925602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185925602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:59:26.588626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16210): Terminating (SIGTERM) 18:59:26.630434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16213): Terminating (SIGTERM) 18:59:26.672062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16217): Terminating (SIGTERM) 18:59:26.714110 --- ParallelTerminationStrategy: PID 16210 died... 18:59:26.734074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16210): Terminated: ok {rc=0} 18:59:26.780274 --- ParallelTerminationStrategy: PID 16213 died... 18:59:26.799856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16213): Terminated: ok {rc=0} 18:59:26.846743 --- ParallelTerminationStrategy: PID 16217 died... 18:59:26.866283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16217): Terminated: ok {rc=0} 18:59:26.954658 bus /sierra_3: Setting Powered False 18:59:28.055282 bus /sierra_3: Setting Powered False 18:59:29.171775 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 18:59:30.434851 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:59:30.440431 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 18:59:30.481665 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 18:59:30.509471 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 18:59:30.564272 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 18:59:30.605069 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 18:59:30.632253 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 18:59:31.211214 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 18:59:31.218938 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:59:31.231337 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 18:59:31.274989 tst handover.py: using LAC 30828 18:59:31.408046 tst handover.py: using RAC 228 18:59:31.539468 tst handover.py: using CellId 30828 18:59:31.706527 tst handover.py: using BVCI 30829 18:59:31.867472 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 18:59:31.910282 tst handover.py: using LAC 30829 18:59:32.077376 tst handover.py: using RAC 229 18:59:32.207633 tst handover.py: using CellId 30829 18:59:32.336524 tst handover.py: using BVCI 30830 18:59:32.457068 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:59:32.468328 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:59:32.479531 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:59:32.490785 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:59:32.502035 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 18:59:32.513142 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 18:59:32.630558 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 18:59:32.747892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:33.201568 run create_hlr_db(pid=16224): Launched 18:59:33.330075 bus /sierra_2: Setting Powered False 18:59:34.391368 run create_hlr_db(pid=16224): Terminated: ok {rc=0} 18:59:34.808352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16226): Launched 18:59:35.120776 run osmo-hlr_10.42.42.2(pid=16227): Launched 18:59:35.241423 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:35.746176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16229): Launched 18:59:36.055607 run osmo-stp_10.42.42.5(pid=16230): Launched 18:59:36.176088 run osmo-msc_10.42.42.6: Starting osmo-msc 18:59:36.710229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16232): Launched 18:59:37.021930 run osmo-msc_10.42.42.6(pid=16233): Launched 18:59:37.197205 run osmo-stp_10.42.42.5(pid=16230): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16230)] 18:59:37.328098 run osmo-stp_10.42.42.5(pid=16230): stdout: | (launched: 2022-12-12_18:59:35.997670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:37.458324 run osmo-stp_10.42.42.5(pid=16230): stderr: | [0;m[38;5;43m20221212185936169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185936169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185936169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185936170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185936170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185936170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185936170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:37.586692 run osmo-stp_10.42.42.5(pid=16230): stdout: | (launched: 2022-12-12_18:59:35.997670) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:37.709255 run osmo-stp_10.42.42.5(pid=16230): stderr: | [0;m[38;5;43m20221212185936169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185936169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185936169 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185936170 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185936170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185936170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185936170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:37.856037 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16230): Process ended prematurely: osmo-stp_10.42.42.5(pid=16230) [trial-2380↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16230)] [trial-2380↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 18:59:37.864495 tst handover.py:18: Test FAILED (6.6 sec) 18:59:37.890783 run osmo-hlr_10.42.42.2(pid=16227): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16227)] 18:59:37.939058 run osmo-hlr_10.42.42.2(pid=16227): stdout: | (launched: 2022-12-12_18:59:35.062941) 18:59:37.988418 run osmo-hlr_10.42.42.2(pid=16227): stderr: | [0;m[1;31m20221212185935241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185935241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185935241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185935241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185935241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185935241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185935254 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185935262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185935262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185935262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:38.057147 run osmo-msc_10.42.42.6(pid=16233): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16233)] 18:59:38.105150 run osmo-msc_10.42.42.6(pid=16233): stdout: | (launched: 2022-12-12_18:59:36.963650) 18:59:38.154224 run osmo-msc_10.42.42.6(pid=16233): stderr: | [0;m[38;5;43m20221212185937237 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185937237 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f20791b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185937237 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185937237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185937237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185937238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185937239 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185937240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185937240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185937240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:59:38.203762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16226): Terminating (SIGTERM) 18:59:38.243596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16229): Terminating (SIGTERM) 18:59:38.283204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16232): Terminating (SIGTERM) 18:59:38.323067 --- ParallelTerminationStrategy: PID 16226 died... 18:59:38.342100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16226): Terminated: ok {rc=0} 18:59:38.385897 --- ParallelTerminationStrategy: PID 16229 died... 18:59:38.404340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16229): Terminated: ok {rc=0} 18:59:38.448025 --- ParallelTerminationStrategy: PID 16232 died... 18:59:38.466517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16232): Terminated: ok {rc=0} 18:59:38.553257 bus /sierra_3: Setting Powered False 18:59:39.653610 bus /sierra_3: Setting Powered False 18:59:40.767628 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 18:59:42.012257 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:59:42.018158 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 18:59:42.074615 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 18:59:42.102049 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 18:59:42.155135 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 18:59:42.210157 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 18:59:42.237513 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 18:59:42.787678 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 18:59:42.793268 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:59:42.804255 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:59:42.845543 tst handover.py: using LAC 30830 18:59:42.966305 tst handover.py: using RAC 230 18:59:43.086435 tst handover.py: using CellId 30830 18:59:43.209839 tst handover.py: using BVCI 30831 18:59:43.322256 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 18:59:43.369887 tst handover.py: using LAC 30831 18:59:43.490667 tst handover.py: using RAC 231 18:59:43.615461 tst handover.py: using CellId 30831 18:59:43.735756 tst handover.py: using BVCI 30832 18:59:43.846896 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:59:43.857893 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:59:43.868715 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:59:43.879513 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:59:43.890366 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 18:59:43.901074 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:59:44.020700 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 18:59:44.142507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:44.625904 run create_hlr_db(pid=16238): Launched 18:59:44.754109 bus /sierra_2: Setting Powered False 18:59:45.819000 run create_hlr_db(pid=16238): Terminated: ok {rc=0} 18:59:46.271659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16240): Launched 18:59:46.625666 run osmo-hlr_10.42.42.2(pid=16241): Launched 18:59:46.864590 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:47.482751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16243): Launched 18:59:47.792498 run osmo-stp_10.42.42.5(pid=16244): Launched 18:59:47.911491 run osmo-msc_10.42.42.6: Starting osmo-msc 18:59:48.443791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16246): Launched 18:59:48.754597 run osmo-msc_10.42.42.6(pid=16247): Launched 18:59:48.928830 run osmo-stp_10.42.42.5(pid=16244): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16244)] 18:59:49.059418 run osmo-stp_10.42.42.5(pid=16244): stdout: | (launched: 2022-12-12_18:59:47.734409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:49.189746 run osmo-stp_10.42.42.5(pid=16244): stderr: | [0;m[38;5;43m20221212185947908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185947908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185947908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185947909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185947909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185947909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185947909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:49.316776 run osmo-stp_10.42.42.5(pid=16244): stdout: | (launched: 2022-12-12_18:59:47.734409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 18:59:49.439142 run osmo-stp_10.42.42.5(pid=16244): stderr: | [0;m[38;5;43m20221212185947908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185947908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185947908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185947909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185947909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185947909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185947909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 18:59:49.584755 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16244): Process ended prematurely: osmo-stp_10.42.42.5(pid=16244) [trial-2380↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16244)] [trial-2380↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 18:59:49.593387 tst handover.py:18: Test FAILED (6.8 sec) 18:59:49.619525 run osmo-hlr_10.42.42.2(pid=16241): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16241)] 18:59:49.667180 run osmo-hlr_10.42.42.2(pid=16241): stdout: | (launched: 2022-12-12_18:59:46.556772) 18:59:49.716890 run osmo-hlr_10.42.42.2(pid=16241): stderr: | [0;m[1;31m20221212185946848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185946848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185946848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185946848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185946848 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185946849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185946877 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185946891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185946891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185946891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 18:59:49.785651 run osmo-msc_10.42.42.6(pid=16247): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16247)] 18:59:49.833408 run osmo-msc_10.42.42.6(pid=16247): stdout: | (launched: 2022-12-12_18:59:48.696241) 18:59:49.882769 run osmo-msc_10.42.42.6(pid=16247): stderr: | [0;m[38;5;43m20221212185948972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212185948972 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe529029c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212185948972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212185948972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212185948972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212185948972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212185948974 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212185948975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212185948975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212185948975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 18:59:49.932566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16240): Terminating (SIGTERM) 18:59:49.972529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16243): Terminating (SIGTERM) 18:59:50.012320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16246): Terminating (SIGTERM) 18:59:50.052385 --- ParallelTerminationStrategy: PID 16240 died... 18:59:50.071573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16240): Terminated: ok {rc=0} 18:59:50.115480 --- ParallelTerminationStrategy: PID 16243 died... 18:59:50.134136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16243): Terminated: ok {rc=0} 18:59:50.177847 --- ParallelTerminationStrategy: PID 16246 died... 18:59:50.196553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16246): Terminated: ok {rc=0} 18:59:50.282875 bus /sierra_3: Setting Powered False 18:59:51.382736 bus /sierra_3: Setting Powered False 18:59:52.499334 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 18:59:53.764151 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 18:59:53.770745 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 18:59:53.823365 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 18:59:53.851105 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 18:59:53.905526 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 18:59:53.956693 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 18:59:53.983968 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 18:59:54.537994 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 18:59:54.543509 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:59:54.555297 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:59:54.594847 tst handover.py: using LAC 30832 18:59:54.725982 tst handover.py: using RAC 232 18:59:54.854015 tst handover.py: using CellId 30832 18:59:54.982782 tst handover.py: using BVCI 30833 18:59:55.102005 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 18:59:55.146628 tst handover.py: using LAC 30833 18:59:55.275184 tst handover.py: using RAC 233 18:59:55.401461 tst handover.py: using CellId 30833 18:59:55.529841 tst handover.py: using BVCI 30834 18:59:55.649018 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:59:55.660689 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:59:55.672114 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:59:55.683892 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:59:55.695638 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 18:59:55.707361 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:59:55.824264 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 18:59:55.942671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 18:59:56.395327 run create_hlr_db(pid=16252): Launched 18:59:56.524005 bus /sierra_2: Setting Powered False 18:59:57.584445 run create_hlr_db(pid=16252): Terminated: ok {rc=0} 18:59:58.005474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16254): Launched 18:59:58.338018 run osmo-hlr_10.42.42.2(pid=16255): Launched 18:59:58.465136 run osmo-stp_10.42.42.5: Starting osmo-stp 18:59:59.004890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16257): Launched 18:59:59.337711 run osmo-stp_10.42.42.5(pid=16258): Launched 18:59:59.466401 run osmo-msc_10.42.42.6: Starting osmo-msc 19:00:00.039152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16260): Launched 19:00:00.371628 run osmo-msc_10.42.42.6(pid=16261): Launched 19:00:00.559069 run osmo-stp_10.42.42.5(pid=16258): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16258)] 19:00:00.701498 run osmo-stp_10.42.42.5(pid=16258): stdout: | (launched: 2022-12-12_18:59:59.275962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:00.853929 run osmo-stp_10.42.42.5(pid=16258): stderr: | [0;m[38;5;43m20221212185959467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185959468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185959468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185959468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185959469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185959469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185959469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:01.001735 run osmo-stp_10.42.42.5(pid=16258): stdout: | (launched: 2022-12-12_18:59:59.275962) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:01.150988 run osmo-stp_10.42.42.5(pid=16258): stderr: | [0;m[38;5;43m20221212185959467 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212185959468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212185959468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212185959468 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212185959469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212185959469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212185959469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:01.313250 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16258): Process ended prematurely: osmo-stp_10.42.42.5(pid=16258) [trial-2380↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16258)] [trial-2380↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 19:00:01.323858 tst handover.py:18: Test FAILED (6.8 sec) 19:00:01.355284 run osmo-hlr_10.42.42.2(pid=16255): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16255)] 19:00:01.408908 run osmo-hlr_10.42.42.2(pid=16255): stdout: | (launched: 2022-12-12_18:59:58.276419) 19:00:01.464069 run osmo-hlr_10.42.42.2(pid=16255): stderr: | [0;m[1;31m20221212185958475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212185958475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212185958475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212185958475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212185958475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212185958475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212185958488 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212185958497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212185958497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212185958497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:01.539730 run osmo-msc_10.42.42.6(pid=16261): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16261)] 19:00:01.593504 run osmo-msc_10.42.42.6(pid=16261): stdout: | (launched: 2022-12-12_19:00:00.309859) 19:00:01.648067 run osmo-msc_10.42.42.6(pid=16261): stderr: | [0;m[38;5;43m20221212190000632 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190000633 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9cbe3cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190000633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190000633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190000633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190000633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190000635 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190000635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190000635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190000635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:00:01.703012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16254): Terminating (SIGTERM) 19:00:01.748054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16257): Terminating (SIGTERM) 19:00:01.793586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16260): Terminating (SIGTERM) 19:00:01.838270 --- ParallelTerminationStrategy: PID 16254 died... 19:00:01.861474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16254): Terminated: ok {rc=0} 19:00:01.918028 --- ParallelTerminationStrategy: PID 16257 died... 19:00:01.946829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16257): Terminated: ok {rc=0} 19:00:01.996435 --- ParallelTerminationStrategy: PID 16260 died... 19:00:02.016915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16260): Terminated: ok {rc=0} 19:00:02.118192 bus /sierra_3: Setting Powered False 19:00:03.230232 bus /sierra_3: Setting Powered False 19:00:04.347976 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:00:05.608926 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:00:05.614863 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:00:05.671536 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:00:05.699259 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:00:05.753484 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:00:05.809451 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:00:05.836715 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:00:06.390795 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:00:06.396280 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:00:06.407980 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:00:06.447085 tst handover.py: using LAC 30834 19:00:06.575537 tst handover.py: using RAC 234 19:00:06.703424 tst handover.py: using CellId 30834 19:00:06.831891 tst handover.py: using BVCI 30835 19:00:06.951524 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:00:07.003930 tst handover.py: using LAC 30835 19:00:07.133360 tst handover.py: using RAC 235 19:00:07.262848 tst handover.py: using CellId 30835 19:00:07.391524 tst handover.py: using BVCI 30836 19:00:07.512589 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:00:07.524214 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:00:07.535588 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:00:07.547330 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:00:07.559086 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:00:07.570759 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:00:07.689814 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:00:07.810525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:08.296134 run create_hlr_db(pid=16269): Launched 19:00:08.423584 bus /sierra_2: Setting Powered False 19:00:09.488829 run create_hlr_db(pid=16269): Terminated: ok {rc=0} 19:00:09.920076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16271): Launched 19:00:10.251052 run osmo-hlr_10.42.42.2(pid=16272): Launched 19:00:10.379035 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:10.919863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16274): Launched 19:00:11.252672 run osmo-stp_10.42.42.5(pid=16275): Launched 19:00:11.380888 run osmo-msc_10.42.42.6: Starting osmo-msc 19:00:11.951044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16277): Launched 19:00:12.283410 run osmo-msc_10.42.42.6(pid=16278): Launched 19:00:12.468905 run osmo-stp_10.42.42.5(pid=16275): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16275)] 19:00:12.606670 run osmo-stp_10.42.42.5(pid=16275): stdout: | (launched: 2022-12-12_19:00:11.191149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:12.745946 run osmo-stp_10.42.42.5(pid=16275): stderr: | [0;m[38;5;43m20221212190011383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190011383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190011383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190011384 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190011384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190011384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190011384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:12.883223 run osmo-stp_10.42.42.5(pid=16275): stdout: | (launched: 2022-12-12_19:00:11.191149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:13.014472 run osmo-stp_10.42.42.5(pid=16275): stderr: | [0;m[38;5;43m20221212190011383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190011383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190011383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190011384 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190011384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190011384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190011384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:13.170668 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16275): Process ended prematurely: osmo-stp_10.42.42.5(pid=16275) [trial-2380↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16275)] [trial-2380↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 19:00:13.179777 tst handover.py:18: Test FAILED (6.8 sec) 19:00:13.208784 run osmo-hlr_10.42.42.2(pid=16272): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16272)] 19:00:13.259670 run osmo-hlr_10.42.42.2(pid=16272): stdout: | (launched: 2022-12-12_19:00:10.189593) 19:00:13.312296 run osmo-hlr_10.42.42.2(pid=16272): stderr: | [0;m[1;31m20221212190010390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190010390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190010390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190010390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190010390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190010390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190010402 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190010411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190010411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190010411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:13.385425 run osmo-msc_10.42.42.6(pid=16278): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16278)] 19:00:13.436376 run osmo-msc_10.42.42.6(pid=16278): stdout: | (launched: 2022-12-12_19:00:12.221918) 19:00:13.489088 run osmo-msc_10.42.42.6(pid=16278): stderr: | [0;m[38;5;43m20221212190012546 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190012546 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f578bfe0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190012547 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190012547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190012547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190012547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190012549 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190012549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190012549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190012549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:00:13.542055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16271): Terminating (SIGTERM) 19:00:13.584461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16274): Terminating (SIGTERM) 19:00:13.627018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16277): Terminating (SIGTERM) 19:00:13.669702 --- ParallelTerminationStrategy: PID 16271 died... 19:00:13.689839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16271): Terminated: ok {rc=0} 19:00:13.737367 --- ParallelTerminationStrategy: PID 16274 died... 19:00:13.757081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16274): Terminated: ok {rc=0} 19:00:13.804306 --- ParallelTerminationStrategy: PID 16277 died... 19:00:13.824116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16277): Terminated: ok {rc=0} 19:00:13.913466 bus /sierra_3: Setting Powered False 19:00:15.013627 bus /sierra_3: Setting Powered False 19:00:16.133715 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 19:00:17.406235 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:00:17.412075 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:00:17.453766 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:00:17.480388 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:00:17.538691 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:00:17.582971 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:00:17.610730 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:00:18.159750 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 19:00:18.165724 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:00:18.177444 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 19:00:18.218672 tst handover.py: using LAC 30836 19:00:18.348360 tst handover.py: using RAC 236 19:00:18.476365 tst handover.py: using CellId 30836 19:00:18.606406 tst handover.py: using BVCI 30837 19:00:18.726858 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 19:00:18.762347 tst handover.py: using LAC 30837 19:00:18.893483 tst handover.py: using RAC 237 19:00:19.016572 tst handover.py: using CellId 30837 19:00:19.138852 tst handover.py: using BVCI 30838 19:00:19.252008 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:00:19.262924 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:00:19.273765 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:00:19.284411 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:00:19.295192 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:00:19.306316 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 19:00:19.426185 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 19:00:19.543300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:19.996508 run create_hlr_db(pid=16283): Launched 19:00:20.123917 bus /sierra_2: Setting Powered False 19:00:21.184227 run create_hlr_db(pid=16283): Terminated: ok {rc=0} 19:00:21.605982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16285): Launched 19:00:21.939446 run osmo-hlr_10.42.42.2(pid=16286): Launched 19:00:22.067389 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:22.603863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16288): Launched 19:00:22.937463 run osmo-stp_10.42.42.5(pid=16289): Launched 19:00:23.064130 run osmo-msc_10.42.42.6: Starting osmo-msc 19:00:23.633695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16291): Launched 19:00:23.967914 run osmo-msc_10.42.42.6(pid=16292): Launched 19:00:24.154915 run osmo-stp_10.42.42.5(pid=16289): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16289)] 19:00:24.294105 run osmo-stp_10.42.42.5(pid=16289): stdout: | (launched: 2022-12-12_19:00:22.875258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:24.433238 run osmo-stp_10.42.42.5(pid=16289): stderr: | [0;m[38;5;43m20221212190023069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190023069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190023070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190023070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190023071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190023071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190023071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:24.570842 run osmo-stp_10.42.42.5(pid=16289): stdout: | (launched: 2022-12-12_19:00:22.875258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:24.702276 run osmo-stp_10.42.42.5(pid=16289): stderr: | [0;m[38;5;43m20221212190023069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190023069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190023070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190023070 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190023071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190023071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190023071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:24.859292 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16289): Process ended prematurely: osmo-stp_10.42.42.5(pid=16289) [trial-2380↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16289)] [trial-2380↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 19:00:24.868437 tst handover.py:18: Test FAILED (6.7 sec) 19:00:24.896771 run osmo-hlr_10.42.42.2(pid=16286): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16286)] 19:00:24.947961 run osmo-hlr_10.42.42.2(pid=16286): stdout: | (launched: 2022-12-12_19:00:21.877528) 19:00:25.000078 run osmo-hlr_10.42.42.2(pid=16286): stderr: | [0;m[1;31m20221212190022076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190022076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190022076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190022076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190022077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190022077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190022088 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190022098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190022099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190022099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:25.072707 run osmo-msc_10.42.42.6(pid=16292): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16292)] 19:00:25.123230 run osmo-msc_10.42.42.6(pid=16292): stdout: | (launched: 2022-12-12_19:00:23.905981) 19:00:25.174889 run osmo-msc_10.42.42.6(pid=16292): stderr: | [0;m[38;5;43m20221212190024229 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190024230 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3f386f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190024230 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190024230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190024230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190024230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190024232 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190024232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190024232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190024232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:00:25.226925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16285): Terminating (SIGTERM) 19:00:25.269100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16288): Terminating (SIGTERM) 19:00:25.311478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16291): Terminating (SIGTERM) 19:00:25.354370 --- ParallelTerminationStrategy: PID 16285 died... 19:00:25.374629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16285): Terminated: ok {rc=0} 19:00:25.421705 --- ParallelTerminationStrategy: PID 16288 died... 19:00:25.441423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16288): Terminated: ok {rc=0} 19:00:25.488846 --- ParallelTerminationStrategy: PID 16291 died... 19:00:25.509138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16291): Terminated: ok {rc=0} 19:00:25.599210 bus /sierra_3: Setting Powered False 19:00:26.699296 bus /sierra_3: Setting Powered False 19:00:27.815426 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 19:00:29.073251 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:00:29.080252 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:00:29.136206 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:00:29.163254 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:00:29.223469 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:00:29.279522 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:00:29.306548 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:00:29.853816 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 19:00:29.860323 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:00:29.872528 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:00:29.912704 tst handover.py: using LAC 30838 19:00:30.038602 tst handover.py: using RAC 238 19:00:30.166010 tst handover.py: using CellId 30838 19:00:30.291939 tst handover.py: using BVCI 30839 19:00:30.408759 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:00:30.458139 tst handover.py: using LAC 30839 19:00:30.585904 tst handover.py: using RAC 239 19:00:30.713393 tst handover.py: using CellId 30839 19:00:30.845502 tst handover.py: using BVCI 30840 19:00:30.968898 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:00:30.981444 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:00:30.993627 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:00:31.006439 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:00:31.019110 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:00:31.031836 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:00:31.175930 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:00:31.321080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:31.840493 run create_hlr_db(pid=16297): Launched 19:00:31.996315 bus /sierra_2: Setting Powered False 19:00:33.060595 run create_hlr_db(pid=16297): Terminated: ok {rc=0} 19:00:33.468738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16299): Launched 19:00:33.773270 run osmo-hlr_10.42.42.2(pid=16300): Launched 19:00:33.888532 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:34.394222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16302): Launched 19:00:34.697418 run osmo-stp_10.42.42.5(pid=16303): Launched 19:00:34.812640 run osmo-msc_10.42.42.6: Starting osmo-msc 19:00:35.334282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16305): Launched 19:00:35.638543 run osmo-msc_10.42.42.6(pid=16306): Launched 19:00:35.807214 run osmo-stp_10.42.42.5(pid=16303): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16303)] 19:00:35.933685 run osmo-stp_10.42.42.5(pid=16303): stdout: | (launched: 2022-12-12_19:00:34.640004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:36.060473 run osmo-stp_10.42.42.5(pid=16303): stderr: | [0;m[38;5;43m20221212190034808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190034808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190034809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190034809 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190034810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190034810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190034810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:36.185994 run osmo-stp_10.42.42.5(pid=16303): stdout: | (launched: 2022-12-12_19:00:34.640004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:36.310603 run osmo-stp_10.42.42.5(pid=16303): stderr: | [0;m[38;5;43m20221212190034808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190034808 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190034809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190034809 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190034810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190034810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190034810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:36.454215 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16303): Process ended prematurely: osmo-stp_10.42.42.5(pid=16303) [trial-2380↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16303)] [trial-2380↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 19:00:36.462609 tst handover.py:18: Test FAILED (6.6 sec) 19:00:36.489106 run osmo-hlr_10.42.42.2(pid=16300): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16300)] 19:00:36.537133 run osmo-hlr_10.42.42.2(pid=16300): stdout: | (launched: 2022-12-12_19:00:33.716422) 19:00:36.586614 run osmo-hlr_10.42.42.2(pid=16300): stderr: | [0;m[1;31m20221212190033889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190033889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190033889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190033889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190033889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190033889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190033901 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190033909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190033909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190033909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:36.655472 run osmo-msc_10.42.42.6(pid=16306): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16306)] 19:00:36.703186 run osmo-msc_10.42.42.6(pid=16306): stdout: | (launched: 2022-12-12_19:00:35.581684) 19:00:36.752462 run osmo-msc_10.42.42.6(pid=16306): stderr: | [0;m[38;5;43m20221212190035854 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190035854 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f79b4b86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190035854 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190035854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190035854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190035854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190035856 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190035857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190035858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190035858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:00:36.802132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16299): Terminating (SIGTERM) 19:00:36.842163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16302): Terminating (SIGTERM) 19:00:36.882057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16305): Terminating (SIGTERM) 19:00:36.922085 --- ParallelTerminationStrategy: PID 16299 died... 19:00:36.940930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16299): Terminated: ok {rc=0} 19:00:36.984553 --- ParallelTerminationStrategy: PID 16302 died... 19:00:37.002878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16302): Terminated: ok {rc=0} 19:00:37.046641 --- ParallelTerminationStrategy: PID 16305 died... 19:00:37.064928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16305): Terminated: ok {rc=0} 19:00:37.150800 bus /sierra_3: Setting Powered False 19:00:38.251183 bus /sierra_3: Setting Powered False 19:00:39.363846 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 19:00:40.623535 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:00:40.630725 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:00:40.686716 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:00:40.714538 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:00:40.767862 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:00:40.822197 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:00:40.849868 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:00:41.401546 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 19:00:41.407306 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:00:41.418799 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:00:41.458749 tst handover.py: using LAC 30840 19:00:41.587079 tst handover.py: using RAC 240 19:00:41.713220 tst handover.py: using CellId 30840 19:00:41.840632 tst handover.py: using BVCI 30841 19:00:41.959564 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:00:42.013398 tst handover.py: using LAC 30841 19:00:42.140093 tst handover.py: using RAC 241 19:00:42.257955 tst handover.py: using CellId 30841 19:00:42.377163 tst handover.py: using BVCI 30842 19:00:42.485739 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:00:42.496630 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:00:42.507342 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:00:42.518018 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:00:42.528780 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:00:42.540033 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:00:42.658666 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:00:42.777667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:43.251310 run create_hlr_db(pid=16311): Launched 19:00:43.375952 bus /sierra_2: Setting Powered False 19:00:44.439201 run create_hlr_db(pid=16311): Terminated: ok {rc=0} 19:00:44.845042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16313): Launched 19:00:45.147414 run osmo-hlr_10.42.42.2(pid=16314): Launched 19:00:45.261908 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:45.754081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16316): Launched 19:00:46.121629 run osmo-stp_10.42.42.5(pid=16317): Launched 19:00:46.363745 run osmo-msc_10.42.42.6: Starting osmo-msc 19:00:47.013684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16319): Launched 19:00:47.355082 run osmo-msc_10.42.42.6(pid=16320): Launched 19:00:47.536103 run osmo-stp_10.42.42.5(pid=16317): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16317)] 19:00:47.672008 run osmo-stp_10.42.42.5(pid=16317): stdout: | (launched: 2022-12-12_19:00:46.047137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:47.809120 run osmo-stp_10.42.42.5(pid=16317): stderr: | [0;m[38;5;43m20221212190046309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190046309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190046309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190046310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190046310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190046310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190046311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:47.943335 run osmo-stp_10.42.42.5(pid=16317): stdout: | (launched: 2022-12-12_19:00:46.047137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:48.070558 run osmo-stp_10.42.42.5(pid=16317): stderr: | [0;m[38;5;43m20221212190046309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190046309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190046309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190046310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190046310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190046310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190046311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:48.223273 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16317): Process ended prematurely: osmo-stp_10.42.42.5(pid=16317) [trial-2380↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16317)] [trial-2380↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 19:00:48.232312 tst handover.py:18: Test FAILED (6.8 sec) 19:00:48.260518 run osmo-hlr_10.42.42.2(pid=16314): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16314)] 19:00:48.310620 run osmo-hlr_10.42.42.2(pid=16314): stdout: | (launched: 2022-12-12_19:00:45.091441) 19:00:48.362708 run osmo-hlr_10.42.42.2(pid=16314): stderr: | [0;m[1;31m20221212190045264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190045264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190045264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190045264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190045264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190045264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190045292 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190045303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190045303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190045303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:48.434912 run osmo-msc_10.42.42.6(pid=16320): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16320)] 19:00:48.484831 run osmo-msc_10.42.42.6(pid=16320): stdout: | (launched: 2022-12-12_19:00:47.293413) 19:00:48.536472 run osmo-msc_10.42.42.6(pid=16320): stderr: | [0;m[38;5;43m20221212190047612 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190047612 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7eff9d1c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190047612 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190047612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190047612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190047612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190047614 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190047614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190047615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190047615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:00:48.588365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16313): Terminating (SIGTERM) 19:00:48.630826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16316): Terminating (SIGTERM) 19:00:48.672786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16319): Terminating (SIGTERM) 19:00:48.715524 --- ParallelTerminationStrategy: PID 16313 died... 19:00:48.735525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16313): Terminated: ok {rc=0} 19:00:48.782228 --- ParallelTerminationStrategy: PID 16316 died... 19:00:48.801593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16316): Terminated: ok {rc=0} 19:00:48.848090 --- ParallelTerminationStrategy: PID 16319 died... 19:00:48.867649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16319): Terminated: ok {rc=0} 19:00:48.956088 bus /sierra_3: Setting Powered False 19:00:50.053358 bus /sierra_3: Setting Powered False 19:00:51.168924 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 19:00:52.426794 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:00:52.432427 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 19:00:52.471017 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 19:00:52.498103 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 19:00:52.551689 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 19:00:52.589657 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 19:00:52.616920 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 19:00:53.167727 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 19:00:53.173568 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:00:53.184832 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 19:00:53.226328 tst handover.py: using LAC 30842 19:00:53.350450 tst handover.py: using RAC 242 19:00:53.475945 tst handover.py: using CellId 30842 19:00:53.599978 tst handover.py: using BVCI 30843 19:00:53.715342 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 19:00:53.749405 tst handover.py: using LAC 30843 19:00:53.865364 tst handover.py: using RAC 243 19:00:53.980231 tst handover.py: using CellId 30843 19:00:54.094797 tst handover.py: using BVCI 30844 19:00:54.201891 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:00:54.213260 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:00:54.223963 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:00:54.234736 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:00:54.245359 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 19:00:54.256064 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 19:00:54.375370 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 19:00:54.496686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:00:54.967435 run create_hlr_db(pid=16325): Launched 19:00:55.090646 bus /sierra_2: Setting Powered False 19:00:56.153968 run create_hlr_db(pid=16325): Terminated: ok {rc=0} 19:00:56.557532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16327): Launched 19:00:56.858367 run osmo-hlr_10.42.42.2(pid=16328): Launched 19:00:56.972075 run osmo-stp_10.42.42.5: Starting osmo-stp 19:00:57.458430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16330): Launched 19:00:57.758219 run osmo-stp_10.42.42.5(pid=16331): Launched 19:00:57.871570 run osmo-msc_10.42.42.6: Starting osmo-msc 19:00:58.385947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16333): Launched 19:00:58.687088 run osmo-msc_10.42.42.6(pid=16334): Launched 19:00:58.854740 run osmo-stp_10.42.42.5(pid=16331): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16331)] 19:00:58.980874 run osmo-stp_10.42.42.5(pid=16331): stdout: | (launched: 2022-12-12_19:00:57.702045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:59.106865 run osmo-stp_10.42.42.5(pid=16331): stderr: | [0;m[38;5;43m20221212190057870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190057870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190057870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190057870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190057871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190057871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190057871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:59.230901 run osmo-stp_10.42.42.5(pid=16331): stdout: | (launched: 2022-12-12_19:00:57.702045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:00:59.349250 run osmo-stp_10.42.42.5(pid=16331): stderr: | [0;m[38;5;43m20221212190057870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190057870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190057870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190057870 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190057871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190057871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190057871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:00:59.490531 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16331): Process ended prematurely: osmo-stp_10.42.42.5(pid=16331) [trial-2380↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16331)] [trial-2380↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 19:00:59.498969 tst handover.py:18: Test FAILED (6.3 sec) 19:00:59.525093 run osmo-hlr_10.42.42.2(pid=16328): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16328)] 19:00:59.572824 run osmo-hlr_10.42.42.2(pid=16328): stdout: | (launched: 2022-12-12_19:00:56.802092) 19:00:59.621764 run osmo-hlr_10.42.42.2(pid=16328): stderr: | [0;m[1;31m20221212190056976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190056976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190056976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190056976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190056976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190056976 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190056989 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190056997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190056998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190056998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:00:59.690342 run osmo-msc_10.42.42.6(pid=16334): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16334)] 19:00:59.737715 run osmo-msc_10.42.42.6(pid=16334): stdout: | (launched: 2022-12-12_19:00:58.630601) 19:00:59.786446 run osmo-msc_10.42.42.6(pid=16334): stderr: | [0;m[38;5;43m20221212190058901 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190058902 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f650f81cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190058902 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190058902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190058902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190058902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190058904 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190058904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190058904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190058904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:00:59.835586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16327): Terminating (SIGTERM) 19:00:59.874853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16330): Terminating (SIGTERM) 19:00:59.914315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16333): Terminating (SIGTERM) 19:00:59.953852 --- ParallelTerminationStrategy: PID 16327 died... 19:00:59.972698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16327): Terminated: ok {rc=0} 19:01:00.016741 --- ParallelTerminationStrategy: PID 16330 died... 19:01:00.035079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16330): Terminated: ok {rc=0} 19:01:00.078108 --- ParallelTerminationStrategy: PID 16333 died... 19:01:00.096402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16333): Terminated: ok {rc=0} 19:01:00.179332 bus /sierra_3: Setting Powered False 19:01:01.273703 bus /sierra_3: Setting Powered False 19:01:02.386960 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 19:01:03.629098 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:01:03.634873 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 19:01:03.687347 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 19:01:03.714908 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 19:01:03.767491 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 19:01:03.818897 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 19:01:03.846384 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 19:01:04.394205 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 19:01:04.399302 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:01:04.410082 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:01:04.448408 tst handover.py: using LAC 30844 19:01:04.566098 tst handover.py: using RAC 244 19:01:04.681940 tst handover.py: using CellId 30844 19:01:04.796535 tst handover.py: using BVCI 30845 19:01:04.903570 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:01:04.949250 tst handover.py: using LAC 30845 19:01:05.064178 tst handover.py: using RAC 245 19:01:05.192669 tst handover.py: using CellId 30845 19:01:05.320296 tst handover.py: using BVCI 30846 19:01:05.437954 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:01:05.449324 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:01:05.460367 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:01:05.472082 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:01:05.483918 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:01:05.495581 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:01:05.611539 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:01:05.725926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:06.165083 run create_hlr_db(pid=16339): Launched 19:01:06.288352 bus /sierra_2: Setting Powered False 19:01:07.348861 run create_hlr_db(pid=16339): Terminated: ok {rc=0} 19:01:07.757234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16341): Launched 19:01:08.083058 run osmo-hlr_10.42.42.2(pid=16342): Launched 19:01:08.206623 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:08.735518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16344): Launched 19:01:09.059346 run osmo-stp_10.42.42.5(pid=16345): Launched 19:01:09.182268 run osmo-msc_10.42.42.6: Starting osmo-msc 19:01:09.736130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16347): Launched 19:01:10.060180 run osmo-msc_10.42.42.6(pid=16348): Launched 19:01:10.240787 run osmo-stp_10.42.42.5(pid=16345): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16345)] 19:01:10.376818 run osmo-stp_10.42.42.5(pid=16345): stdout: | (launched: 2022-12-12_19:01:08.999894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:10.513114 run osmo-stp_10.42.42.5(pid=16345): stderr: | [0;m[38;5;43m20221212190109187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190109188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190109188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190109188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190109189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190109189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190109189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:10.647731 run osmo-stp_10.42.42.5(pid=16345): stdout: | (launched: 2022-12-12_19:01:08.999894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:10.776063 run osmo-stp_10.42.42.5(pid=16345): stderr: | [0;m[38;5;43m20221212190109187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190109188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190109188 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190109188 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190109189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190109189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190109189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:10.930238 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16345): Process ended prematurely: osmo-stp_10.42.42.5(pid=16345) [trial-2380↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16345)] [trial-2380↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 19:01:10.939495 tst handover.py:18: Test FAILED (6.5 sec) 19:01:10.967754 run osmo-hlr_10.42.42.2(pid=16342): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16342)] 19:01:11.017967 run osmo-hlr_10.42.42.2(pid=16342): stdout: | (launched: 2022-12-12_19:01:08.023052) 19:01:11.069600 run osmo-hlr_10.42.42.2(pid=16342): stderr: | [0;m[1;31m20221212190108217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190108217 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190108218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190108218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190108218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190108218 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190108232 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190108242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190108242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190108242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:11.141718 run osmo-msc_10.42.42.6(pid=16348): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16348)] 19:01:11.191498 run osmo-msc_10.42.42.6(pid=16348): stdout: | (launched: 2022-12-12_19:01:10.000255) 19:01:11.243009 run osmo-msc_10.42.42.6(pid=16348): stderr: | [0;m[38;5;43m20221212190110318 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190110318 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd3a3919c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190110318 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190110318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190110318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190110319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190110320 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190110321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190110321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190110321 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:01:11.295221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16341): Terminating (SIGTERM) 19:01:11.336513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16344): Terminating (SIGTERM) 19:01:11.378153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16347): Terminating (SIGTERM) 19:01:11.420629 --- ParallelTerminationStrategy: PID 16341 died... 19:01:11.440544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16341): Terminated: ok {rc=0} 19:01:11.487132 --- ParallelTerminationStrategy: PID 16344 died... 19:01:11.506542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16344): Terminated: ok {rc=0} 19:01:11.552838 --- ParallelTerminationStrategy: PID 16347 died... 19:01:11.572617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16347): Terminated: ok {rc=0} 19:01:11.660571 bus /sierra_3: Setting Powered False 19:01:12.754158 bus /sierra_3: Setting Powered False 19:01:13.867999 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 19:01:15.121509 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:01:15.126575 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 19:01:15.172464 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:01:15.198785 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:01:15.251155 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 19:01:15.299223 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:01:15.326904 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:01:15.879480 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 19:01:15.885997 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:01:15.903050 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:01:15.954601 tst handover.py: using LAC 30846 19:01:16.099298 tst handover.py: using RAC 246 19:01:16.249301 tst handover.py: using CellId 30846 19:01:16.370762 tst handover.py: using BVCI 30847 19:01:16.522362 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:01:16.567908 tst handover.py: using LAC 30847 19:01:16.694684 tst handover.py: using RAC 247 19:01:16.825233 tst handover.py: using CellId 30847 19:01:16.979392 tst handover.py: using BVCI 30848 19:01:17.091726 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:01:17.103837 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:01:17.116619 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:01:17.129681 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:01:17.141824 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:01:17.154664 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:01:17.288354 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:01:17.407729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:17.880160 run create_hlr_db(pid=16353): Launched 19:01:18.004635 bus /sierra_2: Setting Powered False 19:01:19.068346 run create_hlr_db(pid=16353): Terminated: ok {rc=0} 19:01:19.473802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16355): Launched 19:01:19.776540 run osmo-hlr_10.42.42.2(pid=16356): Launched 19:01:19.891818 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:20.388256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16358): Launched 19:01:20.689345 run osmo-stp_10.42.42.5(pid=16359): Launched 19:01:20.804618 run osmo-msc_10.42.42.6: Starting osmo-msc 19:01:21.325123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16361): Launched 19:01:21.628057 run osmo-msc_10.42.42.6(pid=16362): Launched 19:01:21.797424 run osmo-stp_10.42.42.5(pid=16359): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16359)] 19:01:21.924312 run osmo-stp_10.42.42.5(pid=16359): stdout: | (launched: 2022-12-12_19:01:20.633090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:22.050939 run osmo-stp_10.42.42.5(pid=16359): stderr: | [0;m[38;5;43m20221212190120800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190120800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190120800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190120801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190120801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190120801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190120801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:22.175764 run osmo-stp_10.42.42.5(pid=16359): stdout: | (launched: 2022-12-12_19:01:20.633090) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:22.295040 run osmo-stp_10.42.42.5(pid=16359): stderr: | [0;m[38;5;43m20221212190120800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190120800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190120800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190120801 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190120801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190120801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190120801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:22.438769 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16359): Process ended prematurely: osmo-stp_10.42.42.5(pid=16359) [trial-2380↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16359)] [trial-2380↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 19:01:22.447165 tst handover.py:18: Test FAILED (6.6 sec) 19:01:22.473164 run osmo-hlr_10.42.42.2(pid=16356): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16356)] 19:01:22.520075 run osmo-hlr_10.42.42.2(pid=16356): stdout: | (launched: 2022-12-12_19:01:19.720391) 19:01:22.568602 run osmo-hlr_10.42.42.2(pid=16356): stderr: | [0;m[1;31m20221212190119894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190119894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190119894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190119894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190119894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190119894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190119908 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190119917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190119917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190119917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:22.636575 run osmo-msc_10.42.42.6(pid=16362): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16362)] 19:01:22.683673 run osmo-msc_10.42.42.6(pid=16362): stdout: | (launched: 2022-12-12_19:01:21.571169) 19:01:22.732283 run osmo-msc_10.42.42.6(pid=16362): stderr: | [0;m[38;5;43m20221212190121841 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190121841 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f93a7fb5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190121842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190121842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190121842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190121842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190121844 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190121844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190121844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190121844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:01:22.781152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16355): Terminating (SIGTERM) 19:01:22.820523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16358): Terminating (SIGTERM) 19:01:22.860033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16361): Terminating (SIGTERM) 19:01:22.899805 --- ParallelTerminationStrategy: PID 16355 died... 19:01:22.918964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16355): Terminated: ok {rc=0} 19:01:22.962566 --- ParallelTerminationStrategy: PID 16358 died... 19:01:22.981174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16358): Terminated: ok {rc=0} 19:01:23.024518 --- ParallelTerminationStrategy: PID 16361 died... 19:01:23.042884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16361): Terminated: ok {rc=0} 19:01:23.126880 bus /sierra_3: Setting Powered False 19:01:24.224589 bus /sierra_3: Setting Powered False 19:01:25.338913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:01:26.596213 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:01:26.601312 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:01:26.651432 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:01:26.677628 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:01:26.730018 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:01:26.780687 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:01:26.806802 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:01:27.357809 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:01:27.362887 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:01:27.373958 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:01:27.407899 tst handover.py: using LAC 30848 19:01:27.525563 tst handover.py: using RAC 248 19:01:27.644715 tst handover.py: using CellId 30848 19:01:27.760773 tst handover.py: using BVCI 30849 19:01:27.869430 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:01:27.918086 tst handover.py: using LAC 30849 19:01:28.037298 tst handover.py: using RAC 249 19:01:28.154700 tst handover.py: using CellId 30849 19:01:28.273539 tst handover.py: using BVCI 30850 19:01:28.381982 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:01:28.392875 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:01:28.403682 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:01:28.414626 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:01:28.425541 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:01:28.436308 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:01:28.555634 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:01:28.675604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:29.119214 run create_hlr_db(pid=16367): Launched 19:01:29.243036 bus /sierra_2: Setting Powered False 19:01:30.303275 run create_hlr_db(pid=16367): Terminated: ok {rc=0} 19:01:30.715413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16369): Launched 19:01:31.058480 run osmo-hlr_10.42.42.2(pid=16370): Launched 19:01:31.299246 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:31.919637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16372): Launched 19:01:32.293805 run osmo-stp_10.42.42.5(pid=16373): Launched 19:01:32.409516 run osmo-msc_10.42.42.6: Starting osmo-msc 19:01:32.927419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16375): Launched 19:01:33.228881 run osmo-msc_10.42.42.6(pid=16376): Launched 19:01:33.396548 run osmo-stp_10.42.42.5(pid=16373): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16373)] 19:01:33.523489 run osmo-stp_10.42.42.5(pid=16373): stdout: | (launched: 2022-12-12_19:01:32.237343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:33.650044 run osmo-stp_10.42.42.5(pid=16373): stderr: | [0;m[38;5;43m20221212190132406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190132406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190132406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190132407 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190132407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190132407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190132407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:33.774475 run osmo-stp_10.42.42.5(pid=16373): stdout: | (launched: 2022-12-12_19:01:32.237343) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:33.894582 run osmo-stp_10.42.42.5(pid=16373): stderr: | [0;m[38;5;43m20221212190132406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190132406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190132406 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190132407 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190132407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190132407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190132407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:34.037595 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16373): Process ended prematurely: osmo-stp_10.42.42.5(pid=16373) [trial-2380↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16373)] [trial-2380↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 19:01:34.046159 tst handover.py:18: Test FAILED (6.7 sec) 19:01:34.072089 run osmo-hlr_10.42.42.2(pid=16370): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16370)] 19:01:34.119164 run osmo-hlr_10.42.42.2(pid=16370): stdout: | (launched: 2022-12-12_19:01:30.996523) 19:01:34.167786 run osmo-hlr_10.42.42.2(pid=16370): stderr: | [0;m[1;31m20221212190131303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190131303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190131303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190131303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190131303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190131303 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190131319 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190131335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190131336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190131336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:34.235387 run osmo-msc_10.42.42.6(pid=16376): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16376)] 19:01:34.282039 run osmo-msc_10.42.42.6(pid=16376): stdout: | (launched: 2022-12-12_19:01:33.172765) 19:01:34.330332 run osmo-msc_10.42.42.6(pid=16376): stderr: | [0;m[38;5;43m20221212190133442 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190133442 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff4e8831c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190133442 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190133442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190133443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190133443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190133445 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190133445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190133445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190133445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:01:34.379080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16369): Terminating (SIGTERM) 19:01:34.419290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16372): Terminating (SIGTERM) 19:01:34.458338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16375): Terminating (SIGTERM) 19:01:34.497676 --- ParallelTerminationStrategy: PID 16369 died... 19:01:34.516561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16369): Terminated: ok {rc=0} 19:01:34.560264 --- ParallelTerminationStrategy: PID 16372 died... 19:01:34.578793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16372): Terminated: ok {rc=0} 19:01:34.622827 --- ParallelTerminationStrategy: PID 16375 died... 19:01:34.641475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16375): Terminated: ok {rc=0} 19:01:34.726018 bus /sierra_3: Setting Powered False 19:01:35.825633 bus /sierra_3: Setting Powered False 19:01:36.938453 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 19:01:38.190588 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:01:38.195669 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:01:38.233216 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:01:38.259679 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:01:38.312099 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:01:38.352272 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:01:38.379275 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:01:38.929197 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 19:01:38.934787 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:01:38.946155 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 19:01:38.983959 tst handover.py: using LAC 30850 19:01:39.110463 tst handover.py: using RAC 250 19:01:39.236803 tst handover.py: using CellId 30850 19:01:39.356524 tst handover.py: using BVCI 30851 19:01:39.464670 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 19:01:39.500156 tst handover.py: using LAC 30851 19:01:39.618198 tst handover.py: using RAC 251 19:01:39.736436 tst handover.py: using CellId 30851 19:01:39.853941 tst handover.py: using BVCI 30852 19:01:39.964325 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:01:39.975141 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:01:39.985829 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:01:39.996539 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:01:40.007425 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:01:40.018252 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 19:01:40.134923 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 19:01:40.255221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:40.698012 run create_hlr_db(pid=16381): Launched 19:01:40.821766 bus /sierra_2: Setting Powered False 19:01:41.882290 run create_hlr_db(pid=16381): Terminated: ok {rc=0} 19:01:42.296152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16383): Launched 19:01:42.620223 run osmo-hlr_10.42.42.2(pid=16384): Launched 19:01:42.743653 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:43.271581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16386): Launched 19:01:43.595093 run osmo-stp_10.42.42.5(pid=16387): Launched 19:01:43.718552 run osmo-msc_10.42.42.6: Starting osmo-msc 19:01:44.274281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16389): Launched 19:01:44.598514 run osmo-msc_10.42.42.6(pid=16390): Launched 19:01:44.778694 run osmo-stp_10.42.42.5(pid=16387): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16387)] 19:01:44.914606 run osmo-stp_10.42.42.5(pid=16387): stdout: | (launched: 2022-12-12_19:01:43.535455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:45.050879 run osmo-stp_10.42.42.5(pid=16387): stderr: | [0;m[38;5;43m20221212190143724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190143724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190143724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190143725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190143725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190143725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190143725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:45.185780 run osmo-stp_10.42.42.5(pid=16387): stdout: | (launched: 2022-12-12_19:01:43.535455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:45.314010 run osmo-stp_10.42.42.5(pid=16387): stderr: | [0;m[38;5;43m20221212190143724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190143724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190143724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190143725 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190143725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190143725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190143725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:45.467732 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16387): Process ended prematurely: osmo-stp_10.42.42.5(pid=16387) [trial-2380↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16387)] [trial-2380↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 19:01:45.476707 tst handover.py:18: Test FAILED (6.5 sec) 19:01:45.504613 run osmo-hlr_10.42.42.2(pid=16384): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16384)] 19:01:45.554317 run osmo-hlr_10.42.42.2(pid=16384): stdout: | (launched: 2022-12-12_19:01:42.560543) 19:01:45.605484 run osmo-hlr_10.42.42.2(pid=16384): stderr: | [0;m[1;31m20221212190142755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190142755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190142755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190142755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190142755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190142755 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190142768 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190142776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190142776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190142777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:45.676941 run osmo-msc_10.42.42.6(pid=16390): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16390)] 19:01:45.726864 run osmo-msc_10.42.42.6(pid=16390): stdout: | (launched: 2022-12-12_19:01:44.538539) 19:01:45.778060 run osmo-msc_10.42.42.6(pid=16390): stderr: | [0;m[38;5;43m20221212190144858 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190144858 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f501e68ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190144858 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190144858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190144858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190144859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190144860 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190144861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190144861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190144861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:01:45.831282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16383): Terminating (SIGTERM) 19:01:45.879314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16386): Terminating (SIGTERM) 19:01:45.938480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16389): Terminating (SIGTERM) 19:01:45.982092 --- ParallelTerminationStrategy: PID 16383 died... 19:01:46.002445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16383): Terminated: ok {rc=0} 19:01:46.050695 --- ParallelTerminationStrategy: PID 16386 died... 19:01:46.070439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16386): Terminated: ok {rc=0} 19:01:46.118451 --- ParallelTerminationStrategy: PID 16389 died... 19:01:46.138563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16389): Terminated: ok {rc=0} 19:01:46.224527 bus /sierra_3: Setting Powered False 19:01:47.322902 bus /sierra_3: Setting Powered False 19:01:48.440050 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 19:01:49.678343 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:01:49.683519 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:01:49.733409 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:01:49.760389 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:01:49.811794 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:01:49.861684 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:01:49.888079 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:01:50.441567 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 19:01:50.446916 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:01:50.457878 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:01:50.492587 tst handover.py: using LAC 30852 19:01:50.610819 tst handover.py: using RAC 252 19:01:50.728426 tst handover.py: using CellId 30852 19:01:50.855368 tst handover.py: using BVCI 30853 19:01:50.973032 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:01:51.023521 tst handover.py: using LAC 30853 19:01:51.143699 tst handover.py: using RAC 253 19:01:51.261310 tst handover.py: using CellId 30853 19:01:51.379068 tst handover.py: using BVCI 30854 19:01:51.487919 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:01:51.498974 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:01:51.509805 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:01:51.520939 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:01:51.532176 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:01:51.543328 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:01:51.662640 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:01:51.779609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:01:52.220603 run create_hlr_db(pid=16396): Launched 19:01:52.345269 bus /sierra_2: Setting Powered False 19:01:53.405418 run create_hlr_db(pid=16396): Terminated: ok {rc=0} 19:01:53.818228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16398): Launched 19:01:54.144067 run osmo-hlr_10.42.42.2(pid=16399): Launched 19:01:54.267511 run osmo-stp_10.42.42.5: Starting osmo-stp 19:01:54.797330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16401): Launched 19:01:55.121375 run osmo-stp_10.42.42.5(pid=16402): Launched 19:01:55.244094 run osmo-msc_10.42.42.6: Starting osmo-msc 19:01:55.800380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16404): Launched 19:01:56.125256 run osmo-msc_10.42.42.6(pid=16405): Launched 19:01:56.305444 run osmo-stp_10.42.42.5(pid=16402): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16402)] 19:01:56.441556 run osmo-stp_10.42.42.5(pid=16402): stdout: | (launched: 2022-12-12_19:01:55.061863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:56.577588 run osmo-stp_10.42.42.5(pid=16402): stderr: | [0;m[38;5;43m20221212190155248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190155248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190155248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190155249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190155249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190155249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190155249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:56.711925 run osmo-stp_10.42.42.5(pid=16402): stdout: | (launched: 2022-12-12_19:01:55.061863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:01:56.840313 run osmo-stp_10.42.42.5(pid=16402): stderr: | [0;m[38;5;43m20221212190155248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190155248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190155248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190155249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190155249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190155249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190155249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:01:56.994608 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16402): Process ended prematurely: osmo-stp_10.42.42.5(pid=16402) [trial-2380↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16402)] [trial-2380↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 19:01:57.003658 tst handover.py:18: Test FAILED (6.5 sec) 19:01:57.031227 run osmo-hlr_10.42.42.2(pid=16399): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16399)] 19:01:57.081479 run osmo-hlr_10.42.42.2(pid=16399): stdout: | (launched: 2022-12-12_19:01:54.084649) 19:01:57.133197 run osmo-hlr_10.42.42.2(pid=16399): stderr: | [0;m[1;31m20221212190154277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190154277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190154277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190154277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190154278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190154278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190154292 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190154302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190154302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190154303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:01:57.204545 run osmo-msc_10.42.42.6(pid=16405): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16405)] 19:01:57.254131 run osmo-msc_10.42.42.6(pid=16405): stdout: | (launched: 2022-12-12_19:01:56.065404) 19:01:57.305243 run osmo-msc_10.42.42.6(pid=16405): stderr: | [0;m[38;5;43m20221212190156383 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190156383 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f79c2879c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190156383 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190156383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190156383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190156383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190156385 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190156386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190156386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190156386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:01:57.357504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16398): Terminating (SIGTERM) 19:01:57.398978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16401): Terminating (SIGTERM) 19:01:57.440236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16404): Terminating (SIGTERM) 19:01:57.482118 --- ParallelTerminationStrategy: PID 16398 died... 19:01:57.501830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16398): Terminated: ok {rc=0} 19:01:57.547747 --- ParallelTerminationStrategy: PID 16401 died... 19:01:57.566833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16401): Terminated: ok {rc=0} 19:01:57.612588 --- ParallelTerminationStrategy: PID 16404 died... 19:01:57.631862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16404): Terminated: ok {rc=0} 19:01:57.720164 bus /sierra_3: Setting Powered False 19:01:58.818545 bus /sierra_3: Setting Powered False 19:01:59.935659 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 19:02:01.231794 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:02:01.245191 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:02:01.311806 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:02:01.347183 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:02:01.407871 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:02:01.471046 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:02:01.499774 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:02:02.058471 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 19:02:02.067100 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:02:02.079072 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:02:02.117405 tst handover.py: using LAC 30854 19:02:02.269692 tst handover.py: using RAC 254 19:02:02.389344 tst handover.py: using CellId 30854 19:02:02.507147 tst handover.py: using BVCI 30855 19:02:02.617749 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:02:02.668556 tst handover.py: using LAC 30855 19:02:02.785776 tst handover.py: using RAC 255 19:02:02.901757 tst handover.py: using CellId 30855 19:02:03.017711 tst handover.py: using BVCI 30856 19:02:03.155477 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:02:03.167292 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:02:03.179060 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:02:03.191563 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:02:03.203590 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:02:03.215483 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:02:03.334323 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:02:03.449919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:03.890460 run create_hlr_db(pid=16410): Launched 19:02:04.013788 bus /sierra_2: Setting Powered False 19:02:05.074092 run create_hlr_db(pid=16410): Terminated: ok {rc=0} 19:02:05.486973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16412): Launched 19:02:05.810703 run osmo-hlr_10.42.42.2(pid=16413): Launched 19:02:05.934248 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:06.460722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16415): Launched 19:02:06.782336 run osmo-stp_10.42.42.5(pid=16416): Launched 19:02:06.905396 run osmo-msc_10.42.42.6: Starting osmo-msc 19:02:07.459997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16418): Launched 19:02:07.783587 run osmo-msc_10.42.42.6(pid=16419): Launched 19:02:07.964118 run osmo-stp_10.42.42.5(pid=16416): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16416)] 19:02:08.100375 run osmo-stp_10.42.42.5(pid=16416): stdout: | (launched: 2022-12-12_19:02:06.722994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:08.236718 run osmo-stp_10.42.42.5(pid=16416): stderr: | [0;m[38;5;43m20221212190206910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190206910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190206910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190206911 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190206911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190206911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190206912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:08.371528 run osmo-stp_10.42.42.5(pid=16416): stdout: | (launched: 2022-12-12_19:02:06.722994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:08.499810 run osmo-stp_10.42.42.5(pid=16416): stderr: | [0;m[38;5;43m20221212190206910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190206910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190206910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190206911 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190206911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190206911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190206912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:08.653516 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16416): Process ended prematurely: osmo-stp_10.42.42.5(pid=16416) [trial-2380↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16416)] [trial-2380↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 19:02:08.662518 tst handover.py:18: Test FAILED (6.6 sec) 19:02:08.691089 run osmo-hlr_10.42.42.2(pid=16413): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16413)] 19:02:08.741320 run osmo-hlr_10.42.42.2(pid=16413): stdout: | (launched: 2022-12-12_19:02:05.751451) 19:02:08.793069 run osmo-hlr_10.42.42.2(pid=16413): stderr: | [0;m[1;31m20221212190205945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190205945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190205945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190205945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190205945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190205945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190205958 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190205967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190205967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190205967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:08.864876 run osmo-msc_10.42.42.6(pid=16419): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16419)] 19:02:08.914788 run osmo-msc_10.42.42.6(pid=16419): stdout: | (launched: 2022-12-12_19:02:07.723845) 19:02:08.966549 run osmo-msc_10.42.42.6(pid=16419): stderr: | [0;m[38;5;43m20221212190208041 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190208041 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f987fcd9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190208041 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190208041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190208041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190208041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190208043 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190208043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190208044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190208044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:02:09.018549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16412): Terminating (SIGTERM) 19:02:09.059987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16415): Terminating (SIGTERM) 19:02:09.101655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16418): Terminating (SIGTERM) 19:02:09.143290 --- ParallelTerminationStrategy: PID 16412 died... 19:02:09.163171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16412): Terminated: ok {rc=0} 19:02:09.209383 --- ParallelTerminationStrategy: PID 16415 died... 19:02:09.228611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16415): Terminated: ok {rc=0} 19:02:09.274869 --- ParallelTerminationStrategy: PID 16418 died... 19:02:09.294301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16418): Terminated: ok {rc=0} 19:02:09.381388 bus /sierra_3: Setting Powered False 19:02:10.480500 bus /sierra_3: Setting Powered False 19:02:11.595629 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 19:02:12.853061 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:02:12.859108 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 19:02:12.907144 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 19:02:12.933801 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 19:02:12.985394 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 19:02:13.032849 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 19:02:13.058919 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 19:02:13.610964 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 19:02:13.616096 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:02:13.626919 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:02:13.659811 tst handover.py: using LAC 30856 19:02:13.778656 tst handover.py: using RAC 1 19:02:13.897722 tst handover.py: using CellId 30856 19:02:14.017787 tst handover.py: using BVCI 30857 19:02:14.128497 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 19:02:14.177232 tst handover.py: using LAC 30857 19:02:14.296648 tst handover.py: using RAC 2 19:02:14.414949 tst handover.py: using CellId 30857 19:02:14.535238 tst handover.py: using BVCI 30858 19:02:14.645826 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:02:14.656714 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:02:14.667626 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:02:14.678302 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:02:14.689007 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 19:02:14.699548 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:02:14.816093 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 19:02:14.933922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:15.373983 run create_hlr_db(pid=16424): Launched 19:02:15.497186 bus /sierra_2: Setting Powered False 19:02:16.565543 run create_hlr_db(pid=16424): Terminated: ok {rc=0} 19:02:17.008394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16426): Launched 19:02:17.328045 run osmo-hlr_10.42.42.2(pid=16427): Launched 19:02:17.442684 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:17.946633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16429): Launched 19:02:18.249538 run osmo-stp_10.42.42.5(pid=16430): Launched 19:02:18.364349 run osmo-msc_10.42.42.6: Starting osmo-msc 19:02:18.887040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16432): Launched 19:02:19.190056 run osmo-msc_10.42.42.6(pid=16433): Launched 19:02:19.359066 run osmo-stp_10.42.42.5(pid=16430): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16430)] 19:02:19.486127 run osmo-stp_10.42.42.5(pid=16430): stdout: | (launched: 2022-12-12_19:02:18.193233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:19.613252 run osmo-stp_10.42.42.5(pid=16430): stderr: | [0;m[38;5;43m20221212190218363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190218364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190218364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190218364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190218365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190218365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190218365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:19.738313 run osmo-stp_10.42.42.5(pid=16430): stdout: | (launched: 2022-12-12_19:02:18.193233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:19.857549 run osmo-stp_10.42.42.5(pid=16430): stderr: | [0;m[38;5;43m20221212190218363 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190218364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190218364 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190218364 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190218365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190218365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190218365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:20.000638 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16430): Process ended prematurely: osmo-stp_10.42.42.5(pid=16430) [trial-2380↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16430)] [trial-2380↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 19:02:20.009214 tst handover.py:18: Test FAILED (6.4 sec) 19:02:20.035087 run osmo-hlr_10.42.42.2(pid=16427): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16427)] 19:02:20.082101 run osmo-hlr_10.42.42.2(pid=16427): stdout: | (launched: 2022-12-12_19:02:17.271941) 19:02:20.130785 run osmo-hlr_10.42.42.2(pid=16427): stderr: | [0;m[1;31m20221212190217446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190217446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190217446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190217446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190217446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190217446 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190217458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190217467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190217467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190217467 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:20.199440 run osmo-msc_10.42.42.6(pid=16433): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16433)] 19:02:20.246537 run osmo-msc_10.42.42.6(pid=16433): stdout: | (launched: 2022-12-12_19:02:19.133616) 19:02:20.294935 run osmo-msc_10.42.42.6(pid=16433): stderr: | [0;m[38;5;43m20221212190219404 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190219405 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8d378efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190219405 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190219405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190219405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190219405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190219407 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190219407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190219408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190219408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:02:20.343865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16426): Terminating (SIGTERM) 19:02:20.382737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16429): Terminating (SIGTERM) 19:02:20.422116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16432): Terminating (SIGTERM) 19:02:20.462156 --- ParallelTerminationStrategy: PID 16426 died... 19:02:20.481253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16426): Terminated: ok {rc=0} 19:02:20.525457 --- ParallelTerminationStrategy: PID 16429 died... 19:02:20.543932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16429): Terminated: ok {rc=0} 19:02:20.587580 --- ParallelTerminationStrategy: PID 16432 died... 19:02:20.605970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16432): Terminated: ok {rc=0} 19:02:20.690376 bus /sierra_3: Setting Powered False 19:02:21.791193 bus /sierra_3: Setting Powered False 19:02:22.905474 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 19:02:24.160917 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:02:24.167143 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 19:02:24.214566 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:02:24.242055 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:02:24.295286 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 19:02:24.341400 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:02:24.369363 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:02:24.923044 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 19:02:24.929061 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:02:24.941278 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:02:24.976808 tst handover.py: using LAC 30858 19:02:25.102723 tst handover.py: using RAC 3 19:02:25.233647 tst handover.py: using CellId 30858 19:02:25.352246 tst handover.py: using BVCI 30859 19:02:25.461525 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:02:25.508364 tst handover.py: using LAC 30859 19:02:25.638695 tst handover.py: using RAC 4 19:02:25.757869 tst handover.py: using CellId 30859 19:02:25.877122 tst handover.py: using BVCI 30860 19:02:25.986308 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:02:25.997563 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:02:26.008633 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:02:26.019580 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:02:26.030490 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:02:26.041378 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:02:26.159570 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:02:26.277967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:26.753219 run create_hlr_db(pid=16438): Launched 19:02:26.877411 bus /sierra_2: Setting Powered False 19:02:27.941977 run create_hlr_db(pid=16438): Terminated: ok {rc=0} 19:02:28.364762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16440): Launched 19:02:28.690399 run osmo-hlr_10.42.42.2(pid=16441): Launched 19:02:28.814514 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:29.343670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16443): Launched 19:02:29.667429 run osmo-stp_10.42.42.5(pid=16444): Launched 19:02:29.790945 run osmo-msc_10.42.42.6: Starting osmo-msc 19:02:30.347051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16446): Launched 19:02:30.672223 run osmo-msc_10.42.42.6(pid=16447): Launched 19:02:30.914217 run osmo-stp_10.42.42.5(pid=16444): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16444)] 19:02:31.126848 run osmo-stp_10.42.42.5(pid=16444): stdout: | (launched: 2022-12-12_19:02:29.607459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:31.291439 run osmo-stp_10.42.42.5(pid=16444): stderr: | [0;m[38;5;43m20221212190229796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190229796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190229796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190229796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190229797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190229797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190229797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:31.422861 run osmo-stp_10.42.42.5(pid=16444): stdout: | (launched: 2022-12-12_19:02:29.607459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:31.547813 run osmo-stp_10.42.42.5(pid=16444): stderr: | [0;m[38;5;43m20221212190229796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190229796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190229796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190229796 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190229797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190229797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190229797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:31.697917 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16444): Process ended prematurely: osmo-stp_10.42.42.5(pid=16444) [trial-2380↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16444)] [trial-2380↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 19:02:31.707891 tst handover.py:18: Test FAILED (6.8 sec) 19:02:31.735432 run osmo-hlr_10.42.42.2(pid=16441): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16441)] 19:02:31.785114 run osmo-hlr_10.42.42.2(pid=16441): stdout: | (launched: 2022-12-12_19:02:28.630113) 19:02:31.835882 run osmo-hlr_10.42.42.2(pid=16441): stderr: | [0;m[1;31m20221212190228825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190228825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190228825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190228826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190228826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190228826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190228838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190228847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190228847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190228847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:31.907306 run osmo-msc_10.42.42.6(pid=16447): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16447)] 19:02:31.955914 run osmo-msc_10.42.42.6(pid=16447): stdout: | (launched: 2022-12-12_19:02:30.612318) 19:02:32.006362 run osmo-msc_10.42.42.6(pid=16447): stderr: | [0;m[38;5;43m20221212190230958 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190230959 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f15b9fccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190230959 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190230959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190230959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190230959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190230961 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190230961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190230961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190230961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:02:32.057486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16440): Terminating (SIGTERM) 19:02:32.099152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16443): Terminating (SIGTERM) 19:02:32.143202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16446): Terminating (SIGTERM) 19:02:32.186204 --- ParallelTerminationStrategy: PID 16440 died... 19:02:32.205718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16440): Terminated: ok {rc=0} 19:02:32.252603 --- ParallelTerminationStrategy: PID 16443 died... 19:02:32.272883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16443): Terminated: ok {rc=0} 19:02:32.320708 --- ParallelTerminationStrategy: PID 16446 died... 19:02:32.340524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16446): Terminated: ok {rc=0} 19:02:32.429287 bus /sierra_3: Setting Powered False 19:02:33.530413 bus /sierra_3: Setting Powered False 19:02:34.645725 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:02:35.902481 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:02:35.908447 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:02:35.960635 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:02:35.988720 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:02:36.046659 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:02:36.098154 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:02:36.125556 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:02:36.673245 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:02:36.678826 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:02:36.690649 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:02:36.726834 tst handover.py: using LAC 30860 19:02:36.853374 tst handover.py: using RAC 5 19:02:36.979206 tst handover.py: using CellId 30860 19:02:37.105949 tst handover.py: using BVCI 30861 19:02:37.224610 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:02:37.273663 tst handover.py: using LAC 30861 19:02:37.392648 tst handover.py: using RAC 6 19:02:37.509768 tst handover.py: using CellId 30861 19:02:37.631788 tst handover.py: using BVCI 30862 19:02:37.742406 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:02:37.753443 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:02:37.764279 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:02:37.774968 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:02:37.785874 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:02:37.796570 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:02:37.914835 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:02:38.031071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:38.473487 run create_hlr_db(pid=16452): Launched 19:02:38.597419 bus /sierra_2: Setting Powered False 19:02:39.657067 run create_hlr_db(pid=16452): Terminated: ok {rc=0} 19:02:40.050579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16454): Launched 19:02:40.352837 run osmo-hlr_10.42.42.2(pid=16455): Launched 19:02:40.466775 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:40.970913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16457): Launched 19:02:41.272262 run osmo-stp_10.42.42.5(pid=16458): Launched 19:02:41.386452 run osmo-msc_10.42.42.6: Starting osmo-msc 19:02:41.905993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16460): Launched 19:02:42.208565 run osmo-msc_10.42.42.6(pid=16461): Launched 19:02:42.378456 run osmo-stp_10.42.42.5(pid=16458): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16458)] 19:02:42.505181 run osmo-stp_10.42.42.5(pid=16458): stdout: | (launched: 2022-12-12_19:02:41.216005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:42.632112 run osmo-stp_10.42.42.5(pid=16458): stderr: | [0;m[38;5;43m20221212190241386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190241386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190241386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190241387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190241387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190241387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190241388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:42.756918 run osmo-stp_10.42.42.5(pid=16458): stdout: | (launched: 2022-12-12_19:02:41.216005) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:42.876488 run osmo-stp_10.42.42.5(pid=16458): stderr: | [0;m[38;5;43m20221212190241386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190241386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190241386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190241387 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190241387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190241387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190241388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:43.019601 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16458): Process ended prematurely: osmo-stp_10.42.42.5(pid=16458) [trial-2380↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16458)] [trial-2380↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 19:02:43.028044 tst handover.py:18: Test FAILED (6.3 sec) 19:02:43.054652 run osmo-hlr_10.42.42.2(pid=16455): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16455)] 19:02:43.102225 run osmo-hlr_10.42.42.2(pid=16455): stdout: | (launched: 2022-12-12_19:02:40.295968) 19:02:43.151471 run osmo-hlr_10.42.42.2(pid=16455): stderr: | [0;m[1;31m20221212190240469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190240469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190240469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190240469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190240469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190240470 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190240482 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190240491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190240491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190240491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:43.220129 run osmo-msc_10.42.42.6(pid=16461): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16461)] 19:02:43.267478 run osmo-msc_10.42.42.6(pid=16461): stdout: | (launched: 2022-12-12_19:02:42.152196) 19:02:43.316629 run osmo-msc_10.42.42.6(pid=16461): stderr: | [0;m[38;5;43m20221212190242423 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190242423 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9069c8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190242424 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190242424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190242424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190242424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190242426 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190242426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190242427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190242427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:02:43.365992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16454): Terminating (SIGTERM) 19:02:43.405126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16457): Terminating (SIGTERM) 19:02:43.444321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16460): Terminating (SIGTERM) 19:02:43.483744 --- ParallelTerminationStrategy: PID 16454 died... 19:02:43.502669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16454): Terminated: ok {rc=0} 19:02:43.546101 --- ParallelTerminationStrategy: PID 16457 died... 19:02:43.564416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16457): Terminated: ok {rc=0} 19:02:43.607623 --- ParallelTerminationStrategy: PID 16460 died... 19:02:43.626010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16460): Terminated: ok {rc=0} 19:02:43.709739 bus /sierra_3: Setting Powered False 19:02:44.806820 bus /sierra_3: Setting Powered False 19:02:45.928818 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 19:02:47.243168 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:02:47.248863 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:02:47.286395 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:02:47.314424 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:02:47.367715 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:02:47.404727 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:02:47.431198 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:02:47.979133 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 19:02:47.984433 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:02:47.995399 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 19:02:48.028787 tst handover.py: using LAC 30862 19:02:48.147749 tst handover.py: using RAC 7 19:02:48.265899 tst handover.py: using CellId 30862 19:02:48.384639 tst handover.py: using BVCI 30863 19:02:48.494150 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 19:02:48.528704 tst handover.py: using LAC 30863 19:02:48.646375 tst handover.py: using RAC 8 19:02:48.766438 tst handover.py: using CellId 30863 19:02:48.885495 tst handover.py: using BVCI 30864 19:02:49.005468 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:02:49.016884 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:02:49.028291 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:02:49.040450 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:02:49.052111 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:02:49.063745 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 19:02:49.184157 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 19:02:49.301476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:02:49.774710 run create_hlr_db(pid=16466): Launched 19:02:49.897679 bus /sierra_2: Setting Powered False 19:02:50.963098 run create_hlr_db(pid=16466): Terminated: ok {rc=0} 19:02:51.384594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16468): Launched 19:02:51.707119 run osmo-hlr_10.42.42.2(pid=16469): Launched 19:02:51.830591 run osmo-stp_10.42.42.5: Starting osmo-stp 19:02:52.356858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16471): Launched 19:02:52.680378 run osmo-stp_10.42.42.5(pid=16472): Launched 19:02:52.804094 run osmo-msc_10.42.42.6: Starting osmo-msc 19:02:53.359357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16474): Launched 19:02:53.682560 run osmo-msc_10.42.42.6(pid=16475): Launched 19:02:53.862277 run osmo-stp_10.42.42.5(pid=16472): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16472)] 19:02:53.998931 run osmo-stp_10.42.42.5(pid=16472): stdout: | (launched: 2022-12-12_19:02:52.620640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:54.135392 run osmo-stp_10.42.42.5(pid=16472): stderr: | [0;m[38;5;43m20221212190252810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190252810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190252811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190252811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190252812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190252812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190252812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:54.269856 run osmo-stp_10.42.42.5(pid=16472): stdout: | (launched: 2022-12-12_19:02:52.620640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:02:54.398439 run osmo-stp_10.42.42.5(pid=16472): stderr: | [0;m[38;5;43m20221212190252810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190252810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190252811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190252811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190252812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190252812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190252812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:02:54.552443 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16472): Process ended prematurely: osmo-stp_10.42.42.5(pid=16472) [trial-2380↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16472)] [trial-2380↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 19:02:54.561695 tst handover.py:18: Test FAILED (6.6 sec) 19:02:54.589761 run osmo-hlr_10.42.42.2(pid=16469): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16469)] 19:02:54.639961 run osmo-hlr_10.42.42.2(pid=16469): stdout: | (launched: 2022-12-12_19:02:51.647140) 19:02:54.691402 run osmo-hlr_10.42.42.2(pid=16469): stderr: | [0;m[1;31m20221212190251840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190251840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190251840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190251840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190251840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190251840 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190251852 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190251861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190251861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190251861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:02:54.763080 run osmo-msc_10.42.42.6(pid=16475): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16475)] 19:02:54.812882 run osmo-msc_10.42.42.6(pid=16475): stdout: | (launched: 2022-12-12_19:02:53.623077) 19:02:54.864522 run osmo-msc_10.42.42.6(pid=16475): stderr: | [0;m[38;5;43m20221212190253942 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190253942 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f97d2190c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190253942 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190253942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190253942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190253942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190253944 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190253944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190253945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190253945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:02:54.916436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16468): Terminating (SIGTERM) 19:02:54.958589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16471): Terminating (SIGTERM) 19:02:55.000397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16474): Terminating (SIGTERM) 19:02:55.042260 --- ParallelTerminationStrategy: PID 16468 died... 19:02:55.062181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16468): Terminated: ok {rc=0} 19:02:55.108732 --- ParallelTerminationStrategy: PID 16471 died... 19:02:55.128111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16471): Terminated: ok {rc=0} 19:02:55.174442 --- ParallelTerminationStrategy: PID 16474 died... 19:02:55.193854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16474): Terminated: ok {rc=0} 19:02:55.281599 bus /sierra_3: Setting Powered False 19:02:56.380470 bus /sierra_3: Setting Powered False 19:02:57.497473 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 19:02:58.740253 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:02:58.746068 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:02:58.796478 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:02:58.823995 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:02:58.876838 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:02:58.926845 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:02:58.954581 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:02:59.506321 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 19:02:59.511635 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:02:59.522826 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:02:59.557200 tst handover.py: using LAC 30864 19:02:59.684484 tst handover.py: using RAC 9 19:02:59.810491 tst handover.py: using CellId 30864 19:02:59.936789 tst handover.py: using BVCI 30865 19:03:00.054738 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:03:00.103890 tst handover.py: using LAC 30865 19:03:00.231994 tst handover.py: using RAC 10 19:03:00.358172 tst handover.py: using CellId 30865 19:03:00.486458 tst handover.py: using BVCI 30866 19:03:00.605772 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:03:00.617225 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:03:00.628330 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:03:00.639548 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:03:00.651241 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:03:00.662614 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:03:00.781033 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:03:00.911653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:01.396027 run create_hlr_db(pid=16481): Launched 19:03:01.556805 bus /sierra_2: Setting Powered False 19:03:02.620687 run create_hlr_db(pid=16481): Terminated: ok {rc=0} 19:03:03.026518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16483): Launched 19:03:03.328075 run osmo-hlr_10.42.42.2(pid=16484): Launched 19:03:03.443886 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:03.937883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16486): Launched 19:03:04.238971 run osmo-stp_10.42.42.5(pid=16487): Launched 19:03:04.352917 run osmo-msc_10.42.42.6: Starting osmo-msc 19:03:04.871436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16489): Launched 19:03:05.174593 run osmo-msc_10.42.42.6(pid=16490): Launched 19:03:05.342892 run osmo-stp_10.42.42.5(pid=16487): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16487)] 19:03:05.470355 run osmo-stp_10.42.42.5(pid=16487): stdout: | (launched: 2022-12-12_19:03:04.182796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:05.596815 run osmo-stp_10.42.42.5(pid=16487): stderr: | [0;m[38;5;43m20221212190304352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190304352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190304352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190304353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190304353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190304353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190304354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:05.721434 run osmo-stp_10.42.42.5(pid=16487): stdout: | (launched: 2022-12-12_19:03:04.182796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:05.840563 run osmo-stp_10.42.42.5(pid=16487): stderr: | [0;m[38;5;43m20221212190304352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190304352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190304352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190304353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190304353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190304353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190304354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:05.983316 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16487): Process ended prematurely: osmo-stp_10.42.42.5(pid=16487) [trial-2380↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16487)] [trial-2380↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 19:03:05.991592 tst handover.py:18: Test FAILED (6.5 sec) 19:03:06.017604 run osmo-hlr_10.42.42.2(pid=16484): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16484)] 19:03:06.064640 run osmo-hlr_10.42.42.2(pid=16484): stdout: | (launched: 2022-12-12_19:03:03.271909) 19:03:06.113466 run osmo-hlr_10.42.42.2(pid=16484): stderr: | [0;m[1;31m20221212190303444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190303444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190303444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190303444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190303445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190303445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190303456 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190303465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190303465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190303465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:06.181676 run osmo-msc_10.42.42.6(pid=16490): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16490)] 19:03:06.228787 run osmo-msc_10.42.42.6(pid=16490): stdout: | (launched: 2022-12-12_19:03:05.118332) 19:03:06.277463 run osmo-msc_10.42.42.6(pid=16490): stderr: | [0;m[38;5;43m20221212190305387 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190305387 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f29a17adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190305387 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190305387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190305388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190305388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190305390 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190305390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190305390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190305390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:03:06.326911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16483): Terminating (SIGTERM) 19:03:06.366392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16486): Terminating (SIGTERM) 19:03:06.405859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16489): Terminating (SIGTERM) 19:03:06.445639 --- ParallelTerminationStrategy: PID 16483 died... 19:03:06.464509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16483): Terminated: ok {rc=0} 19:03:06.508273 --- ParallelTerminationStrategy: PID 16486 died... 19:03:06.526822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16486): Terminated: ok {rc=0} 19:03:06.571632 --- ParallelTerminationStrategy: PID 16489 died... 19:03:06.590341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16489): Terminated: ok {rc=0} 19:03:06.675980 bus /sierra_3: Setting Powered False 19:03:07.775792 bus /sierra_3: Setting Powered False 19:03:08.889715 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 19:03:10.144573 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:03:10.150445 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:03:10.201265 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:03:10.229201 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:03:10.283169 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:03:10.333737 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:03:10.361570 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:03:10.910671 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 19:03:10.916368 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:03:10.927849 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:03:10.963048 tst handover.py: using LAC 30866 19:03:11.091256 tst handover.py: using RAC 11 19:03:11.217370 tst handover.py: using CellId 30866 19:03:11.345736 tst handover.py: using BVCI 30867 19:03:11.456340 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:03:11.504578 tst handover.py: using LAC 30867 19:03:11.624719 tst handover.py: using RAC 12 19:03:11.748220 tst handover.py: using CellId 30867 19:03:11.866562 tst handover.py: using BVCI 30868 19:03:11.978223 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:03:11.989126 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:03:11.999719 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:03:12.011050 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:03:12.022359 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:03:12.033679 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:03:12.152555 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:03:12.276100 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:12.751694 run create_hlr_db(pid=16495): Launched 19:03:12.876435 bus /sierra_2: Setting Powered False 19:03:13.940596 run create_hlr_db(pid=16495): Terminated: ok {rc=0} 19:03:14.364934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16497): Launched 19:03:14.691636 run osmo-hlr_10.42.42.2(pid=16498): Launched 19:03:14.816059 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:15.346399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16500): Launched 19:03:15.649778 run osmo-stp_10.42.42.5(pid=16501): Launched 19:03:15.766251 run osmo-msc_10.42.42.6: Starting osmo-msc 19:03:16.369329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16503): Launched 19:03:16.715480 run osmo-msc_10.42.42.6(pid=16504): Launched 19:03:17.018618 run osmo-stp_10.42.42.5(pid=16501): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16501)] 19:03:17.183531 run osmo-stp_10.42.42.5(pid=16501): stdout: | (launched: 2022-12-12_19:03:15.593354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:17.388557 run osmo-stp_10.42.42.5(pid=16501): stderr: | [0;m[38;5;43m20221212190315761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190315761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190315762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190315762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190315763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190315763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190315763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:17.515937 run osmo-stp_10.42.42.5(pid=16501): stdout: | (launched: 2022-12-12_19:03:15.593354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:17.636511 run osmo-stp_10.42.42.5(pid=16501): stderr: | [0;m[38;5;43m20221212190315761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190315761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190315762 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190315762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190315763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190315763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190315763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:17.780942 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16501): Process ended prematurely: osmo-stp_10.42.42.5(pid=16501) [trial-2380↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16501)] [trial-2380↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 19:03:17.789674 tst handover.py:18: Test FAILED (6.9 sec) 19:03:17.816477 run osmo-hlr_10.42.42.2(pid=16498): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16498)] 19:03:17.865106 run osmo-hlr_10.42.42.2(pid=16498): stdout: | (launched: 2022-12-12_19:03:14.631238) 19:03:17.914596 run osmo-hlr_10.42.42.2(pid=16498): stderr: | [0;m[1;31m20221212190314825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190314825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190314825 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190314826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190314826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190314826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190314837 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190314846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190314846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190314846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:17.984152 run osmo-msc_10.42.42.6(pid=16504): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16504)] 19:03:18.032059 run osmo-msc_10.42.42.6(pid=16504): stdout: | (launched: 2022-12-12_19:03:16.652907) 19:03:18.081261 run osmo-msc_10.42.42.6(pid=16504): stderr: | [0;m[38;5;43m20221212190317219 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190317220 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbcd2a2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190317220 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190317220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190317220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190317220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190317222 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190317222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190317222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190317222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:03:18.130658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16497): Terminating (SIGTERM) 19:03:18.170065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16500): Terminating (SIGTERM) 19:03:18.209916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16503): Terminating (SIGTERM) 19:03:18.250103 --- ParallelTerminationStrategy: PID 16497 died... 19:03:18.269489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16497): Terminated: ok {rc=0} 19:03:18.313996 --- ParallelTerminationStrategy: PID 16500 died... 19:03:18.332648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16500): Terminated: ok {rc=0} 19:03:18.376930 --- ParallelTerminationStrategy: PID 16503 died... 19:03:18.395799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16503): Terminated: ok {rc=0} 19:03:18.482680 bus /sierra_3: Setting Powered False 19:03:19.583188 bus /sierra_3: Setting Powered False 19:03:20.699876 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 19:03:21.956354 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:03:21.962291 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 19:03:22.023144 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 19:03:22.050704 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 19:03:22.103229 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 19:03:22.163973 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 19:03:22.191161 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 19:03:22.745552 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 19:03:22.750899 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:03:22.762493 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:03:22.811846 tst handover.py: using LAC 30868 19:03:22.939092 tst handover.py: using RAC 13 19:03:23.066748 tst handover.py: using CellId 30868 19:03:23.198150 tst handover.py: using BVCI 30869 19:03:23.317015 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 19:03:23.360323 tst handover.py: using LAC 30869 19:03:23.486154 tst handover.py: using RAC 14 19:03:23.615080 tst handover.py: using CellId 30869 19:03:23.740848 tst handover.py: using BVCI 30870 19:03:23.857711 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:03:23.869274 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:03:23.880652 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:03:23.892395 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:03:23.904106 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 19:03:23.915635 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:03:24.034658 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 19:03:24.151448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:24.592355 run create_hlr_db(pid=16509): Launched 19:03:24.717540 bus /sierra_2: Setting Powered False 19:03:25.777543 run create_hlr_db(pid=16509): Terminated: ok {rc=0} 19:03:26.189717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16511): Launched 19:03:26.514349 run osmo-hlr_10.42.42.2(pid=16512): Launched 19:03:26.638543 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:27.167631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16514): Launched 19:03:27.491773 run osmo-stp_10.42.42.5(pid=16515): Launched 19:03:27.616361 run osmo-msc_10.42.42.6: Starting osmo-msc 19:03:28.172516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16517): Launched 19:03:28.496430 run osmo-msc_10.42.42.6(pid=16518): Launched 19:03:28.678167 run osmo-stp_10.42.42.5(pid=16515): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16515)] 19:03:28.815045 run osmo-stp_10.42.42.5(pid=16515): stdout: | (launched: 2022-12-12_19:03:27.432086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:28.951447 run osmo-stp_10.42.42.5(pid=16515): stderr: | [0;m[38;5;43m20221212190327619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190327619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190327619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190327620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190327620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190327620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190327620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:29.086408 run osmo-stp_10.42.42.5(pid=16515): stdout: | (launched: 2022-12-12_19:03:27.432086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:29.214905 run osmo-stp_10.42.42.5(pid=16515): stderr: | [0;m[38;5;43m20221212190327619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190327619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190327619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190327620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190327620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190327620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190327620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:29.368436 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16515): Process ended prematurely: osmo-stp_10.42.42.5(pid=16515) [trial-2380↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16515)] [trial-2380↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 19:03:29.377484 tst handover.py:18: Test FAILED (6.6 sec) 19:03:29.405031 run osmo-hlr_10.42.42.2(pid=16512): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16512)] 19:03:29.455171 run osmo-hlr_10.42.42.2(pid=16512): stdout: | (launched: 2022-12-12_19:03:26.454590) 19:03:29.506577 run osmo-hlr_10.42.42.2(pid=16512): stderr: | [0;m[1;31m20221212190326646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190326646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190326647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190326647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190326647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190326647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190326667 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190326677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190326677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190326677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:29.578575 run osmo-msc_10.42.42.6(pid=16518): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16518)] 19:03:29.628529 run osmo-msc_10.42.42.6(pid=16518): stdout: | (launched: 2022-12-12_19:03:28.436493) 19:03:29.680021 run osmo-msc_10.42.42.6(pid=16518): stderr: | [0;m[38;5;43m20221212190328757 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190328757 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f470e92ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190328757 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190328757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190328757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190328758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190328759 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190328760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190328760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190328760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:03:29.731746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16511): Terminating (SIGTERM) 19:03:29.773299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16514): Terminating (SIGTERM) 19:03:29.814937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16517): Terminating (SIGTERM) 19:03:29.856902 --- ParallelTerminationStrategy: PID 16511 died... 19:03:29.876697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16511): Terminated: ok {rc=0} 19:03:29.922758 --- ParallelTerminationStrategy: PID 16514 died... 19:03:29.942067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16514): Terminated: ok {rc=0} 19:03:29.988373 --- ParallelTerminationStrategy: PID 16517 died... 19:03:30.007684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16517): Terminated: ok {rc=0} 19:03:30.095103 bus /sierra_3: Setting Powered False 19:03:31.197184 bus /sierra_3: Setting Powered False 19:03:32.313616 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:03:33.583970 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:03:33.590086 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:03:33.656392 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:03:33.684447 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:03:33.737971 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:03:33.803531 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:03:33.831045 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:03:34.384370 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:03:34.390046 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:03:34.401618 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:03:34.455279 tst handover.py: using LAC 30870 19:03:34.580846 tst handover.py: using RAC 15 19:03:34.699016 tst handover.py: using CellId 30870 19:03:34.817094 tst handover.py: using BVCI 30871 19:03:34.925414 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:03:34.973298 tst handover.py: using LAC 30871 19:03:35.089427 tst handover.py: using RAC 16 19:03:35.207382 tst handover.py: using CellId 30871 19:03:35.323165 tst handover.py: using BVCI 30872 19:03:35.431366 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:03:35.442421 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:03:35.453607 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:03:35.464449 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:03:35.475370 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:03:35.486267 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:03:35.607247 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:03:35.731341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:36.172218 run create_hlr_db(pid=16523): Launched 19:03:36.296000 bus /sierra_2: Setting Powered False 19:03:37.355488 run create_hlr_db(pid=16523): Terminated: ok {rc=0} 19:03:37.750070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16525): Launched 19:03:38.051109 run osmo-hlr_10.42.42.2(pid=16526): Launched 19:03:38.165154 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:38.659358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16528): Launched 19:03:38.961354 run osmo-stp_10.42.42.5(pid=16529): Launched 19:03:39.077151 run osmo-msc_10.42.42.6: Starting osmo-msc 19:03:39.595913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16531): Launched 19:03:39.898248 run osmo-msc_10.42.42.6(pid=16532): Launched 19:03:40.067188 run osmo-stp_10.42.42.5(pid=16529): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16529)] 19:03:40.194327 run osmo-stp_10.42.42.5(pid=16529): stdout: | (launched: 2022-12-12_19:03:38.905317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:40.321627 run osmo-stp_10.42.42.5(pid=16529): stderr: | [0;m[38;5;43m20221212190339076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190339076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190339076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190339076 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190339077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190339077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190339077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:40.446860 run osmo-stp_10.42.42.5(pid=16529): stdout: | (launched: 2022-12-12_19:03:38.905317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:40.566738 run osmo-stp_10.42.42.5(pid=16529): stderr: | [0;m[38;5;43m20221212190339076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190339076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190339076 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190339076 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190339077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190339077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190339077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:40.710319 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16529): Process ended prematurely: osmo-stp_10.42.42.5(pid=16529) [trial-2380↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16529)] [trial-2380↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 19:03:40.718821 tst handover.py:18: Test FAILED (6.3 sec) 19:03:40.745092 run osmo-hlr_10.42.42.2(pid=16526): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16526)] 19:03:40.792764 run osmo-hlr_10.42.42.2(pid=16526): stdout: | (launched: 2022-12-12_19:03:37.994984) 19:03:40.842626 run osmo-hlr_10.42.42.2(pid=16526): stderr: | [0;m[1;31m20221212190338169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190338169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190338169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190338169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190338169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190338169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190338180 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190338189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190338189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190338189 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:40.911352 run osmo-msc_10.42.42.6(pid=16532): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16532)] 19:03:40.958727 run osmo-msc_10.42.42.6(pid=16532): stdout: | (launched: 2022-12-12_19:03:39.841907) 19:03:41.007791 run osmo-msc_10.42.42.6(pid=16532): stderr: | [0;m[38;5;43m20221212190340114 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190340115 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0333eeac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190340115 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190340115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190340115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190340115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190340117 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190340117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190340119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190340119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:03:41.057153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16525): Terminating (SIGTERM) 19:03:41.096758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16528): Terminating (SIGTERM) 19:03:41.136555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16531): Terminating (SIGTERM) 19:03:41.176442 --- ParallelTerminationStrategy: PID 16525 died... 19:03:41.195573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16525): Terminated: ok {rc=0} 19:03:41.239359 --- ParallelTerminationStrategy: PID 16528 died... 19:03:41.258068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16528): Terminated: ok {rc=0} 19:03:41.301828 --- ParallelTerminationStrategy: PID 16531 died... 19:03:41.320575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16531): Terminated: ok {rc=0} 19:03:41.406664 bus /sierra_3: Setting Powered False 19:03:42.506720 bus /sierra_3: Setting Powered False 19:03:43.622798 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 19:03:44.903882 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:03:44.909692 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:03:44.962437 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:03:44.990675 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:03:45.044542 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:03:45.096613 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:03:45.124345 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:03:45.674971 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 19:03:45.680666 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:03:45.692119 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 19:03:45.741139 tst handover.py: using LAC 30872 19:03:45.879423 tst handover.py: using RAC 17 19:03:46.019605 tst handover.py: using CellId 30872 19:03:46.139724 tst handover.py: using BVCI 30873 19:03:46.271869 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 19:03:46.309163 tst handover.py: using LAC 30873 19:03:46.436828 tst handover.py: using RAC 18 19:03:46.564617 tst handover.py: using CellId 30873 19:03:46.698643 tst handover.py: using BVCI 30874 19:03:46.821771 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:03:46.834545 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:03:46.848026 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:03:46.861891 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:03:46.874532 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:03:46.887600 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 19:03:47.038187 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 19:03:47.165874 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:47.644159 run create_hlr_db(pid=16537): Launched 19:03:47.768406 bus /sierra_2: Setting Powered False 19:03:48.832165 run create_hlr_db(pid=16537): Terminated: ok {rc=0} 19:03:49.238596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16539): Launched 19:03:49.541741 run osmo-hlr_10.42.42.2(pid=16540): Launched 19:03:49.657174 run osmo-stp_10.42.42.5: Starting osmo-stp 19:03:50.169442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16542): Launched 19:03:50.471911 run osmo-stp_10.42.42.5(pid=16543): Launched 19:03:50.587470 run osmo-msc_10.42.42.6: Starting osmo-msc 19:03:51.108668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16545): Launched 19:03:51.410694 run osmo-msc_10.42.42.6(pid=16546): Launched 19:03:51.579418 run osmo-stp_10.42.42.5(pid=16543): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16543)] 19:03:51.705760 run osmo-stp_10.42.42.5(pid=16543): stdout: | (launched: 2022-12-12_19:03:50.415287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:51.832369 run osmo-stp_10.42.42.5(pid=16543): stderr: | [0;m[38;5;43m20221212190350584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190350584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190350584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190350584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190350585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190350585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190350585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:51.957568 run osmo-stp_10.42.42.5(pid=16543): stdout: | (launched: 2022-12-12_19:03:50.415287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:03:52.077384 run osmo-stp_10.42.42.5(pid=16543): stderr: | [0;m[38;5;43m20221212190350584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190350584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190350584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190350584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190350585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190350585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190350585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:03:52.220537 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16543): Process ended prematurely: osmo-stp_10.42.42.5(pid=16543) [trial-2380↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16543)] [trial-2380↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 19:03:52.229147 tst handover.py:18: Test FAILED (6.5 sec) 19:03:52.255925 run osmo-hlr_10.42.42.2(pid=16540): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16540)] 19:03:52.303498 run osmo-hlr_10.42.42.2(pid=16540): stdout: | (launched: 2022-12-12_19:03:49.485488) 19:03:52.352516 run osmo-hlr_10.42.42.2(pid=16540): stderr: | [0;m[1;31m20221212190349658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190349658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190349658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190349658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190349658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190349658 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190349670 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190349679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190349679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190349679 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:03:52.421246 run osmo-msc_10.42.42.6(pid=16546): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16546)] 19:03:52.468224 run osmo-msc_10.42.42.6(pid=16546): stdout: | (launched: 2022-12-12_19:03:51.354439) 19:03:52.517194 run osmo-msc_10.42.42.6(pid=16546): stderr: | [0;m[38;5;43m20221212190351625 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190351625 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f609767bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190351625 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190351625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190351625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190351625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190351627 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190351628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190351628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190351628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:03:52.565999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16539): Terminating (SIGTERM) 19:03:52.605056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16542): Terminating (SIGTERM) 19:03:52.645686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16545): Terminating (SIGTERM) 19:03:52.685267 --- ParallelTerminationStrategy: PID 16539 died... 19:03:52.704179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16539): Terminated: ok {rc=0} 19:03:52.747729 --- ParallelTerminationStrategy: PID 16542 died... 19:03:52.766411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16542): Terminated: ok {rc=0} 19:03:52.809888 --- ParallelTerminationStrategy: PID 16545 died... 19:03:52.828412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16545): Terminated: ok {rc=0} 19:03:52.914407 bus /sierra_3: Setting Powered False 19:03:54.015325 bus /sierra_3: Setting Powered False 19:03:55.131169 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 19:03:56.389105 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:03:56.395346 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:03:56.461547 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:03:56.489100 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:03:56.543357 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:03:56.608721 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:03:56.636254 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:03:57.185560 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 19:03:57.190868 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:03:57.202223 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:03:57.255192 tst handover.py: using LAC 30874 19:03:57.382960 tst handover.py: using RAC 19 19:03:57.509346 tst handover.py: using CellId 30874 19:03:57.636429 tst handover.py: using BVCI 30875 19:03:57.752864 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:03:57.800899 tst handover.py: using LAC 30875 19:03:57.930666 tst handover.py: using RAC 20 19:03:58.056385 tst handover.py: using CellId 30875 19:03:58.178728 tst handover.py: using BVCI 30876 19:03:58.289329 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:03:58.300338 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:03:58.311274 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:03:58.322723 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:03:58.334301 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:03:58.345795 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:03:58.465300 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:03:58.581938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:03:59.056635 run create_hlr_db(pid=16551): Launched 19:03:59.183148 bus /sierra_2: Setting Powered False 19:04:00.247631 run create_hlr_db(pid=16551): Terminated: ok {rc=0} 19:04:00.669981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16553): Launched 19:04:01.009368 run osmo-hlr_10.42.42.2(pid=16554): Launched 19:04:01.251909 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:01.862139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16556): Launched 19:04:02.195544 run osmo-stp_10.42.42.5(pid=16557): Launched 19:04:02.329292 run osmo-msc_10.42.42.6: Starting osmo-msc 19:04:02.869355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16559): Launched 19:04:03.173326 run osmo-msc_10.42.42.6(pid=16560): Launched 19:04:03.341960 run osmo-stp_10.42.42.5(pid=16557): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16557)] 19:04:03.469176 run osmo-stp_10.42.42.5(pid=16557): stdout: | (launched: 2022-12-12_19:04:02.135734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:03.595485 run osmo-stp_10.42.42.5(pid=16557): stderr: | [0;m[38;5;43m20221212190402332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190402332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190402332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190402333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190402333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190402333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190402333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:03.720788 run osmo-stp_10.42.42.5(pid=16557): stdout: | (launched: 2022-12-12_19:04:02.135734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:03.840617 run osmo-stp_10.42.42.5(pid=16557): stderr: | [0;m[38;5;43m20221212190402332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190402332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190402332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190402333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190402333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190402333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190402333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:03.984013 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16557): Process ended prematurely: osmo-stp_10.42.42.5(pid=16557) [trial-2380↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16557)] [trial-2380↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 19:04:03.992353 tst handover.py:18: Test FAILED (6.8 sec) 19:04:04.018373 run osmo-hlr_10.42.42.2(pid=16554): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16554)] 19:04:04.065383 run osmo-hlr_10.42.42.2(pid=16554): stdout: | (launched: 2022-12-12_19:04:00.946675) 19:04:04.114194 run osmo-hlr_10.42.42.2(pid=16554): stderr: | [0;m[1;31m20221212190401287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190401287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190401287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190401287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190401287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190401287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190401307 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190401315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190401315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190401315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:04.183001 run osmo-msc_10.42.42.6(pid=16560): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16560)] 19:04:04.230411 run osmo-msc_10.42.42.6(pid=16560): stdout: | (launched: 2022-12-12_19:04:03.116807) 19:04:04.279443 run osmo-msc_10.42.42.6(pid=16560): stderr: | [0;m[38;5;43m20221212190403387 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190403388 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc7c7381c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190403388 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190403388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190403388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190403388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190403390 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190403390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190403390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190403391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:04:04.328554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16553): Terminating (SIGTERM) 19:04:04.367834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16556): Terminating (SIGTERM) 19:04:04.407131 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16559): Terminating (SIGTERM) 19:04:04.446879 --- ParallelTerminationStrategy: PID 16553 died... 19:04:04.465888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16553): Terminated: ok {rc=0} 19:04:04.509503 --- ParallelTerminationStrategy: PID 16556 died... 19:04:04.527995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16556): Terminated: ok {rc=0} 19:04:04.571356 --- ParallelTerminationStrategy: PID 16559 died... 19:04:04.589891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16559): Terminated: ok {rc=0} 19:04:04.676017 bus /sierra_3: Setting Powered False 19:04:05.776327 bus /sierra_3: Setting Powered False 19:04:06.891770 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 19:04:08.167955 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:04:08.174248 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:04:08.235842 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:04:08.262389 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:04:08.315269 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:04:08.377217 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:04:08.403453 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:04:08.953271 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 19:04:08.958366 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:04:08.969365 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:04:09.016332 tst handover.py: using LAC 30876 19:04:09.135153 tst handover.py: using RAC 21 19:04:09.252866 tst handover.py: using CellId 30876 19:04:09.371238 tst handover.py: using BVCI 30877 19:04:09.481533 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:04:09.529017 tst handover.py: using LAC 30877 19:04:09.646877 tst handover.py: using RAC 22 19:04:09.766176 tst handover.py: using CellId 30877 19:04:09.885195 tst handover.py: using BVCI 30878 19:04:09.993695 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:04:10.004510 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:04:10.015252 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:04:10.026064 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:04:10.036847 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:04:10.047557 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:04:10.165808 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:04:10.287898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:10.763472 run create_hlr_db(pid=16565): Launched 19:04:10.887857 bus /sierra_2: Setting Powered False 19:04:11.968298 run create_hlr_db(pid=16565): Terminated: ok {rc=0} 19:04:12.376099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16567): Launched 19:04:12.680201 run osmo-hlr_10.42.42.2(pid=16568): Launched 19:04:12.795132 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:13.289658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16570): Launched 19:04:13.591582 run osmo-stp_10.42.42.5(pid=16571): Launched 19:04:13.706348 run osmo-msc_10.42.42.6: Starting osmo-msc 19:04:14.226488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16573): Launched 19:04:14.529848 run osmo-msc_10.42.42.6(pid=16574): Launched 19:04:14.698458 run osmo-stp_10.42.42.5(pid=16571): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16571)] 19:04:14.825929 run osmo-stp_10.42.42.5(pid=16571): stdout: | (launched: 2022-12-12_19:04:13.535640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:14.952934 run osmo-stp_10.42.42.5(pid=16571): stderr: | [0;m[38;5;43m20221212190413704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190413704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190413704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190413705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190413705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190413705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190413705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:15.078620 run osmo-stp_10.42.42.5(pid=16571): stdout: | (launched: 2022-12-12_19:04:13.535640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:15.199298 run osmo-stp_10.42.42.5(pid=16571): stderr: | [0;m[38;5;43m20221212190413704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190413704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190413704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190413705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190413705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190413705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190413705 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:15.343267 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16571): Process ended prematurely: osmo-stp_10.42.42.5(pid=16571) [trial-2380↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16571)] [trial-2380↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 19:04:15.351506 tst handover.py:18: Test FAILED (6.4 sec) 19:04:15.377619 run osmo-hlr_10.42.42.2(pid=16568): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16568)] 19:04:15.425437 run osmo-hlr_10.42.42.2(pid=16568): stdout: | (launched: 2022-12-12_19:04:12.623742) 19:04:15.475000 run osmo-hlr_10.42.42.2(pid=16568): stderr: | [0;m[1;31m20221212190412799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190412799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190412799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190412799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190412799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190412799 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190412812 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190412822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190412822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190412822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:15.543781 run osmo-msc_10.42.42.6(pid=16574): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16574)] 19:04:15.591570 run osmo-msc_10.42.42.6(pid=16574): stdout: | (launched: 2022-12-12_19:04:14.473215) 19:04:15.640627 run osmo-msc_10.42.42.6(pid=16574): stderr: | [0;m[38;5;43m20221212190414745 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190414745 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2a7366fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190414745 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190414745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190414745 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190414746 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190414747 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190414748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190414748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190414748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:04:15.690196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16567): Terminating (SIGTERM) 19:04:15.729810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16570): Terminating (SIGTERM) 19:04:15.769734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16573): Terminating (SIGTERM) 19:04:15.809480 --- ParallelTerminationStrategy: PID 16567 died... 19:04:15.828670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16567): Terminated: ok {rc=0} 19:04:15.877236 --- ParallelTerminationStrategy: PID 16570 died... 19:04:15.897358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16570): Terminated: ok {rc=0} 19:04:15.950027 --- ParallelTerminationStrategy: PID 16573 died... 19:04:15.969083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16573): Terminated: ok {rc=0} 19:04:16.064317 bus /sierra_3: Setting Powered False 19:04:17.169200 bus /sierra_3: Setting Powered False 19:04:18.289473 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 19:04:19.557742 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:04:19.563255 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 19:04:19.622448 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 19:04:19.649153 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 19:04:19.703780 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 19:04:19.763376 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 19:04:19.789768 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 19:04:20.342724 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 19:04:20.347994 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:04:20.359333 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:04:20.403483 tst handover.py: using LAC 30878 19:04:20.521081 tst handover.py: using RAC 23 19:04:20.639355 tst handover.py: using CellId 30878 19:04:20.767120 tst handover.py: using BVCI 30879 19:04:20.885138 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 19:04:20.936117 tst handover.py: using LAC 30879 19:04:21.064709 tst handover.py: using RAC 24 19:04:21.191436 tst handover.py: using CellId 30879 19:04:21.317806 tst handover.py: using BVCI 30880 19:04:21.437089 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:04:21.448810 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:04:21.460269 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:04:21.472283 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:04:21.484278 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 19:04:21.496152 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:04:21.616016 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 19:04:21.735792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:22.210368 run create_hlr_db(pid=16580): Launched 19:04:22.334757 bus /sierra_2: Setting Powered False 19:04:23.398121 run create_hlr_db(pid=16580): Terminated: ok {rc=0} 19:04:23.819780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16582): Launched 19:04:24.144761 run osmo-hlr_10.42.42.2(pid=16583): Launched 19:04:24.268920 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:24.799493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16585): Launched 19:04:25.123021 run osmo-stp_10.42.42.5(pid=16586): Launched 19:04:25.246290 run osmo-msc_10.42.42.6: Starting osmo-msc 19:04:25.803761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16588): Launched 19:04:26.128221 run osmo-msc_10.42.42.6(pid=16589): Launched 19:04:26.308694 run osmo-stp_10.42.42.5(pid=16586): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16586)] 19:04:26.445177 run osmo-stp_10.42.42.5(pid=16586): stdout: | (launched: 2022-12-12_19:04:25.063452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:26.581528 run osmo-stp_10.42.42.5(pid=16586): stderr: | [0;m[38;5;43m20221212190425251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190425251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190425251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190425252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190425252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190425252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190425252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:26.716486 run osmo-stp_10.42.42.5(pid=16586): stdout: | (launched: 2022-12-12_19:04:25.063452) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:26.845223 run osmo-stp_10.42.42.5(pid=16586): stderr: | [0;m[38;5;43m20221212190425251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190425251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190425251 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190425252 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190425252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190425252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190425252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:26.999399 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16586): Process ended prematurely: osmo-stp_10.42.42.5(pid=16586) [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16586)] [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 19:04:27.008667 tst handover.py:18: Test FAILED (6.7 sec) 19:04:27.037316 run osmo-hlr_10.42.42.2(pid=16583): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16583)] 19:04:27.087862 run osmo-hlr_10.42.42.2(pid=16583): stdout: | (launched: 2022-12-12_19:04:24.084878) 19:04:27.139781 run osmo-hlr_10.42.42.2(pid=16583): stderr: | [0;m[1;31m20221212190424278 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190424279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190424279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190424279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190424279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190424279 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190424291 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190424299 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190424300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190424300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:27.212117 run osmo-msc_10.42.42.6(pid=16589): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16589)] 19:04:27.262421 run osmo-msc_10.42.42.6(pid=16589): stdout: | (launched: 2022-12-12_19:04:26.068370) 19:04:27.314189 run osmo-msc_10.42.42.6(pid=16589): stderr: | [0;m[38;5;43m20221212190426385 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190426385 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f37b93b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190426386 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190426386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190426386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190426386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190426388 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190426388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190426388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190426388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:04:27.366502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16582): Terminating (SIGTERM) 19:04:27.408458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16585): Terminating (SIGTERM) 19:04:27.450645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16588): Terminating (SIGTERM) 19:04:27.493373 --- ParallelTerminationStrategy: PID 16582 died... 19:04:27.513401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16582): Terminated: ok {rc=0} 19:04:27.560193 --- ParallelTerminationStrategy: PID 16585 died... 19:04:27.579884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16585): Terminated: ok {rc=0} 19:04:27.626788 --- ParallelTerminationStrategy: PID 16588 died... 19:04:27.646260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16588): Terminated: ok {rc=0} 19:04:27.734284 bus /sierra_3: Setting Powered False 19:04:28.835114 bus /sierra_3: Setting Powered False 19:04:29.953926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 19:04:31.280347 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:04:31.289715 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:04:31.354074 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:04:31.391023 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:04:31.458767 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:04:31.511907 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:04:31.540135 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:04:32.109272 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 19:04:32.117824 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:04:32.133054 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 19:04:32.185143 tst handover.py: using LAC 30880 19:04:32.305356 tst handover.py: using RAC 25 19:04:32.422459 tst handover.py: using CellId 30880 19:04:32.540682 tst handover.py: using BVCI 30881 19:04:32.648222 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 19:04:32.683614 tst handover.py: using LAC 30881 19:04:32.812120 tst handover.py: using RAC 26 19:04:32.939857 tst handover.py: using CellId 30881 19:04:33.067919 tst handover.py: using BVCI 30882 19:04:33.186930 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:04:33.198673 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:04:33.210236 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:04:33.222588 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:04:33.235213 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:04:33.247481 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 19:04:33.368061 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 19:04:33.484751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:33.924703 run create_hlr_db(pid=16594): Launched 19:04:34.050376 bus /sierra_2: Setting Powered False 19:04:35.114176 run create_hlr_db(pid=16594): Terminated: ok {rc=0} 19:04:35.518773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16597): Launched 19:04:35.821201 run osmo-hlr_10.42.42.2(pid=16598): Launched 19:04:35.936351 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:36.444457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16600): Launched 19:04:36.746540 run osmo-stp_10.42.42.5(pid=16601): Launched 19:04:36.860837 run osmo-msc_10.42.42.6: Starting osmo-msc 19:04:37.378720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16603): Launched 19:04:37.681600 run osmo-msc_10.42.42.6(pid=16604): Launched 19:04:37.850403 run osmo-stp_10.42.42.5(pid=16601): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16601)] 19:04:37.977220 run osmo-stp_10.42.42.5(pid=16601): stdout: | (launched: 2022-12-12_19:04:36.690242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:38.103959 run osmo-stp_10.42.42.5(pid=16601): stderr: | [0;m[38;5;43m20221212190436857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190436857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190436857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190436858 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190436858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190436858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190436858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:38.229124 run osmo-stp_10.42.42.5(pid=16601): stdout: | (launched: 2022-12-12_19:04:36.690242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:38.348445 run osmo-stp_10.42.42.5(pid=16601): stderr: | [0;m[38;5;43m20221212190436857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190436857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190436857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190436858 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190436858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190436858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190436858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:38.491483 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16601): Process ended prematurely: osmo-stp_10.42.42.5(pid=16601) [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16601)] [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 19:04:38.499978 tst handover.py:18: Test FAILED (6.4 sec) 19:04:38.526499 run osmo-hlr_10.42.42.2(pid=16598): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16598)] 19:04:38.573837 run osmo-hlr_10.42.42.2(pid=16598): stdout: | (launched: 2022-12-12_19:04:35.764726) 19:04:38.622809 run osmo-hlr_10.42.42.2(pid=16598): stderr: | [0;m[1;31m20221212190435940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190435940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190435940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190435940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190435940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190435940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190435952 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190435962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190435963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190435963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:38.691216 run osmo-msc_10.42.42.6(pid=16604): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16604)] 19:04:38.738793 run osmo-msc_10.42.42.6(pid=16604): stdout: | (launched: 2022-12-12_19:04:37.625167) 19:04:38.787833 run osmo-msc_10.42.42.6(pid=16604): stderr: | [0;m[38;5;43m20221212190437896 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190437897 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f262515fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190437897 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190437897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190437897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190437897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190437899 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190437899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190437899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190437899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:04:38.837438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16597): Terminating (SIGTERM) 19:04:38.877112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16600): Terminating (SIGTERM) 19:04:38.916450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16603): Terminating (SIGTERM) 19:04:38.956448 --- ParallelTerminationStrategy: PID 16597 died... 19:04:38.975541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16597): Terminated: ok {rc=0} 19:04:39.019219 --- ParallelTerminationStrategy: PID 16600 died... 19:04:39.038310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16600): Terminated: ok {rc=0} 19:04:39.082113 --- ParallelTerminationStrategy: PID 16603 died... 19:04:39.100715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16603): Terminated: ok {rc=0} 19:04:39.186525 bus /sierra_3: Setting Powered False 19:04:40.286401 bus /sierra_3: Setting Powered False 19:04:41.399663 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 19:04:42.656035 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:04:42.661738 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:04:42.723104 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:04:42.750914 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:04:42.804213 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:04:42.864800 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:04:42.892549 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:04:43.451398 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 19:04:43.458278 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:04:43.470443 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:04:43.514966 tst handover.py: using LAC 30882 19:04:43.640735 tst handover.py: using RAC 27 19:04:43.764729 tst handover.py: using CellId 30882 19:04:43.890271 tst handover.py: using BVCI 30883 19:04:44.009460 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:04:44.056925 tst handover.py: using LAC 30883 19:04:44.180729 tst handover.py: using RAC 28 19:04:44.304552 tst handover.py: using CellId 30883 19:04:44.429056 tst handover.py: using BVCI 30884 19:04:44.546178 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:04:44.557990 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:04:44.569525 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:04:44.581424 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:04:44.593345 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:04:44.605050 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:04:44.723906 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:04:44.838572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:45.281679 run create_hlr_db(pid=16609): Launched 19:04:45.406485 bus /sierra_2: Setting Powered False 19:04:46.481947 run create_hlr_db(pid=16609): Terminated: ok {rc=0} 19:04:46.930037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16611): Launched 19:04:47.270033 run osmo-hlr_10.42.42.2(pid=16612): Launched 19:04:47.393853 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:47.929682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16614): Launched 19:04:48.254971 run osmo-stp_10.42.42.5(pid=16615): Launched 19:04:48.378669 run osmo-msc_10.42.42.6: Starting osmo-msc 19:04:48.933402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16617): Launched 19:04:49.259059 run osmo-msc_10.42.42.6(pid=16618): Launched 19:04:49.439377 run osmo-stp_10.42.42.5(pid=16615): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16615)] 19:04:49.575479 run osmo-stp_10.42.42.5(pid=16615): stdout: | (launched: 2022-12-12_19:04:48.195363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:49.711700 run osmo-stp_10.42.42.5(pid=16615): stderr: | [0;m[38;5;43m20221212190448382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190448382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190448383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190448383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190448384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190448384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190448384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:49.846381 run osmo-stp_10.42.42.5(pid=16615): stdout: | (launched: 2022-12-12_19:04:48.195363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:04:49.975092 run osmo-stp_10.42.42.5(pid=16615): stderr: | [0;m[38;5;43m20221212190448382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190448382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190448383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190448383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190448384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190448384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190448384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:04:50.129587 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16615): Process ended prematurely: osmo-stp_10.42.42.5(pid=16615) [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16615)] [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 19:04:50.138709 tst handover.py:18: Test FAILED (6.7 sec) 19:04:50.166450 run osmo-hlr_10.42.42.2(pid=16612): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16612)] 19:04:50.216889 run osmo-hlr_10.42.42.2(pid=16612): stdout: | (launched: 2022-12-12_19:04:47.210108) 19:04:50.268484 run osmo-hlr_10.42.42.2(pid=16612): stderr: | [0;m[1;31m20221212190447405 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190447406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190447406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190447406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190447406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190447406 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190447419 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190447429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190447429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190447429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:04:50.340090 run osmo-msc_10.42.42.6(pid=16618): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16618)] 19:04:50.389806 run osmo-msc_10.42.42.6(pid=16618): stdout: | (launched: 2022-12-12_19:04:49.199376) 19:04:50.441306 run osmo-msc_10.42.42.6(pid=16618): stderr: | [0;m[38;5;43m20221212190449520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190449520 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0996f2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190449520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190449520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190449521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190449521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190449523 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190449523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190449523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190449523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:04:50.493253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16611): Terminating (SIGTERM) 19:04:50.534968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16614): Terminating (SIGTERM) 19:04:50.576570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16617): Terminating (SIGTERM) 19:04:50.618602 --- ParallelTerminationStrategy: PID 16611 died... 19:04:50.638601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16611): Terminated: ok {rc=0} 19:04:50.684940 --- ParallelTerminationStrategy: PID 16614 died... 19:04:50.704495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16614): Terminated: ok {rc=0} 19:04:50.750639 --- ParallelTerminationStrategy: PID 16617 died... 19:04:50.770526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16617): Terminated: ok {rc=0} 19:04:50.857369 bus /sierra_3: Setting Powered False 19:04:51.954505 bus /sierra_3: Setting Powered False 19:04:53.070017 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 19:04:54.341932 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:04:54.347405 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:04:54.405359 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:04:54.431964 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:04:54.484256 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:04:54.542627 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:04:54.569201 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:04:55.121222 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 19:04:55.126588 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:04:55.137936 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:04:55.181332 tst handover.py: using LAC 30884 19:04:55.300135 tst handover.py: using RAC 29 19:04:55.420104 tst handover.py: using CellId 30884 19:04:55.539190 tst handover.py: using BVCI 30885 19:04:55.647597 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:04:55.694198 tst handover.py: using LAC 30885 19:04:55.817522 tst handover.py: using RAC 30 19:04:55.945701 tst handover.py: using CellId 30885 19:04:56.062241 tst handover.py: using BVCI 30886 19:04:56.172272 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:04:56.183480 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:04:56.194483 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:04:56.205567 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:04:56.216570 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:04:56.227334 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:04:56.346095 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:04:56.462522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:04:56.936591 run create_hlr_db(pid=16623): Launched 19:04:57.061137 bus /sierra_2: Setting Powered False 19:04:58.122246 run create_hlr_db(pid=16623): Terminated: ok {rc=0} 19:04:58.536357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16625): Launched 19:04:58.860835 run osmo-hlr_10.42.42.2(pid=16626): Launched 19:04:58.984816 run osmo-stp_10.42.42.5: Starting osmo-stp 19:04:59.516110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16628): Launched 19:04:59.841364 run osmo-stp_10.42.42.5(pid=16629): Launched 19:04:59.965490 run osmo-msc_10.42.42.6: Starting osmo-msc 19:05:00.522351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16631): Launched 19:05:00.856789 run osmo-msc_10.42.42.6(pid=16632): Launched 19:05:01.178385 run osmo-stp_10.42.42.5(pid=16629): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16629)] 19:05:01.375960 run osmo-stp_10.42.42.5(pid=16629): stdout: | (launched: 2022-12-12_19:04:59.781157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:01.628580 run osmo-stp_10.42.42.5(pid=16629): stderr: | [0;m[38;5;43m20221212190459969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190459969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190459969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190459970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190459970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190459970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190459970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:01.773555 run osmo-stp_10.42.42.5(pid=16629): stdout: | (launched: 2022-12-12_19:04:59.781157) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:01.938112 run osmo-stp_10.42.42.5(pid=16629): stderr: | [0;m[38;5;43m20221212190459969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190459969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190459969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190459970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190459970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190459970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190459970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:02.135922 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16629): Process ended prematurely: osmo-stp_10.42.42.5(pid=16629) [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16629)] [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 19:05:02.145983 tst handover.py:18: Test FAILED (7.0 sec) 19:05:02.177227 run osmo-hlr_10.42.42.2(pid=16626): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16626)] 19:05:02.229647 run osmo-hlr_10.42.42.2(pid=16626): stdout: | (launched: 2022-12-12_19:04:58.800929) 19:05:02.283634 run osmo-hlr_10.42.42.2(pid=16626): stderr: | [0;m[1;31m20221212190458995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190458995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190458995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190458995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190458995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190458995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190459007 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190459016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190459016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190459016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:02.358340 run osmo-msc_10.42.42.6(pid=16632): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16632)] 19:05:02.410648 run osmo-msc_10.42.42.6(pid=16632): stdout: | (launched: 2022-12-12_19:05:00.787169) 19:05:02.464424 run osmo-msc_10.42.42.6(pid=16632): stderr: | [0;m[38;5;43m20221212190501393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190501393 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fec8f685c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190501393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190501393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190501393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190501393 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190501395 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190501395 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190501396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190501396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:05:02.518790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16625): Terminating (SIGTERM) 19:05:02.562859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16628): Terminating (SIGTERM) 19:05:02.606832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16631): Terminating (SIGTERM) 19:05:02.650811 --- ParallelTerminationStrategy: PID 16625 died... 19:05:02.671366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16625): Terminated: ok {rc=0} 19:05:02.720692 --- ParallelTerminationStrategy: PID 16628 died... 19:05:02.741179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16628): Terminated: ok {rc=0} 19:05:02.790527 --- ParallelTerminationStrategy: PID 16631 died... 19:05:02.810681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16631): Terminated: ok {rc=0} 19:05:02.901076 bus /sierra_3: Setting Powered False 19:05:03.997617 bus /sierra_3: Setting Powered False 19:05:05.111879 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 19:05:06.383433 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:05:06.388565 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 19:05:06.439692 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 19:05:06.466089 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 19:05:06.518143 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 19:05:06.571113 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 19:05:06.598825 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 19:05:07.147016 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 19:05:07.153427 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:05:07.165013 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 19:05:07.214334 tst handover.py: using LAC 30886 19:05:07.333388 tst handover.py: using RAC 31 19:05:07.453853 tst handover.py: using CellId 30886 19:05:07.594648 tst handover.py: using BVCI 30887 19:05:07.714038 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 19:05:07.751721 tst handover.py: using LAC 30887 19:05:07.876907 tst handover.py: using RAC 32 19:05:08.002688 tst handover.py: using CellId 30887 19:05:08.130106 tst handover.py: using BVCI 30888 19:05:08.249046 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:05:08.260441 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:05:08.271666 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:05:08.283319 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:05:08.295180 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 19:05:08.306816 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 19:05:08.423288 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 19:05:08.544127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:09.018421 run create_hlr_db(pid=16647): Launched 19:05:09.142629 bus /sierra_2: Setting Powered False 19:05:10.206488 run create_hlr_db(pid=16647): Terminated: ok {rc=0} 19:05:10.629429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16649): Launched 19:05:10.954451 run osmo-hlr_10.42.42.2(pid=16650): Launched 19:05:11.078693 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:11.607515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16652): Launched 19:05:11.931506 run osmo-stp_10.42.42.5(pid=16653): Launched 19:05:12.055774 run osmo-msc_10.42.42.6: Starting osmo-msc 19:05:12.690885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16733): Launched 19:05:13.011804 run osmo-msc_10.42.42.6(pid=16763): Launched 19:05:13.251521 run osmo-stp_10.42.42.5(pid=16653): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16653)] 19:05:13.535577 run osmo-stp_10.42.42.5(pid=16653): stdout: | (launched: 2022-12-12_19:05:11.871302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:13.676177 run osmo-stp_10.42.42.5(pid=16653): stderr: | [0;m[38;5;43m20221212190512058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190512058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190512058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190512059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190512059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190512059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190512059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:13.814929 run osmo-stp_10.42.42.5(pid=16653): stdout: | (launched: 2022-12-12_19:05:11.871302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:13.947694 run osmo-stp_10.42.42.5(pid=16653): stderr: | [0;m[38;5;43m20221212190512058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190512058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190512058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190512059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190512059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190512059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190512059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:14.107053 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16653): Process ended prematurely: osmo-stp_10.42.42.5(pid=16653) [trial-2380↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16653)] [trial-2380↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 19:05:14.116906 tst handover.py:18: Test FAILED (7.0 sec) 19:05:14.147956 run osmo-hlr_10.42.42.2(pid=16650): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16650)] 19:05:14.199786 run osmo-hlr_10.42.42.2(pid=16650): stdout: | (launched: 2022-12-12_19:05:10.894493) 19:05:14.253328 run osmo-hlr_10.42.42.2(pid=16650): stderr: | [0;m[1;31m20221212190511087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190511087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190511087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190511087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190511087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190511087 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190511100 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190511110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190511110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190511110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:14.325461 run osmo-msc_10.42.42.6(pid=16763): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16763)] 19:05:14.374738 run osmo-msc_10.42.42.6(pid=16763): stdout: | (launched: 2022-12-12_19:05:12.951202) 19:05:14.425288 run osmo-msc_10.42.42.6(pid=16763): stderr: | [0;m[38;5;43m20221212190513393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190513394 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd2fc9b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190513394 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190513394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190513394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190513394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190513403 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190513403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190513404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190513404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:05:14.478675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16649): Terminating (SIGTERM) 19:05:14.521015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16652): Terminating (SIGTERM) 19:05:14.563318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16733): Terminating (SIGTERM) 19:05:14.606146 --- ParallelTerminationStrategy: PID 16649 died... 19:05:14.626424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16649): Terminated: ok {rc=0} 19:05:14.673906 --- ParallelTerminationStrategy: PID 16652 died... 19:05:14.693736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16652): Terminated: ok {rc=0} 19:05:14.740733 --- ParallelTerminationStrategy: PID 16733 died... 19:05:14.760467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16733): Terminated: ok {rc=0} 19:05:14.849464 bus /sierra_3: Setting Powered False 19:05:15.946675 bus /sierra_3: Setting Powered False 19:05:17.093969 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 19:05:18.370035 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:05:18.376503 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:05:18.441295 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:05:18.468100 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:05:18.520605 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:05:18.587753 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:05:18.614102 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:05:19.161680 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 19:05:19.167050 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:05:19.178445 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:05:19.226762 tst handover.py: using LAC 30888 19:05:19.347126 tst handover.py: using RAC 33 19:05:19.466762 tst handover.py: using CellId 30888 19:05:19.586518 tst handover.py: using BVCI 30889 19:05:19.695920 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:05:19.744422 tst handover.py: using LAC 30889 19:05:19.863817 tst handover.py: using RAC 34 19:05:19.984229 tst handover.py: using CellId 30889 19:05:20.099980 tst handover.py: using BVCI 30890 19:05:20.208309 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:05:20.219285 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:05:20.230000 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:05:20.240942 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:05:20.251927 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:05:20.262897 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:05:20.378583 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:05:20.493623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:20.933931 run create_hlr_db(pid=17013): Launched 19:05:21.061747 bus /sierra_2: Setting Powered False 19:05:22.126065 run create_hlr_db(pid=17013): Terminated: ok {rc=0} 19:05:22.554527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17019): Launched 19:05:22.894533 run osmo-hlr_10.42.42.2(pid=17045): Launched 19:05:23.104650 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:23.651117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17186): Launched 19:05:23.992007 run osmo-stp_10.42.42.5(pid=17194): Launched 19:05:24.238287 run osmo-msc_10.42.42.6: Starting osmo-msc 19:05:24.885046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17196): Launched 19:05:25.227314 run osmo-msc_10.42.42.6(pid=17197): Launched 19:05:25.593804 run osmo-stp_10.42.42.5(pid=17194): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17194)] 19:05:25.879650 run osmo-stp_10.42.42.5(pid=17194): stdout: | (launched: 2022-12-12_19:05:23.929542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:26.047889 run osmo-stp_10.42.42.5(pid=17194): stderr: | [0;m[38;5;43m20221212190524221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190524222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190524222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190524222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190524223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190524223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190524223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:26.187059 run osmo-stp_10.42.42.5(pid=17194): stdout: | (launched: 2022-12-12_19:05:23.929542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:26.320420 run osmo-stp_10.42.42.5(pid=17194): stderr: | [0;m[38;5;43m20221212190524221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190524222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190524222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190524222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190524223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190524223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190524223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:26.480240 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17194): Process ended prematurely: osmo-stp_10.42.42.5(pid=17194) [trial-2380↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17194)] [trial-2380↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 19:05:26.491283 tst handover.py:18: Test FAILED (7.3 sec) 19:05:26.522692 run osmo-hlr_10.42.42.2(pid=17045): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17045)] 19:05:26.575402 run osmo-hlr_10.42.42.2(pid=17045): stdout: | (launched: 2022-12-12_19:05:22.834622) 19:05:26.629695 run osmo-hlr_10.42.42.2(pid=17045): stderr: | [0;m[1;31m20221212190523062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190523062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190523062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190523062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190523062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190523062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190523082 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190523098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190523099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190523099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:26.705099 run osmo-msc_10.42.42.6(pid=17197): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17197)] 19:05:26.757179 run osmo-msc_10.42.42.6(pid=17197): stdout: | (launched: 2022-12-12_19:05:25.167314) 19:05:26.810655 run osmo-msc_10.42.42.6(pid=17197): stderr: | [0;m[38;5;43m20221212190525668 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190525668 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe65491c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190525668 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190525668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190525673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190525673 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190525676 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190525676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190525677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190525677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:05:26.864745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17019): Terminating (SIGTERM) 19:05:26.909764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17186): Terminating (SIGTERM) 19:05:26.955678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17196): Terminating (SIGTERM) 19:05:27.001943 --- ParallelTerminationStrategy: PID 17019 died... 19:05:27.022944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17019): Terminated: ok {rc=0} 19:05:27.073901 --- ParallelTerminationStrategy: PID 17186 died... 19:05:27.094557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17186): Terminated: ok {rc=0} 19:05:27.143875 --- ParallelTerminationStrategy: PID 17196 died... 19:05:27.164591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17196): Terminated: ok {rc=0} 19:05:27.256706 bus /sierra_3: Setting Powered False 19:05:28.360220 bus /sierra_3: Setting Powered False 19:05:29.476463 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 19:05:30.748833 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:05:30.754307 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:05:30.817254 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:05:30.855153 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:05:30.913881 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:05:30.996401 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:05:31.028365 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:05:31.561580 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 19:05:31.568818 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:05:31.582032 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:05:31.637556 tst handover.py: using LAC 30890 19:05:31.769876 tst handover.py: using RAC 35 19:05:31.900898 tst handover.py: using CellId 30890 19:05:32.031940 tst handover.py: using BVCI 30891 19:05:32.170330 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:05:32.221250 tst handover.py: using LAC 30891 19:05:32.346880 tst handover.py: using RAC 36 19:05:32.466768 tst handover.py: using CellId 30891 19:05:32.586840 tst handover.py: using BVCI 30892 19:05:32.698239 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:05:32.709435 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:05:32.720395 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:05:32.731386 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:05:32.742452 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:05:32.753415 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:05:32.873250 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:05:32.995917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:33.476694 run create_hlr_db(pid=17203): Launched 19:05:33.605623 bus /sierra_2: Setting Powered False 19:05:34.670064 run create_hlr_db(pid=17203): Terminated: ok {rc=0} 19:05:35.080225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17205): Launched 19:05:35.387867 run osmo-hlr_10.42.42.2(pid=17206): Launched 19:05:35.506195 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:36.007126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17208): Launched 19:05:36.312050 run osmo-stp_10.42.42.5(pid=17209): Launched 19:05:36.428487 run osmo-msc_10.42.42.6: Starting osmo-msc 19:05:36.952090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17211): Launched 19:05:37.257464 run osmo-msc_10.42.42.6(pid=17212): Launched 19:05:37.428155 run osmo-stp_10.42.42.5(pid=17209): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17209)] 19:05:37.557178 run osmo-stp_10.42.42.5(pid=17209): stdout: | (launched: 2022-12-12_19:05:36.255250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:37.684912 run osmo-stp_10.42.42.5(pid=17209): stderr: | [0;m[38;5;43m20221212190536424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190536425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190536425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190536425 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190536426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190536426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190536426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:37.811705 run osmo-stp_10.42.42.5(pid=17209): stdout: | (launched: 2022-12-12_19:05:36.255250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:37.931890 run osmo-stp_10.42.42.5(pid=17209): stderr: | [0;m[38;5;43m20221212190536424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190536425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190536425 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190536425 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190536426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190536426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190536426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:38.076125 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17209): Process ended prematurely: osmo-stp_10.42.42.5(pid=17209) [trial-2380↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17209)] [trial-2380↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 19:05:38.084521 tst handover.py:18: Test FAILED (6.5 sec) 19:05:38.110663 run osmo-hlr_10.42.42.2(pid=17206): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17206)] 19:05:38.157940 run osmo-hlr_10.42.42.2(pid=17206): stdout: | (launched: 2022-12-12_19:05:35.331106) 19:05:38.206853 run osmo-hlr_10.42.42.2(pid=17206): stderr: | [0;m[1;31m20221212190535505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190535505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190535505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190535505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190535505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190535505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190535518 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190535526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190535527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190535527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:38.275226 run osmo-msc_10.42.42.6(pid=17212): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17212)] 19:05:38.322473 run osmo-msc_10.42.42.6(pid=17212): stdout: | (launched: 2022-12-12_19:05:37.200729) 19:05:38.371407 run osmo-msc_10.42.42.6(pid=17212): stderr: | [0;m[38;5;43m20221212190537471 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190537471 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe1c348ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190537471 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190537471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190537471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190537472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190537473 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190537474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190537474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190537474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:05:38.421183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17205): Terminating (SIGTERM) 19:05:38.460674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17208): Terminating (SIGTERM) 19:05:38.499979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17211): Terminating (SIGTERM) 19:05:38.539556 --- ParallelTerminationStrategy: PID 17205 died... 19:05:38.558617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17205): Terminated: ok {rc=0} 19:05:38.603007 --- ParallelTerminationStrategy: PID 17208 died... 19:05:38.621627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17208): Terminated: ok {rc=0} 19:05:38.665454 --- ParallelTerminationStrategy: PID 17211 died... 19:05:38.683936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17211): Terminated: ok {rc=0} 19:05:38.769087 bus /sierra_3: Setting Powered False 19:05:39.867874 bus /sierra_3: Setting Powered False 19:05:40.982735 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 19:05:42.258121 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:05:42.263181 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 19:05:42.314107 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 19:05:42.340699 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 19:05:42.394974 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 19:05:42.445896 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 19:05:42.472229 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 19:05:43.023108 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 19:05:43.028300 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:05:43.039284 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:05:43.073865 tst handover.py: using LAC 30892 19:05:43.193944 tst handover.py: using RAC 37 19:05:43.314208 tst handover.py: using CellId 30892 19:05:43.436844 tst handover.py: using BVCI 30893 19:05:43.556541 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 19:05:43.606454 tst handover.py: using LAC 30893 19:05:43.733645 tst handover.py: using RAC 38 19:05:43.861868 tst handover.py: using CellId 30893 19:05:43.983719 tst handover.py: using BVCI 30894 19:05:44.095561 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:05:44.106786 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:05:44.117686 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:05:44.128649 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:05:44.139751 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 19:05:44.150661 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:05:44.270166 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 19:05:44.390871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:44.868502 run create_hlr_db(pid=17217): Launched 19:05:44.996275 bus /sierra_2: Setting Powered False 19:05:46.073472 run create_hlr_db(pid=17217): Terminated: ok {rc=0} 19:05:46.549854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17219): Launched 19:05:46.942684 run osmo-hlr_10.42.42.2(pid=17220): Launched 19:05:47.211828 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:47.740433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17222): Launched 19:05:48.048049 run osmo-stp_10.42.42.5(pid=17223): Launched 19:05:48.164394 run osmo-msc_10.42.42.6: Starting osmo-msc 19:05:48.690759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17225): Launched 19:05:48.999450 run osmo-msc_10.42.42.6(pid=17226): Launched 19:05:49.170256 run osmo-stp_10.42.42.5(pid=17223): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17223)] 19:05:49.297982 run osmo-stp_10.42.42.5(pid=17223): stdout: | (launched: 2022-12-12_19:05:47.991442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:49.426441 run osmo-stp_10.42.42.5(pid=17223): stderr: | [0;m[38;5;43m20221212190548161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190548161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190548162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190548162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190548163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190548163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190548163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:49.552870 run osmo-stp_10.42.42.5(pid=17223): stdout: | (launched: 2022-12-12_19:05:47.991442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:05:49.674598 run osmo-stp_10.42.42.5(pid=17223): stderr: | [0;m[38;5;43m20221212190548161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190548161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190548162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190548162 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190548163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190548163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190548163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:05:49.819476 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17223): Process ended prematurely: osmo-stp_10.42.42.5(pid=17223) [trial-2380↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17223)] [trial-2380↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 19:05:49.828020 tst handover.py:18: Test FAILED (6.8 sec) 19:05:49.854576 run osmo-hlr_10.42.42.2(pid=17220): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17220)] 19:05:49.902143 run osmo-hlr_10.42.42.2(pid=17220): stdout: | (launched: 2022-12-12_19:05:46.882368) 19:05:49.951346 run osmo-hlr_10.42.42.2(pid=17220): stderr: | [0;m[1;31m20221212190547122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190547122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190547122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190547122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190547122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190547122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190547134 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190547150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190547150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190547150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:05:50.020294 run osmo-msc_10.42.42.6(pid=17226): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17226)] 19:05:50.067883 run osmo-msc_10.42.42.6(pid=17226): stdout: | (launched: 2022-12-12_19:05:48.942697) 19:05:50.116764 run osmo-msc_10.42.42.6(pid=17226): stderr: | [0;m[38;5;43m20221212190549215 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190549215 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3d5dfddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190549215 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190549215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190549215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190549215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190549217 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190549218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190549218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190549218 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:05:50.166114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17219): Terminating (SIGTERM) 19:05:50.205608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17222): Terminating (SIGTERM) 19:05:50.245276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17225): Terminating (SIGTERM) 19:05:50.285256 --- ParallelTerminationStrategy: PID 17219 died... 19:05:50.304059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17219): Terminated: ok {rc=0} 19:05:50.348207 --- ParallelTerminationStrategy: PID 17222 died... 19:05:50.366910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17222): Terminated: ok {rc=0} 19:05:50.410742 --- ParallelTerminationStrategy: PID 17225 died... 19:05:50.429192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17225): Terminated: ok {rc=0} 19:05:50.514860 bus /sierra_3: Setting Powered False 19:05:51.615024 bus /sierra_3: Setting Powered False 19:05:52.731292 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 19:05:53.992085 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:05:53.998062 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:05:54.051310 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:05:54.079233 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:05:54.133278 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:05:54.184685 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:05:54.212045 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:05:54.763489 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 19:05:54.769364 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:05:54.780668 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:05:54.817086 tst handover.py: using LAC 30894 19:05:54.938743 tst handover.py: using RAC 39 19:05:55.061038 tst handover.py: using CellId 30894 19:05:55.181517 tst handover.py: using BVCI 30895 19:05:55.302447 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:05:55.352368 tst handover.py: using LAC 30895 19:05:55.481376 tst handover.py: using RAC 40 19:05:55.611277 tst handover.py: using CellId 30895 19:05:55.738795 tst handover.py: using BVCI 30896 19:05:55.850180 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:05:55.861216 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:05:55.871924 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:05:55.883083 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:05:55.894058 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:05:55.904860 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:05:56.022276 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:05:56.142650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:05:56.622003 run create_hlr_db(pid=17231): Launched 19:05:56.747513 bus /sierra_2: Setting Powered False 19:05:57.811616 run create_hlr_db(pid=17231): Terminated: ok {rc=0} 19:05:58.238545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17233): Launched 19:05:58.565679 run osmo-hlr_10.42.42.2(pid=17234): Launched 19:05:58.692111 run osmo-stp_10.42.42.5: Starting osmo-stp 19:05:59.224777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17236): Launched 19:05:59.553753 run osmo-stp_10.42.42.5(pid=17237): Launched 19:05:59.680735 run osmo-msc_10.42.42.6: Starting osmo-msc 19:06:00.244456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17239): Launched 19:06:00.574573 run osmo-msc_10.42.42.6(pid=17240): Launched 19:06:00.760504 run osmo-stp_10.42.42.5(pid=17237): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17237)] 19:06:00.920135 run osmo-stp_10.42.42.5(pid=17237): stdout: | (launched: 2022-12-12_19:05:59.493431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:01.181434 run osmo-stp_10.42.42.5(pid=17237): stderr: | [0;m[38;5;43m20221212190559682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190559683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190559683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190559683 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190559684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190559684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190559684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:01.505589 run osmo-stp_10.42.42.5(pid=17237): stdout: | (launched: 2022-12-12_19:05:59.493431) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:01.679946 run osmo-stp_10.42.42.5(pid=17237): stderr: | [0;m[38;5;43m20221212190559682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190559683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190559683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190559683 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190559684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190559684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190559684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:01.841705 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17237): Process ended prematurely: osmo-stp_10.42.42.5(pid=17237) [trial-2380↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17237)] [trial-2380↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 19:06:01.851053 tst handover.py:18: Test FAILED (7.1 sec) 19:06:01.878226 run osmo-hlr_10.42.42.2(pid=17234): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17234)] 19:06:01.927230 run osmo-hlr_10.42.42.2(pid=17234): stdout: | (launched: 2022-12-12_19:05:58.505595) 19:06:01.980083 run osmo-hlr_10.42.42.2(pid=17234): stderr: | [0;m[1;31m20221212190558699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190558699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190558699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190558699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190558699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190558699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190558716 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190558725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190558725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190558725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:06:02.050859 run osmo-msc_10.42.42.6(pid=17240): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17240)] 19:06:02.100492 run osmo-msc_10.42.42.6(pid=17240): stdout: | (launched: 2022-12-12_19:06:00.514145) 19:06:02.151961 run osmo-msc_10.42.42.6(pid=17240): stderr: | [0;m[38;5;43m20221212190601004 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190601004 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f28f1cfcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190601004 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190601004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190601005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190601005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190601007 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190601007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190601007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190601007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:06:02.203516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17233): Terminating (SIGTERM) 19:06:02.244734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17236): Terminating (SIGTERM) 19:06:02.287818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17239): Terminating (SIGTERM) 19:06:02.331275 --- ParallelTerminationStrategy: PID 17233 died... 19:06:02.350561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17233): Terminated: ok {rc=0} 19:06:02.394541 --- ParallelTerminationStrategy: PID 17236 died... 19:06:02.413021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17236): Terminated: ok {rc=0} 19:06:02.457450 --- ParallelTerminationStrategy: PID 17239 died... 19:06:02.476148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17239): Terminated: ok {rc=0} 19:06:02.561049 bus /sierra_3: Setting Powered False 19:06:03.662917 bus /sierra_3: Setting Powered False 19:06:04.780870 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2380 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 19:06:06.039902 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 19:06:06.046012 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 19:06:06.111381 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 19:06:06.139441 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 19:06:06.193287 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 19:06:06.258122 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 19:06:06.286067 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 19:06:06.836670 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2380 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 19:06:06.842538 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:06:06.854132 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:06:06.903793 tst handover.py: using LAC 30896 19:06:07.033790 tst handover.py: using RAC 41 19:06:07.163934 tst handover.py: using CellId 30896 19:06:07.292879 tst handover.py: using BVCI 30897 19:06:07.414203 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 19:06:07.463271 tst handover.py: using LAC 30897 19:06:07.593489 tst handover.py: using RAC 42 19:06:07.713374 tst handover.py: using CellId 30897 19:06:07.833686 tst handover.py: using BVCI 30898 19:06:07.943938 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:06:07.954862 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:06:07.965693 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:06:07.977331 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:06:07.989300 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 19:06:08.000588 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:06:08.118011 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 19:06:08.240405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:06:08.719300 run create_hlr_db(pid=17245): Launched 19:06:08.845135 bus /sierra_2: Setting Powered False 19:06:09.909389 run create_hlr_db(pid=17245): Terminated: ok {rc=0} 19:06:10.319847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17247): Launched 19:06:10.626111 run osmo-hlr_10.42.42.2(pid=17248): Launched 19:06:10.742589 run osmo-stp_10.42.42.5: Starting osmo-stp 19:06:11.242969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17250): Launched 19:06:11.550792 run osmo-stp_10.42.42.5(pid=17251): Launched 19:06:11.667827 run osmo-msc_10.42.42.6: Starting osmo-msc 19:06:12.192711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17253): Launched 19:06:12.498330 run osmo-msc_10.42.42.6(pid=17254): Launched 19:06:12.668305 run osmo-stp_10.42.42.5(pid=17251): ERR: Terminated: ERROR {rc=1} [trial-2380↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17251)] 19:06:12.796732 run osmo-stp_10.42.42.5(pid=17251): stdout: | (launched: 2022-12-12_19:06:11.494154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:12.924511 run osmo-stp_10.42.42.5(pid=17251): stderr: | [0;m[38;5;43m20221212190611661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190611661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190611662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190611662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190611663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190611663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190611663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:13.050389 run osmo-stp_10.42.42.5(pid=17251): stdout: | (launched: 2022-12-12_19:06:11.494154) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 19:06:13.171377 run osmo-stp_10.42.42.5(pid=17251): stderr: | [0;m[38;5;43m20221212190611661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221212190611661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221212190611662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221212190611662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212190611663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212190611663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212190611663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 19:06:13.315974 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=17251): Process ended prematurely: osmo-stp_10.42.42.5(pid=17251) [trial-2380↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17251)] [trial-2380↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 19:06:13.324361 tst handover.py:18: Test FAILED (6.5 sec) 19:06:13.350579 run osmo-hlr_10.42.42.2(pid=17248): ERR: Terminated: ERROR {rc=237} [trial-2380↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17248)] 19:06:13.398115 run osmo-hlr_10.42.42.2(pid=17248): stdout: | (launched: 2022-12-12_19:06:10.569231) 19:06:13.446926 run osmo-hlr_10.42.42.2(pid=17248): stderr: | [0;m[1;31m20221212190610743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221212190610743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221212190610743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221212190610743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221212190610743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221212190610743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221212190610755 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221212190610763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212190610763 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212190610764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 19:06:13.515391 run osmo-msc_10.42.42.6(pid=17254): ERR: Terminated: ERROR {rc=2} [trial-2380↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17254)] 19:06:13.562563 run osmo-msc_10.42.42.6(pid=17254): stdout: | (launched: 2022-12-12_19:06:12.441712) 19:06:13.611386 run osmo-msc_10.42.42.6(pid=17254): stderr: | [0;m[38;5;43m20221212190612714 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221212190612714 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd05ae02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221212190612714 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221212190612714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221212190612714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221212190612715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221212190612716 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221212190612717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212190612717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212190612717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 19:06:13.660593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17247): Terminating (SIGTERM) 19:06:13.699993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17250): Terminating (SIGTERM) 19:06:13.739205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17253): Terminating (SIGTERM) 19:06:13.778845 --- ParallelTerminationStrategy: PID 17247 died... 19:06:13.798021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17247): Terminated: ok {rc=0} 19:06:13.841877 --- ParallelTerminationStrategy: PID 17250 died... 19:06:13.860309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17250): Terminated: ok {rc=0} 19:06:13.909268 --- ParallelTerminationStrategy: PID 17253 died... 19:06:13.928868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17253): Terminated: ok {rc=0} 19:06:14.020566 bus /sierra_3: Setting Powered False 19:06:15.118688 bus /sierra_3: Setting Powered False 19:06:16.236115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2380 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 19:06:17.513939 tst trial-2380: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380/run.2022-12-12_17-41-28/trial-2380.xml -------------------------------------------------------------------------------------------- trial-2380 FAIL -------------------------------------------------------------------------------------------- 19:06:19.451899 tst trial-2380: trial-2380: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.8 sec) Error: osmo-nitb_10.42.42.2(pid=8529): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8529) [trial-2380↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8529)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.0 sec) Error: osmo-stp_10.42.42.5(pid=8539): Process ended prematurely: osmo-stp_10.42.42.5(pid=8539) [trial-2380↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8539)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=8550): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8550) [trial-2380↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8550)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=8560): Process ended prematurely: osmo-stp_10.42.42.5(pid=8560) [trial-2380↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8560)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8574): Process ended prematurely: osmo-stp_10.42.42.5(pid=8574) [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8574)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8585): Process ended prematurely: osmo-stp_10.42.42.5(pid=8585) [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8585)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8599): Process ended prematurely: osmo-stp_10.42.42.5(pid=8599) [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8599)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8610): Process ended prematurely: osmo-stp_10.42.42.5(pid=8610) [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8610)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8627): Process ended prematurely: osmo-stp_10.42.42.5(pid=8627) [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8627)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8641): Process ended prematurely: osmo-stp_10.42.42.5(pid=8641) [trial-2380↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8641)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8655): Process ended prematurely: osmo-stp_10.42.42.5(pid=8655) [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8655)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8666): Process ended prematurely: osmo-stp_10.42.42.5(pid=8666) [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8666)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8680): Process ended prematurely: osmo-stp_10.42.42.5(pid=8680) [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8680)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8691): Process ended prematurely: osmo-stp_10.42.42.5(pid=8691) [trial-2380↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8691)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8705): Process ended prematurely: osmo-stp_10.42.42.5(pid=8705) [trial-2380↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8705)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8716): Process ended prematurely: osmo-stp_10.42.42.5(pid=8716) [trial-2380↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8716)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8730): Process ended prematurely: osmo-stp_10.42.42.5(pid=8730) [trial-2380↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8730)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8741): Process ended prematurely: osmo-stp_10.42.42.5(pid=8741) [trial-2380↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8741)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8756): Process ended prematurely: osmo-stp_10.42.42.5(pid=8756) [trial-2380↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8756)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8767): Process ended prematurely: osmo-stp_10.42.42.5(pid=8767) [trial-2380↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8767)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.9 sec) Error: osmo-stp_10.42.42.5(pid=8786): Process ended prematurely: osmo-stp_10.42.42.5(pid=8786) [trial-2380↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8786)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=8798): Process ended prematurely: osmo-stp_10.42.42.5(pid=8798) [trial-2380↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8798)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=8816): Process ended prematurely: osmo-stp_10.42.42.5(pid=8816) [trial-2380↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8816)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8826): Process ended prematurely: osmo-stp_10.42.42.5(pid=8826) [trial-2380↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8826)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8836): Process ended prematurely: osmo-stp_10.42.42.5(pid=8836) [trial-2380↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8836)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8853): Process ended prematurely: osmo-stp_10.42.42.5(pid=8853) [trial-2380↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8853)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=8865): Process ended prematurely: osmo-stp_10.42.42.5(pid=8865) [trial-2380↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8865)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8883): Process ended prematurely: osmo-stp_10.42.42.5(pid=8883) [trial-2380↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8883)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8894): Process ended prematurely: osmo-stp_10.42.42.5(pid=8894) [trial-2380↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8894)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8904): Process ended prematurely: osmo-stp_10.42.42.5(pid=8904) [trial-2380↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8904)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8921): Process ended prematurely: osmo-stp_10.42.42.5(pid=8921) [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8921)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=8934): Process ended prematurely: osmo-stp_10.42.42.5(pid=8934) [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8934)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=8952): Process ended prematurely: osmo-stp_10.42.42.5(pid=8952) [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8952)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8965): Process ended prematurely: osmo-stp_10.42.42.5(pid=8965) [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8965)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8975): Process ended prematurely: osmo-stp_10.42.42.5(pid=8975) [trial-2380↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8975)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=8993): Process ended prematurely: osmo-stp_10.42.42.5(pid=8993) [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8993)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=9005): Process ended prematurely: osmo-stp_10.42.42.5(pid=9005) [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9005)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=9023): Process ended prematurely: osmo-stp_10.42.42.5(pid=9023) [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9023)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9033): Process ended prematurely: osmo-stp_10.42.42.5(pid=9033) [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9033)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9043): Process ended prematurely: osmo-stp_10.42.42.5(pid=9043) [trial-2380↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9043)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9058): Process ended prematurely: osmo-stp_10.42.42.5(pid=9058) [trial-2380↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9058)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=9071): Process ended prematurely: osmo-stp_10.42.42.5(pid=9071) [trial-2380↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9071)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=9080): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9080) [trial-2380↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9080)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9090): Process ended prematurely: osmo-stp_10.42.42.5(pid=9090) [trial-2380↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9090)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9099): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9099) [trial-2380↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9099)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9109): Process ended prematurely: osmo-stp_10.42.42.5(pid=9109) [trial-2380↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9109)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9123): Process ended prematurely: osmo-stp_10.42.42.5(pid=9123) [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9123)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9138): Process ended prematurely: osmo-stp_10.42.42.5(pid=9138) [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9138)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9153): Process ended prematurely: osmo-stp_10.42.42.5(pid=9153) [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9153)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9164): Process ended prematurely: osmo-stp_10.42.42.5(pid=9164) [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9164)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9178): Process ended prematurely: osmo-stp_10.42.42.5(pid=9178) [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9178)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9189): Process ended prematurely: osmo-stp_10.42.42.5(pid=9189) [trial-2380↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9189)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9203): Process ended prematurely: osmo-stp_10.42.42.5(pid=9203) [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9203)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9214): Process ended prematurely: osmo-stp_10.42.42.5(pid=9214) [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9214)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=9255): Process ended prematurely: osmo-stp_10.42.42.5(pid=9255) [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9255)] FAIL: mo_mt_call_osmux.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=9512): Process ended prematurely: osmo-stp_10.42.42.5(pid=9512) [trial-2380↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9512)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9526): Process ended prematurely: osmo-stp_10.42.42.5(pid=9526) [trial-2380↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9526)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9537): Process ended prematurely: osmo-stp_10.42.42.5(pid=9537) [trial-2380↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9537)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9552): Process ended prematurely: osmo-stp_10.42.42.5(pid=9552) [trial-2380↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9552)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9566): Process ended prematurely: osmo-stp_10.42.42.5(pid=9566) [trial-2380↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9566)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9580): Process ended prematurely: osmo-stp_10.42.42.5(pid=9580) [trial-2380↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9580)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9594): Process ended prematurely: osmo-stp_10.42.42.5(pid=9594) [trial-2380↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9594)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=9612): Process ended prematurely: osmo-stp_10.42.42.5(pid=9612) [trial-2380↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9612)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=9624): Process ended prematurely: osmo-stp_10.42.42.5(pid=9624) [trial-2380↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9624)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=9643): Process ended prematurely: osmo-stp_10.42.42.5(pid=9643) [trial-2380↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9643)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9653): Process ended prematurely: osmo-stp_10.42.42.5(pid=9653) [trial-2380↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9653)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9663): Process ended prematurely: osmo-stp_10.42.42.5(pid=9663) [trial-2380↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9663)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=9680): Process ended prematurely: osmo-stp_10.42.42.5(pid=9680) [trial-2380↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9680)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=9692): Process ended prematurely: osmo-stp_10.42.42.5(pid=9692) [trial-2380↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9692)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=9710): Process ended prematurely: osmo-stp_10.42.42.5(pid=9710) [trial-2380↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9710)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=9720): Process ended prematurely: osmo-stp_10.42.42.5(pid=9720) [trial-2380↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9720)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9730): Process ended prematurely: osmo-stp_10.42.42.5(pid=9730) [trial-2380↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9730)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=9747): Process ended prematurely: osmo-stp_10.42.42.5(pid=9747) [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9747)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=9759): Process ended prematurely: osmo-stp_10.42.42.5(pid=9759) [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9759)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=9777): Process ended prematurely: osmo-stp_10.42.42.5(pid=9777) [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9777)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9788): Process ended prematurely: osmo-stp_10.42.42.5(pid=9788) [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9788)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9799): Process ended prematurely: osmo-stp_10.42.42.5(pid=9799) [trial-2380↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9799)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=9817): Process ended prematurely: osmo-stp_10.42.42.5(pid=9817) [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9817)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=9829): Process ended prematurely: osmo-stp_10.42.42.5(pid=9829) [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9829)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=9847): Process ended prematurely: osmo-stp_10.42.42.5(pid=9847) [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9847)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9857): Process ended prematurely: osmo-stp_10.42.42.5(pid=9857) [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9857)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9867): Process ended prematurely: osmo-stp_10.42.42.5(pid=9867) [trial-2380↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9867)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9882): Process ended prematurely: osmo-stp_10.42.42.5(pid=9882) [trial-2380↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9882)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9899): Process ended prematurely: osmo-stp_10.42.42.5(pid=9899) [trial-2380↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9899)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=9907): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9907) [trial-2380↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9907)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9917): Process ended prematurely: osmo-stp_10.42.42.5(pid=9917) [trial-2380↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9917)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=9939): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9939) [trial-2380↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9939)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9961): Process ended prematurely: osmo-stp_10.42.42.5(pid=9961) [trial-2380↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9961)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=9976): Process ended prematurely: osmo-stp_10.42.42.5(pid=9976) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9976)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9987): Process ended prematurely: osmo-stp_10.42.42.5(pid=9987) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9987)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10001): Process ended prematurely: osmo-stp_10.42.42.5(pid=10001) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10001)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10013): Process ended prematurely: osmo-stp_10.42.42.5(pid=10013) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10013)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10027): Process ended prematurely: osmo-stp_10.42.42.5(pid=10027) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10027)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10038): Process ended prematurely: osmo-stp_10.42.42.5(pid=10038) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10038)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10052): Process ended prematurely: osmo-stp_10.42.42.5(pid=10052) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10052)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10063): Process ended prematurely: osmo-stp_10.42.42.5(pid=10063) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10063)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10077): Process ended prematurely: osmo-stp_10.42.42.5(pid=10077) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10077)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10088): Process ended prematurely: osmo-stp_10.42.42.5(pid=10088) [trial-2380↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10088)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10102): Process ended prematurely: osmo-stp_10.42.42.5(pid=10102) [trial-2380↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10102)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10113): Process ended prematurely: osmo-stp_10.42.42.5(pid=10113) [trial-2380↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10113)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10127): Process ended prematurely: osmo-stp_10.42.42.5(pid=10127) [trial-2380↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10127)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10138): Process ended prematurely: osmo-stp_10.42.42.5(pid=10138) [trial-2380↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10138)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10152): Process ended prematurely: osmo-stp_10.42.42.5(pid=10152) [trial-2380↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10152)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10163): Process ended prematurely: osmo-stp_10.42.42.5(pid=10163) [trial-2380↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10163)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10178): Process ended prematurely: osmo-stp_10.42.42.5(pid=10178) [trial-2380↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10178)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10189): Process ended prematurely: osmo-stp_10.42.42.5(pid=10189) [trial-2380↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10189)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10203): Process ended prematurely: osmo-stp_10.42.42.5(pid=10203) [trial-2380↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10203)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10214): Process ended prematurely: osmo-stp_10.42.42.5(pid=10214) [trial-2380↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10214)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=10232): Process ended prematurely: osmo-stp_10.42.42.5(pid=10232) [trial-2380↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10232)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10244): Process ended prematurely: osmo-stp_10.42.42.5(pid=10244) [trial-2380↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10244)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10262): Process ended prematurely: osmo-stp_10.42.42.5(pid=10262) [trial-2380↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10262)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10272): Process ended prematurely: osmo-stp_10.42.42.5(pid=10272) [trial-2380↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10272)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10282): Process ended prematurely: osmo-stp_10.42.42.5(pid=10282) [trial-2380↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10282)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=10299): Process ended prematurely: osmo-stp_10.42.42.5(pid=10299) [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10299)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10314): Process ended prematurely: osmo-stp_10.42.42.5(pid=10314) [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10314)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10333): Process ended prematurely: osmo-stp_10.42.42.5(pid=10333) [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10333)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10343): Process ended prematurely: osmo-stp_10.42.42.5(pid=10343) [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10343)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10353): Process ended prematurely: osmo-stp_10.42.42.5(pid=10353) [trial-2380↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10353)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=10372): Process ended prematurely: osmo-stp_10.42.42.5(pid=10372) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10372)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10386): Process ended prematurely: osmo-stp_10.42.42.5(pid=10386) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10386)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10404): Process ended prematurely: osmo-stp_10.42.42.5(pid=10404) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10404)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10414): Process ended prematurely: osmo-stp_10.42.42.5(pid=10414) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10414)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10424): Process ended prematurely: osmo-stp_10.42.42.5(pid=10424) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10424)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=10442): Process ended prematurely: osmo-stp_10.42.42.5(pid=10442) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10442)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=10454): Process ended prematurely: osmo-stp_10.42.42.5(pid=10454) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10454)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10472): Process ended prematurely: osmo-stp_10.42.42.5(pid=10472) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10472)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10482): Process ended prematurely: osmo-stp_10.42.42.5(pid=10482) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10482)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=10492): Process ended prematurely: osmo-stp_10.42.42.5(pid=10492) [trial-2380↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10492)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=10510): Process ended prematurely: osmo-stp_10.42.42.5(pid=10510) [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10510)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10522): Process ended prematurely: osmo-stp_10.42.42.5(pid=10522) [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10522)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=10540): Process ended prematurely: osmo-stp_10.42.42.5(pid=10540) [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10540)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10550): Process ended prematurely: osmo-stp_10.42.42.5(pid=10550) [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10550)] FAIL: ping_idle_ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10832): Process ended prematurely: osmo-stp_10.42.42.5(pid=10832) [trial-2380↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10832)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=10847): Process ended prematurely: osmo-stp_10.42.42.5(pid=10847) [trial-2380↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10847)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10861): Process ended prematurely: osmo-stp_10.42.42.5(pid=10861) [trial-2380↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10861)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=10870): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10870) [trial-2380↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10870)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10880): Process ended prematurely: osmo-stp_10.42.42.5(pid=10880) [trial-2380↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10880)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=10890): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10890) [trial-2380↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10890)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=10900): Process ended prematurely: osmo-stp_10.42.42.5(pid=10900) [trial-2380↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10900)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10926): Process ended prematurely: osmo-stp_10.42.42.5(pid=10926) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10926)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10941): Process ended prematurely: osmo-stp_10.42.42.5(pid=10941) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10941)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10955): Process ended prematurely: osmo-stp_10.42.42.5(pid=10955) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10955)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10966): Process ended prematurely: osmo-stp_10.42.42.5(pid=10966) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10966)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10980): Process ended prematurely: osmo-stp_10.42.42.5(pid=10980) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10980)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10991): Process ended prematurely: osmo-stp_10.42.42.5(pid=10991) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10991)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11005): Process ended prematurely: osmo-stp_10.42.42.5(pid=11005) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11005)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11016): Process ended prematurely: osmo-stp_10.42.42.5(pid=11016) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11016)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11031): Process ended prematurely: osmo-stp_10.42.42.5(pid=11031) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11031)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11042): Process ended prematurely: osmo-stp_10.42.42.5(pid=11042) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11042)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11056): Process ended prematurely: osmo-stp_10.42.42.5(pid=11056) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11056)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11067): Process ended prematurely: osmo-stp_10.42.42.5(pid=11067) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11067)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11081): Process ended prematurely: osmo-stp_10.42.42.5(pid=11081) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11081)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11092): Process ended prematurely: osmo-stp_10.42.42.5(pid=11092) [trial-2380↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11092)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11108): Process ended prematurely: osmo-stp_10.42.42.5(pid=11108) [trial-2380↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11108)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11119): Process ended prematurely: osmo-stp_10.42.42.5(pid=11119) [trial-2380↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11119)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=11138): Process ended prematurely: osmo-stp_10.42.42.5(pid=11138) [trial-2380↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11138)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=11150): Process ended prematurely: osmo-stp_10.42.42.5(pid=11150) [trial-2380↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11150)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=11168): Process ended prematurely: osmo-stp_10.42.42.5(pid=11168) [trial-2380↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11168)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11178): Process ended prematurely: osmo-stp_10.42.42.5(pid=11178) [trial-2380↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11178)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11188): Process ended prematurely: osmo-stp_10.42.42.5(pid=11188) [trial-2380↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11188)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11205): Process ended prematurely: osmo-stp_10.42.42.5(pid=11205) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11205)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=11219): Process ended prematurely: osmo-stp_10.42.42.5(pid=11219) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11219)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=11239): Process ended prematurely: osmo-stp_10.42.42.5(pid=11239) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11239)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11250): Process ended prematurely: osmo-stp_10.42.42.5(pid=11250) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11250)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11260): Process ended prematurely: osmo-stp_10.42.42.5(pid=11260) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11260)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=11277): Process ended prematurely: osmo-stp_10.42.42.5(pid=11277) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11277)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=11294): Process ended prematurely: osmo-stp_10.42.42.5(pid=11294) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11294)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=11312): Process ended prematurely: osmo-stp_10.42.42.5(pid=11312) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11312)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11322): Process ended prematurely: osmo-stp_10.42.42.5(pid=11322) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11322)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11332): Process ended prematurely: osmo-stp_10.42.42.5(pid=11332) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11332)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=11349): Process ended prematurely: osmo-stp_10.42.42.5(pid=11349) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11349)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11361): Process ended prematurely: osmo-stp_10.42.42.5(pid=11361) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11361)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=11379): Process ended prematurely: osmo-stp_10.42.42.5(pid=11379) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11379)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11389): Process ended prematurely: osmo-stp_10.42.42.5(pid=11389) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11389)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11399): Process ended prematurely: osmo-stp_10.42.42.5(pid=11399) [trial-2380↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11399)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11413): Process ended prematurely: osmo-stp_10.42.42.5(pid=11413) [trial-2380↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11413)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11430): Process ended prematurely: osmo-stp_10.42.42.5(pid=11430) [trial-2380↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11430)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=11439): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11439) [trial-2380↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11439)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11449): Process ended prematurely: osmo-stp_10.42.42.5(pid=11449) [trial-2380↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11449)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=11458): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11458) [trial-2380↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11458)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=11468): Process ended prematurely: osmo-stp_10.42.42.5(pid=11468) [trial-2380↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11468)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11482): Process ended prematurely: osmo-stp_10.42.42.5(pid=11482) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11482)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11493): Process ended prematurely: osmo-stp_10.42.42.5(pid=11493) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11493)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11507): Process ended prematurely: osmo-stp_10.42.42.5(pid=11507) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11507)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11518): Process ended prematurely: osmo-stp_10.42.42.5(pid=11518) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11518)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11532): Process ended prematurely: osmo-stp_10.42.42.5(pid=11532) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11532)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11543): Process ended prematurely: osmo-stp_10.42.42.5(pid=11543) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11543)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11557): Process ended prematurely: osmo-stp_10.42.42.5(pid=11557) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11557)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11568): Process ended prematurely: osmo-stp_10.42.42.5(pid=11568) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11568)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11582): Process ended prematurely: osmo-stp_10.42.42.5(pid=11582) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11582)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11593): Process ended prematurely: osmo-stp_10.42.42.5(pid=11593) [trial-2380↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11593)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11608): Process ended prematurely: osmo-stp_10.42.42.5(pid=11608) [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11608)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11619): Process ended prematurely: osmo-stp_10.42.42.5(pid=11619) [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11619)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11636): Process ended prematurely: osmo-stp_10.42.42.5(pid=11636) [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11636)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11647): Process ended prematurely: osmo-stp_10.42.42.5(pid=11647) [trial-2380↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11647)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11661): Process ended prematurely: osmo-stp_10.42.42.5(pid=11661) [trial-2380↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11661)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11672): Process ended prematurely: osmo-stp_10.42.42.5(pid=11672) [trial-2380↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11672)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11686): Process ended prematurely: osmo-stp_10.42.42.5(pid=11686) [trial-2380↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11686)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11697): Process ended prematurely: osmo-stp_10.42.42.5(pid=11697) [trial-2380↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11697)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=11715): Process ended prematurely: osmo-stp_10.42.42.5(pid=11715) [trial-2380↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11715)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11727): Process ended prematurely: osmo-stp_10.42.42.5(pid=11727) [trial-2380↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11727)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=11745): Process ended prematurely: osmo-stp_10.42.42.5(pid=11745) [trial-2380↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11745)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11756): Process ended prematurely: osmo-stp_10.42.42.5(pid=11756) [trial-2380↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11756)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11766): Process ended prematurely: osmo-stp_10.42.42.5(pid=11766) [trial-2380↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11766)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=11783): Process ended prematurely: osmo-stp_10.42.42.5(pid=11783) [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11783)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=11795): Process ended prematurely: osmo-stp_10.42.42.5(pid=11795) [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11795)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=11813): Process ended prematurely: osmo-stp_10.42.42.5(pid=11813) [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11813)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11823): Process ended prematurely: osmo-stp_10.42.42.5(pid=11823) [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11823)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11833): Process ended prematurely: osmo-stp_10.42.42.5(pid=11833) [trial-2380↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11833)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11852): Process ended prematurely: osmo-stp_10.42.42.5(pid=11852) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11852)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=11864): Process ended prematurely: osmo-stp_10.42.42.5(pid=11864) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11864)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=11882): Process ended prematurely: osmo-stp_10.42.42.5(pid=11882) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11882)] FAIL: ping.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=12164): Process ended prematurely: osmo-stp_10.42.42.5(pid=12164) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12164)] FAIL: ping_idle_ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=12174): Process ended prematurely: osmo-stp_10.42.42.5(pid=12174) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12174)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=12191): Process ended prematurely: osmo-stp_10.42.42.5(pid=12191) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12191)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=12203): Process ended prematurely: osmo-stp_10.42.42.5(pid=12203) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12203)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=12222): Process ended prematurely: osmo-stp_10.42.42.5(pid=12222) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12222)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12233): Process ended prematurely: osmo-stp_10.42.42.5(pid=12233) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12233)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12246): Process ended prematurely: osmo-stp_10.42.42.5(pid=12246) [trial-2380↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12246)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=12263): Process ended prematurely: osmo-stp_10.42.42.5(pid=12263) [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12263)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=12275): Process ended prematurely: osmo-stp_10.42.42.5(pid=12275) [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12275)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=12293): Process ended prematurely: osmo-stp_10.42.42.5(pid=12293) [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12293)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12303): Process ended prematurely: osmo-stp_10.42.42.5(pid=12303) [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12303)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12313): Process ended prematurely: osmo-stp_10.42.42.5(pid=12313) [trial-2380↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12313)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12326): Process ended prematurely: osmo-stp_10.42.42.5(pid=12326) [trial-2380↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12326)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12339): Process ended prematurely: osmo-stp_10.42.42.5(pid=12339) [trial-2380↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12339)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=12347): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12347) [trial-2380↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12347)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12357): Process ended prematurely: osmo-stp_10.42.42.5(pid=12357) [trial-2380↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12357)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=12366): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12366) [trial-2380↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12366)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12377): Process ended prematurely: osmo-stp_10.42.42.5(pid=12377) [trial-2380↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12377)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12391): Process ended prematurely: osmo-stp_10.42.42.5(pid=12391) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12391)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12402): Process ended prematurely: osmo-stp_10.42.42.5(pid=12402) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12402)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12416): Process ended prematurely: osmo-stp_10.42.42.5(pid=12416) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12416)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12427): Process ended prematurely: osmo-stp_10.42.42.5(pid=12427) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12427)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12441): Process ended prematurely: osmo-stp_10.42.42.5(pid=12441) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12441)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12452): Process ended prematurely: osmo-stp_10.42.42.5(pid=12452) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12452)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12466): Process ended prematurely: osmo-stp_10.42.42.5(pid=12466) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12466)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12477): Process ended prematurely: osmo-stp_10.42.42.5(pid=12477) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12477)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12491): Process ended prematurely: osmo-stp_10.42.42.5(pid=12491) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12491)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12502): Process ended prematurely: osmo-stp_10.42.42.5(pid=12502) [trial-2380↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12502)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12516): Process ended prematurely: osmo-stp_10.42.42.5(pid=12516) [trial-2380↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12516)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12527): Process ended prematurely: osmo-stp_10.42.42.5(pid=12527) [trial-2380↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12527)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12541): Process ended prematurely: osmo-stp_10.42.42.5(pid=12541) [trial-2380↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12541)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12552): Process ended prematurely: osmo-stp_10.42.42.5(pid=12552) [trial-2380↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12552)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12570): Process ended prematurely: osmo-stp_10.42.42.5(pid=12570) [trial-2380↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12570)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12581): Process ended prematurely: osmo-stp_10.42.42.5(pid=12581) [trial-2380↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12581)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=12611): Process ended prematurely: osmo-stp_10.42.42.5(pid=12611) [trial-2380↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12611)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=12974): Process ended prematurely: osmo-stp_10.42.42.5(pid=12974) [trial-2380↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12974)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=13168): Process ended prematurely: osmo-stp_10.42.42.5(pid=13168) [trial-2380↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13168)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=13178): Process ended prematurely: osmo-stp_10.42.42.5(pid=13178) [trial-2380↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13178)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13188): Process ended prematurely: osmo-stp_10.42.42.5(pid=13188) [trial-2380↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13188)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=13205): Process ended prematurely: osmo-stp_10.42.42.5(pid=13205) [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13205)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=13217): Process ended prematurely: osmo-stp_10.42.42.5(pid=13217) [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13217)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=13235): Process ended prematurely: osmo-stp_10.42.42.5(pid=13235) [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13235)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13245): Process ended prematurely: osmo-stp_10.42.42.5(pid=13245) [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13245)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13255): Process ended prematurely: osmo-stp_10.42.42.5(pid=13255) [trial-2380↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13255)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=13272): Process ended prematurely: osmo-stp_10.42.42.5(pid=13272) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13272)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=13284): Process ended prematurely: osmo-stp_10.42.42.5(pid=13284) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13284)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=13302): Process ended prematurely: osmo-stp_10.42.42.5(pid=13302) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13302)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13312): Process ended prematurely: osmo-stp_10.42.42.5(pid=13312) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13312)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13322): Process ended prematurely: osmo-stp_10.42.42.5(pid=13322) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13322)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=13340): Process ended prematurely: osmo-stp_10.42.42.5(pid=13340) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13340)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=13352): Process ended prematurely: osmo-stp_10.42.42.5(pid=13352) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13352)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=13370): Process ended prematurely: osmo-stp_10.42.42.5(pid=13370) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13370)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13380): Process ended prematurely: osmo-stp_10.42.42.5(pid=13380) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13380)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13390): Process ended prematurely: osmo-stp_10.42.42.5(pid=13390) [trial-2380↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13390)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13403): Process ended prematurely: osmo-stp_10.42.42.5(pid=13403) [trial-2380↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13403)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13416): Process ended prematurely: osmo-stp_10.42.42.5(pid=13416) [trial-2380↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13416)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=13425): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13425) [trial-2380↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13425)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13436): Process ended prematurely: osmo-stp_10.42.42.5(pid=13436) [trial-2380↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13436)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=13445): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13445) [trial-2380↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13445)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13455): Process ended prematurely: osmo-stp_10.42.42.5(pid=13455) [trial-2380↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13455)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13473): Process ended prematurely: osmo-stp_10.42.42.5(pid=13473) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13473)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13485): Process ended prematurely: osmo-stp_10.42.42.5(pid=13485) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13485)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13499): Process ended prematurely: osmo-stp_10.42.42.5(pid=13499) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13499)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13510): Process ended prematurely: osmo-stp_10.42.42.5(pid=13510) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13510)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13524): Process ended prematurely: osmo-stp_10.42.42.5(pid=13524) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13524)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13535): Process ended prematurely: osmo-stp_10.42.42.5(pid=13535) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13535)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13549): Process ended prematurely: osmo-stp_10.42.42.5(pid=13549) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13549)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13560): Process ended prematurely: osmo-stp_10.42.42.5(pid=13560) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13560)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13575): Process ended prematurely: osmo-stp_10.42.42.5(pid=13575) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13575)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13586): Process ended prematurely: osmo-stp_10.42.42.5(pid=13586) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13586)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13600): Process ended prematurely: osmo-stp_10.42.42.5(pid=13600) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13600)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13611): Process ended prematurely: osmo-stp_10.42.42.5(pid=13611) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13611)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13625): Process ended prematurely: osmo-stp_10.42.42.5(pid=13625) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13625)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13636): Process ended prematurely: osmo-stp_10.42.42.5(pid=13636) [trial-2380↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13636)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13650): Process ended prematurely: osmo-stp_10.42.42.5(pid=13650) [trial-2380↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13650)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13661): Process ended prematurely: osmo-stp_10.42.42.5(pid=13661) [trial-2380↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13661)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=13680): Process ended prematurely: osmo-stp_10.42.42.5(pid=13680) [trial-2380↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13680)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=13692): Process ended prematurely: osmo-stp_10.42.42.5(pid=13692) [trial-2380↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13692)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=13710): Process ended prematurely: osmo-stp_10.42.42.5(pid=13710) [trial-2380↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13710)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13720): Process ended prematurely: osmo-stp_10.42.42.5(pid=13720) [trial-2380↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13720)] FAIL: ping_idle_ping.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14002): Process ended prematurely: osmo-stp_10.42.42.5(pid=14002) [trial-2380↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14002)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.6 sec) Error: osmo-stp_10.42.42.5(pid=14019): Process ended prematurely: osmo-stp_10.42.42.5(pid=14019) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14019)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=14032): Process ended prematurely: osmo-stp_10.42.42.5(pid=14032) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14032)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=14051): Process ended prematurely: osmo-stp_10.42.42.5(pid=14051) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14051)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14063): Process ended prematurely: osmo-stp_10.42.42.5(pid=14063) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14063)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14073): Process ended prematurely: osmo-stp_10.42.42.5(pid=14073) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14073)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=14093): Process ended prematurely: osmo-stp_10.42.42.5(pid=14093) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14093)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=14105): Process ended prematurely: osmo-stp_10.42.42.5(pid=14105) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14105)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=14124): Process ended prematurely: osmo-stp_10.42.42.5(pid=14124) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14124)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14136): Process ended prematurely: osmo-stp_10.42.42.5(pid=14136) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14136)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14146): Process ended prematurely: osmo-stp_10.42.42.5(pid=14146) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14146)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=14163): Process ended prematurely: osmo-stp_10.42.42.5(pid=14163) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14163)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=14175): Process ended prematurely: osmo-stp_10.42.42.5(pid=14175) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14175)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=14193): Process ended prematurely: osmo-stp_10.42.42.5(pid=14193) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14193)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14203): Process ended prematurely: osmo-stp_10.42.42.5(pid=14203) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14203)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14213): Process ended prematurely: osmo-stp_10.42.42.5(pid=14213) [trial-2380↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14213)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14234): Process ended prematurely: osmo-stp_10.42.42.5(pid=14234) [trial-2380↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14234)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14247): Process ended prematurely: osmo-stp_10.42.42.5(pid=14247) [trial-2380↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14247)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=14255): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14255) [trial-2380↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14255)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=14265): Process ended prematurely: osmo-stp_10.42.42.5(pid=14265) [trial-2380↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14265)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=14274): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14274) [trial-2380↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14274)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14284): Process ended prematurely: osmo-stp_10.42.42.5(pid=14284) [trial-2380↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14284)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14298): Process ended prematurely: osmo-stp_10.42.42.5(pid=14298) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14298)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14309): Process ended prematurely: osmo-stp_10.42.42.5(pid=14309) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14309)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14323): Process ended prematurely: osmo-stp_10.42.42.5(pid=14323) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14323)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14334): Process ended prematurely: osmo-stp_10.42.42.5(pid=14334) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14334)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14349): Process ended prematurely: osmo-stp_10.42.42.5(pid=14349) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14349)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14360): Process ended prematurely: osmo-stp_10.42.42.5(pid=14360) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14360)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14375): Process ended prematurely: osmo-stp_10.42.42.5(pid=14375) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14375)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14386): Process ended prematurely: osmo-stp_10.42.42.5(pid=14386) [trial-2380↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14386)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14400): Process ended prematurely: osmo-stp_10.42.42.5(pid=14400) [trial-2380↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14400)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14411): Process ended prematurely: osmo-stp_10.42.42.5(pid=14411) [trial-2380↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14411)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14425): Process ended prematurely: osmo-stp_10.42.42.5(pid=14425) [trial-2380↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14425)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14436): Process ended prematurely: osmo-stp_10.42.42.5(pid=14436) [trial-2380↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14436)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=14457): Process ended prematurely: osmo-stp_10.42.42.5(pid=14457) [trial-2380↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14457)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=14469): Process ended prematurely: osmo-stp_10.42.42.5(pid=14469) [trial-2380↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14469)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=14488): Process ended prematurely: osmo-stp_10.42.42.5(pid=14488) [trial-2380↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14488)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14498): Process ended prematurely: osmo-stp_10.42.42.5(pid=14498) [trial-2380↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14498)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14508): Process ended prematurely: osmo-stp_10.42.42.5(pid=14508) [trial-2380↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14508)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14526): Process ended prematurely: osmo-stp_10.42.42.5(pid=14526) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14526)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=14538): Process ended prematurely: osmo-stp_10.42.42.5(pid=14538) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14538)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=14557): Process ended prematurely: osmo-stp_10.42.42.5(pid=14557) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14557)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14567): Process ended prematurely: osmo-stp_10.42.42.5(pid=14567) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14567)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14577): Process ended prematurely: osmo-stp_10.42.42.5(pid=14577) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14577)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=14594): Process ended prematurely: osmo-stp_10.42.42.5(pid=14594) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14594)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=14606): Process ended prematurely: osmo-stp_10.42.42.5(pid=14606) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14606)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=14624): Process ended prematurely: osmo-stp_10.42.42.5(pid=14624) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14624)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14634): Process ended prematurely: osmo-stp_10.42.42.5(pid=14634) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14634)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14644): Process ended prematurely: osmo-stp_10.42.42.5(pid=14644) [trial-2380↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14644)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14658): Process ended prematurely: osmo-stp_10.42.42.5(pid=14658) [trial-2380↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14658)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=14672): Process ended prematurely: osmo-stp_10.42.42.5(pid=14672) [trial-2380↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14672)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=14682): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14682) [trial-2380↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14682)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14692): Process ended prematurely: osmo-stp_10.42.42.5(pid=14692) [trial-2380↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14692)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14706): Process ended prematurely: osmo-stp_10.42.42.5(pid=14706) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14706)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14717): Process ended prematurely: osmo-stp_10.42.42.5(pid=14717) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14717)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14731): Process ended prematurely: osmo-stp_10.42.42.5(pid=14731) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14731)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14742): Process ended prematurely: osmo-stp_10.42.42.5(pid=14742) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14742)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14756): Process ended prematurely: osmo-stp_10.42.42.5(pid=14756) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14756)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14768): Process ended prematurely: osmo-stp_10.42.42.5(pid=14768) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14768)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14782): Process ended prematurely: osmo-stp_10.42.42.5(pid=14782) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14782)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14803): Process ended prematurely: osmo-stp_10.42.42.5(pid=14803) [trial-2380↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14803)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15168): Process ended prematurely: osmo-stp_10.42.42.5(pid=15168) [trial-2380↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15168)] FAIL: mo_mt_call_osmux.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=15354): Process ended prematurely: osmo-stp_10.42.42.5(pid=15354) [trial-2380↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15354)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15369): Process ended prematurely: osmo-stp_10.42.42.5(pid=15369) [trial-2380↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15369)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15381): Process ended prematurely: osmo-stp_10.42.42.5(pid=15381) [trial-2380↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15381)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15395): Process ended prematurely: osmo-stp_10.42.42.5(pid=15395) [trial-2380↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15395)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15406): Process ended prematurely: osmo-stp_10.42.42.5(pid=15406) [trial-2380↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15406)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=15424): Process ended prematurely: osmo-stp_10.42.42.5(pid=15424) [trial-2380↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15424)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=15436): Process ended prematurely: osmo-stp_10.42.42.5(pid=15436) [trial-2380↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15436)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=15455): Process ended prematurely: osmo-stp_10.42.42.5(pid=15455) [trial-2380↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15455)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15465): Process ended prematurely: osmo-stp_10.42.42.5(pid=15465) [trial-2380↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15465)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15475): Process ended prematurely: osmo-stp_10.42.42.5(pid=15475) [trial-2380↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15475)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=15492): Process ended prematurely: osmo-stp_10.42.42.5(pid=15492) [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15492)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=15504): Process ended prematurely: osmo-stp_10.42.42.5(pid=15504) [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15504)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=15522): Process ended prematurely: osmo-stp_10.42.42.5(pid=15522) [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15522)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15533): Process ended prematurely: osmo-stp_10.42.42.5(pid=15533) [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15533)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15543): Process ended prematurely: osmo-stp_10.42.42.5(pid=15543) [trial-2380↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15543)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=15560): Process ended prematurely: osmo-stp_10.42.42.5(pid=15560) [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15560)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=15572): Process ended prematurely: osmo-stp_10.42.42.5(pid=15572) [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15572)] FAIL: iperf3m4.py (12.8 sec) Error: osmo-stp_10.42.42.5(pid=15861): Process ended prematurely: osmo-stp_10.42.42.5(pid=15861) [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15861)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15884): Process ended prematurely: osmo-stp_10.42.42.5(pid=15884) [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15884)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15894): Process ended prematurely: osmo-stp_10.42.42.5(pid=15894) [trial-2380↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15894)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=15911): Process ended prematurely: osmo-stp_10.42.42.5(pid=15911) [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15911)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=15923): Process ended prematurely: osmo-stp_10.42.42.5(pid=15923) [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15923)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=15941): Process ended prematurely: osmo-stp_10.42.42.5(pid=15941) [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15941)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15955): Process ended prematurely: osmo-stp_10.42.42.5(pid=15955) [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15955)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15965): Process ended prematurely: osmo-stp_10.42.42.5(pid=15965) [trial-2380↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15965)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15979): Process ended prematurely: osmo-stp_10.42.42.5(pid=15979) [trial-2380↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15979)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=15987): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15987) [trial-2380↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15987)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=15989): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15989) [trial-2380↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15989)] FAIL: esme_ms_sms_storeforward.py (2.8 sec) Error: osmo-nitb_10.42.42.2(pid=15991): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15991) [trial-2380↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15991)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=15993): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15993) [trial-2380↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15993)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.6 sec) Error: osmo-hlr_10.42.42.2(pid=16002): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16002) [trial-2380↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16002)] FAIL: esme_connect_policy_closed.py (6.2 sec) Error: osmo-hlr_10.42.42.2(pid=16013): Process ended prematurely: osmo-hlr_10.42.42.2(pid=16013) [trial-2380↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16013)] FAIL: esme_ms_sms_storeforward.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16025): Process ended prematurely: osmo-stp_10.42.42.5(pid=16025) [trial-2380↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16025)] FAIL: esme_ms_sms_transaction.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16036): Process ended prematurely: osmo-stp_10.42.42.5(pid=16036) [trial-2380↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16036)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16050): Process ended prematurely: osmo-stp_10.42.42.5(pid=16050) [trial-2380↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16050)] FAIL: register_a5_0_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16061): Process ended prematurely: osmo-stp_10.42.42.5(pid=16061) [trial-2380↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16061)] FAIL: register_a5_1_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16072): Process ended prematurely: osmo-stp_10.42.42.5(pid=16072) [trial-2380↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16072)] FAIL: register_a5_3_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16083): Process ended prematurely: osmo-stp_10.42.42.5(pid=16083) [trial-2380↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16083)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (19.9 sec) Error: srsepc(pid=16103): Process ended prematurely: srsepc(pid=16103) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16103)] FAIL: iperf3_bidir.py (19.1 sec) Error: srsepc(pid=16119): Process ended prematurely: srsepc(pid=16119) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16119)] FAIL: iperf3_dl.py (18.9 sec) Error: srsepc(pid=16135): Process ended prematurely: srsepc(pid=16135) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16135)] FAIL: iperf3_ul.py (19.1 sec) Error: srsepc(pid=16151): Process ended prematurely: srsepc(pid=16151) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16151)] FAIL: ping.py (18.7 sec) Error: srsepc(pid=16167): Process ended prematurely: srsepc(pid=16167) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16167)] FAIL: rrc_idle_mo_ping.py (18.2 sec) Error: srsepc(pid=16183): Process ended prematurely: srsepc(pid=16183) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16183)] FAIL: rrc_idle_mt_ping.py (18.6 sec) Error: srsepc(pid=16199): Process ended prematurely: srsepc(pid=16199) [trial-2380↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=16199)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16214): Process ended prematurely: osmo-stp_10.42.42.5(pid=16214) [trial-2380↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16214)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16230): Process ended prematurely: osmo-stp_10.42.42.5(pid=16230) [trial-2380↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16230)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16244): Process ended prematurely: osmo-stp_10.42.42.5(pid=16244) [trial-2380↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16244)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16258): Process ended prematurely: osmo-stp_10.42.42.5(pid=16258) [trial-2380↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16258)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16275): Process ended prematurely: osmo-stp_10.42.42.5(pid=16275) [trial-2380↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16275)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16289): Process ended prematurely: osmo-stp_10.42.42.5(pid=16289) [trial-2380↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16289)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16303): Process ended prematurely: osmo-stp_10.42.42.5(pid=16303) [trial-2380↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16303)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16317): Process ended prematurely: osmo-stp_10.42.42.5(pid=16317) [trial-2380↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16317)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16331): Process ended prematurely: osmo-stp_10.42.42.5(pid=16331) [trial-2380↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16331)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16345): Process ended prematurely: osmo-stp_10.42.42.5(pid=16345) [trial-2380↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16345)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16359): Process ended prematurely: osmo-stp_10.42.42.5(pid=16359) [trial-2380↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16359)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16373): Process ended prematurely: osmo-stp_10.42.42.5(pid=16373) [trial-2380↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16373)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16387): Process ended prematurely: osmo-stp_10.42.42.5(pid=16387) [trial-2380↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16387)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16402): Process ended prematurely: osmo-stp_10.42.42.5(pid=16402) [trial-2380↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16402)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16416): Process ended prematurely: osmo-stp_10.42.42.5(pid=16416) [trial-2380↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16416)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16430): Process ended prematurely: osmo-stp_10.42.42.5(pid=16430) [trial-2380↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16430)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16444): Process ended prematurely: osmo-stp_10.42.42.5(pid=16444) [trial-2380↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16444)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16458): Process ended prematurely: osmo-stp_10.42.42.5(pid=16458) [trial-2380↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16458)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16472): Process ended prematurely: osmo-stp_10.42.42.5(pid=16472) [trial-2380↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16472)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16487): Process ended prematurely: osmo-stp_10.42.42.5(pid=16487) [trial-2380↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16487)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16501): Process ended prematurely: osmo-stp_10.42.42.5(pid=16501) [trial-2380↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16501)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16515): Process ended prematurely: osmo-stp_10.42.42.5(pid=16515) [trial-2380↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16515)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16529): Process ended prematurely: osmo-stp_10.42.42.5(pid=16529) [trial-2380↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16529)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16543): Process ended prematurely: osmo-stp_10.42.42.5(pid=16543) [trial-2380↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16543)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16557): Process ended prematurely: osmo-stp_10.42.42.5(pid=16557) [trial-2380↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16557)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16571): Process ended prematurely: osmo-stp_10.42.42.5(pid=16571) [trial-2380↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16571)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16586): Process ended prematurely: osmo-stp_10.42.42.5(pid=16586) [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16586)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16601): Process ended prematurely: osmo-stp_10.42.42.5(pid=16601) [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16601)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16615): Process ended prematurely: osmo-stp_10.42.42.5(pid=16615) [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16615)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=16629): Process ended prematurely: osmo-stp_10.42.42.5(pid=16629) [trial-2380↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16629)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=16653): Process ended prematurely: osmo-stp_10.42.42.5(pid=16653) [trial-2380↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16653)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=17194): Process ended prematurely: osmo-stp_10.42.42.5(pid=17194) [trial-2380↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17194)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17209): Process ended prematurely: osmo-stp_10.42.42.5(pid=17209) [trial-2380↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17209)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17223): Process ended prematurely: osmo-stp_10.42.42.5(pid=17223) [trial-2380↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17223)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=17237): Process ended prematurely: osmo-stp_10.42.42.5(pid=17237) [trial-2380↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17237)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17251): Process ended prematurely: osmo-stp_10.42.42.5(pid=17251) [trial-2380↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17251)] + rm -rf trial-2380/inst + cd trial-2380 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-12 17:41:17 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380-run.tgz run.2022-12-12_17-41-28 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2380-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17675.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6687.tgz osmo-hlr.build-8711.tgz osmo-hnbgw.build-2978.tgz osmo-mgw.build-8956.tgz osmo-msc.build-29295.tgz osmo-nitb.build-12984.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30079.tgz osmo-stp.build-9252.tgz osmo-trx.build-4679.tgz osmocom-bb.build-4707.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE