Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6677 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6672 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29252 originally caused by: Started by upstream project "master-osmo-msc" build number 34193 originally caused by: Started by upstream project "master-libsmpp34" build number 1812 originally caused by: Started by timer Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12962 originally caused by: Started by upstream project "master-openbsc" build number 13158 originally caused by: Started by upstream project "master-libsmpp34" build number 1812 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9236 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9106 originally caused by: Started by upstream project "master-libosmo-netif" build number 6953 originally caused by: Started by upstream project "master-libosmo-abis" build number 4951 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8941 originally caused by: Started by upstream project "master-osmo-mgw" build number 9173 originally caused by: Started by upstream project "master-libosmo-netif" build number 6953 originally caused by: Started by upstream project "master-libosmo-abis" build number 4951 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8696 originally caused by: Started by upstream project "master-osmo-hlr" build number 8830 originally caused by: Started by upstream project "master-libosmo-netif" build number 6953 originally caused by: Started by upstream project "master-libosmo-abis" build number 4951 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30029 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37174 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6672 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37175 originally caused by: Started by upstream project "master-libosmo-netif" build number 6953 originally caused by: Started by upstream project "master-libosmo-abis" build number 4951 originally caused by: Started by upstream project "master-libosmocore" build number 3066 Started by upstream project "master-osmo-sgsn" build number 37176 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9106 originally caused by: Started by upstream project "master-libosmo-netif" build number 6953 Started by upstream project "osmo-gsm-tester_build-osmo-bts" build number 7503 originally caused by: Started by upstream project "master-osmo-bts" build number 7564 originally caused by: Started by upstream project "master-libosmo-abis" build number 4951 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5530 originally caused by: Started by upstream project "master-osmo-bts" build number 7564 originally caused by: Started by upstream project "master-libosmo-abis" build number 4951 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8034 originally caused by: Started by upstream project "master-osmo-bts" build number 7564 originally caused by: Started by upstream project "master-libosmo-abis" build number 4951 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17649 originally caused by: Started by upstream project "master-osmo-bsc" build number 20101 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9106 originally caused by: Started by upstream project "master-libosmo-netif" build number 6953 originally caused by: Started by upstream project "master-libosmo-abis" build number 4951 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "master-osmo-bsc" build number 20102 originally caused by: Started by upstream project "master-osmo-mgw" build number 9173 originally caused by: Started by upstream project "master-libosmo-netif" build number 6953 Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29253 originally caused by: Started by upstream project "master-osmo-msc" build number 34194 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9106 originally caused by: Started by upstream project "master-libosmo-netif" build number 6953 originally caused by: Started by upstream project "master-libosmo-abis" build number 4951 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34195 originally caused by: Started by upstream project "master-osmo-mgw" build number 9173 originally caused by: Started by upstream project "master-libosmo-netif" build number 6953 Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4673 originally caused by: Started by upstream project "master-osmo-trx" build number 4877 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12963 originally caused by: Started by upstream project "master-openbsc" build number 13159 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9106 originally caused by: Started by upstream project "master-libosmo-netif" build number 6953 originally caused by: Started by upstream project "master-libosmo-abis" build number 4951 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30030 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37177 originally caused by: Started by upstream project "master-osmo-iuh" build number 12844 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9106 originally caused by: Started by upstream project "master-libosmo-netif" build number 6953 originally caused by: Started by upstream project "master-libosmo-abis" build number 4951 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29254 originally caused by: Started by upstream project "master-osmo-msc" build number 34196 originally caused by: Started by upstream project "master-osmo-iuh" build number 12844 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9106 originally caused by: Started by upstream project "master-libosmo-netif" build number 6953 originally caused by: Started by upstream project "master-libosmo-abis" build number 4951 originally caused by: Started by upstream project "master-libosmocore" build number 3066 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8942 originally caused by: Started by upstream project "master-osmo-mgw" build number 9174 originally caused by: Started by upstream project "master-libosmo-netif" build number 6954 originally caused by: Started by upstream project "master-libosmo-abis" build number 4952 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8697 originally caused by: Started by upstream project "master-osmo-hlr" build number 8831 originally caused by: Started by upstream project "master-libosmo-netif" build number 6954 originally caused by: Started by upstream project "master-libosmo-abis" build number 4952 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9237 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9107 originally caused by: Started by upstream project "master-libosmo-netif" build number 6954 originally caused by: Started by upstream project "master-libosmo-abis" build number 4952 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts" build number 7504 originally caused by: Started by upstream project "master-osmo-bts" build number 7565 originally caused by: Started by upstream project "master-libosmo-abis" build number 4952 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 originally caused by: Started by upstream project "master-osmo-bts" build number 7565 originally caused by: Started by upstream project "master-libosmo-abis" build number 4952 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 originally caused by: Started by upstream project "master-osmo-bts" build number 7565 originally caused by: Started by upstream project "master-libosmo-abis" build number 4952 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17650 originally caused by: Started by upstream project "master-osmo-bsc" build number 20103 originally caused by: Started by upstream project "master-osmo-mgw" build number 9174 originally caused by: Started by upstream project "master-libosmo-netif" build number 6954 originally caused by: Started by upstream project "master-libosmo-abis" build number 4952 originally caused by: Started by timer Started by upstream project "master-osmo-bsc" build number 20104 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9107 originally caused by: Started by upstream project "master-libosmo-netif" build number 6954 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30031 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37178 originally caused by: Started by upstream project "master-libosmo-netif" build number 6954 originally caused by: Started by upstream project "master-libosmo-abis" build number 4952 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37179 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9107 originally caused by: Started by upstream project "master-libosmo-netif" build number 6954 Started by upstream project "master-osmo-sgsn" build number 37180 originally caused by: Started by upstream project "master-osmo-iuh" build number 12845 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9107 Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17650 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6677 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8697 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8942 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2942 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29254 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5148 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30031 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4673 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12963 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9237 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4694 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5187 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3905 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins17068425844857234307.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 02:07:48 + trial_dir_prefix=trial- + rm -rf trial-2352 trial-2352-bin.tgz trial-2352-run.tgz + trial_dir=trial-2353 + mkdir -p trial-2353 + mv open5gs.build-8.tgz osmo-bsc.build-17650.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6677.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2942.tgz osmo-mgw.build-8942.tgz osmo-msc.build-29254.tgz osmo-nitb.build-12963.tgz osmo-pcu-oc2g.build-3905.tgz osmo-pcu-sysmo.build-5187.tgz osmo-pcu.build-5148.tgz osmo-sgsn.build-30031.tgz osmo-stp.build-9237.tgz osmo-trx.build-4673.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz trial-2353 + cat open5gs.build-8.md5 osmo-bsc.build-17650.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6677.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2942.md5 osmo-mgw.build-8942.md5 osmo-msc.build-29254.md5 osmo-nitb.build-12963.md5 osmo-pcu-oc2g.build-3905.md5 osmo-pcu-sysmo.build-5187.md5 osmo-pcu.build-5148.md5 osmo-sgsn.build-30031.md5 osmo-stp.build-9237.md5 osmo-trx.build-4673.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17650.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6677.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2942.md5 osmo-mgw.build-8942.md5 osmo-msc.build-29254.md5 osmo-nitb.build-12963.md5 osmo-pcu-oc2g.build-3905.md5 osmo-pcu-sysmo.build-5187.md5 osmo-pcu.build-5148.md5 osmo-sgsn.build-30031.md5 osmo-stp.build-9237.md5 osmo-trx.build-4673.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2353 combinations: None trial: 'trial-2353' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2353 -------------------------------------------------------------------------------------------- 02:07:59.399487 tst trial-2353: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/log --------------------------------------------------------------------- trial-2353 nitb_sms:sysmo --------------------------------------------------------------------- 02:10:08.297716 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:08.301312 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 02:10:08.322041 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 02:10:08.329646 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 02:10:08.384091 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 02:10:08.404873 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 02:10:08.411944 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 02:10:08.947527 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 02:10:08.952436 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 02:10:08.963271 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 02:10:09.336873 tst mo_mt_sms.py: using LAC 18337 02:10:09.573187 tst mo_mt_sms.py: using RAC 232 02:10:09.689312 tst mo_mt_sms.py: using CellId 18337 02:10:09.815462 tst mo_mt_sms.py: using BVCI 18338 02:10:09.931409 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 02:10:10.113488 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 02:10:10.234715 tst mo_mt_sms.py:9: start nitb and bts... 02:10:10.453119 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:10:12.813300 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10407): Launched 02:10:13.139969 run osmo-nitb_10.42.42.2(pid=10408): Launched 02:10:13.318258 run osmo-nitb_10.42.42.2(pid=10408): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10408)] 02:10:13.451411 run osmo-nitb_10.42.42.2(pid=10408): stdout: | (launched: 2022-12-09_02:10:13.078983) 02:10:13.585679 run osmo-nitb_10.42.42.2(pid=10408): stderr: | (launched: 2022-12-09_02:10:13.127831) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:10:13.719870 run osmo-nitb_10.42.42.2(pid=10408): stdout: | (launched: 2022-12-09_02:10:13.078983) 02:10:13.848751 run osmo-nitb_10.42.42.2(pid=10408): stderr: | (launched: 2022-12-09_02:10:13.127831) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:10:14.002659 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=10408): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10408) [trial-2353↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10408)] [trial-2353↪nitb_sms:sysmo↪mo_mt_sms.py:11] 02:10:14.011415 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 02:10:14.018353 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10407): Terminating (SIGTERM) 02:10:14.229167 --- ParallelTerminationStrategy: PID 10407 died... 02:10:14.250357 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10407): Terminated: ok {rc=0} 02:10:14.338724 bus /sierra_3: Setting Powered False 02:10:15.439299 bus /sierra_3: Setting Powered False 02:10:16.555363 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 sms:sysmo --------------------------------------------------------------------- 02:10:17.737680 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:17.741812 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 02:10:17.762461 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 02:10:17.790072 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 02:10:17.843574 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 02:10:17.864557 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 02:10:17.891544 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 02:10:18.436095 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 sms:sysmo mo_mt_sms.py ---------------------------------------------- 02:10:18.441535 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:10:18.452104 tst sms:sysmo: Using 1 x bts (candidates: 1) 02:10:18.489452 tst mo_mt_sms.py: using LAC 18338 02:10:18.611889 tst mo_mt_sms.py: using RAC 233 02:10:18.730984 tst mo_mt_sms.py: using CellId 18338 02:10:18.850675 tst mo_mt_sms.py: using BVCI 18339 02:10:18.962134 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:10:18.972657 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:10:18.983197 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:10:18.994003 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:10:19.004791 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:10:19.015533 tst sms:sysmo: Using 1 x modem (candidates: 2) 02:10:19.128552 tst sms:sysmo: Using 1 x modem (candidates: 2) 02:10:19.250970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:21.022699 run create_hlr_db(pid=10413): Launched 02:10:21.147738 bus /sierra_2: Setting Powered False 02:10:22.211070 run create_hlr_db(pid=10413): Terminated: ok {rc=0} 02:10:22.664919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10415): Launched 02:10:22.992797 run osmo-hlr_10.42.42.2(pid=10416): Launched 02:10:23.117457 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:25.691616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10418): Launched 02:10:26.018326 run osmo-stp_10.42.42.5(pid=10419): Launched 02:10:26.141914 run osmo-msc_10.42.42.6: Starting osmo-msc 02:10:31.653902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10421): Launched 02:10:31.980188 run osmo-msc_10.42.42.6(pid=10422): Launched 02:10:32.227970 run osmo-stp_10.42.42.5(pid=10419): ERR: Terminated: ERROR {rc=1} [trial-2353↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10419)] 02:10:32.458769 run osmo-stp_10.42.42.5(pid=10419): stdout: | (launched: 2022-12-09_02:10:25.957300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:32.587207 run osmo-stp_10.42.42.5(pid=10419): stderr: | 20221209021026152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021026152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021026153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021026153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021026154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021026154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021026154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:32.713333 run osmo-stp_10.42.42.5(pid=10419): stdout: | (launched: 2022-12-09_02:10:25.957300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:32.833906 run osmo-stp_10.42.42.5(pid=10419): stderr: | 20221209021026152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021026152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021026153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021026153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021026154 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021026154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021026154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:32.978296 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10419): Process ended prematurely: osmo-stp_10.42.42.5(pid=10419) [trial-2353↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10419)] [trial-2353↪sms:sysmo↪mo_mt_sms.py:16] 02:10:32.986710 tst mo_mt_sms.py:16: Test FAILED (14.5 sec) 02:10:33.012836 run osmo-hlr_10.42.42.2(pid=10416): ERR: Terminated: ERROR {rc=237} [trial-2353↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10416)] 02:10:33.060841 run osmo-hlr_10.42.42.2(pid=10416): stdout: | (launched: 2022-12-09_02:10:22.931557) 02:10:33.110656 run osmo-hlr_10.42.42.2(pid=10416): stderr: | 20221209021023136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021023136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021023136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021023136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021023136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021023136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021023149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021023157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021023157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021023157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:10:33.180236 run osmo-msc_10.42.42.6(pid=10422): ERR: Terminated: ERROR {rc=2} [trial-2353↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10422)] 02:10:33.228534 run osmo-msc_10.42.42.6(pid=10422): stdout: | (launched: 2022-12-09_02:10:31.917647) 02:10:33.278204 run osmo-msc_10.42.42.6(pid=10422): stderr: | 20221209021032381 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021032381 DLGLOBAL DEBUG validating counter group 0x7f112fac5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021032381 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021032382 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021032382 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021032382 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021032384 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021032384 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021032384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021032384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:10:33.328080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10415): Terminating (SIGTERM) 02:10:33.367850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10418): Terminating (SIGTERM) 02:10:33.407777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10421): Terminating (SIGTERM) 02:10:33.448087 --- ParallelTerminationStrategy: PID 10415 died... 02:10:33.467397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10415): Terminated: ok {rc=0} 02:10:33.511721 --- ParallelTerminationStrategy: PID 10418 died... 02:10:33.530681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10418): Terminated: ok {rc=0} 02:10:33.575196 --- ParallelTerminationStrategy: PID 10421 died... 02:10:33.594024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10421): Terminated: ok {rc=0} 02:10:33.680726 bus /sierra_3: Setting Powered False 02:10:34.781551 bus /sierra_3: Setting Powered False 02:10:35.898579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_ussd:sysmo --------------------------------------------------------------------- 02:10:37.113962 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:37.117562 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 02:10:37.138370 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 02:10:37.145222 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 02:10:37.179386 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 02:10:37.201046 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 02:10:37.207890 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 02:10:37.729462 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2353 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 02:10:37.734953 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 02:10:37.746420 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 02:10:37.782985 tst assert_extension.py: using LAC 18339 02:10:37.913840 tst assert_extension.py: using RAC 234 02:10:38.043550 tst assert_extension.py: using CellId 18339 02:10:38.171626 tst assert_extension.py: using BVCI 18340 02:10:38.291631 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 02:10:38.407613 tst assert_extension.py:10: start nitb and bts... 02:10:38.610368 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:10:39.230318 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10427): Launched 02:10:39.534428 run osmo-nitb_10.42.42.2(pid=10428): Launched 02:10:39.701376 run osmo-nitb_10.42.42.2(pid=10428): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10428)] 02:10:39.836137 run osmo-nitb_10.42.42.2(pid=10428): stdout: | (launched: 2022-12-09_02:10:39.476787) 02:10:39.972130 run osmo-nitb_10.42.42.2(pid=10428): stderr: | (launched: 2022-12-09_02:10:39.521977) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:10:40.108261 run osmo-nitb_10.42.42.2(pid=10428): stdout: | (launched: 2022-12-09_02:10:39.476787) 02:10:40.239017 run osmo-nitb_10.42.42.2(pid=10428): stderr: | (launched: 2022-12-09_02:10:39.521977) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10428): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10428) [trial-2353↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10428)] 02:10:40.648148 tst osmo-nitb_10.42.42.2(pid=10428): stdout: | (launched: 2022-12-09_02:10:39.476787) 02:10:40.770073 tst osmo-nitb_10.42.42.2(pid=10428): stderr: | (launched: 2022-12-09_02:10:39.521977) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:10:40.913950 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10428): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10428) [trial-2353↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10428)] [trial-2353↪nitb_ussd:sysmo↪assert_extension.py:12] 02:10:40.922367 tst assert_extension.py:12: Test FAILED (3.2 sec) 02:10:40.929156 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10427): Terminating (SIGTERM) 02:10:41.137870 --- ParallelTerminationStrategy: PID 10427 died... 02:10:41.158905 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10427): Terminated: ok {rc=0} 02:10:41.244101 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 ussd:sysmo --------------------------------------------------------------------- 02:10:42.407571 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:42.411858 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 02:10:42.433401 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 02:10:42.462089 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 02:10:42.496405 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 02:10:42.518083 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 02:10:42.546123 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 02:10:43.076048 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2353 ussd:sysmo assert_extension.py ---------------------------------------------- 02:10:43.081746 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:10:43.092934 tst ussd:sysmo: Using 1 x bts (candidates: 1) 02:10:43.133788 tst assert_extension.py: using LAC 18340 02:10:43.262363 tst assert_extension.py: using RAC 235 02:10:43.389943 tst assert_extension.py: using CellId 18340 02:10:43.517512 tst assert_extension.py: using BVCI 18341 02:10:43.629182 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:10:43.639983 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:10:43.651093 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:10:43.662314 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:10:43.673518 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:10:43.684433 tst ussd:sysmo: Using 1 x modem (candidates: 1) 02:10:43.804167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:44.311816 run create_hlr_db(pid=10432): Launched 02:10:44.435705 bus /sierra_2: Setting Powered False 02:10:45.499920 run create_hlr_db(pid=10432): Terminated: ok {rc=0} 02:10:45.966346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10434): Launched 02:10:46.292644 run osmo-hlr_10.42.42.2(pid=10435): Launched 02:10:46.532620 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:47.329459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10437): Launched 02:10:47.639818 run osmo-stp_10.42.42.5(pid=10438): Launched 02:10:47.754628 run osmo-msc_10.42.42.6: Starting osmo-msc 02:10:48.301177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10440): Launched 02:10:48.605401 run osmo-msc_10.42.42.6(pid=10441): Launched 02:10:48.774684 run osmo-stp_10.42.42.5(pid=10438): ERR: Terminated: ERROR {rc=1} [trial-2353↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10438)] 02:10:48.902960 run osmo-stp_10.42.42.5(pid=10438): stdout: | (launched: 2022-12-09_02:10:47.582191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:49.030799 run osmo-stp_10.42.42.5(pid=10438): stderr: | 20221209021047755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021047755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021047756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021047756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021047756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021047757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021047757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:49.157376 run osmo-stp_10.42.42.5(pid=10438): stdout: | (launched: 2022-12-09_02:10:47.582191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:49.277793 run osmo-stp_10.42.42.5(pid=10438): stderr: | 20221209021047755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021047755 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021047756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021047756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021047756 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021047757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021047757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:49.423280 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10438): Process ended prematurely: osmo-stp_10.42.42.5(pid=10438) [trial-2353↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10438)] [trial-2353↪ussd:sysmo↪assert_extension.py:17] 02:10:49.431576 tst assert_extension.py:17: Test FAILED (6.3 sec) 02:10:49.457488 run osmo-hlr_10.42.42.2(pid=10435): ERR: Terminated: ERROR {rc=237} [trial-2353↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10435)] 02:10:49.505339 run osmo-hlr_10.42.42.2(pid=10435): stdout: | (launched: 2022-12-09_02:10:46.230407) 02:10:49.554786 run osmo-hlr_10.42.42.2(pid=10435): stderr: | 20221209021046514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021046514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021046515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021046515 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021046515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021046515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021046535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021046553 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021046554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021046554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:10:49.623402 run osmo-msc_10.42.42.6(pid=10441): ERR: Terminated: ERROR {rc=2} [trial-2353↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10441)] 02:10:49.671140 run osmo-msc_10.42.42.6(pid=10441): stdout: | (launched: 2022-12-09_02:10:48.547456) 02:10:49.720416 run osmo-msc_10.42.42.6(pid=10441): stderr: | 20221209021048824 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021048824 DLGLOBAL DEBUG validating counter group 0x7f23e9e62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021048824 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021048824 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021048824 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021048825 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021048827 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021048827 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021048828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021048828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:10:49.770216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10434): Terminating (SIGTERM) 02:10:49.809974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10437): Terminating (SIGTERM) 02:10:49.849462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10440): Terminating (SIGTERM) 02:10:49.889628 --- ParallelTerminationStrategy: PID 10434 died... 02:10:49.908766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10434): Terminated: ok {rc=0} 02:10:49.952941 --- ParallelTerminationStrategy: PID 10437 died... 02:10:49.971849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10437): Terminated: ok {rc=0} 02:10:50.015987 --- ParallelTerminationStrategy: PID 10440 died... 02:10:50.034645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10440): Terminated: ok {rc=0} 02:10:50.118335 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:10:51.320408 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:51.327598 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:10:51.350032 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:10:51.379026 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:10:51.432892 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:10:51.454535 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:10:51.482514 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:10:52.034003 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:10:52.089009 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:52.101202 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:10:52.162754 tst mo_mt_call.py: using LAC 18341 02:10:52.283583 tst mo_mt_call.py: using RAC 236 02:10:52.404533 tst mo_mt_call.py: using CellId 18341 02:10:52.524526 tst mo_mt_call.py: using BVCI 18342 02:10:52.636202 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:52.647610 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:52.658688 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:52.669699 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:52.680643 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:52.691633 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:10:52.813295 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:10:52.934581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:53.450687 run create_hlr_db(pid=10446): Launched 02:10:53.576330 bus /sierra_2: Setting Powered False 02:10:54.641460 run create_hlr_db(pid=10446): Terminated: ok {rc=0} 02:10:55.102324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10448): Launched 02:10:55.435234 run osmo-hlr_10.42.42.2(pid=10449): Launched 02:10:55.562596 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:56.137330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10451): Launched 02:10:56.469556 run osmo-stp_10.42.42.5(pid=10452): Launched 02:10:56.596862 run osmo-msc_10.42.42.6: Starting osmo-msc 02:10:57.196466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10454): Launched 02:10:57.532519 run osmo-msc_10.42.42.6(pid=10455): Launched 02:10:57.718529 run osmo-stp_10.42.42.5(pid=10452): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10452)] 02:10:57.859378 run osmo-stp_10.42.42.5(pid=10452): stdout: | (launched: 2022-12-09_02:10:56.407487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:57.999545 run osmo-stp_10.42.42.5(pid=10452): stderr: | 20221209021056602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021056602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021056603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021056603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021056604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021056604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021056604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:58.137607 run osmo-stp_10.42.42.5(pid=10452): stdout: | (launched: 2022-12-09_02:10:56.407487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:58.269406 run osmo-stp_10.42.42.5(pid=10452): stderr: | 20221209021056602 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021056602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021056603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021056603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021056604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021056604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021056604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:58.427021 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10452): Process ended prematurely: osmo-stp_10.42.42.5(pid=10452) [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10452)] [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:10:58.436601 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 02:10:58.464900 run osmo-hlr_10.42.42.2(pid=10449): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10449)] 02:10:58.515506 run osmo-hlr_10.42.42.2(pid=10449): stdout: | (launched: 2022-12-09_02:10:55.373015) 02:10:58.567840 run osmo-hlr_10.42.42.2(pid=10449): stderr: | 20221209021055573 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021055574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021055574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021055574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021055574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021055574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021055589 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021055597 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021055597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021055597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:10:58.640575 run osmo-msc_10.42.42.6(pid=10455): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10455)] 02:10:58.691202 run osmo-msc_10.42.42.6(pid=10455): stdout: | (launched: 2022-12-09_02:10:57.470486) 02:10:58.743619 run osmo-msc_10.42.42.6(pid=10455): stderr: | 20221209021057791 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021057791 DLGLOBAL DEBUG validating counter group 0x7fc0c3627c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021057791 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021057791 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021057791 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021057791 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021057793 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021057793 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021057794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021057794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:10:58.796338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10448): Terminating (SIGTERM) 02:10:58.838964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10451): Terminating (SIGTERM) 02:10:58.881511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10454): Terminating (SIGTERM) 02:10:58.924056 --- ParallelTerminationStrategy: PID 10448 died... 02:10:58.944051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10448): Terminated: ok {rc=0} 02:10:58.991066 --- ParallelTerminationStrategy: PID 10451 died... 02:10:59.010752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10451): Terminated: ok {rc=0} 02:10:59.057774 --- ParallelTerminationStrategy: PID 10454 died... 02:10:59.077311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10454): Terminated: ok {rc=0} 02:10:59.166311 bus /sierra_3: Setting Powered False 02:11:00.264158 bus /sierra_3: Setting Powered False 02:11:01.379099 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:11:02.524505 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:11:02.536561 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:11:02.598584 tst mo_mt_call_osmux.py: using LAC 18342 02:11:02.838725 tst mo_mt_call_osmux.py: using RAC 237 02:11:02.968642 tst mo_mt_call_osmux.py: using CellId 18342 02:11:03.089742 tst mo_mt_call_osmux.py: using BVCI 18343 02:11:03.201846 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:11:03.213247 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:11:03.224371 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:11:03.235375 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:11:03.246664 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:11:03.257761 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:11:03.375232 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:11:03.498568 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:04.017940 run create_hlr_db(pid=10458): Launched 02:11:04.147138 bus /sierra_2: Setting Powered False 02:11:05.212497 run create_hlr_db(pid=10458): Terminated: ok {rc=0} 02:11:05.658312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10460): Launched 02:11:05.970526 run osmo-hlr_10.42.42.2(pid=10461): Launched 02:11:06.087860 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:06.623067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10463): Launched 02:11:06.933624 run osmo-stp_10.42.42.5(pid=10464): Launched 02:11:07.051230 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:07.612815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10466): Launched 02:11:07.923857 run osmo-msc_10.42.42.6(pid=10467): Launched 02:11:08.096846 run osmo-stp_10.42.42.5(pid=10464): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10464)] 02:11:08.227011 run osmo-stp_10.42.42.5(pid=10464): stdout: | (launched: 2022-12-09_02:11:06.874827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:08.356920 run osmo-stp_10.42.42.5(pid=10464): stderr: | 20221209021107047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021107047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021107047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021107048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021107051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021107051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021107051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:08.485923 run osmo-stp_10.42.42.5(pid=10464): stdout: | (launched: 2022-12-09_02:11:06.874827) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:08.608573 run osmo-stp_10.42.42.5(pid=10464): stderr: | 20221209021107047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021107047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021107047 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021107048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021107051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021107051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021107051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:08.755920 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10464): Process ended prematurely: osmo-stp_10.42.42.5(pid=10464) [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10464)] [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:11:08.765035 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:11:08.791419 run osmo-hlr_10.42.42.2(pid=10461): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10461)] 02:11:08.839492 run osmo-hlr_10.42.42.2(pid=10461): stdout: | (launched: 2022-12-09_02:11:05.911550) 02:11:08.889494 run osmo-hlr_10.42.42.2(pid=10461): stderr: | 20221209021106091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021106092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021106092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021106092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021106092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021106092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021106293 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021106302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021106303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021106303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:08.958630 run osmo-msc_10.42.42.6(pid=10467): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10467)] 02:11:09.006598 run osmo-msc_10.42.42.6(pid=10467): stdout: | (launched: 2022-12-09_02:11:07.864746) 02:11:09.055909 run osmo-msc_10.42.42.6(pid=10467): stderr: | 20221209021108141 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021108141 DLGLOBAL DEBUG validating counter group 0x7fcb3cebcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021108142 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021108142 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021108142 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021108142 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021108144 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021108144 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021108144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021108144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:09.105732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10460): Terminating (SIGTERM) 02:11:09.145548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10463): Terminating (SIGTERM) 02:11:09.185389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10466): Terminating (SIGTERM) 02:11:09.225418 --- ParallelTerminationStrategy: PID 10460 died... 02:11:09.244452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10460): Terminated: ok {rc=0} 02:11:09.288543 --- ParallelTerminationStrategy: PID 10463 died... 02:11:09.307421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10463): Terminated: ok {rc=0} 02:11:09.351695 --- ParallelTerminationStrategy: PID 10466 died... 02:11:09.370451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10466): Terminated: ok {rc=0} 02:11:09.454867 bus /sierra_3: Setting Powered False 02:11:10.554389 bus /sierra_3: Setting Powered False 02:11:11.671020 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:11:12.909121 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:11:12.916071 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:11:12.937627 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:11:12.967719 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:11:13.021388 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:11:13.042883 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:11:13.071838 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:11:13.628174 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:11:13.682658 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:13.694293 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:11:13.753395 tst mo_mt_call.py: using LAC 18343 02:11:13.885886 tst mo_mt_call.py: using RAC 238 02:11:14.017047 tst mo_mt_call.py: using CellId 18343 02:11:14.141151 tst mo_mt_call.py: using BVCI 18344 02:11:14.255115 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:14.266756 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:14.277855 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:14.288856 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:14.300070 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:14.311007 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:11:14.432195 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:11:14.552011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:15.035445 run create_hlr_db(pid=10473): Launched 02:11:15.161531 bus /sierra_2: Setting Powered False 02:11:16.251437 run create_hlr_db(pid=10473): Terminated: ok {rc=0} 02:11:16.773633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10475): Launched 02:11:17.109283 run osmo-hlr_10.42.42.2(pid=10476): Launched 02:11:17.270216 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:17.823418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10478): Launched 02:11:18.134095 run osmo-stp_10.42.42.5(pid=10479): Launched 02:11:18.251528 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:18.811307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10481): Launched 02:11:19.121854 run osmo-msc_10.42.42.6(pid=10482): Launched 02:11:19.293256 run osmo-stp_10.42.42.5(pid=10479): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10479)] 02:11:19.423325 run osmo-stp_10.42.42.5(pid=10479): stdout: | (launched: 2022-12-09_02:11:18.075302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:19.552152 run osmo-stp_10.42.42.5(pid=10479): stderr: | 20221209021118249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021118250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021118251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021118251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021118251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021118252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021118252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:19.680759 run osmo-stp_10.42.42.5(pid=10479): stdout: | (launched: 2022-12-09_02:11:18.075302) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:19.803192 run osmo-stp_10.42.42.5(pid=10479): stderr: | 20221209021118249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021118250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021118251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021118251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021118251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021118252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021118252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:19.949845 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10479): Process ended prematurely: osmo-stp_10.42.42.5(pid=10479) [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10479)] [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:11:19.958539 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:11:19.984644 run osmo-hlr_10.42.42.2(pid=10476): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10476)] 02:11:20.032009 run osmo-hlr_10.42.42.2(pid=10476): stdout: | (launched: 2022-12-09_02:11:17.044420) 02:11:20.081189 run osmo-hlr_10.42.42.2(pid=10476): stderr: | 20221209021117326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021117326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021117327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021117327 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021117327 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021117327 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021117339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021117348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021117348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021117348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:20.149496 run osmo-msc_10.42.42.6(pid=10482): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10482)] 02:11:20.196708 run osmo-msc_10.42.42.6(pid=10482): stdout: | (launched: 2022-12-09_02:11:19.062759) 02:11:20.245868 run osmo-msc_10.42.42.6(pid=10482): stderr: | 20221209021119341 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021119341 DLGLOBAL DEBUG validating counter group 0x7f6746ce3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021119342 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021119342 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021119342 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021119342 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021119344 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021119346 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021119346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021119346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:20.295340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10475): Terminating (SIGTERM) 02:11:20.334643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10478): Terminating (SIGTERM) 02:11:20.373882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10481): Terminating (SIGTERM) 02:11:20.413380 --- ParallelTerminationStrategy: PID 10475 died... 02:11:20.431999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10475): Terminated: ok {rc=0} 02:11:20.475467 --- ParallelTerminationStrategy: PID 10478 died... 02:11:20.493791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10478): Terminated: ok {rc=0} 02:11:20.537670 --- ParallelTerminationStrategy: PID 10481 died... 02:11:20.556161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10481): Terminated: ok {rc=0} 02:11:20.640592 bus /sierra_3: Setting Powered False 02:11:21.739400 bus /sierra_3: Setting Powered False 02:11:22.859558 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:11:24.011956 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:24.024449 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:11:24.083566 tst mo_mt_call_osmux.py: using LAC 18344 02:11:24.214804 tst mo_mt_call_osmux.py: using RAC 239 02:11:24.346807 tst mo_mt_call_osmux.py: using CellId 18344 02:11:24.479381 tst mo_mt_call_osmux.py: using BVCI 18345 02:11:24.600132 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:24.611839 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:24.623252 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:24.634873 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:24.646718 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:24.658824 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:11:24.778068 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:11:24.896844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:25.415765 run create_hlr_db(pid=10484): Launched 02:11:25.541106 bus /sierra_2: Setting Powered False 02:11:26.606321 run create_hlr_db(pid=10484): Terminated: ok {rc=0} 02:11:27.050347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10486): Launched 02:11:27.363580 run osmo-hlr_10.42.42.2(pid=10487): Launched 02:11:27.482006 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:28.017323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10489): Launched 02:11:28.327612 run osmo-stp_10.42.42.5(pid=10490): Launched 02:11:28.445573 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:29.005837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10492): Launched 02:11:29.316601 run osmo-msc_10.42.42.6(pid=10493): Launched 02:11:29.488255 run osmo-stp_10.42.42.5(pid=10490): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10490)] 02:11:29.618357 run osmo-stp_10.42.42.5(pid=10490): stdout: | (launched: 2022-12-09_02:11:28.269234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:29.749258 run osmo-stp_10.42.42.5(pid=10490): stderr: | 20221209021128443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021128443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021128443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021128443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021128444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021128444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021128444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:29.877357 run osmo-stp_10.42.42.5(pid=10490): stdout: | (launched: 2022-12-09_02:11:28.269234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:29.999748 run osmo-stp_10.42.42.5(pid=10490): stderr: | 20221209021128443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021128443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021128443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021128443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021128444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021128444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021128444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:30.146774 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10490): Process ended prematurely: osmo-stp_10.42.42.5(pid=10490) [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10490)] [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:11:30.155868 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:11:30.182198 run osmo-hlr_10.42.42.2(pid=10487): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10487)] 02:11:30.229849 run osmo-hlr_10.42.42.2(pid=10487): stdout: | (launched: 2022-12-09_02:11:27.304312) 02:11:30.279128 run osmo-hlr_10.42.42.2(pid=10487): stderr: | 20221209021127486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021127486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021127486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021127486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021127486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021127486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021127499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021127509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021127509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021127509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:30.347749 run osmo-msc_10.42.42.6(pid=10493): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10493)] 02:11:30.395383 run osmo-msc_10.42.42.6(pid=10493): stdout: | (launched: 2022-12-09_02:11:29.257900) 02:11:30.444341 run osmo-msc_10.42.42.6(pid=10493): stderr: | 20221209021129537 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021129537 DLGLOBAL DEBUG validating counter group 0x7fdccbbb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021129537 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021129537 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021129537 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021129537 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021129539 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021129540 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021129540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021129540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:30.493887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10486): Terminating (SIGTERM) 02:11:30.533441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10489): Terminating (SIGTERM) 02:11:30.572808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10492): Terminating (SIGTERM) 02:11:30.612470 --- ParallelTerminationStrategy: PID 10486 died... 02:11:30.631395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10486): Terminated: ok {rc=0} 02:11:30.675343 --- ParallelTerminationStrategy: PID 10489 died... 02:11:30.694036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10489): Terminated: ok {rc=0} 02:11:30.737825 --- ParallelTerminationStrategy: PID 10492 died... 02:11:30.756561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10492): Terminated: ok {rc=0} 02:11:30.845304 bus /sierra_3: Setting Powered False 02:11:31.957256 bus /sierra_3: Setting Powered False 02:11:33.077643 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:11:34.315060 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:11:34.322009 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:11:34.344117 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:11:34.372828 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:11:34.425198 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:11:34.446700 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:11:34.474594 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:11:35.027240 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:11:35.080744 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:35.092337 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:11:35.148687 tst mo_mt_call.py: using LAC 18345 02:11:35.278903 tst mo_mt_call.py: using RAC 240 02:11:35.406991 tst mo_mt_call.py: using CellId 18345 02:11:35.534993 tst mo_mt_call.py: using BVCI 18346 02:11:35.655708 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:35.667524 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:35.678942 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:35.690966 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:35.702428 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:35.714069 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:11:35.835465 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:11:35.951110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:36.435132 run create_hlr_db(pid=10499): Launched 02:11:36.561973 bus /sierra_2: Setting Powered False 02:11:37.623152 run create_hlr_db(pid=10499): Terminated: ok {rc=0} 02:11:38.078016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10501): Launched 02:11:38.414030 run osmo-hlr_10.42.42.2(pid=10502): Launched 02:11:38.541520 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:39.117039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10504): Launched 02:11:39.450615 run osmo-stp_10.42.42.5(pid=10505): Launched 02:11:39.577867 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:40.169871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10507): Launched 02:11:40.482604 run osmo-msc_10.42.42.6(pid=10508): Launched 02:11:40.656274 run osmo-stp_10.42.42.5(pid=10505): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10505)] 02:11:40.787405 run osmo-stp_10.42.42.5(pid=10505): stdout: | (launched: 2022-12-09_02:11:39.388240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:40.918290 run osmo-stp_10.42.42.5(pid=10505): stderr: | 20221209021139585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021139585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021139585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021139586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021139586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021139586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021139586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:41.046831 run osmo-stp_10.42.42.5(pid=10505): stdout: | (launched: 2022-12-09_02:11:39.388240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:41.170132 run osmo-stp_10.42.42.5(pid=10505): stderr: | 20221209021139585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021139585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021139585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021139586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021139586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021139586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021139586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:41.317554 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10505): Process ended prematurely: osmo-stp_10.42.42.5(pid=10505) [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10505)] [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:11:41.326426 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:11:41.353276 run osmo-hlr_10.42.42.2(pid=10502): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10502)] 02:11:41.401475 run osmo-hlr_10.42.42.2(pid=10502): stdout: | (launched: 2022-12-09_02:11:38.351679) 02:11:41.451155 run osmo-hlr_10.42.42.2(pid=10502): stderr: | 20221209021138553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021138553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021138553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021138553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021138553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021138553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021138565 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021138574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021138574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021138574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:41.520416 run osmo-msc_10.42.42.6(pid=10508): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10508)] 02:11:41.568369 run osmo-msc_10.42.42.6(pid=10508): stdout: | (launched: 2022-12-09_02:11:40.423422) 02:11:41.617818 run osmo-msc_10.42.42.6(pid=10508): stderr: | 20221209021140697 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021140697 DLGLOBAL DEBUG validating counter group 0x7fe970f99c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021140698 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021140698 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021140698 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021140698 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021140700 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021140700 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021140700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021140700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:41.667416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10501): Terminating (SIGTERM) 02:11:41.706887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10504): Terminating (SIGTERM) 02:11:41.746310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10507): Terminating (SIGTERM) 02:11:41.786539 --- ParallelTerminationStrategy: PID 10501 died... 02:11:41.805738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10501): Terminated: ok {rc=0} 02:11:41.849904 --- ParallelTerminationStrategy: PID 10504 died... 02:11:41.869168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10504): Terminated: ok {rc=0} 02:11:41.913234 --- ParallelTerminationStrategy: PID 10507 died... 02:11:41.931785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10507): Terminated: ok {rc=0} 02:11:42.018107 bus /sierra_3: Setting Powered False 02:11:43.117333 bus /sierra_3: Setting Powered False 02:11:44.233048 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:11:45.380449 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:45.392497 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:11:45.449847 tst mo_mt_call_osmux.py: using LAC 18346 02:11:45.581413 tst mo_mt_call_osmux.py: using RAC 241 02:11:45.715512 tst mo_mt_call_osmux.py: using CellId 18346 02:11:45.849094 tst mo_mt_call_osmux.py: using BVCI 18347 02:11:45.983032 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:45.995805 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:46.009320 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:46.021862 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:46.034925 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:46.048109 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:11:46.196761 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:11:46.349738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:46.891730 run create_hlr_db(pid=10510): Launched 02:11:47.055413 bus /sierra_2: Setting Powered False 02:11:48.115527 run create_hlr_db(pid=10510): Terminated: ok {rc=0} 02:11:48.571804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10512): Launched 02:11:48.907276 run osmo-hlr_10.42.42.2(pid=10513): Launched 02:11:49.035218 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:49.610822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10515): Launched 02:11:49.945734 run osmo-stp_10.42.42.5(pid=10516): Launched 02:11:50.066726 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:50.647662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10518): Launched 02:11:50.960181 run osmo-msc_10.42.42.6(pid=10519): Launched 02:11:51.133306 run osmo-stp_10.42.42.5(pid=10516): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10516)] 02:11:51.263696 run osmo-stp_10.42.42.5(pid=10516): stdout: | (launched: 2022-12-09_02:11:49.883290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:51.394641 run osmo-stp_10.42.42.5(pid=10516): stderr: | 20221209021150058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021150058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021150058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021150058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021150061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021150061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021150061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:51.523560 run osmo-stp_10.42.42.5(pid=10516): stdout: | (launched: 2022-12-09_02:11:49.883290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:51.647234 run osmo-stp_10.42.42.5(pid=10516): stderr: | 20221209021150058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021150058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021150058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021150058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021150061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021150061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021150061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:51.795305 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10516): Process ended prematurely: osmo-stp_10.42.42.5(pid=10516) [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10516)] [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:11:51.804424 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 02:11:51.831127 run osmo-hlr_10.42.42.2(pid=10513): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10513)] 02:11:51.879837 run osmo-hlr_10.42.42.2(pid=10513): stdout: | (launched: 2022-12-09_02:11:48.844103) 02:11:51.929745 run osmo-hlr_10.42.42.2(pid=10513): stderr: | 20221209021149047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021149047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021149047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021149047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021149047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021149048 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021149061 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021149069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021149070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021149070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:51.999565 run osmo-msc_10.42.42.6(pid=10519): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10519)] 02:11:52.048009 run osmo-msc_10.42.42.6(pid=10519): stdout: | (launched: 2022-12-09_02:11:50.901295) 02:11:52.097952 run osmo-msc_10.42.42.6(pid=10519): stderr: | 20221209021151176 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021151177 DLGLOBAL DEBUG validating counter group 0x7ff3d7e02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021151177 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021151177 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021151177 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021151177 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021151179 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021151179 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021151179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021151180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:52.148171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10512): Terminating (SIGTERM) 02:11:52.188374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10515): Terminating (SIGTERM) 02:11:52.228444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10518): Terminating (SIGTERM) 02:11:52.269274 --- ParallelTerminationStrategy: PID 10512 died... 02:11:52.288609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10512): Terminated: ok {rc=0} 02:11:52.332927 --- ParallelTerminationStrategy: PID 10515 died... 02:11:52.352003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10515): Terminated: ok {rc=0} 02:11:52.396336 --- ParallelTerminationStrategy: PID 10518 died... 02:11:52.415266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10518): Terminated: ok {rc=0} 02:11:52.499422 bus /sierra_3: Setting Powered False 02:11:53.598667 bus /sierra_3: Setting Powered False 02:11:54.716836 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:11:55.959858 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:11:55.967310 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:11:55.988022 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:11:56.014875 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:11:56.067126 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:11:56.088028 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:11:56.114599 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:11:56.665559 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:11:56.714663 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:56.725871 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:11:56.782043 tst mo_mt_call.py: using LAC 18347 02:11:56.905481 tst mo_mt_call.py: using RAC 242 02:11:57.026630 tst mo_mt_call.py: using CellId 18347 02:11:57.153726 tst mo_mt_call.py: using BVCI 18348 02:11:57.267151 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:57.278341 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:57.289389 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:57.300296 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:57.311501 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:57.322669 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:11:57.442189 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:11:57.561543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:58.079579 run create_hlr_db(pid=10524): Launched 02:11:58.205605 bus /sierra_2: Setting Powered False 02:11:59.270615 run create_hlr_db(pid=10524): Terminated: ok {rc=0} 02:11:59.712584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10526): Launched 02:12:00.023793 run osmo-hlr_10.42.42.2(pid=10527): Launched 02:12:00.141184 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:00.678229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10529): Launched 02:12:01.001639 run osmo-stp_10.42.42.5(pid=10530): Launched 02:12:01.229171 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:02.055142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10532): Launched 02:12:02.404759 run osmo-msc_10.42.42.6(pid=10533): Launched 02:12:02.592207 run osmo-stp_10.42.42.5(pid=10530): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10530)] 02:12:02.733846 run osmo-stp_10.42.42.5(pid=10530): stdout: | (launched: 2022-12-09_02:12:00.938593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:02.876005 run osmo-stp_10.42.42.5(pid=10530): stderr: | 20221209021201366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021201367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021201369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021201371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021201373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021201374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021201374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:03.014645 run osmo-stp_10.42.42.5(pid=10530): stdout: | (launched: 2022-12-09_02:12:00.938593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:03.147025 run osmo-stp_10.42.42.5(pid=10530): stderr: | 20221209021201366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021201367 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021201369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021201371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021201373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021201374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021201374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:03.304889 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10530): Process ended prematurely: osmo-stp_10.42.42.5(pid=10530) [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10530)] [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:12:03.314594 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 02:12:03.342744 run osmo-hlr_10.42.42.2(pid=10527): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10527)] 02:12:03.393342 run osmo-hlr_10.42.42.2(pid=10527): stdout: | (launched: 2022-12-09_02:11:59.965241) 02:12:03.445440 run osmo-hlr_10.42.42.2(pid=10527): stderr: | 20221209021200145 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021200145 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021200145 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021200145 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021200145 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021200145 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021200156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021200165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021200165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021200165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:03.517664 run osmo-msc_10.42.42.6(pid=10533): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10533)] 02:12:03.568086 run osmo-msc_10.42.42.6(pid=10533): stdout: | (launched: 2022-12-09_02:12:02.342362) 02:12:03.620172 run osmo-msc_10.42.42.6(pid=10533): stderr: | 20221209021202666 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021202666 DLGLOBAL DEBUG validating counter group 0x7fca5f196c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021202666 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021202666 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021202666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021202666 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021202668 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021202668 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021202669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021202669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:03.672659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10526): Terminating (SIGTERM) 02:12:03.714616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10529): Terminating (SIGTERM) 02:12:03.756510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10532): Terminating (SIGTERM) 02:12:03.798942 --- ParallelTerminationStrategy: PID 10526 died... 02:12:03.818931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10526): Terminated: ok {rc=0} 02:12:03.865884 --- ParallelTerminationStrategy: PID 10529 died... 02:12:03.885421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10529): Terminated: ok {rc=0} 02:12:03.931731 --- ParallelTerminationStrategy: PID 10532 died... 02:12:03.951310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10532): Terminated: ok {rc=0} 02:12:04.039889 bus /sierra_3: Setting Powered False 02:12:05.139394 bus /sierra_3: Setting Powered False 02:12:06.255802 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:12:07.406636 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:12:07.419030 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:12:07.477435 tst mo_mt_call_osmux.py: using LAC 18348 02:12:07.609421 tst mo_mt_call_osmux.py: using RAC 243 02:12:07.733512 tst mo_mt_call_osmux.py: using CellId 18348 02:12:07.856596 tst mo_mt_call_osmux.py: using BVCI 18349 02:12:07.969592 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:12:07.981298 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:12:07.992434 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:12:08.003821 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:12:08.014962 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:12:08.026126 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:12:08.145952 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:12:08.265518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:08.749424 run create_hlr_db(pid=10535): Launched 02:12:08.875699 bus /sierra_2: Setting Powered False 02:12:09.936167 run create_hlr_db(pid=10535): Terminated: ok {rc=0} 02:12:10.370003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10537): Launched 02:12:10.681954 run osmo-hlr_10.42.42.2(pid=10538): Launched 02:12:10.799728 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:11.352176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10540): Launched 02:12:11.663637 run osmo-stp_10.42.42.5(pid=10541): Launched 02:12:11.781921 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:12.343491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10543): Launched 02:12:12.654549 run osmo-msc_10.42.42.6(pid=10544): Launched 02:12:12.827576 run osmo-stp_10.42.42.5(pid=10541): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10541)] 02:12:12.957882 run osmo-stp_10.42.42.5(pid=10541): stdout: | (launched: 2022-12-09_02:12:11.604777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:13.087898 run osmo-stp_10.42.42.5(pid=10541): stderr: | 20221209021211779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021211779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021211779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021211780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021211780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021211780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021211780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:13.216213 run osmo-stp_10.42.42.5(pid=10541): stdout: | (launched: 2022-12-09_02:12:11.604777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:13.339203 run osmo-stp_10.42.42.5(pid=10541): stderr: | 20221209021211779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021211779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021211779 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021211780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021211780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021211780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021211780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:13.486445 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10541): Process ended prematurely: osmo-stp_10.42.42.5(pid=10541) [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10541)] [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:12:13.495593 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:12:13.522020 run osmo-hlr_10.42.42.2(pid=10538): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10538)] 02:12:13.569664 run osmo-hlr_10.42.42.2(pid=10538): stdout: | (launched: 2022-12-09_02:12:10.622995) 02:12:13.618991 run osmo-hlr_10.42.42.2(pid=10538): stderr: | 20221209021210803 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021210803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021210803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021210803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021210803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021210803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021210815 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021210825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021210825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021210825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:13.687693 run osmo-msc_10.42.42.6(pid=10544): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10544)] 02:12:13.735126 run osmo-msc_10.42.42.6(pid=10544): stdout: | (launched: 2022-12-09_02:12:12.595840) 02:12:13.784692 run osmo-msc_10.42.42.6(pid=10544): stderr: | 20221209021212874 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021212874 DLGLOBAL DEBUG validating counter group 0x7f945a30fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021212874 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021212874 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021212874 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021212875 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021212876 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021212877 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021212877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021212877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:13.834208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10537): Terminating (SIGTERM) 02:12:13.873503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10540): Terminating (SIGTERM) 02:12:13.912869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10543): Terminating (SIGTERM) 02:12:13.952658 --- ParallelTerminationStrategy: PID 10537 died... 02:12:13.971808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10537): Terminated: ok {rc=0} 02:12:14.015694 --- ParallelTerminationStrategy: PID 10540 died... 02:12:14.034596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10540): Terminated: ok {rc=0} 02:12:14.078352 --- ParallelTerminationStrategy: PID 10543 died... 02:12:14.096851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10543): Terminated: ok {rc=0} 02:12:14.180663 bus /sierra_3: Setting Powered False 02:12:15.278605 bus /sierra_3: Setting Powered False 02:12:16.415778 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:12:17.650626 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:12:17.657137 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:12:17.678182 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:12:17.705137 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:12:17.758188 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:12:17.779414 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:12:17.806288 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:12:18.354792 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:12:18.404222 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:18.415317 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:12:18.471708 tst mo_mt_call.py: using LAC 18349 02:12:18.595110 tst mo_mt_call.py: using RAC 244 02:12:18.718817 tst mo_mt_call.py: using CellId 18349 02:12:18.842049 tst mo_mt_call.py: using BVCI 18350 02:12:18.954817 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:18.966053 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:18.976998 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:18.987888 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:18.998922 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:19.009982 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:12:19.129666 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:12:19.251099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:19.768331 run create_hlr_db(pid=10549): Launched 02:12:19.896346 bus /sierra_2: Setting Powered False 02:12:20.960813 run create_hlr_db(pid=10549): Terminated: ok {rc=0} 02:12:21.403532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10551): Launched 02:12:21.715497 run osmo-hlr_10.42.42.2(pid=10552): Launched 02:12:21.833527 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:22.367985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10554): Launched 02:12:22.678740 run osmo-stp_10.42.42.5(pid=10555): Launched 02:12:22.797171 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:23.357802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10557): Launched 02:12:23.668753 run osmo-msc_10.42.42.6(pid=10558): Launched 02:12:23.841159 run osmo-stp_10.42.42.5(pid=10555): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10555)] 02:12:23.971195 run osmo-stp_10.42.42.5(pid=10555): stdout: | (launched: 2022-12-09_02:12:22.620201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:24.101370 run osmo-stp_10.42.42.5(pid=10555): stderr: | 20221209021222793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021222793 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021222794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021222794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021222795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021222795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021222795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:24.230527 run osmo-stp_10.42.42.5(pid=10555): stdout: | (launched: 2022-12-09_02:12:22.620201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:24.353692 run osmo-stp_10.42.42.5(pid=10555): stderr: | 20221209021222793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021222793 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021222794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021222794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021222795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021222795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021222795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:24.500800 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10555): Process ended prematurely: osmo-stp_10.42.42.5(pid=10555) [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10555)] [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:12:24.509598 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:12:24.535753 run osmo-hlr_10.42.42.2(pid=10552): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10552)] 02:12:24.583202 run osmo-hlr_10.42.42.2(pid=10552): stdout: | (launched: 2022-12-09_02:12:21.656778) 02:12:24.632361 run osmo-hlr_10.42.42.2(pid=10552): stderr: | 20221209021221835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021221835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021221835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021221835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021221835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021221835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021221847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021221856 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021221857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021221857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:24.700503 run osmo-msc_10.42.42.6(pid=10558): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10558)] 02:12:24.748246 run osmo-msc_10.42.42.6(pid=10558): stdout: | (launched: 2022-12-09_02:12:23.609502) 02:12:24.797483 run osmo-msc_10.42.42.6(pid=10558): stderr: | 20221209021223884 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021223884 DLGLOBAL DEBUG validating counter group 0x7f81bdbfcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021223884 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021223884 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021223885 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021223885 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021223886 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021223887 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021223887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021223887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:24.846910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10551): Terminating (SIGTERM) 02:12:24.887101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10554): Terminating (SIGTERM) 02:12:24.926721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10557): Terminating (SIGTERM) 02:12:24.966552 --- ParallelTerminationStrategy: PID 10551 died... 02:12:24.985534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10551): Terminated: ok {rc=0} 02:12:25.029362 --- ParallelTerminationStrategy: PID 10554 died... 02:12:25.048068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10554): Terminated: ok {rc=0} 02:12:25.091933 --- ParallelTerminationStrategy: PID 10557 died... 02:12:25.110512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10557): Terminated: ok {rc=0} 02:12:25.196688 bus /sierra_3: Setting Powered False 02:12:26.298090 bus /sierra_3: Setting Powered False 02:12:27.414758 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:12:28.566094 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:28.578458 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:12:28.637381 tst mo_mt_call_osmux.py: using LAC 18350 02:12:28.769238 tst mo_mt_call_osmux.py: using RAC 245 02:12:28.901621 tst mo_mt_call_osmux.py: using CellId 18350 02:12:29.024096 tst mo_mt_call_osmux.py: using BVCI 18351 02:12:29.136801 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:29.148136 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:29.159415 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:29.170480 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:29.181392 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:29.192911 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:12:29.314355 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:12:29.438658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:29.924388 run create_hlr_db(pid=10560): Launched 02:12:30.049569 bus /sierra_2: Setting Powered False 02:12:31.109761 run create_hlr_db(pid=10560): Terminated: ok {rc=0} 02:12:31.556764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10562): Launched 02:12:31.901666 run osmo-hlr_10.42.42.2(pid=10563): Launched 02:12:32.048244 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:32.664184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10565): Launched 02:12:32.999337 run osmo-stp_10.42.42.5(pid=10566): Launched 02:12:33.126148 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:33.727500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10568): Launched 02:12:34.063858 run osmo-msc_10.42.42.6(pid=10569): Launched 02:12:34.248257 run osmo-stp_10.42.42.5(pid=10566): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10566)] 02:12:34.389257 run osmo-stp_10.42.42.5(pid=10566): stdout: | (launched: 2022-12-09_02:12:32.937160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:34.529211 run osmo-stp_10.42.42.5(pid=10566): stderr: | 20221209021233132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021233132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021233132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021233132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021233133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021233133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021233133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:34.667961 run osmo-stp_10.42.42.5(pid=10566): stdout: | (launched: 2022-12-09_02:12:32.937160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:34.800162 run osmo-stp_10.42.42.5(pid=10566): stderr: | 20221209021233132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021233132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021233132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021233132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021233133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021233133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021233133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:34.958909 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10566): Process ended prematurely: osmo-stp_10.42.42.5(pid=10566) [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10566)] [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:12:34.968559 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:12:34.996897 run osmo-hlr_10.42.42.2(pid=10563): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10563)] 02:12:35.047262 run osmo-hlr_10.42.42.2(pid=10563): stdout: | (launched: 2022-12-09_02:12:31.831833) 02:12:35.098926 run osmo-hlr_10.42.42.2(pid=10563): stderr: | 20221209021232205 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021232205 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021232205 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021232205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021232206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021232206 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021232230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021232243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021232243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021232243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:35.170745 run osmo-msc_10.42.42.6(pid=10569): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10569)] 02:12:35.220896 run osmo-msc_10.42.42.6(pid=10569): stdout: | (launched: 2022-12-09_02:12:34.001620) 02:12:35.272570 run osmo-msc_10.42.42.6(pid=10569): stderr: | 20221209021234328 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021234328 DLGLOBAL DEBUG validating counter group 0x7f5f8e2ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021234329 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021234329 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021234329 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021234329 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021234331 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021234331 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021234331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021234331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:35.324656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10562): Terminating (SIGTERM) 02:12:35.366503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10565): Terminating (SIGTERM) 02:12:35.408305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10568): Terminating (SIGTERM) 02:12:35.450441 --- ParallelTerminationStrategy: PID 10562 died... 02:12:35.470378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10562): Terminated: ok {rc=0} 02:12:35.516924 --- ParallelTerminationStrategy: PID 10565 died... 02:12:35.536600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10565): Terminated: ok {rc=0} 02:12:35.583006 --- ParallelTerminationStrategy: PID 10568 died... 02:12:35.602526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10568): Terminated: ok {rc=0} 02:12:35.690206 bus /sierra_3: Setting Powered False 02:12:36.788773 bus /sierra_3: Setting Powered False 02:12:37.904276 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:12:39.137918 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:12:39.144432 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:12:39.165164 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:12:39.192410 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:12:39.244519 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:12:39.265385 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:12:39.292104 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:12:39.842897 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:12:39.892577 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:39.903742 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:12:39.963772 tst mo_mt_call.py: using LAC 18351 02:12:40.085716 tst mo_mt_call.py: using RAC 246 02:12:40.206909 tst mo_mt_call.py: using CellId 18351 02:12:40.329546 tst mo_mt_call.py: using BVCI 18352 02:12:40.443968 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:40.455165 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:40.466175 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:40.477111 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:40.488070 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:40.499162 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:12:40.619900 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:12:40.737359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:41.221445 run create_hlr_db(pid=10576): Launched 02:12:41.346781 bus /sierra_2: Setting Powered False 02:12:42.408796 run create_hlr_db(pid=10576): Terminated: ok {rc=0} 02:12:42.864045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10578): Launched 02:12:43.198808 run osmo-hlr_10.42.42.2(pid=10579): Launched 02:12:43.326428 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:43.902668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10581): Launched 02:12:44.237128 run osmo-stp_10.42.42.5(pid=10582): Launched 02:12:44.365629 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:44.968763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10584): Launched 02:12:45.303002 run osmo-msc_10.42.42.6(pid=10585): Launched 02:12:45.488296 run osmo-stp_10.42.42.5(pid=10582): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10582)] 02:12:45.627851 run osmo-stp_10.42.42.5(pid=10582): stdout: | (launched: 2022-12-09_02:12:44.174909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:45.768106 run osmo-stp_10.42.42.5(pid=10582): stderr: | 20221209021244371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021244371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021244372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021244372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021244373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021244373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021244373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:45.918442 run osmo-stp_10.42.42.5(pid=10582): stdout: | (launched: 2022-12-09_02:12:44.174909) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:46.057718 run osmo-stp_10.42.42.5(pid=10582): stderr: | 20221209021244371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021244371 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021244372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021244372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021244373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021244373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021244373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:46.218854 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10582): Process ended prematurely: osmo-stp_10.42.42.5(pid=10582) [trial-2353↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10582)] [trial-2353↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:12:46.229097 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 02:12:46.258465 run osmo-hlr_10.42.42.2(pid=10579): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10579)] 02:12:46.310286 run osmo-hlr_10.42.42.2(pid=10579): stdout: | (launched: 2022-12-09_02:12:43.136389) 02:12:46.363612 run osmo-hlr_10.42.42.2(pid=10579): stderr: | 20221209021243337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021243337 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021243337 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021243337 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021243337 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021243337 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021243349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021243359 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021243359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021243359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:46.437267 run osmo-msc_10.42.42.6(pid=10585): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10585)] 02:12:46.488879 run osmo-msc_10.42.42.6(pid=10585): stdout: | (launched: 2022-12-09_02:12:45.240559) 02:12:46.542410 run osmo-msc_10.42.42.6(pid=10585): stderr: | 20221209021245567 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021245567 DLGLOBAL DEBUG validating counter group 0x7ff925592c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021245567 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021245567 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021245568 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021245568 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021245569 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021245570 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021245570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021245570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:46.601697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10578): Terminating (SIGTERM) 02:12:46.651836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10581): Terminating (SIGTERM) 02:12:46.708149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10584): Terminating (SIGTERM) 02:12:46.762551 --- ParallelTerminationStrategy: PID 10578 died... 02:12:46.787280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10578): Terminated: ok {rc=0} 02:12:46.841885 --- ParallelTerminationStrategy: PID 10581 died... 02:12:46.867791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10581): Terminated: ok {rc=0} 02:12:46.926256 --- ParallelTerminationStrategy: PID 10584 died... 02:12:46.950107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10584): Terminated: ok {rc=0} 02:12:47.057615 bus /sierra_3: Setting Powered False 02:12:48.165960 bus /sierra_3: Setting Powered False 02:12:49.281860 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:12:50.430963 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:50.442968 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:12:50.501044 tst mo_mt_call_osmux.py: using LAC 18352 02:12:50.624627 tst mo_mt_call_osmux.py: using RAC 247 02:12:50.748503 tst mo_mt_call_osmux.py: using CellId 18352 02:12:50.872247 tst mo_mt_call_osmux.py: using BVCI 18353 02:12:50.986754 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:50.998097 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:51.009166 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:51.020159 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:51.031214 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:51.042367 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:12:51.162732 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:12:51.282049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:51.764486 run create_hlr_db(pid=10587): Launched 02:12:51.889972 bus /sierra_2: Setting Powered False 02:12:52.951635 run create_hlr_db(pid=10587): Terminated: ok {rc=0} 02:12:53.405476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10589): Launched 02:12:53.739469 run osmo-hlr_10.42.42.2(pid=10590): Launched 02:12:53.867158 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:54.444757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10592): Launched 02:12:54.779187 run osmo-stp_10.42.42.5(pid=10593): Launched 02:12:54.906445 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:55.510303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10595): Launched 02:12:55.844265 run osmo-msc_10.42.42.6(pid=10596): Launched 02:12:56.029756 run osmo-stp_10.42.42.5(pid=10593): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10593)] 02:12:56.169404 run osmo-stp_10.42.42.5(pid=10593): stdout: | (launched: 2022-12-09_02:12:54.716222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:56.309777 run osmo-stp_10.42.42.5(pid=10593): stderr: | 20221209021254912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021254913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021254913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021254913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021254914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021254914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021254914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:56.448502 run osmo-stp_10.42.42.5(pid=10593): stdout: | (launched: 2022-12-09_02:12:54.716222) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:56.581222 run osmo-stp_10.42.42.5(pid=10593): stderr: | 20221209021254912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021254913 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021254913 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021254913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021254914 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021254914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021254914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:56.739805 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10593): Process ended prematurely: osmo-stp_10.42.42.5(pid=10593) [trial-2353↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10593)] [trial-2353↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:12:56.749821 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:12:56.778028 run osmo-hlr_10.42.42.2(pid=10590): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10590)] 02:12:56.829167 run osmo-hlr_10.42.42.2(pid=10590): stdout: | (launched: 2022-12-09_02:12:53.677572) 02:12:56.882090 run osmo-hlr_10.42.42.2(pid=10590): stderr: | 20221209021253881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021253881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021253881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021253881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021253881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021253881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021253898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021253907 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021253907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021253907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:56.955407 run osmo-msc_10.42.42.6(pid=10596): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10596)] 02:12:57.006248 run osmo-msc_10.42.42.6(pid=10596): stdout: | (launched: 2022-12-09_02:12:55.781928) 02:12:57.058661 run osmo-msc_10.42.42.6(pid=10596): stderr: | 20221209021256108 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021256108 DLGLOBAL DEBUG validating counter group 0x7f4085d92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021256108 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021256108 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021256109 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021256109 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021256111 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021256111 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021256111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021256111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:57.111379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10589): Terminating (SIGTERM) 02:12:57.153581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10592): Terminating (SIGTERM) 02:12:57.195914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10595): Terminating (SIGTERM) 02:12:57.238186 --- ParallelTerminationStrategy: PID 10589 died... 02:12:57.258204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10589): Terminated: ok {rc=0} 02:12:57.305053 --- ParallelTerminationStrategy: PID 10592 died... 02:12:57.324717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10592): Terminated: ok {rc=0} 02:12:57.371238 --- ParallelTerminationStrategy: PID 10595 died... 02:12:57.390625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10595): Terminated: ok {rc=0} 02:12:57.478328 bus /sierra_3: Setting Powered False 02:12:58.577642 bus /sierra_3: Setting Powered False 02:12:59.694698 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:13:00.941167 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:13:00.947481 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:13:00.975276 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:13:01.003559 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:13:01.053062 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:13:01.075333 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:13:01.102913 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:13:01.661904 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:13:01.719328 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:13:01.731636 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:13:01.792068 tst mo_mt_call.py: using LAC 18353 02:13:01.948879 tst mo_mt_call.py: using RAC 248 02:13:02.090207 tst mo_mt_call.py: using CellId 18353 02:13:02.240571 tst mo_mt_call.py: using BVCI 18354 02:13:02.356138 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:13:02.367344 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:13:02.378054 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:13:02.388685 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:13:02.399446 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:13:02.410670 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:13:02.531416 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:13:02.652693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:03.135852 run create_hlr_db(pid=10601): Launched 02:13:03.262373 bus /sierra_2: Setting Powered False 02:13:04.323941 run create_hlr_db(pid=10601): Terminated: ok {rc=0} 02:13:04.759033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10603): Launched 02:13:05.070958 run osmo-hlr_10.42.42.2(pid=10604): Launched 02:13:05.188339 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:05.741115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10606): Launched 02:13:06.052880 run osmo-stp_10.42.42.5(pid=10607): Launched 02:13:06.171246 run osmo-msc_10.42.42.6: Starting osmo-msc 02:13:06.736464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10609): Launched 02:13:07.049296 run osmo-msc_10.42.42.6(pid=10610): Launched 02:13:07.223287 run osmo-stp_10.42.42.5(pid=10607): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10607)] 02:13:07.363468 run osmo-stp_10.42.42.5(pid=10607): stdout: | (launched: 2022-12-09_02:13:05.993939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:07.507147 run osmo-stp_10.42.42.5(pid=10607): stderr: | 20221209021306170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021306170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021306170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021306171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021306171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021306171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021306171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:07.646625 run osmo-stp_10.42.42.5(pid=10607): stdout: | (launched: 2022-12-09_02:13:05.993939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:07.780221 run osmo-stp_10.42.42.5(pid=10607): stderr: | 20221209021306170 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021306170 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021306170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021306171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021306171 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021306171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021306171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:07.939915 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10607): Process ended prematurely: osmo-stp_10.42.42.5(pid=10607) [trial-2353↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10607)] [trial-2353↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:13:07.949890 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:13:07.978659 run osmo-hlr_10.42.42.2(pid=10604): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10604)] 02:13:08.029877 run osmo-hlr_10.42.42.2(pid=10604): stdout: | (launched: 2022-12-09_02:13:05.012039) 02:13:08.082584 run osmo-hlr_10.42.42.2(pid=10604): stderr: | 20221209021305192 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021305192 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021305192 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021305192 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021305192 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021305192 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021305204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021305214 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021305214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021305214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:08.155933 run osmo-msc_10.42.42.6(pid=10610): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10610)] 02:13:08.207099 run osmo-msc_10.42.42.6(pid=10610): stdout: | (launched: 2022-12-09_02:13:06.990373) 02:13:08.259962 run osmo-msc_10.42.42.6(pid=10610): stderr: | 20221209021307269 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021307269 DLGLOBAL DEBUG validating counter group 0x7fe958b2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021307269 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021307269 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021307269 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021307269 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021307271 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021307271 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021307272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021307272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:13:08.312927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10603): Terminating (SIGTERM) 02:13:08.355932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10606): Terminating (SIGTERM) 02:13:08.398867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10609): Terminating (SIGTERM) 02:13:08.442011 --- ParallelTerminationStrategy: PID 10603 died... 02:13:08.462484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10603): Terminated: ok {rc=0} 02:13:08.510165 --- ParallelTerminationStrategy: PID 10606 died... 02:13:08.529926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10606): Terminated: ok {rc=0} 02:13:08.577311 --- ParallelTerminationStrategy: PID 10609 died... 02:13:08.597195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10609): Terminated: ok {rc=0} 02:13:08.685549 bus /sierra_3: Setting Powered False 02:13:09.784422 bus /sierra_3: Setting Powered False 02:13:10.900383 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:13:12.049770 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:13:12.061581 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:13:12.123392 tst mo_mt_call_osmux.py: using LAC 18354 02:13:12.245406 tst mo_mt_call_osmux.py: using RAC 249 02:13:12.368658 tst mo_mt_call_osmux.py: using CellId 18354 02:13:12.490325 tst mo_mt_call_osmux.py: using BVCI 18355 02:13:12.602960 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:13:12.614094 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:13:12.624873 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:13:12.635697 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:13:12.646512 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:13:12.657461 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:13:12.777225 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:13:12.894558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:13.378913 run create_hlr_db(pid=10617): Launched 02:13:13.505074 bus /sierra_2: Setting Powered False 02:13:14.566438 run create_hlr_db(pid=10617): Terminated: ok {rc=0} 02:13:14.998255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10619): Launched 02:13:15.310085 run osmo-hlr_10.42.42.2(pid=10620): Launched 02:13:15.427701 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:15.985241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10622): Launched 02:13:16.318778 run osmo-stp_10.42.42.5(pid=10623): Launched 02:13:16.549546 run osmo-msc_10.42.42.6: Starting osmo-msc 02:13:17.253287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10625): Launched 02:13:17.564814 run osmo-msc_10.42.42.6(pid=10626): Launched 02:13:17.738961 run osmo-stp_10.42.42.5(pid=10623): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10623)] 02:13:17.869948 run osmo-stp_10.42.42.5(pid=10623): stdout: | (launched: 2022-12-09_02:13:16.257338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:18.000388 run osmo-stp_10.42.42.5(pid=10623): stderr: | 20221209021316591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021316592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021316592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021316592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021316593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021316593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021316593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:18.128343 run osmo-stp_10.42.42.5(pid=10623): stdout: | (launched: 2022-12-09_02:13:16.257338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:18.251198 run osmo-stp_10.42.42.5(pid=10623): stderr: | 20221209021316591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021316592 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021316592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021316592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021316593 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021316593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021316593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:18.398524 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10623): Process ended prematurely: osmo-stp_10.42.42.5(pid=10623) [trial-2353↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10623)] [trial-2353↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:13:18.407255 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:13:18.433530 run osmo-hlr_10.42.42.2(pid=10620): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10620)] 02:13:18.481561 run osmo-hlr_10.42.42.2(pid=10620): stdout: | (launched: 2022-12-09_02:13:15.250957) 02:13:18.531105 run osmo-hlr_10.42.42.2(pid=10620): stderr: | 20221209021315429 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021315429 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021315429 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021315429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021315429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021315429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021315441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021315449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021315450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021315450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:18.600839 run osmo-msc_10.42.42.6(pid=10626): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10626)] 02:13:18.648672 run osmo-msc_10.42.42.6(pid=10626): stdout: | (launched: 2022-12-09_02:13:17.505758) 02:13:18.697929 run osmo-msc_10.42.42.6(pid=10626): stderr: | 20221209021317779 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021317779 DLGLOBAL DEBUG validating counter group 0x7f1509c77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021317780 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021317780 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021317780 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021317780 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021317783 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021317784 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021317784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021317784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:13:18.747414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10619): Terminating (SIGTERM) 02:13:18.787151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10622): Terminating (SIGTERM) 02:13:18.826788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10625): Terminating (SIGTERM) 02:13:18.866650 --- ParallelTerminationStrategy: PID 10619 died... 02:13:18.885537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10619): Terminated: ok {rc=0} 02:13:18.929355 --- ParallelTerminationStrategy: PID 10622 died... 02:13:18.947730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10622): Terminated: ok {rc=0} 02:13:18.991753 --- ParallelTerminationStrategy: PID 10625 died... 02:13:19.010318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10625): Terminated: ok {rc=0} 02:13:19.097525 bus /sierra_3: Setting Powered False 02:13:20.196747 bus /sierra_3: Setting Powered False 02:13:21.313061 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 emergency:sysmo --------------------------------------------------------------------- 02:13:22.551151 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:13:22.555931 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 02:13:22.579266 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 02:13:22.608150 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 02:13:22.693404 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 02:13:22.714213 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 02:13:22.740761 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 02:13:23.323420 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2353 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 02:13:23.328337 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:23.338963 tst emergency:sysmo: Using 1 x bts (candidates: 1) 02:13:23.374461 tst emergency_mo_mt_call.py: using LAC 18355 02:13:23.495056 tst emergency_mo_mt_call.py: using RAC 250 02:13:23.616302 tst emergency_mo_mt_call.py: using CellId 18355 02:13:23.737852 tst emergency_mo_mt_call.py: using BVCI 18356 02:13:23.848318 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:23.859017 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:23.869605 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:23.880091 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:23.890807 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:23.901429 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:13:24.022145 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:13:24.139235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:24.617757 run create_hlr_db(pid=10631): Launched 02:13:24.743018 bus /sierra_2: Setting Powered False 02:13:25.803420 run create_hlr_db(pid=10631): Terminated: ok {rc=0} 02:13:26.253540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10633): Launched 02:13:26.584203 run osmo-hlr_10.42.42.2(pid=10634): Launched 02:13:26.710619 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:27.282457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10636): Launched 02:13:27.611379 run osmo-stp_10.42.42.5(pid=10637): Launched 02:13:27.746922 tst emergency_mo_mt_call.py: using MSISDN 6977 02:13:27.922440 run osmo-msc_10.42.42.6: Starting osmo-msc 02:13:28.513599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10639): Launched 02:13:28.842840 run osmo-msc_10.42.42.6(pid=10640): Launched 02:13:29.026241 run osmo-stp_10.42.42.5(pid=10637): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10637)] 02:13:29.164664 run osmo-stp_10.42.42.5(pid=10637): stdout: | (launched: 2022-12-09_02:13:27.549709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:29.303737 run osmo-stp_10.42.42.5(pid=10637): stderr: | 20221209021327747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021327747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021327747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021327748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021327748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021327748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021327748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:29.441426 run osmo-stp_10.42.42.5(pid=10637): stdout: | (launched: 2022-12-09_02:13:27.549709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:29.571854 run osmo-stp_10.42.42.5(pid=10637): stderr: | 20221209021327747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021327747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021327747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021327748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021327748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021327748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021327748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:29.728264 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10637): Process ended prematurely: osmo-stp_10.42.42.5(pid=10637) [trial-2353↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10637)] [trial-2353↪emergency:sysmo↪emergency_mo_mt_call.py:19] 02:13:29.737178 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 02:13:29.765180 run osmo-hlr_10.42.42.2(pid=10634): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10634)] 02:13:29.816283 run osmo-hlr_10.42.42.2(pid=10634): stdout: | (launched: 2022-12-09_02:13:26.522282) 02:13:29.868728 run osmo-hlr_10.42.42.2(pid=10634): stderr: | 20221209021326726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021326726 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021326726 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021326726 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021326726 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021326726 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021326740 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021326749 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021326750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021326750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:29.942339 run osmo-msc_10.42.42.6(pid=10640): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10640)] 02:13:29.993212 run osmo-msc_10.42.42.6(pid=10640): stdout: | (launched: 2022-12-09_02:13:28.781321) 02:13:30.045896 run osmo-msc_10.42.42.6(pid=10640): stderr: | 20221209021329105 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021329105 DLGLOBAL DEBUG validating counter group 0x7feb10578c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021329105 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021329105 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021329105 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021329105 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021329107 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021329108 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021329108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021329108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:13:30.098821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10633): Terminating (SIGTERM) 02:13:30.141359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10636): Terminating (SIGTERM) 02:13:30.184166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10639): Terminating (SIGTERM) 02:13:30.226969 --- ParallelTerminationStrategy: PID 10633 died... 02:13:30.247131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10633): Terminated: ok {rc=0} 02:13:30.294420 --- ParallelTerminationStrategy: PID 10636 died... 02:13:30.314062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10636): Terminated: ok {rc=0} 02:13:30.361117 --- ParallelTerminationStrategy: PID 10639 died... 02:13:30.380763 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10639): Terminated: ok {rc=0} 02:13:30.468993 bus /sierra_3: Setting Powered False 02:13:31.571729 bus /sierra_3: Setting Powered False 02:13:32.688698 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 02:13:33.777391 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:33.789790 tst emergency:sysmo: Using 1 x bts (candidates: 1) 02:13:33.830094 tst emergency_preemptive_call.py: using LAC 18356 02:13:33.961257 tst emergency_preemptive_call.py: using RAC 251 02:13:34.090787 tst emergency_preemptive_call.py: using CellId 18356 02:13:34.219929 tst emergency_preemptive_call.py: using BVCI 18357 02:13:34.338886 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:34.350193 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:34.361256 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:34.372490 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:34.383747 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:34.395009 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:13:34.515567 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:13:34.633893 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:13:34.753644 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:13:34.872907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:35.382457 run create_hlr_db(pid=10642): Launched 02:13:35.506568 bus /sierra_2: Setting Powered False 02:13:36.570820 run create_hlr_db(pid=10642): Terminated: ok {rc=0} 02:13:37.006791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10644): Launched 02:13:37.314730 run osmo-hlr_10.42.42.2(pid=10645): Launched 02:13:37.431403 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:37.965563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10647): Launched 02:13:38.273205 run osmo-stp_10.42.42.5(pid=10648): Launched 02:13:38.399073 tst emergency_preemptive_call.py: using MSISDN 6978 02:13:38.554752 run osmo-msc_10.42.42.6: Starting osmo-msc 02:13:39.105612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10650): Launched 02:13:39.412373 run osmo-msc_10.42.42.6(pid=10651): Launched 02:13:39.589668 run osmo-stp_10.42.42.5(pid=10648): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10648)] 02:13:39.719375 run osmo-stp_10.42.42.5(pid=10648): stdout: | (launched: 2022-12-09_02:13:38.214187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:39.848876 run osmo-stp_10.42.42.5(pid=10648): stderr: | 20221209021338389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021338389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021338389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021338390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021338390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021338391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021338391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:39.976480 run osmo-stp_10.42.42.5(pid=10648): stdout: | (launched: 2022-12-09_02:13:38.214187) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:40.098044 run osmo-stp_10.42.42.5(pid=10648): stderr: | 20221209021338389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021338389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021338389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021338390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021338390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021338391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021338391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:40.243022 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10648): Process ended prematurely: osmo-stp_10.42.42.5(pid=10648) [trial-2353↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10648)] [trial-2353↪emergency:sysmo↪emergency_preemptive_call.py:32] 02:13:40.251275 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 02:13:40.277175 run osmo-hlr_10.42.42.2(pid=10645): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10645)] 02:13:40.325269 run osmo-hlr_10.42.42.2(pid=10645): stdout: | (launched: 2022-12-09_02:13:37.256454) 02:13:40.374528 run osmo-hlr_10.42.42.2(pid=10645): stderr: | 20221209021337435 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021337435 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021337435 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021337435 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021337435 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021337435 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021337446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021337455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021337455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021337456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:40.443495 run osmo-msc_10.42.42.6(pid=10651): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10651)] 02:13:40.491704 run osmo-msc_10.42.42.6(pid=10651): stdout: | (launched: 2022-12-09_02:13:39.354236) 02:13:40.540857 run osmo-msc_10.42.42.6(pid=10651): stderr: | 20221209021339629 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021339629 DLGLOBAL DEBUG validating counter group 0x7f40a92a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021339630 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021339630 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021339630 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021339630 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021339632 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021339632 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021339632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021339632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:13:40.590266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10644): Terminating (SIGTERM) 02:13:40.629882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10647): Terminating (SIGTERM) 02:13:40.669481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10650): Terminating (SIGTERM) 02:13:40.709401 --- ParallelTerminationStrategy: PID 10644 died... 02:13:40.728803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10644): Terminated: ok {rc=0} 02:13:40.772787 --- ParallelTerminationStrategy: PID 10647 died... 02:13:40.791329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10647): Terminated: ok {rc=0} 02:13:40.835630 --- ParallelTerminationStrategy: PID 10650 died... 02:13:40.854344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10650): Terminated: ok {rc=0} 02:13:40.940400 bus /sierra_9: Setting Powered False 02:13:42.040717 bus /sierra_9: Setting Powered False 02:13:43.157104 bus /sierra_8: Setting Powered False 02:13:44.255996 bus /sierra_8: Setting Powered False 02:13:45.371187 bus /sierra_3: Setting Powered False 02:13:46.479140 bus /sierra_3: Setting Powered False 02:13:47.614268 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:sysmo --------------------------------------------------------------------- 02:13:48.877081 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:13:48.881261 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 02:13:48.901969 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 02:13:48.940711 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 02:13:49.030629 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 02:13:49.053184 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 02:13:49.091170 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 02:13:49.675185 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 02:13:49.726673 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:49.737310 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:13:49.771298 tst cs_paging_gprs_active.py: using LAC 18357 02:13:49.893384 tst cs_paging_gprs_active.py: using RAC 252 02:13:50.016547 tst cs_paging_gprs_active.py: using CellId 18357 02:13:50.137969 tst cs_paging_gprs_active.py: using BVCI 18358 02:13:50.251263 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:50.261947 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:50.272433 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:50.283512 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:50.294473 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:50.305509 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:50.316504 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:50.327465 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:50.338557 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:50.461459 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:50.579885 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:13:50.789891 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:51.105120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10656): Launched 02:13:51.377132 run iperf3-srv_10.42.42.10(pid=10657): Launched 02:13:51.493618 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:13:51.702428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:52.017162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10658): Launched 02:13:52.288909 run iperf3-srv_10.42.42.10(pid=10659): Launched 02:13:52.404823 tst cs_paging_gprs_active.py:38: start network... 02:13:52.612655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:53.096739 run create_hlr_db(pid=10660): Launched 02:13:53.223219 bus /sierra_2: Setting Powered False 02:13:54.284336 run create_hlr_db(pid=10660): Terminated: ok {rc=0} 02:13:54.720295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10662): Launched 02:13:55.034298 run osmo-hlr_10.42.42.2(pid=10663): Launched 02:13:55.152895 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:55.691757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10665): Launched 02:13:56.003641 run osmo-stp_10.42.42.5(pid=10666): Launched 02:13:56.121339 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:13:57.639468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10668): Launched 02:13:57.757848 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:13:58.022996 run patchelf(pid=10669): Launched 02:13:58.196538 run osmo-stp_10.42.42.5(pid=10666): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10666)] 02:13:58.327040 run osmo-stp_10.42.42.5(pid=10666): stdout: | (launched: 2022-12-09_02:13:55.944862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:58.459197 run osmo-stp_10.42.42.5(pid=10666): stderr: | 20221209021356118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021356118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021356118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021356119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021356119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021356119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021356119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:58.591389 run osmo-stp_10.42.42.5(pid=10666): stdout: | (launched: 2022-12-09_02:13:55.944862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:58.718632 run osmo-stp_10.42.42.5(pid=10666): stderr: | 20221209021356118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021356118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021356118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021356119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021356119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021356119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021356119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:58.869810 run patchelf(pid=10669): Terminating (SIGINT) 02:13:59.044071 run patchelf(pid=10669): Terminated: ok {rc=0} 02:13:59.169271 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10666): Process ended prematurely: osmo-stp_10.42.42.5(pid=10666) [trial-2353↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10666)] [trial-2353↪gprs:sysmo↪cs_paging_gprs_active.py:38] 02:13:59.178577 tst cs_paging_gprs_active.py:38: Test FAILED (9.5 sec) 02:13:59.205352 run osmo-hlr_10.42.42.2(pid=10663): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10663)] 02:13:59.252537 run osmo-hlr_10.42.42.2(pid=10663): stdout: | (launched: 2022-12-09_02:13:54.974978) 02:13:59.301792 run osmo-hlr_10.42.42.2(pid=10663): stderr: | 20221209021355156 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021355156 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021355156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021355156 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021355156 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021355156 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021355168 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021355177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021355177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021355177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:59.351481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10656): Terminating (SIGTERM) 02:13:59.390966 run iperf3-srv_10.42.42.10(pid=10657): Terminating (SIGTERM) 02:13:59.430223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10658): Terminating (SIGTERM) 02:13:59.469790 run iperf3-srv_10.42.42.10(pid=10659): Terminating (SIGTERM) 02:13:59.509148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10662): Terminating (SIGTERM) 02:13:59.548581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10665): Terminating (SIGTERM) 02:13:59.588007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10668): Terminating (SIGTERM) 02:13:59.627723 --- ParallelTerminationStrategy: PID 10656 died... 02:13:59.646293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10656): Terminated: ok {rc=0} 02:13:59.690070 --- ParallelTerminationStrategy: PID 10657 died... 02:13:59.708433 run iperf3-srv_10.42.42.10(pid=10657): Terminated {rc=256} 02:13:59.752130 --- ParallelTerminationStrategy: PID 10658 died... 02:13:59.770697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10658): Terminated: ok {rc=0} 02:13:59.814221 --- ParallelTerminationStrategy: PID 10659 died... 02:13:59.832789 run iperf3-srv_10.42.42.10(pid=10659): Terminated {rc=256} 02:13:59.876206 --- ParallelTerminationStrategy: PID 10662 died... 02:13:59.894782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10662): Terminated: ok {rc=0} 02:13:59.938453 --- ParallelTerminationStrategy: PID 10665 died... 02:13:59.956832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10665): Terminated: ok {rc=0} 02:14:00.000394 --- ParallelTerminationStrategy: PID 10668 died... 02:14:00.018900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10668): Terminated: ok {rc=0} 02:14:00.103150 bus /gobi_0: Setting Powered False 02:14:01.209394 bus /gobi_0: Setting Powered False 02:14:02.327634 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo iperf3.py ---------------------------------------------- 02:14:03.475576 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:03.486792 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:14:03.522344 tst iperf3.py: using LAC 18358 02:14:03.655522 tst iperf3.py: using RAC 253 02:14:03.787657 tst iperf3.py: using CellId 18358 02:14:03.918402 tst iperf3.py: using BVCI 18359 02:14:04.040003 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:04.051086 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:04.062107 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:04.073242 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:04.084250 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:04.095430 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:04.106735 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:04.117993 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:04.129118 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:14:04.246205 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:14:04.457497 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:04.772400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10670): Launched 02:14:05.046222 run iperf3-srv_10.42.42.10(pid=10671): Launched 02:14:05.162136 tst iperf3.py:8: start network... 02:14:05.370014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:05.853489 run create_hlr_db(pid=10672): Launched 02:14:05.980170 bus /gobi_6: Setting Powered False 02:14:07.041826 run create_hlr_db(pid=10672): Terminated: ok {rc=0} 02:14:07.497454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10674): Launched 02:14:07.833124 run osmo-hlr_10.42.42.2(pid=10675): Launched 02:14:07.962036 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:08.537565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10677): Launched 02:14:08.873301 run osmo-stp_10.42.42.5(pid=10678): Launched 02:14:09.001582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:09.579635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10680): Launched 02:14:09.706297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:09.990967 run patchelf(pid=10681): Launched 02:14:10.175604 run osmo-stp_10.42.42.5(pid=10678): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10678)] 02:14:10.316212 run osmo-stp_10.42.42.5(pid=10678): stdout: | (launched: 2022-12-09_02:14:08.808412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:10.458328 run osmo-stp_10.42.42.5(pid=10678): stderr: | 20221209021409007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021409007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021409008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021409008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021409008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021409008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021409009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:10.600724 run osmo-stp_10.42.42.5(pid=10678): stdout: | (launched: 2022-12-09_02:14:08.808412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:10.736815 run osmo-stp_10.42.42.5(pid=10678): stderr: | 20221209021409007 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021409007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021409008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021409008 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021409008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021409008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021409009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:10.898870 run patchelf(pid=10681): Terminating (SIGINT) 02:14:11.085024 run patchelf(pid=10681): Terminated: ok {rc=0} 02:14:11.219188 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10678): Process ended prematurely: osmo-stp_10.42.42.5(pid=10678) [trial-2353↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10678)] [trial-2353↪gprs:sysmo↪iperf3.py:8] 02:14:11.229390 tst iperf3.py:8: Test FAILED (7.8 sec) 02:14:11.258630 run osmo-hlr_10.42.42.2(pid=10675): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10675)] 02:14:11.309195 run osmo-hlr_10.42.42.2(pid=10675): stdout: | (launched: 2022-12-09_02:14:07.770243) 02:14:11.361427 run osmo-hlr_10.42.42.2(pid=10675): stderr: | 20221209021407973 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021407973 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021407973 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021407973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021407973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021407973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021407986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021407994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021407994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021407994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:11.414227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10670): Terminating (SIGTERM) 02:14:11.456504 run iperf3-srv_10.42.42.10(pid=10671): Terminating (SIGTERM) 02:14:11.498821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10674): Terminating (SIGTERM) 02:14:11.541308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10677): Terminating (SIGTERM) 02:14:11.583594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10680): Terminating (SIGTERM) 02:14:11.626077 --- ParallelTerminationStrategy: PID 10670 died... 02:14:11.646075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10670): Terminated: ok {rc=0} 02:14:11.693140 --- ParallelTerminationStrategy: PID 10671 died... 02:14:11.712759 run iperf3-srv_10.42.42.10(pid=10671): Terminated {rc=256} 02:14:11.759535 --- ParallelTerminationStrategy: PID 10674 died... 02:14:11.779184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10674): Terminated: ok {rc=0} 02:14:11.826008 --- ParallelTerminationStrategy: PID 10677 died... 02:14:11.845677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10677): Terminated: ok {rc=0} 02:14:11.892751 --- ParallelTerminationStrategy: PID 10680 died... 02:14:11.912820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10680): Terminated: ok {rc=0} 02:14:12.002329 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo iperf3m4.py ---------------------------------------------- 02:14:13.154379 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:13.166255 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:14:13.203321 tst iperf3m4.py: using LAC 18359 02:14:13.336170 tst iperf3m4.py: using RAC 254 02:14:13.466474 tst iperf3m4.py: using CellId 18359 02:14:13.599114 tst iperf3m4.py: using BVCI 18360 02:14:13.722620 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:13.733857 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:13.744777 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:13.755996 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:13.767659 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:13.778766 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:13.790102 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:13.801281 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:13.812494 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:14:13.932434 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:14:14.056321 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:14:14.176837 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:14:14.298298 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:14:14.524587 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:14.861735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10682): Launched 02:14:15.154513 run iperf3-srv_10.42.42.10(pid=10683): Launched 02:14:15.279715 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:14:15.505919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:15.846862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10684): Launched 02:14:16.150328 run iperf3-srv_10.42.42.10(pid=10685): Launched 02:14:16.286180 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:14:16.502398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:16.833669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10686): Launched 02:14:17.133632 run iperf3-srv_10.42.42.10(pid=10687): Launched 02:14:17.251580 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:14:17.462031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:17.777183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10688): Launched 02:14:18.067465 run iperf3-srv_10.42.42.10(pid=10689): Launched 02:14:18.194534 tst iperf3m4.py:8: start network... 02:14:18.420557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:18.942337 run create_hlr_db(pid=10690): Launched 02:14:19.068930 bus /gobi_6: Setting Powered False 02:14:20.135333 run create_hlr_db(pid=10690): Terminated: ok {rc=0} 02:14:20.600324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10692): Launched 02:14:20.936883 run osmo-hlr_10.42.42.2(pid=10693): Launched 02:14:21.065395 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:21.640831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10695): Launched 02:14:21.976510 run osmo-stp_10.42.42.5(pid=10696): Launched 02:14:22.104203 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:22.682718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10698): Launched 02:14:22.810006 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:23.095593 run patchelf(pid=10699): Launched 02:14:23.280751 run osmo-stp_10.42.42.5(pid=10696): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10696)] 02:14:23.421837 run osmo-stp_10.42.42.5(pid=10696): stdout: | (launched: 2022-12-09_02:14:21.913634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:23.564884 run osmo-stp_10.42.42.5(pid=10696): stderr: | 20221209021422111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021422111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021422111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021422112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021422112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021422112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021422112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:23.707552 run osmo-stp_10.42.42.5(pid=10696): stdout: | (launched: 2022-12-09_02:14:21.913634) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:23.844321 run osmo-stp_10.42.42.5(pid=10696): stderr: | 20221209021422111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021422111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021422111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021422112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021422112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021422112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021422112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:24.007097 run patchelf(pid=10699): Terminating (SIGINT) 02:14:24.193191 run patchelf(pid=10699): Terminated: ok {rc=0} 02:14:24.327141 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10696): Process ended prematurely: osmo-stp_10.42.42.5(pid=10696) [trial-2353↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10696)] [trial-2353↪gprs:sysmo↪iperf3m4.py:8] 02:14:24.337353 tst iperf3m4.py:8: Test FAILED (11.2 sec) 02:14:24.367024 run osmo-hlr_10.42.42.2(pid=10693): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10693)] 02:14:24.419190 run osmo-hlr_10.42.42.2(pid=10693): stdout: | (launched: 2022-12-09_02:14:20.873530) 02:14:24.470132 run osmo-hlr_10.42.42.2(pid=10693): stderr: | 20221209021421078 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021421078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021421078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021421078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021421078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021421078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021421090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021421099 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021421099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021421099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:24.521118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10682): Terminating (SIGTERM) 02:14:24.561827 run iperf3-srv_10.42.42.10(pid=10683): Terminating (SIGTERM) 02:14:24.602506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10684): Terminating (SIGTERM) 02:14:24.643334 run iperf3-srv_10.42.42.10(pid=10685): Terminating (SIGTERM) 02:14:24.683900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10686): Terminating (SIGTERM) 02:14:24.724506 run iperf3-srv_10.42.42.10(pid=10687): Terminating (SIGTERM) 02:14:24.765209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10688): Terminating (SIGTERM) 02:14:24.805624 run iperf3-srv_10.42.42.10(pid=10689): Terminating (SIGTERM) 02:14:24.845462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10692): Terminating (SIGTERM) 02:14:24.885434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10695): Terminating (SIGTERM) 02:14:24.925563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10698): Terminating (SIGTERM) 02:14:24.965876 --- ParallelTerminationStrategy: PID 10682 died... 02:14:24.985238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10682): Terminated: ok {rc=0} 02:14:25.029850 --- ParallelTerminationStrategy: PID 10683 died... 02:14:25.048624 run iperf3-srv_10.42.42.10(pid=10683): Terminated {rc=256} 02:14:25.093513 --- ParallelTerminationStrategy: PID 10684 died... 02:14:25.112423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10684): Terminated: ok {rc=0} 02:14:25.156570 --- ParallelTerminationStrategy: PID 10685 died... 02:14:25.175356 run iperf3-srv_10.42.42.10(pid=10685): Terminated {rc=256} 02:14:25.219342 --- ParallelTerminationStrategy: PID 10686 died... 02:14:25.238161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10686): Terminated: ok {rc=0} 02:14:25.282294 --- ParallelTerminationStrategy: PID 10687 died... 02:14:25.301090 run iperf3-srv_10.42.42.10(pid=10687): Terminated {rc=256} 02:14:25.345183 --- ParallelTerminationStrategy: PID 10688 died... 02:14:25.363876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10688): Terminated: ok {rc=0} 02:14:25.408005 --- ParallelTerminationStrategy: PID 10689 died... 02:14:25.426646 run iperf3-srv_10.42.42.10(pid=10689): Terminated {rc=256} 02:14:25.470571 --- ParallelTerminationStrategy: PID 10692 died... 02:14:25.489522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10692): Terminated: ok {rc=0} 02:14:25.533519 --- ParallelTerminationStrategy: PID 10695 died... 02:14:25.552361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10695): Terminated: ok {rc=0} 02:14:25.596619 --- ParallelTerminationStrategy: PID 10698 died... 02:14:25.615447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10698): Terminated: ok {rc=0} 02:14:25.700475 bus /gobi_4: Setting Powered False 02:14:26.801335 bus /gobi_4: Setting Powered False 02:14:27.918964 bus /gobi_1: Setting Powered False 02:14:29.017418 bus /gobi_1: Setting Powered False 02:14:30.132768 bus /gobi_0: Setting Powered False 02:14:31.228379 bus /gobi_0: Setting Powered False 02:14:32.346486 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo ping.py ---------------------------------------------- 02:14:33.451813 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:33.463849 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:14:33.505895 tst ping.py: using LAC 18360 02:14:33.627490 tst ping.py: using RAC 255 02:14:33.747779 tst ping.py: using CellId 18360 02:14:33.866314 tst ping.py: using BVCI 18361 02:14:33.978914 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:33.989806 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:34.000588 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:34.011136 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:34.021585 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:34.032002 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:34.042733 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:34.053319 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:14:34.168900 tst ping.py:19: start network... 02:14:34.372382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:34.847945 run create_hlr_db(pid=10700): Launched 02:14:34.972768 bus /gobi_6: Setting Powered False 02:14:36.033322 run create_hlr_db(pid=10700): Terminated: ok {rc=0} 02:14:36.483008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10702): Launched 02:14:36.813596 run osmo-hlr_10.42.42.2(pid=10703): Launched 02:14:36.939588 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:37.508812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10705): Launched 02:14:37.838703 run osmo-stp_10.42.42.5(pid=10706): Launched 02:14:37.965386 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:38.532360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10708): Launched 02:14:38.657024 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:38.936584 run patchelf(pid=10709): Launched 02:14:39.120399 run osmo-stp_10.42.42.5(pid=10706): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10706)] 02:14:39.259189 run osmo-stp_10.42.42.5(pid=10706): stdout: | (launched: 2022-12-09_02:14:37.777093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:39.399851 run osmo-stp_10.42.42.5(pid=10706): stderr: | 20221209021437970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021437970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021437971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021437971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021437973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021437974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021437974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:39.540128 run osmo-stp_10.42.42.5(pid=10706): stdout: | (launched: 2022-12-09_02:14:37.777093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:39.674681 run osmo-stp_10.42.42.5(pid=10706): stderr: | 20221209021437970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021437970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021437971 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021437971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021437973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021437974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021437974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:39.833953 run patchelf(pid=10709): Terminating (SIGINT) 02:14:40.017153 run patchelf(pid=10709): Terminated: ok {rc=0} 02:14:40.148648 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10706): Process ended prematurely: osmo-stp_10.42.42.5(pid=10706) [trial-2353↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10706)] [trial-2353↪gprs:sysmo↪ping.py:22] 02:14:40.158096 tst ping.py:22: Test FAILED (6.7 sec) 02:14:40.186817 run osmo-hlr_10.42.42.2(pid=10703): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10703)] 02:14:40.237633 run osmo-hlr_10.42.42.2(pid=10703): stdout: | (launched: 2022-12-09_02:14:36.751677) 02:14:40.289756 run osmo-hlr_10.42.42.2(pid=10703): stderr: | 20221209021436955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021436956 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021436956 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021436956 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021436956 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021436956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021436968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021436976 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021436976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021436977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:40.342367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10702): Terminating (SIGTERM) 02:14:40.384602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10705): Terminating (SIGTERM) 02:14:40.427100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10708): Terminating (SIGTERM) 02:14:40.469908 --- ParallelTerminationStrategy: PID 10702 died... 02:14:40.490222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10702): Terminated: ok {rc=0} 02:14:40.537214 --- ParallelTerminationStrategy: PID 10705 died... 02:14:40.556807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10705): Terminated: ok {rc=0} 02:14:40.604145 --- ParallelTerminationStrategy: PID 10708 died... 02:14:40.623887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10708): Terminated: ok {rc=0} 02:14:40.712257 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 02:14:41.800308 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:41.812620 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:14:41.851543 tst ping_idle_ping.py: using LAC 18361 02:14:41.983403 tst ping_idle_ping.py: using RAC 1 02:14:42.114112 tst ping_idle_ping.py: using CellId 18361 02:14:42.243229 tst ping_idle_ping.py: using BVCI 18362 02:14:42.365357 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:42.376604 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:42.388032 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:42.399484 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:42.410668 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:42.421863 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:42.433088 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:42.444397 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:14:42.568788 tst ping_idle_ping.py:24: start network... 02:14:42.775441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:43.252790 run create_hlr_db(pid=10712): Launched 02:14:43.378335 bus /gobi_6: Setting Powered False 02:14:44.439044 run create_hlr_db(pid=10712): Terminated: ok {rc=0} 02:14:44.886987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10714): Launched 02:14:45.216907 run osmo-hlr_10.42.42.2(pid=10715): Launched 02:14:45.343073 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:45.925525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10717): Launched 02:14:46.265353 run osmo-stp_10.42.42.5(pid=10718): Launched 02:14:46.446271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:47.119669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10720): Launched 02:14:47.258734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:47.543599 run patchelf(pid=10721): Launched 02:14:47.727036 run osmo-stp_10.42.42.5(pid=10718): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10718)] 02:14:47.866150 run osmo-stp_10.42.42.5(pid=10718): stdout: | (launched: 2022-12-09_02:14:46.201795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:48.007929 run osmo-stp_10.42.42.5(pid=10718): stderr: | 20221209021446565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021446565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021446570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021446571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021446571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021446572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021446572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:48.148924 run osmo-stp_10.42.42.5(pid=10718): stdout: | (launched: 2022-12-09_02:14:46.201795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:48.283736 run osmo-stp_10.42.42.5(pid=10718): stderr: | 20221209021446565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021446565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021446570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021446571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021446571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021446572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021446572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:48.443721 run patchelf(pid=10721): Terminating (SIGINT) 02:14:48.626798 run patchelf(pid=10721): Terminated: ok {rc=0} 02:14:48.758926 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10718): Process ended prematurely: osmo-stp_10.42.42.5(pid=10718) [trial-2353↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10718)] [trial-2353↪gprs:sysmo↪ping_idle_ping.py:27] 02:14:48.768257 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 02:14:48.796747 run osmo-hlr_10.42.42.2(pid=10715): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10715)] 02:14:48.847443 run osmo-hlr_10.42.42.2(pid=10715): stdout: | (launched: 2022-12-09_02:14:45.155334) 02:14:48.899894 run osmo-hlr_10.42.42.2(pid=10715): stderr: | 20221209021445358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021445358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021445358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021445358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021445358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021445358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021445371 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021445381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021445382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021445382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:48.953284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10714): Terminating (SIGTERM) 02:14:48.995852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10717): Terminating (SIGTERM) 02:14:49.038298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10720): Terminating (SIGTERM) 02:14:49.081532 --- ParallelTerminationStrategy: PID 10714 died... 02:14:49.101366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10714): Terminated: ok {rc=0} 02:14:49.148233 --- ParallelTerminationStrategy: PID 10717 died... 02:14:49.167898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10717): Terminated: ok {rc=0} 02:14:49.214842 --- ParallelTerminationStrategy: PID 10720 died... 02:14:49.234367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10720): Terminated: ok {rc=0} 02:14:49.323985 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 02:14:50.606877 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:14:50.612003 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:14:50.632849 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:14:50.671734 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:14:50.759326 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:14:50.780057 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:14:50.818632 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:14:51.412207 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:14:51.462312 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:51.473193 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:14:51.510512 tst cs_paging_gprs_active.py: using LAC 18362 02:14:51.633083 tst cs_paging_gprs_active.py: using RAC 2 02:14:51.757105 tst cs_paging_gprs_active.py: using CellId 18362 02:14:51.881119 tst cs_paging_gprs_active.py: using BVCI 18363 02:14:51.996580 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:52.007599 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:52.018318 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:52.029165 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:52.039713 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:52.050368 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:52.061170 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:52.071712 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:52.082710 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:52.202752 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:52.323705 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:14:52.533969 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:52.848860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10725): Launched 02:14:53.123156 run iperf3-srv_10.42.42.10(pid=10726): Launched 02:14:53.242007 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:14:53.452678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:53.768318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10727): Launched 02:14:54.042963 run iperf3-srv_10.42.42.10(pid=10728): Launched 02:14:54.159696 tst cs_paging_gprs_active.py:38: start network... 02:14:54.369900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:54.856686 run create_hlr_db(pid=10729): Launched 02:14:54.985374 bus /gobi_6: Setting Powered False 02:14:56.047345 run create_hlr_db(pid=10729): Terminated: ok {rc=0} 02:14:56.505012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10731): Launched 02:14:56.842555 run osmo-hlr_10.42.42.2(pid=10732): Launched 02:14:56.973425 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:57.551651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10734): Launched 02:14:57.888591 run osmo-stp_10.42.42.5(pid=10735): Launched 02:14:58.018613 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:58.596365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10737): Launched 02:14:58.723936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:59.009055 run patchelf(pid=10738): Launched 02:14:59.193607 run osmo-stp_10.42.42.5(pid=10735): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10735)] 02:14:59.334336 run osmo-stp_10.42.42.5(pid=10735): stdout: | (launched: 2022-12-09_02:14:57.825050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:59.476920 run osmo-stp_10.42.42.5(pid=10735): stderr: | 20221209021458019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021458019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021458020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021458020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021458020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021458021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021458021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:59.619385 run osmo-stp_10.42.42.5(pid=10735): stdout: | (launched: 2022-12-09_02:14:57.825050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:59.756094 run osmo-stp_10.42.42.5(pid=10735): stderr: | 20221209021458019 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021458019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021458020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021458020 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021458020 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021458021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021458021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:59.918551 run patchelf(pid=10738): Terminating (SIGINT) 02:15:00.105256 run patchelf(pid=10738): Terminated: ok {rc=0} 02:15:00.239514 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10735): Process ended prematurely: osmo-stp_10.42.42.5(pid=10735) [trial-2353↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10735)] [trial-2353↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:15:00.249730 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 02:15:00.278945 run osmo-hlr_10.42.42.2(pid=10732): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10732)] 02:15:00.329866 run osmo-hlr_10.42.42.2(pid=10732): stdout: | (launched: 2022-12-09_02:14:56.779080) 02:15:00.382422 run osmo-hlr_10.42.42.2(pid=10732): stderr: | 20221209021456980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021456980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021456981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021456981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021456981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021456981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021456992 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021457001 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021457001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021457001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:00.435361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10725): Terminating (SIGTERM) 02:15:00.477944 run iperf3-srv_10.42.42.10(pid=10726): Terminating (SIGTERM) 02:15:00.520316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10727): Terminating (SIGTERM) 02:15:00.562931 run iperf3-srv_10.42.42.10(pid=10728): Terminating (SIGTERM) 02:15:00.605169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10731): Terminating (SIGTERM) 02:15:00.647610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10734): Terminating (SIGTERM) 02:15:00.690098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10737): Terminating (SIGTERM) 02:15:00.732582 --- ParallelTerminationStrategy: PID 10725 died... 02:15:00.752738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10725): Terminated: ok {rc=0} 02:15:00.800015 --- ParallelTerminationStrategy: PID 10726 died... 02:15:00.819473 run iperf3-srv_10.42.42.10(pid=10726): Terminated {rc=256} 02:15:00.873608 --- ParallelTerminationStrategy: PID 10727 died... 02:15:00.897600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10727): Terminated: ok {rc=0} 02:15:00.946497 --- ParallelTerminationStrategy: PID 10728 died... 02:15:00.966422 run iperf3-srv_10.42.42.10(pid=10728): Terminated {rc=256} 02:15:01.013695 --- ParallelTerminationStrategy: PID 10731 died... 02:15:01.033726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10731): Terminated: ok {rc=0} 02:15:01.080907 --- ParallelTerminationStrategy: PID 10734 died... 02:15:01.101187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10734): Terminated: ok {rc=0} 02:15:01.148785 --- ParallelTerminationStrategy: PID 10737 died... 02:15:01.169111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10737): Terminated: ok {rc=0} 02:15:01.258665 bus /gobi_0: Setting Powered False 02:15:02.360340 bus /gobi_0: Setting Powered False 02:15:03.477657 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:15:04.631410 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:04.643709 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:15:04.686430 tst iperf3.py: using LAC 18363 02:15:04.817046 tst iperf3.py: using RAC 3 02:15:04.948376 tst iperf3.py: using CellId 18363 02:15:05.079345 tst iperf3.py: using BVCI 18364 02:15:05.201368 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:05.212773 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:05.224016 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:05.235399 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:05.246789 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:05.258217 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:05.269789 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:05.281160 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:05.292673 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:15:05.415432 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:15:05.625728 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:05.940390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10742): Launched 02:15:06.213900 run iperf3-srv_10.42.42.10(pid=10743): Launched 02:15:06.330515 tst iperf3.py:8: start network... 02:15:06.538558 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:07.023789 run create_hlr_db(pid=10744): Launched 02:15:07.151553 bus /gobi_6: Setting Powered False 02:15:08.212772 run create_hlr_db(pid=10744): Terminated: ok {rc=0} 02:15:08.668880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10746): Launched 02:15:09.006282 run osmo-hlr_10.42.42.2(pid=10747): Launched 02:15:09.134507 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:09.711861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10749): Launched 02:15:10.048409 run osmo-stp_10.42.42.5(pid=10750): Launched 02:15:10.175860 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:10.755583 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10752): Launched 02:15:10.882805 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:11.168116 run patchelf(pid=10753): Launched 02:15:11.352596 run osmo-stp_10.42.42.5(pid=10750): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10750)] 02:15:11.493170 run osmo-stp_10.42.42.5(pid=10750): stdout: | (launched: 2022-12-09_02:15:09.985734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:11.635956 run osmo-stp_10.42.42.5(pid=10750): stderr: | 20221209021510181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021510181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021510181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021510181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021510182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021510182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021510182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:11.778462 run osmo-stp_10.42.42.5(pid=10750): stdout: | (launched: 2022-12-09_02:15:09.985734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:11.915466 run osmo-stp_10.42.42.5(pid=10750): stderr: | 20221209021510181 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021510181 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021510181 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021510181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021510182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021510182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021510182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:12.077835 run patchelf(pid=10753): Terminating (SIGINT) 02:15:12.263892 run patchelf(pid=10753): Terminated: ok {rc=0} 02:15:12.398348 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10750): Process ended prematurely: osmo-stp_10.42.42.5(pid=10750) [trial-2353↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10750)] [trial-2353↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 02:15:12.408493 tst iperf3.py:8: Test FAILED (7.8 sec) 02:15:12.437816 run osmo-hlr_10.42.42.2(pid=10747): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10747)] 02:15:12.488714 run osmo-hlr_10.42.42.2(pid=10747): stdout: | (launched: 2022-12-09_02:15:08.943320) 02:15:12.541297 run osmo-hlr_10.42.42.2(pid=10747): stderr: | 20221209021509147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021509147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021509147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021509147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021509147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021509147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021509158 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021509166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021509166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021509166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:12.594225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10742): Terminating (SIGTERM) 02:15:12.636788 run iperf3-srv_10.42.42.10(pid=10743): Terminating (SIGTERM) 02:15:12.679194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10746): Terminating (SIGTERM) 02:15:12.721835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10749): Terminating (SIGTERM) 02:15:12.764189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10752): Terminating (SIGTERM) 02:15:12.806700 --- ParallelTerminationStrategy: PID 10742 died... 02:15:12.826828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10742): Terminated: ok {rc=0} 02:15:12.873984 --- ParallelTerminationStrategy: PID 10743 died... 02:15:12.893540 run iperf3-srv_10.42.42.10(pid=10743): Terminated {rc=256} 02:15:12.940495 --- ParallelTerminationStrategy: PID 10746 died... 02:15:12.960133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10746): Terminated: ok {rc=0} 02:15:13.007072 --- ParallelTerminationStrategy: PID 10749 died... 02:15:13.026617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10749): Terminated: ok {rc=0} 02:15:13.072859 --- ParallelTerminationStrategy: PID 10752 died... 02:15:13.092731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10752): Terminated: ok {rc=0} 02:15:13.179860 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:15:14.329522 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.341271 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:15:14.380273 tst iperf3m4.py: using LAC 18364 02:15:14.505465 tst iperf3m4.py: using RAC 4 02:15:14.629637 tst iperf3m4.py: using CellId 18364 02:15:14.763071 tst iperf3m4.py: using BVCI 18365 02:15:14.887020 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.898686 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.910211 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.921793 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.933856 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.945314 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.956915 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.968330 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.979980 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:15:15.099234 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:15:15.221549 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:15:15.343080 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:15:15.465494 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:15:15.693002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:16.054191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10754): Launched 02:15:16.388794 run iperf3-srv_10.42.42.10(pid=10755): Launched 02:15:16.531410 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:15:16.762865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:17.111168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10756): Launched 02:15:17.415879 run iperf3-srv_10.42.42.10(pid=10757): Launched 02:15:17.542337 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:15:17.768567 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:18.107772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10758): Launched 02:15:18.400380 run iperf3-srv_10.42.42.10(pid=10759): Launched 02:15:18.525667 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:15:18.751250 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:19.090100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10760): Launched 02:15:19.384219 run iperf3-srv_10.42.42.10(pid=10761): Launched 02:15:19.510177 tst iperf3m4.py:8: start network... 02:15:19.736363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:20.257573 run create_hlr_db(pid=10762): Launched 02:15:20.384664 bus /gobi_6: Setting Powered False 02:15:21.450566 run create_hlr_db(pid=10762): Terminated: ok {rc=0} 02:15:21.915479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10764): Launched 02:15:22.251837 run osmo-hlr_10.42.42.2(pid=10765): Launched 02:15:22.382567 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:22.959628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10767): Launched 02:15:23.295084 run osmo-stp_10.42.42.5(pid=10768): Launched 02:15:23.423636 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:24.001942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10770): Launched 02:15:24.129216 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:24.414222 run patchelf(pid=10771): Launched 02:15:24.599165 run osmo-stp_10.42.42.5(pid=10768): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10768)] 02:15:24.739902 run osmo-stp_10.42.42.5(pid=10768): stdout: | (launched: 2022-12-09_02:15:23.232188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:24.882250 run osmo-stp_10.42.42.5(pid=10768): stderr: | 20221209021523429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021523429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021523429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021523429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021523430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021523430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021523430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:25.025252 run osmo-stp_10.42.42.5(pid=10768): stdout: | (launched: 2022-12-09_02:15:23.232188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:25.161748 run osmo-stp_10.42.42.5(pid=10768): stderr: | 20221209021523429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021523429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021523429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021523429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021523430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021523430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021523430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:25.323563 run patchelf(pid=10771): Terminating (SIGINT) 02:15:25.509990 run patchelf(pid=10771): Terminated: ok {rc=0} 02:15:25.644301 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10768): Process ended prematurely: osmo-stp_10.42.42.5(pid=10768) [trial-2353↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10768)] [trial-2353↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 02:15:25.654476 tst iperf3m4.py:8: Test FAILED (11.4 sec) 02:15:25.684065 run osmo-hlr_10.42.42.2(pid=10765): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10765)] 02:15:25.734604 run osmo-hlr_10.42.42.2(pid=10765): stdout: | (launched: 2022-12-09_02:15:22.188843) 02:15:25.787034 run osmo-hlr_10.42.42.2(pid=10765): stderr: | 20221209021522392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021522392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021522392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021522392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021522392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021522392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021522405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021522413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021522413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021522413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:25.839798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10754): Terminating (SIGTERM) 02:15:25.882126 run iperf3-srv_10.42.42.10(pid=10755): Terminating (SIGTERM) 02:15:25.924483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10756): Terminating (SIGTERM) 02:15:25.967399 run iperf3-srv_10.42.42.10(pid=10757): Terminating (SIGTERM) 02:15:26.009608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10758): Terminating (SIGTERM) 02:15:26.051775 run iperf3-srv_10.42.42.10(pid=10759): Terminating (SIGTERM) 02:15:26.094027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10760): Terminating (SIGTERM) 02:15:26.136247 run iperf3-srv_10.42.42.10(pid=10761): Terminating (SIGTERM) 02:15:26.178442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10764): Terminating (SIGTERM) 02:15:26.220933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10767): Terminating (SIGTERM) 02:15:26.263582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10770): Terminating (SIGTERM) 02:15:26.306094 --- ParallelTerminationStrategy: PID 10754 died... 02:15:26.326058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10754): Terminated: ok {rc=0} 02:15:26.373065 --- ParallelTerminationStrategy: PID 10755 died... 02:15:26.392542 run iperf3-srv_10.42.42.10(pid=10755): Terminated {rc=256} 02:15:26.439044 --- ParallelTerminationStrategy: PID 10756 died... 02:15:26.458674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10756): Terminated: ok {rc=0} 02:15:26.505331 --- ParallelTerminationStrategy: PID 10757 died... 02:15:26.524863 run iperf3-srv_10.42.42.10(pid=10757): Terminated {rc=256} 02:15:26.571304 --- ParallelTerminationStrategy: PID 10758 died... 02:15:26.590845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10758): Terminated: ok {rc=0} 02:15:26.637669 --- ParallelTerminationStrategy: PID 10759 died... 02:15:26.657260 run iperf3-srv_10.42.42.10(pid=10759): Terminated {rc=256} 02:15:26.703864 --- ParallelTerminationStrategy: PID 10760 died... 02:15:26.723362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10760): Terminated: ok {rc=0} 02:15:26.770172 --- ParallelTerminationStrategy: PID 10761 died... 02:15:26.789910 run iperf3-srv_10.42.42.10(pid=10761): Terminated {rc=256} 02:15:26.836548 --- ParallelTerminationStrategy: PID 10764 died... 02:15:26.856310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10764): Terminated: ok {rc=0} 02:15:26.902950 --- ParallelTerminationStrategy: PID 10767 died... 02:15:26.922664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10767): Terminated: ok {rc=0} 02:15:26.969876 --- ParallelTerminationStrategy: PID 10770 died... 02:15:26.989656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10770): Terminated: ok {rc=0} 02:15:27.079028 bus /gobi_4: Setting Powered False 02:15:28.179404 bus /gobi_4: Setting Powered False 02:15:29.298028 bus /gobi_1: Setting Powered False 02:15:30.397344 bus /gobi_1: Setting Powered False 02:15:31.516374 bus /gobi_0: Setting Powered False 02:15:32.614058 bus /gobi_0: Setting Powered False 02:15:33.731566 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 02:15:34.836884 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:34.848407 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:15:34.886252 tst ping.py: using LAC 18365 02:15:35.006890 tst ping.py: using RAC 5 02:15:35.129892 tst ping.py: using CellId 18365 02:15:35.250596 tst ping.py: using BVCI 18366 02:15:35.363900 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:35.374759 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:35.385641 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:35.396257 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:35.406848 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:35.417448 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:35.428179 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:35.438910 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:15:35.561282 tst ping.py:19: start network... 02:15:35.785682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:36.299784 run create_hlr_db(pid=10772): Launched 02:15:36.428098 bus /gobi_6: Setting Powered False 02:15:37.493533 run create_hlr_db(pid=10772): Terminated: ok {rc=0} 02:15:37.934226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10774): Launched 02:15:38.241701 run osmo-hlr_10.42.42.2(pid=10775): Launched 02:15:38.358757 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:38.887314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10777): Launched 02:15:39.194034 run osmo-stp_10.42.42.5(pid=10778): Launched 02:15:39.312428 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:39.843764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10780): Launched 02:15:39.960081 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:40.220098 run patchelf(pid=10781): Launched 02:15:40.389899 run osmo-stp_10.42.42.5(pid=10778): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10778)] 02:15:40.518424 run osmo-stp_10.42.42.5(pid=10778): stdout: | (launched: 2022-12-09_02:15:39.136023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:40.649266 run osmo-stp_10.42.42.5(pid=10778): stderr: | 20221209021539308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021539308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021539308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021539309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021539311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021539311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021539311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:40.779527 run osmo-stp_10.42.42.5(pid=10778): stdout: | (launched: 2022-12-09_02:15:39.136023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:40.904512 run osmo-stp_10.42.42.5(pid=10778): stderr: | 20221209021539308 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021539308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021539308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021539309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021539311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021539311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021539311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:41.052581 run patchelf(pid=10781): Terminating (SIGINT) 02:15:41.224051 run patchelf(pid=10781): Terminated: ok {rc=0} 02:15:41.347049 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10778): Process ended prematurely: osmo-stp_10.42.42.5(pid=10778) [trial-2353↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10778)] [trial-2353↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 02:15:41.355937 tst ping.py:22: Test FAILED (6.5 sec) 02:15:41.382969 run osmo-hlr_10.42.42.2(pid=10775): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10775)] 02:15:41.431094 run osmo-hlr_10.42.42.2(pid=10775): stdout: | (launched: 2022-12-09_02:15:38.183404) 02:15:41.480516 run osmo-hlr_10.42.42.2(pid=10775): stderr: | 20221209021538362 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021538362 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021538362 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021538362 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021538362 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021538362 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021538374 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021538383 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021538383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021538383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:41.530492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10774): Terminating (SIGTERM) 02:15:41.570327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10777): Terminating (SIGTERM) 02:15:41.610540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10780): Terminating (SIGTERM) 02:15:41.650850 --- ParallelTerminationStrategy: PID 10774 died... 02:15:41.670078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10774): Terminated: ok {rc=0} 02:15:41.715120 --- ParallelTerminationStrategy: PID 10777 died... 02:15:41.733987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10777): Terminated: ok {rc=0} 02:15:41.778762 --- ParallelTerminationStrategy: PID 10780 died... 02:15:41.797538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10780): Terminated: ok {rc=0} 02:15:41.897510 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:15:43.000277 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:43.011941 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:15:43.052753 tst ping_idle_ping.py: using LAC 18366 02:15:43.175590 tst ping_idle_ping.py: using RAC 6 02:15:43.298073 tst ping_idle_ping.py: using CellId 18366 02:15:43.420777 tst ping_idle_ping.py: using BVCI 18367 02:15:43.532732 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:43.543617 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:43.554484 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:43.565796 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:43.577010 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:43.588084 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:43.599432 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:43.610725 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:15:43.735515 tst ping_idle_ping.py:24: start network... 02:15:43.942529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:44.422297 run create_hlr_db(pid=10782): Launched 02:15:44.549405 bus /gobi_6: Setting Powered False 02:15:45.610526 run create_hlr_db(pid=10782): Terminated: ok {rc=0} 02:15:46.100642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10784): Launched 02:15:46.463690 run osmo-hlr_10.42.42.2(pid=10785): Launched 02:15:46.600301 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:47.322610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10787): Launched 02:15:47.655547 run osmo-stp_10.42.42.5(pid=10788): Launched 02:15:47.781856 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:48.355852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10790): Launched 02:15:48.482370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:48.763225 run patchelf(pid=10791): Launched 02:15:48.946390 run osmo-stp_10.42.42.5(pid=10788): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10788)] 02:15:49.085138 run osmo-stp_10.42.42.5(pid=10788): stdout: | (launched: 2022-12-09_02:15:47.593884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:49.225817 run osmo-stp_10.42.42.5(pid=10788): stderr: | 20221209021547788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021547788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021547788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021547789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021547791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021547791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021547791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:49.366205 run osmo-stp_10.42.42.5(pid=10788): stdout: | (launched: 2022-12-09_02:15:47.593884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:49.500746 run osmo-stp_10.42.42.5(pid=10788): stderr: | 20221209021547788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021547788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021547788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021547789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021547791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021547791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021547791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:49.660259 run patchelf(pid=10791): Terminating (SIGINT) 02:15:49.843765 run patchelf(pid=10791): Terminated: ok {rc=0} 02:15:49.976109 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10788): Process ended prematurely: osmo-stp_10.42.42.5(pid=10788) [trial-2353↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10788)] [trial-2353↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 02:15:49.985775 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 02:15:50.014299 run osmo-hlr_10.42.42.2(pid=10785): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10785)] 02:15:50.064637 run osmo-hlr_10.42.42.2(pid=10785): stdout: | (launched: 2022-12-09_02:15:46.399362) 02:15:50.116666 run osmo-hlr_10.42.42.2(pid=10785): stderr: | 20221209021546836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021546836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021546836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021546836 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021546836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021546836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021546867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021546876 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021546876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021546876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:50.168872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10784): Terminating (SIGTERM) 02:15:50.211292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10787): Terminating (SIGTERM) 02:15:50.253766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10790): Terminating (SIGTERM) 02:15:50.296362 --- ParallelTerminationStrategy: PID 10784 died... 02:15:50.316797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10784): Terminated: ok {rc=0} 02:15:50.364771 --- ParallelTerminationStrategy: PID 10787 died... 02:15:50.384671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10787): Terminated: ok {rc=0} 02:15:50.431865 --- ParallelTerminationStrategy: PID 10790 died... 02:15:50.451725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10790): Terminated: ok {rc=0} 02:15:50.541736 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:15:51.834649 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:15:51.841605 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:15:51.864008 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:15:51.904594 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:15:51.996165 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:15:52.017868 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:15:52.057925 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:15:52.648353 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:15:52.699870 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:52.710896 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:15:52.767638 tst cs_paging_gprs_active.py: using LAC 18367 02:15:52.890174 tst cs_paging_gprs_active.py: using RAC 7 02:15:53.012238 tst cs_paging_gprs_active.py: using CellId 18367 02:15:53.135469 tst cs_paging_gprs_active.py: using BVCI 18368 02:15:53.249981 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:53.261070 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:53.271781 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:53.282504 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:53.293269 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:53.303949 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:53.314815 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:53.325482 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:53.336311 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:53.455119 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:53.578426 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:15:53.806389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:54.144853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10795): Launched 02:15:54.438699 run iperf3-srv_10.42.42.10(pid=10796): Launched 02:15:54.564372 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:15:54.790900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:55.129688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10797): Launched 02:15:55.422295 run iperf3-srv_10.42.42.10(pid=10798): Launched 02:15:55.547744 tst cs_paging_gprs_active.py:38: start network... 02:15:55.774193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:56.295917 run create_hlr_db(pid=10799): Launched 02:15:56.424105 bus /gobi_6: Setting Powered False 02:15:57.489518 run create_hlr_db(pid=10799): Terminated: ok {rc=0} 02:15:57.940226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10801): Launched 02:15:58.255240 run osmo-hlr_10.42.42.2(pid=10802): Launched 02:15:58.375213 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:58.914884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10804): Launched 02:15:59.228665 run osmo-stp_10.42.42.5(pid=10805): Launched 02:15:59.347323 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:59.888325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10807): Launched 02:16:00.007366 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:00.272922 run patchelf(pid=10808): Launched 02:16:00.446218 run osmo-stp_10.42.42.5(pid=10805): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10805)] 02:16:00.577466 run osmo-stp_10.42.42.5(pid=10805): stdout: | (launched: 2022-12-09_02:15:59.169433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:00.710652 run osmo-stp_10.42.42.5(pid=10805): stderr: | 20221209021559343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021559344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021559344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021559344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021559345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021559345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021559345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:00.844887 run osmo-stp_10.42.42.5(pid=10805): stdout: | (launched: 2022-12-09_02:15:59.169433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:00.986820 run osmo-stp_10.42.42.5(pid=10805): stderr: | 20221209021559343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021559344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021559344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021559344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021559345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021559345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021559345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:01.140320 run patchelf(pid=10808): Terminating (SIGINT) 02:16:01.318227 run patchelf(pid=10808): Terminated: ok {rc=0} 02:16:01.447002 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10805): Process ended prematurely: osmo-stp_10.42.42.5(pid=10805) [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10805)] [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:16:01.457108 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 02:16:01.485732 run osmo-hlr_10.42.42.2(pid=10802): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10802)] 02:16:01.535839 run osmo-hlr_10.42.42.2(pid=10802): stdout: | (launched: 2022-12-09_02:15:58.195588) 02:16:01.587052 run osmo-hlr_10.42.42.2(pid=10802): stderr: | 20221209021558378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021558378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021558378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021558378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021558378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021558378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021558430 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021558439 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021558439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021558439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:01.638310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10795): Terminating (SIGTERM) 02:16:01.679987 run iperf3-srv_10.42.42.10(pid=10796): Terminating (SIGTERM) 02:16:01.723989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10797): Terminating (SIGTERM) 02:16:01.766058 run iperf3-srv_10.42.42.10(pid=10798): Terminating (SIGTERM) 02:16:01.810769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10801): Terminating (SIGTERM) 02:16:01.852781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10804): Terminating (SIGTERM) 02:16:01.894705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10807): Terminating (SIGTERM) 02:16:01.935899 --- ParallelTerminationStrategy: PID 10795 died... 02:16:01.955826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10795): Terminated: ok {rc=0} 02:16:02.001203 --- ParallelTerminationStrategy: PID 10796 died... 02:16:02.020862 run iperf3-srv_10.42.42.10(pid=10796): Terminated {rc=256} 02:16:02.066665 --- ParallelTerminationStrategy: PID 10797 died... 02:16:02.086087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10797): Terminated: ok {rc=0} 02:16:02.130989 --- ParallelTerminationStrategy: PID 10798 died... 02:16:02.149914 run iperf3-srv_10.42.42.10(pid=10798): Terminated {rc=256} 02:16:02.194739 --- ParallelTerminationStrategy: PID 10801 died... 02:16:02.214055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10801): Terminated: ok {rc=0} 02:16:02.258673 --- ParallelTerminationStrategy: PID 10804 died... 02:16:02.277435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10804): Terminated: ok {rc=0} 02:16:02.321452 --- ParallelTerminationStrategy: PID 10807 died... 02:16:02.340199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10807): Terminated: ok {rc=0} 02:16:02.427004 bus /gobi_0: Setting Powered False 02:16:03.527185 bus /gobi_0: Setting Powered False 02:16:04.640303 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:16:05.792220 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:05.804319 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:16:05.865714 tst iperf3.py: using LAC 18368 02:16:05.998534 tst iperf3.py: using RAC 8 02:16:06.130699 tst iperf3.py: using CellId 18368 02:16:06.263580 tst iperf3.py: using BVCI 18369 02:16:06.387506 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:06.399057 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:06.410549 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:06.422299 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:06.433735 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:06.445165 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:06.456797 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:06.468191 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:06.479747 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:16:06.599282 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:16:06.810034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:07.127007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10809): Launched 02:16:07.402003 run iperf3-srv_10.42.42.10(pid=10810): Launched 02:16:07.519048 tst iperf3.py:8: start network... 02:16:07.729101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:08.215315 run create_hlr_db(pid=10811): Launched 02:16:08.342158 bus /gobi_6: Setting Powered False 02:16:09.403827 run create_hlr_db(pid=10811): Terminated: ok {rc=0} 02:16:09.860219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10813): Launched 02:16:10.198602 run osmo-hlr_10.42.42.2(pid=10814): Launched 02:16:10.327027 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:10.907223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10816): Launched 02:16:11.243649 run osmo-stp_10.42.42.5(pid=10817): Launched 02:16:11.371431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:11.949273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10819): Launched 02:16:12.077854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:12.362783 run patchelf(pid=10820): Launched 02:16:12.547765 run osmo-stp_10.42.42.5(pid=10817): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10817)] 02:16:12.688316 run osmo-stp_10.42.42.5(pid=10817): stdout: | (launched: 2022-12-09_02:16:11.180549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:12.831040 run osmo-stp_10.42.42.5(pid=10817): stderr: | 20221209021611378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021611378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021611378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021611379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021611379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021611379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021611379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:12.974169 run osmo-stp_10.42.42.5(pid=10817): stdout: | (launched: 2022-12-09_02:16:11.180549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:13.111471 run osmo-stp_10.42.42.5(pid=10817): stderr: | 20221209021611378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021611378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021611378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021611379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021611379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021611379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021611379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:13.273752 run patchelf(pid=10820): Terminating (SIGINT) 02:16:13.460088 run patchelf(pid=10820): Terminated: ok {rc=0} 02:16:13.594761 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10817): Process ended prematurely: osmo-stp_10.42.42.5(pid=10817) [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10817)] [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 02:16:13.604909 tst iperf3.py:8: Test FAILED (7.9 sec) 02:16:13.634435 run osmo-hlr_10.42.42.2(pid=10814): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10814)] 02:16:13.685246 run osmo-hlr_10.42.42.2(pid=10814): stdout: | (launched: 2022-12-09_02:16:10.135561) 02:16:13.737538 run osmo-hlr_10.42.42.2(pid=10814): stderr: | 20221209021610338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021610338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021610338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021610338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021610338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021610338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021610349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021610358 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021610358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021610358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:13.790617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10809): Terminating (SIGTERM) 02:16:13.833017 run iperf3-srv_10.42.42.10(pid=10810): Terminating (SIGTERM) 02:16:13.875408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10813): Terminating (SIGTERM) 02:16:13.918021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10816): Terminating (SIGTERM) 02:16:13.960828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10819): Terminating (SIGTERM) 02:16:14.003677 --- ParallelTerminationStrategy: PID 10809 died... 02:16:14.024107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10809): Terminated: ok {rc=0} 02:16:14.071496 --- ParallelTerminationStrategy: PID 10810 died... 02:16:14.091369 run iperf3-srv_10.42.42.10(pid=10810): Terminated {rc=256} 02:16:14.138262 --- ParallelTerminationStrategy: PID 10813 died... 02:16:14.157902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10813): Terminated: ok {rc=0} 02:16:14.204643 --- ParallelTerminationStrategy: PID 10816 died... 02:16:14.224306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10816): Terminated: ok {rc=0} 02:16:14.271768 --- ParallelTerminationStrategy: PID 10819 died... 02:16:14.291629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10819): Terminated: ok {rc=0} 02:16:14.380562 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:16:15.530261 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:15.541983 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:16:15.602898 tst iperf3m4.py: using LAC 18369 02:16:15.726149 tst iperf3m4.py: using RAC 9 02:16:15.874946 tst iperf3m4.py: using CellId 18369 02:16:16.011195 tst iperf3m4.py: using BVCI 18370 02:16:16.167863 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:16.180879 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:16.193424 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:16.206885 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:16.218952 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:16.231073 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:16.243806 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:16.255608 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:16.267924 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:16:16.395193 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:16:16.528277 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:16:16.676426 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:16:16.797970 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:16:17.014990 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:17.338793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10821): Launched 02:16:17.614191 run iperf3-srv_10.42.42.10(pid=10822): Launched 02:16:17.731263 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:16:17.941804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:18.258629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10823): Launched 02:16:18.532237 run iperf3-srv_10.42.42.10(pid=10824): Launched 02:16:18.650041 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:16:18.859303 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:19.175192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10825): Launched 02:16:19.449315 run iperf3-srv_10.42.42.10(pid=10826): Launched 02:16:19.566433 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:16:19.775669 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:20.092129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10827): Launched 02:16:20.365994 run iperf3-srv_10.42.42.10(pid=10828): Launched 02:16:20.482128 tst iperf3m4.py:8: start network... 02:16:20.690655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:21.177216 run create_hlr_db(pid=10829): Launched 02:16:21.303404 bus /gobi_6: Setting Powered False 02:16:22.368346 run create_hlr_db(pid=10829): Terminated: ok {rc=0} 02:16:22.834905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10832): Launched 02:16:23.173840 run osmo-hlr_10.42.42.2(pid=10833): Launched 02:16:23.302151 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:23.881076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10835): Launched 02:16:24.218210 run osmo-stp_10.42.42.5(pid=10836): Launched 02:16:24.346471 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:24.925274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10838): Launched 02:16:25.053353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:25.338641 run patchelf(pid=10839): Launched 02:16:25.524196 run osmo-stp_10.42.42.5(pid=10836): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10836)] 02:16:25.664634 run osmo-stp_10.42.42.5(pid=10836): stdout: | (launched: 2022-12-09_02:16:24.155262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:25.807129 run osmo-stp_10.42.42.5(pid=10836): stderr: | 20221209021624351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021624352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021624352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021624352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021624354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021624355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021624355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:25.949886 run osmo-stp_10.42.42.5(pid=10836): stdout: | (launched: 2022-12-09_02:16:24.155262) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:26.087348 run osmo-stp_10.42.42.5(pid=10836): stderr: | 20221209021624351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021624352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021624352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021624352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021624354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021624355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021624355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:26.250067 run patchelf(pid=10839): Terminating (SIGINT) 02:16:26.436457 run patchelf(pid=10839): Terminated: ok {rc=0} 02:16:26.570970 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10836): Process ended prematurely: osmo-stp_10.42.42.5(pid=10836) [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10836)] [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:16:26.581275 tst iperf3m4.py:8: Test FAILED (11.1 sec) 02:16:26.611211 run osmo-hlr_10.42.42.2(pid=10833): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10833)] 02:16:26.662145 run osmo-hlr_10.42.42.2(pid=10833): stdout: | (launched: 2022-12-09_02:16:23.110680) 02:16:26.714654 run osmo-hlr_10.42.42.2(pid=10833): stderr: | 20221209021623313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021623313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021623313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021623313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021623314 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021623314 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021623325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021623334 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021623334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021623334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:26.767482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10821): Terminating (SIGTERM) 02:16:26.810002 run iperf3-srv_10.42.42.10(pid=10822): Terminating (SIGTERM) 02:16:26.852596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10823): Terminating (SIGTERM) 02:16:26.895446 run iperf3-srv_10.42.42.10(pid=10824): Terminating (SIGTERM) 02:16:26.938168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10825): Terminating (SIGTERM) 02:16:26.981732 run iperf3-srv_10.42.42.10(pid=10826): Terminating (SIGTERM) 02:16:27.024490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10827): Terminating (SIGTERM) 02:16:27.066948 run iperf3-srv_10.42.42.10(pid=10828): Terminating (SIGTERM) 02:16:27.109385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10832): Terminating (SIGTERM) 02:16:27.151951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10835): Terminating (SIGTERM) 02:16:27.194476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10838): Terminating (SIGTERM) 02:16:27.237209 --- ParallelTerminationStrategy: PID 10821 died... 02:16:27.257452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10821): Terminated: ok {rc=0} 02:16:27.304658 --- ParallelTerminationStrategy: PID 10822 died... 02:16:27.324464 run iperf3-srv_10.42.42.10(pid=10822): Terminated {rc=256} 02:16:27.371401 --- ParallelTerminationStrategy: PID 10823 died... 02:16:27.391341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10823): Terminated: ok {rc=0} 02:16:27.438573 --- ParallelTerminationStrategy: PID 10824 died... 02:16:27.458288 run iperf3-srv_10.42.42.10(pid=10824): Terminated {rc=256} 02:16:27.505345 --- ParallelTerminationStrategy: PID 10825 died... 02:16:27.525010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10825): Terminated: ok {rc=0} 02:16:27.571886 --- ParallelTerminationStrategy: PID 10826 died... 02:16:27.591451 run iperf3-srv_10.42.42.10(pid=10826): Terminated {rc=256} 02:16:27.638484 --- ParallelTerminationStrategy: PID 10827 died... 02:16:27.658506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10827): Terminated: ok {rc=0} 02:16:27.705432 --- ParallelTerminationStrategy: PID 10828 died... 02:16:27.725169 run iperf3-srv_10.42.42.10(pid=10828): Terminated {rc=256} 02:16:27.771853 --- ParallelTerminationStrategy: PID 10832 died... 02:16:27.791750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10832): Terminated: ok {rc=0} 02:16:27.838490 --- ParallelTerminationStrategy: PID 10835 died... 02:16:27.858256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10835): Terminated: ok {rc=0} 02:16:27.905691 --- ParallelTerminationStrategy: PID 10838 died... 02:16:27.925557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10838): Terminated: ok {rc=0} 02:16:28.014348 bus /gobi_4: Setting Powered False 02:16:29.116016 bus /gobi_4: Setting Powered False 02:16:30.235350 bus /gobi_1: Setting Powered False 02:16:31.334682 bus /gobi_1: Setting Powered False 02:16:32.455501 bus /gobi_0: Setting Powered False 02:16:33.556040 bus /gobi_0: Setting Powered False 02:16:34.674684 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:16:35.778580 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:35.791263 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:16:35.850843 tst ping.py: using LAC 18370 02:16:35.981366 tst ping.py: using RAC 10 02:16:36.111974 tst ping.py: using CellId 18370 02:16:36.242805 tst ping.py: using BVCI 18371 02:16:36.365350 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:36.376996 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:36.388378 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:36.400107 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:36.411724 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:36.423462 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:36.435597 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:36.447230 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:16:36.564435 tst ping.py:19: start network... 02:16:36.770944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:37.249712 run create_hlr_db(pid=10840): Launched 02:16:37.376404 bus /gobi_6: Setting Powered False 02:16:38.437351 run create_hlr_db(pid=10840): Terminated: ok {rc=0} 02:16:38.888470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10842): Launched 02:16:39.220300 run osmo-hlr_10.42.42.2(pid=10843): Launched 02:16:39.348468 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:39.925150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10845): Launched 02:16:40.256446 run osmo-stp_10.42.42.5(pid=10846): Launched 02:16:40.382070 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:40.951199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10848): Launched 02:16:41.076553 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:41.356280 run patchelf(pid=10849): Launched 02:16:41.538648 run osmo-stp_10.42.42.5(pid=10846): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10846)] 02:16:41.677377 run osmo-stp_10.42.42.5(pid=10846): stdout: | (launched: 2022-12-09_02:16:40.194782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:41.817658 run osmo-stp_10.42.42.5(pid=10846): stderr: | 20221209021640389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021640389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021640389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021640390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021640392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021640392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021640392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:41.958269 run osmo-stp_10.42.42.5(pid=10846): stdout: | (launched: 2022-12-09_02:16:40.194782) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:42.093329 run osmo-stp_10.42.42.5(pid=10846): stderr: | 20221209021640389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021640389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021640389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021640390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021640392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021640392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021640392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:42.253242 run patchelf(pid=10849): Terminating (SIGINT) 02:16:42.436538 run patchelf(pid=10849): Terminated: ok {rc=0} 02:16:42.568511 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10846): Process ended prematurely: osmo-stp_10.42.42.5(pid=10846) [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10846)] [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 02:16:42.577952 tst ping.py:22: Test FAILED (6.8 sec) 02:16:42.606759 run osmo-hlr_10.42.42.2(pid=10843): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10843)] 02:16:42.657972 run osmo-hlr_10.42.42.2(pid=10843): stdout: | (launched: 2022-12-09_02:16:39.158245) 02:16:42.710549 run osmo-hlr_10.42.42.2(pid=10843): stderr: | 20221209021639358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021639358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021639358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021639359 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021639359 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021639359 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021639376 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021639385 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021639386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021639386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:42.763446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10842): Terminating (SIGTERM) 02:16:42.806285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10845): Terminating (SIGTERM) 02:16:42.848618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10848): Terminating (SIGTERM) 02:16:42.892023 --- ParallelTerminationStrategy: PID 10842 died... 02:16:42.912191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10842): Terminated: ok {rc=0} 02:16:42.959565 --- ParallelTerminationStrategy: PID 10845 died... 02:16:42.979686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10845): Terminated: ok {rc=0} 02:16:43.026803 --- ParallelTerminationStrategy: PID 10848 died... 02:16:43.046598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10848): Terminated: ok {rc=0} 02:16:43.135721 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:16:44.224383 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:44.236928 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:16:44.302753 tst ping_idle_ping.py: using LAC 18371 02:16:44.433908 tst ping_idle_ping.py: using RAC 11 02:16:44.555427 tst ping_idle_ping.py: using CellId 18371 02:16:44.677915 tst ping_idle_ping.py: using BVCI 18372 02:16:44.790590 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:44.802239 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:44.813219 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:44.823777 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:44.834442 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:44.845064 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:44.855903 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:44.866610 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:16:44.987439 tst ping_idle_ping.py:24: start network... 02:16:45.210917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:45.727360 run create_hlr_db(pid=10850): Launched 02:16:45.860696 bus /gobi_6: Setting Powered False 02:16:46.952289 run create_hlr_db(pid=10850): Terminated: ok {rc=0} 02:16:47.415211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10852): Launched 02:16:47.725921 run osmo-hlr_10.42.42.2(pid=10853): Launched 02:16:47.842777 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:48.396616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10855): Launched 02:16:48.707311 run osmo-stp_10.42.42.5(pid=10856): Launched 02:16:48.825665 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:49.359633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10858): Launched 02:16:49.477215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:49.739622 run patchelf(pid=10859): Launched 02:16:49.910547 run osmo-stp_10.42.42.5(pid=10856): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10856)] 02:16:50.040315 run osmo-stp_10.42.42.5(pid=10856): stdout: | (launched: 2022-12-09_02:16:48.647621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:50.172023 run osmo-stp_10.42.42.5(pid=10856): stderr: | 20221209021648821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021648821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021648821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021648822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021648822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021648822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021648822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:50.304696 run osmo-stp_10.42.42.5(pid=10856): stdout: | (launched: 2022-12-09_02:16:48.647621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:50.430921 run osmo-stp_10.42.42.5(pid=10856): stderr: | 20221209021648821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021648821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021648821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021648822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021648822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021648822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021648822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:50.580245 run patchelf(pid=10859): Terminating (SIGINT) 02:16:50.752378 run patchelf(pid=10859): Terminated: ok {rc=0} 02:16:50.876143 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10856): Process ended prematurely: osmo-stp_10.42.42.5(pid=10856) [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10856)] [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:16:50.885026 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:16:50.911604 run osmo-hlr_10.42.42.2(pid=10853): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10853)] 02:16:50.959397 run osmo-hlr_10.42.42.2(pid=10853): stdout: | (launched: 2022-12-09_02:16:47.666945) 02:16:51.009380 run osmo-hlr_10.42.42.2(pid=10853): stderr: | 20221209021647845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021647845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021647845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021647845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021647845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021647845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021647858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021647869 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021647869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021647869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:51.059481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10852): Terminating (SIGTERM) 02:16:51.099742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10855): Terminating (SIGTERM) 02:16:51.139933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10858): Terminating (SIGTERM) 02:16:51.180622 --- ParallelTerminationStrategy: PID 10852 died... 02:16:51.199913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10852): Terminated: ok {rc=0} 02:16:51.244582 --- ParallelTerminationStrategy: PID 10855 died... 02:16:51.263559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10855): Terminated: ok {rc=0} 02:16:51.307987 --- ParallelTerminationStrategy: PID 10858 died... 02:16:51.326861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10858): Terminated: ok {rc=0} 02:16:51.413134 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:16:52.709106 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:16:52.715537 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:16:52.736900 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:16:52.775629 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:16:52.862184 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:16:52.882917 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:16:52.921228 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:16:53.520636 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:16:53.576547 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:53.588290 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:16:53.651101 tst cs_paging_gprs_active.py: using LAC 18372 02:16:53.782106 tst cs_paging_gprs_active.py: using RAC 12 02:16:53.914005 tst cs_paging_gprs_active.py: using CellId 18372 02:16:54.046063 tst cs_paging_gprs_active.py: using BVCI 18373 02:16:54.170073 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.181532 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.192775 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.204251 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.215604 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.227191 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.238761 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.250420 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.262200 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:54.390134 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:54.512000 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:16:54.723070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:55.039869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10864): Launched 02:16:55.314068 run iperf3-srv_10.42.42.10(pid=10865): Launched 02:16:55.430946 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:16:55.640502 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:55.956261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10866): Launched 02:16:56.230511 run iperf3-srv_10.42.42.10(pid=10867): Launched 02:16:56.347921 tst cs_paging_gprs_active.py:38: start network... 02:16:56.557187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:57.043136 run create_hlr_db(pid=10868): Launched 02:16:57.171671 bus /gobi_6: Setting Powered False 02:16:58.233892 run create_hlr_db(pid=10868): Terminated: ok {rc=0} 02:16:58.692676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10870): Launched 02:16:59.030783 run osmo-hlr_10.42.42.2(pid=10871): Launched 02:16:59.159663 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:59.738536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10873): Launched 02:17:00.075906 run osmo-stp_10.42.42.5(pid=10874): Launched 02:17:00.207171 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:00.787550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10876): Launched 02:17:00.957279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:01.236246 run patchelf(pid=10877): Launched 02:17:01.429636 run osmo-stp_10.42.42.5(pid=10874): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10874)] 02:17:01.567126 run osmo-stp_10.42.42.5(pid=10874): stdout: | (launched: 2022-12-09_02:17:00.012582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:01.721981 run osmo-stp_10.42.42.5(pid=10874): stderr: | 20221209021700210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021700210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021700210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021700211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021700211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021700211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021700211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:01.859304 run osmo-stp_10.42.42.5(pid=10874): stdout: | (launched: 2022-12-09_02:17:00.012582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:01.992780 run osmo-stp_10.42.42.5(pid=10874): stderr: | 20221209021700210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021700210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021700210 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021700211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021700211 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021700211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021700211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:02.167503 run patchelf(pid=10877): Terminating (SIGINT) 02:17:02.350398 run patchelf(pid=10877): Terminated: ok {rc=0} 02:17:02.486434 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10874): Process ended prematurely: osmo-stp_10.42.42.5(pid=10874) [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10874)] [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:17:02.496888 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 02:17:02.527070 run osmo-hlr_10.42.42.2(pid=10871): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10871)] 02:17:02.578965 run osmo-hlr_10.42.42.2(pid=10871): stdout: | (launched: 2022-12-09_02:16:58.967446) 02:17:02.632333 run osmo-hlr_10.42.42.2(pid=10871): stderr: | 20221209021659171 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021659171 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021659171 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021659171 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021659171 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021659171 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021659183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021659194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021659194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021659194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:02.686532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10864): Terminating (SIGTERM) 02:17:02.729955 run iperf3-srv_10.42.42.10(pid=10865): Terminating (SIGTERM) 02:17:02.773386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10866): Terminating (SIGTERM) 02:17:02.816827 run iperf3-srv_10.42.42.10(pid=10867): Terminating (SIGTERM) 02:17:02.859883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10870): Terminating (SIGTERM) 02:17:02.903287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10873): Terminating (SIGTERM) 02:17:02.946528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10876): Terminating (SIGTERM) 02:17:02.990338 --- ParallelTerminationStrategy: PID 10864 died... 02:17:03.010581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10864): Terminated: ok {rc=0} 02:17:03.058914 --- ParallelTerminationStrategy: PID 10865 died... 02:17:03.079055 run iperf3-srv_10.42.42.10(pid=10865): Terminated {rc=256} 02:17:03.126855 --- ParallelTerminationStrategy: PID 10866 died... 02:17:03.146867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10866): Terminated: ok {rc=0} 02:17:03.194572 --- ParallelTerminationStrategy: PID 10867 died... 02:17:03.214642 run iperf3-srv_10.42.42.10(pid=10867): Terminated {rc=256} 02:17:03.262688 --- ParallelTerminationStrategy: PID 10870 died... 02:17:03.282808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10870): Terminated: ok {rc=0} 02:17:03.330736 --- ParallelTerminationStrategy: PID 10873 died... 02:17:03.350800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10873): Terminated: ok {rc=0} 02:17:03.398228 --- ParallelTerminationStrategy: PID 10876 died... 02:17:03.418391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10876): Terminated: ok {rc=0} 02:17:03.508080 bus /gobi_0: Setting Powered False 02:17:04.607764 bus /gobi_0: Setting Powered False 02:17:05.725170 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:17:06.877137 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:06.889509 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:17:06.952025 tst iperf3.py: using LAC 18373 02:17:07.084107 tst iperf3.py: using RAC 13 02:17:07.217269 tst iperf3.py: using CellId 18373 02:17:07.350343 tst iperf3.py: using BVCI 18374 02:17:07.474311 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:07.485933 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:07.497257 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:07.508667 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:07.520248 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:07.531700 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:07.543385 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:07.554867 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:07.566521 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:17:07.685760 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:17:07.896823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:17:08.213568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10881): Launched 02:17:08.487938 run iperf3-srv_10.42.42.10(pid=10882): Launched 02:17:08.605786 tst iperf3.py:8: start network... 02:17:08.816032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:09.303660 run create_hlr_db(pid=10883): Launched 02:17:09.431171 bus /gobi_6: Setting Powered False 02:17:10.493125 run create_hlr_db(pid=10883): Terminated: ok {rc=0} 02:17:10.950253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10885): Launched 02:17:11.287930 run osmo-hlr_10.42.42.2(pid=10886): Launched 02:17:11.416694 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:12.000163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10888): Launched 02:17:12.337160 run osmo-stp_10.42.42.5(pid=10889): Launched 02:17:12.465566 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:13.046762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10891): Launched 02:17:13.174721 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:13.460330 run patchelf(pid=10892): Launched 02:17:13.646456 run osmo-stp_10.42.42.5(pid=10889): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10889)] 02:17:13.787694 run osmo-stp_10.42.42.5(pid=10889): stdout: | (launched: 2022-12-09_02:17:12.274317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:13.931299 run osmo-stp_10.42.42.5(pid=10889): stderr: | 20221209021712471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021712471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021712471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021712471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021712472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021712472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021712472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:14.075348 run osmo-stp_10.42.42.5(pid=10889): stdout: | (launched: 2022-12-09_02:17:12.274317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:14.212808 run osmo-stp_10.42.42.5(pid=10889): stderr: | 20221209021712471 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021712471 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021712471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021712471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021712472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021712472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021712472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:14.375745 run patchelf(pid=10892): Terminating (SIGINT) 02:17:14.563478 run patchelf(pid=10892): Terminated: ok {rc=0} 02:17:14.698373 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10889): Process ended prematurely: osmo-stp_10.42.42.5(pid=10889) [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10889)] [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 02:17:14.708610 tst iperf3.py:8: Test FAILED (7.9 sec) 02:17:14.737687 run osmo-hlr_10.42.42.2(pid=10886): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10886)] 02:17:14.788081 run osmo-hlr_10.42.42.2(pid=10886): stdout: | (launched: 2022-12-09_02:17:11.225045) 02:17:14.840526 run osmo-hlr_10.42.42.2(pid=10886): stderr: | 20221209021711428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021711428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021711428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021711428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021711428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021711428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021711440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021711448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021711449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021711449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:14.893511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10881): Terminating (SIGTERM) 02:17:14.936156 run iperf3-srv_10.42.42.10(pid=10882): Terminating (SIGTERM) 02:17:14.978674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10885): Terminating (SIGTERM) 02:17:15.021579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10888): Terminating (SIGTERM) 02:17:15.063974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10891): Terminating (SIGTERM) 02:17:15.106699 --- ParallelTerminationStrategy: PID 10881 died... 02:17:15.127002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10881): Terminated: ok {rc=0} 02:17:15.174174 --- ParallelTerminationStrategy: PID 10882 died... 02:17:15.193823 run iperf3-srv_10.42.42.10(pid=10882): Terminated {rc=256} 02:17:15.240705 --- ParallelTerminationStrategy: PID 10885 died... 02:17:15.260450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10885): Terminated: ok {rc=0} 02:17:15.307505 --- ParallelTerminationStrategy: PID 10888 died... 02:17:15.327225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10888): Terminated: ok {rc=0} 02:17:15.374102 --- ParallelTerminationStrategy: PID 10891 died... 02:17:15.393894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10891): Terminated: ok {rc=0} 02:17:15.482176 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:17:16.637602 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:16.650377 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:17:16.711561 tst iperf3m4.py: using LAC 18374 02:17:16.874489 tst iperf3m4.py: using RAC 14 02:17:17.009225 tst iperf3m4.py: using CellId 18374 02:17:17.145338 tst iperf3m4.py: using BVCI 18375 02:17:17.271516 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:17.282705 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:17.293559 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:17.304464 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:17.315386 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:17.326272 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:17.337259 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:17.347979 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:17.359013 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:17:17.480693 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:17:17.604495 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:17:17.732519 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:17:17.853077 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:17:18.075262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:17:18.406541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10893): Launched 02:17:18.693327 run iperf3-srv_10.42.42.10(pid=10894): Launched 02:17:18.816018 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:17:19.038581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:17:19.370528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10895): Launched 02:17:19.657173 run iperf3-srv_10.42.42.10(pid=10896): Launched 02:17:19.779624 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:17:20.001552 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:17:20.332325 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10897): Launched 02:17:20.619216 run iperf3-srv_10.42.42.10(pid=10898): Launched 02:17:20.741736 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:17:20.962806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:17:21.293961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10899): Launched 02:17:21.579604 run iperf3-srv_10.42.42.10(pid=10900): Launched 02:17:21.701833 tst iperf3m4.py:8: start network... 02:17:21.922862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:22.432766 run create_hlr_db(pid=10901): Launched 02:17:22.557853 bus /gobi_6: Setting Powered False 02:17:23.622817 run create_hlr_db(pid=10901): Terminated: ok {rc=0} 02:17:24.060405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10903): Launched 02:17:24.391546 run osmo-hlr_10.42.42.2(pid=10904): Launched 02:17:24.518793 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:25.094607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10906): Launched 02:17:25.423839 run osmo-stp_10.42.42.5(pid=10919): Launched 02:17:25.548997 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:26.118319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10921): Launched 02:17:26.245381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:26.525109 run patchelf(pid=10922): Launched 02:17:26.707220 run osmo-stp_10.42.42.5(pid=10919): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10919)] 02:17:26.846145 run osmo-stp_10.42.42.5(pid=10919): stdout: | (launched: 2022-12-09_02:17:25.362696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:26.986709 run osmo-stp_10.42.42.5(pid=10919): stderr: | 20221209021725558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021725558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021725558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021725559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021725561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021725561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021725561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:27.127939 run osmo-stp_10.42.42.5(pid=10919): stdout: | (launched: 2022-12-09_02:17:25.362696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:27.262425 run osmo-stp_10.42.42.5(pid=10919): stderr: | 20221209021725558 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021725558 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021725558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021725559 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021725561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021725561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021725561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:27.421908 run patchelf(pid=10922): Terminating (SIGINT) 02:17:27.605795 run patchelf(pid=10922): Terminated: ok {rc=0} 02:17:27.737963 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10919): Process ended prematurely: osmo-stp_10.42.42.5(pid=10919) [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10919)] [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:17:27.748053 tst iperf3m4.py:8: Test FAILED (11.2 sec) 02:17:27.777312 run osmo-hlr_10.42.42.2(pid=10904): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10904)] 02:17:27.827583 run osmo-hlr_10.42.42.2(pid=10904): stdout: | (launched: 2022-12-09_02:17:24.329590) 02:17:27.879513 run osmo-hlr_10.42.42.2(pid=10904): stderr: | 20221209021724533 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021724533 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021724533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021724533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021724533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021724533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021724546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021724554 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021724555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021724555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:27.931907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10893): Terminating (SIGTERM) 02:17:27.974095 run iperf3-srv_10.42.42.10(pid=10894): Terminating (SIGTERM) 02:17:28.016399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10895): Terminating (SIGTERM) 02:17:28.058811 run iperf3-srv_10.42.42.10(pid=10896): Terminating (SIGTERM) 02:17:28.100840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10897): Terminating (SIGTERM) 02:17:28.143128 run iperf3-srv_10.42.42.10(pid=10898): Terminating (SIGTERM) 02:17:28.185147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10899): Terminating (SIGTERM) 02:17:28.227156 run iperf3-srv_10.42.42.10(pid=10900): Terminating (SIGTERM) 02:17:28.269163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10903): Terminating (SIGTERM) 02:17:28.311363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10906): Terminating (SIGTERM) 02:17:28.353436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10921): Terminating (SIGTERM) 02:17:28.395794 --- ParallelTerminationStrategy: PID 10893 died... 02:17:28.415878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10893): Terminated: ok {rc=0} 02:17:28.462674 --- ParallelTerminationStrategy: PID 10894 died... 02:17:28.482258 run iperf3-srv_10.42.42.10(pid=10894): Terminated {rc=256} 02:17:28.528873 --- ParallelTerminationStrategy: PID 10895 died... 02:17:28.548672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10895): Terminated: ok {rc=0} 02:17:28.595337 --- ParallelTerminationStrategy: PID 10896 died... 02:17:28.615258 run iperf3-srv_10.42.42.10(pid=10896): Terminated {rc=256} 02:17:28.661554 --- ParallelTerminationStrategy: PID 10897 died... 02:17:28.681087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10897): Terminated: ok {rc=0} 02:17:28.727443 --- ParallelTerminationStrategy: PID 10898 died... 02:17:28.747041 run iperf3-srv_10.42.42.10(pid=10898): Terminated {rc=256} 02:17:28.793352 --- ParallelTerminationStrategy: PID 10899 died... 02:17:28.812719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10899): Terminated: ok {rc=0} 02:17:28.859043 --- ParallelTerminationStrategy: PID 10900 died... 02:17:28.878602 run iperf3-srv_10.42.42.10(pid=10900): Terminated {rc=256} 02:17:28.925226 --- ParallelTerminationStrategy: PID 10903 died... 02:17:28.944681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10903): Terminated: ok {rc=0} 02:17:28.991497 --- ParallelTerminationStrategy: PID 10906 died... 02:17:29.011021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10906): Terminated: ok {rc=0} 02:17:29.057457 --- ParallelTerminationStrategy: PID 10921 died... 02:17:29.076919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10921): Terminated: ok {rc=0} 02:17:29.164822 bus /gobi_4: Setting Powered False 02:17:30.263171 bus /gobi_4: Setting Powered False 02:17:31.376443 bus /gobi_1: Setting Powered False 02:17:32.474995 bus /gobi_1: Setting Powered False 02:17:33.593864 bus /gobi_0: Setting Powered False 02:17:34.692057 bus /gobi_0: Setting Powered False 02:17:35.806491 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:17:36.909451 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:36.920907 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:17:36.977790 tst ping.py: using LAC 18375 02:17:37.095702 tst ping.py: using RAC 15 02:17:37.224432 tst ping.py: using CellId 18375 02:17:37.351077 tst ping.py: using BVCI 18376 02:17:37.469165 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:37.480701 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:37.491885 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:37.503264 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:37.514635 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:37.525985 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:37.537586 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:37.548870 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:17:37.668490 tst ping.py:19: start network... 02:17:37.885340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:38.386958 run create_hlr_db(pid=10926): Launched 02:17:38.509527 bus /gobi_6: Setting Powered False 02:17:39.573608 run create_hlr_db(pid=10926): Terminated: ok {rc=0} 02:17:40.004674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10928): Launched 02:17:40.307507 run osmo-hlr_10.42.42.2(pid=10929): Launched 02:17:40.422779 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:40.943964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10931): Launched 02:17:41.246501 run osmo-stp_10.42.42.5(pid=10932): Launched 02:17:41.361106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:41.880156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10934): Launched 02:17:41.994604 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:42.249971 run patchelf(pid=10935): Launched 02:17:42.415962 run osmo-stp_10.42.42.5(pid=10932): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10932)] 02:17:42.542204 run osmo-stp_10.42.42.5(pid=10932): stdout: | (launched: 2022-12-09_02:17:41.189264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:42.671349 run osmo-stp_10.42.42.5(pid=10932): stderr: | 20221209021741362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021741362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021741362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021741363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021741363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021741363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021741363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:42.799638 run osmo-stp_10.42.42.5(pid=10932): stdout: | (launched: 2022-12-09_02:17:41.189264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:42.922755 run osmo-stp_10.42.42.5(pid=10932): stderr: | 20221209021741362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021741362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021741362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021741363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021741363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021741363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021741363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:43.067707 run patchelf(pid=10935): Terminating (SIGINT) 02:17:43.235120 run patchelf(pid=10935): Terminated: ok {rc=0} 02:17:43.356062 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10932): Process ended prematurely: osmo-stp_10.42.42.5(pid=10932) [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10932)] [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 02:17:43.364823 tst ping.py:22: Test FAILED (6.4 sec) 02:17:43.391588 run osmo-hlr_10.42.42.2(pid=10929): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10929)] 02:17:43.439082 run osmo-hlr_10.42.42.2(pid=10929): stdout: | (launched: 2022-12-09_02:17:40.249859) 02:17:43.488130 run osmo-hlr_10.42.42.2(pid=10929): stderr: | 20221209021740426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021740426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021740426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021740426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021740426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021740426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021740438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021740447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021740447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021740447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:43.537634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10928): Terminating (SIGTERM) 02:17:43.577362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10931): Terminating (SIGTERM) 02:17:43.616693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10934): Terminating (SIGTERM) 02:17:43.656560 --- ParallelTerminationStrategy: PID 10928 died... 02:17:43.675481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10928): Terminated: ok {rc=0} 02:17:43.719145 --- ParallelTerminationStrategy: PID 10931 died... 02:17:43.737644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10931): Terminated: ok {rc=0} 02:17:43.781245 --- ParallelTerminationStrategy: PID 10934 died... 02:17:43.799644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10934): Terminated: ok {rc=0} 02:17:43.885929 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:17:44.974319 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:44.986379 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:17:45.045476 tst ping_idle_ping.py: using LAC 18376 02:17:45.168766 tst ping_idle_ping.py: using RAC 16 02:17:45.287320 tst ping_idle_ping.py: using CellId 18376 02:17:45.404563 tst ping_idle_ping.py: using BVCI 18377 02:17:45.524586 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:45.536722 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:45.548136 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:45.560336 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:45.572318 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:45.584414 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:45.596568 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:45.608575 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:17:45.726233 tst ping_idle_ping.py:24: start network... 02:17:45.949373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:46.434042 run create_hlr_db(pid=10936): Launched 02:17:46.593969 bus /gobi_6: Setting Powered False 02:17:47.654421 run create_hlr_db(pid=10936): Terminated: ok {rc=0} 02:17:48.096594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10938): Launched 02:17:48.436932 run osmo-hlr_10.42.42.2(pid=10939): Launched 02:17:48.559252 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:49.115867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10941): Launched 02:17:49.419554 run osmo-stp_10.42.42.5(pid=10942): Launched 02:17:49.533850 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:50.049285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10944): Launched 02:17:50.163249 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:50.415390 run patchelf(pid=10945): Launched 02:17:50.581666 run osmo-stp_10.42.42.5(pid=10942): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10942)] 02:17:50.708034 run osmo-stp_10.42.42.5(pid=10942): stdout: | (launched: 2022-12-09_02:17:49.364293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:50.836517 run osmo-stp_10.42.42.5(pid=10942): stderr: | 20221209021749535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021749535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021749535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021749536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021749536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021749536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021749537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:50.964705 run osmo-stp_10.42.42.5(pid=10942): stdout: | (launched: 2022-12-09_02:17:49.364293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:51.087361 run osmo-stp_10.42.42.5(pid=10942): stderr: | 20221209021749535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021749535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021749535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021749536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021749536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021749536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021749537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:51.232544 run patchelf(pid=10945): Terminating (SIGINT) 02:17:51.399242 run patchelf(pid=10945): Terminated: ok {rc=0} 02:17:51.519490 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10942): Process ended prematurely: osmo-stp_10.42.42.5(pid=10942) [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10942)] [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:17:51.528319 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 02:17:51.554841 run osmo-hlr_10.42.42.2(pid=10939): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10939)] 02:17:51.602363 run osmo-hlr_10.42.42.2(pid=10939): stdout: | (launched: 2022-12-09_02:17:48.378063) 02:17:51.651218 run osmo-hlr_10.42.42.2(pid=10939): stderr: | 20221209021748580 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021748580 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021748580 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021748580 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021748580 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021748580 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021748592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021748600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021748600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021748601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:51.700684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10938): Terminating (SIGTERM) 02:17:51.740475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10941): Terminating (SIGTERM) 02:17:51.780214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10944): Terminating (SIGTERM) 02:17:51.820215 --- ParallelTerminationStrategy: PID 10938 died... 02:17:51.839254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10938): Terminated: ok {rc=0} 02:17:51.883461 --- ParallelTerminationStrategy: PID 10941 died... 02:17:51.902526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10941): Terminated: ok {rc=0} 02:17:51.947105 --- ParallelTerminationStrategy: PID 10944 died... 02:17:51.966119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10944): Terminated: ok {rc=0} 02:17:52.049095 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:17:53.339763 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:17:53.347130 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:17:53.370562 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:17:53.407742 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:17:53.462641 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:17:53.484238 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:17:53.521253 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:17:54.078766 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:17:54.084154 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:54.095756 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:17:54.155499 tst switch_tch_pdch.py: using LAC 18377 02:17:54.285811 tst switch_tch_pdch.py: using RAC 17 02:17:54.411380 tst switch_tch_pdch.py: using CellId 18377 02:17:54.535353 tst switch_tch_pdch.py: using BVCI 18378 02:17:54.645446 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:54.656784 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:54.668171 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:54.679472 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:54.690776 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:54.702199 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:54.713665 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:54.725063 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:17:54.840354 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:17:54.959534 tst switch_tch_pdch.py:51: start network... 02:17:55.175188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:55.670654 run create_hlr_db(pid=10949): Launched 02:17:55.792852 bus /gobi_6: Setting Powered False 02:17:56.856313 run create_hlr_db(pid=10949): Terminated: ok {rc=0} 02:17:57.282128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10951): Launched 02:17:57.581128 run osmo-hlr_10.42.42.2(pid=10952): Launched 02:17:57.694388 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:58.215935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10954): Launched 02:17:58.511416 run osmo-stp_10.42.42.5(pid=10955): Launched 02:17:58.629546 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:59.143944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10957): Launched 02:17:59.255168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:59.502129 run patchelf(pid=10958): Launched 02:17:59.664219 run osmo-stp_10.42.42.5(pid=10955): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10955)] 02:17:59.787909 run osmo-stp_10.42.42.5(pid=10955): stdout: | (launched: 2022-12-09_02:17:58.456832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:59.913683 run osmo-stp_10.42.42.5(pid=10955): stderr: | 20221209021758626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021758627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021758627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021758627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021758628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021758628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021758628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:00.039405 run osmo-stp_10.42.42.5(pid=10955): stdout: | (launched: 2022-12-09_02:17:58.456832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:00.159535 run osmo-stp_10.42.42.5(pid=10955): stderr: | 20221209021758626 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021758627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021758627 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021758627 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021758628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021758628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021758628 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:00.301472 run patchelf(pid=10958): Terminating (SIGINT) 02:18:00.466610 run patchelf(pid=10958): Terminated: ok {rc=0} 02:18:00.584913 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10955): Process ended prematurely: osmo-stp_10.42.42.5(pid=10955) [trial-2353↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10955)] [trial-2353↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:18:00.593754 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 02:18:00.620154 run osmo-hlr_10.42.42.2(pid=10952): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10952)] 02:18:00.667266 run osmo-hlr_10.42.42.2(pid=10952): stdout: | (launched: 2022-12-09_02:17:57.525377) 02:18:00.715940 run osmo-hlr_10.42.42.2(pid=10952): stderr: | 20221209021757703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021757703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021757703 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021757703 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021757703 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021757703 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021757719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021757729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021757729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021757729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:00.765136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10951): Terminating (SIGTERM) 02:18:00.805086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10954): Terminating (SIGTERM) 02:18:00.849221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10957): Terminating (SIGTERM) 02:18:00.897943 --- ParallelTerminationStrategy: PID 10951 died... 02:18:00.917451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10951): Terminated: ok {rc=0} 02:18:00.961886 --- ParallelTerminationStrategy: PID 10954 died... 02:18:00.981845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10954): Terminated: ok {rc=0} 02:18:01.027396 --- ParallelTerminationStrategy: PID 10957 died... 02:18:01.047002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10957): Terminated: ok {rc=0} 02:18:01.132259 bus /gobi_0: Setting Powered False 02:18:02.233856 bus /gobi_0: Setting Powered False 02:18:03.351758 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:18:04.587918 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:04.595420 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:18:04.617590 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:18:04.653506 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:18:04.707354 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:18:04.728628 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:18:04.764274 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:18:05.320343 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:18:05.325639 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:18:05.336759 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:18:05.394325 tst switch_tch_pdch.py: using LAC 18378 02:18:05.519039 tst switch_tch_pdch.py: using RAC 18 02:18:05.642266 tst switch_tch_pdch.py: using CellId 18378 02:18:05.769637 tst switch_tch_pdch.py: using BVCI 18379 02:18:05.886675 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:18:05.898020 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:18:05.909150 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:18:05.920349 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:18:05.931629 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:18:05.943022 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:18:05.954628 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:18:05.966059 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:18:06.082391 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:18:06.196785 tst switch_tch_pdch.py:51: start network... 02:18:06.392748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:06.822054 run create_hlr_db(pid=10962): Launched 02:18:06.943767 bus /gobi_6: Setting Powered False 02:18:08.003389 run create_hlr_db(pid=10962): Terminated: ok {rc=0} 02:18:08.388126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10964): Launched 02:18:08.680361 run osmo-hlr_10.42.42.2(pid=10965): Launched 02:18:08.792100 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:09.274306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10967): Launched 02:18:09.565146 run osmo-stp_10.42.42.5(pid=10968): Launched 02:18:09.675894 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:18:10.155828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10970): Launched 02:18:10.267826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:18:10.514680 run patchelf(pid=10971): Launched 02:18:10.677279 run osmo-stp_10.42.42.5(pid=10968): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10968)] 02:18:10.801283 run osmo-stp_10.42.42.5(pid=10968): stdout: | (launched: 2022-12-09_02:18:09.512069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:10.927679 run osmo-stp_10.42.42.5(pid=10968): stderr: | 20221209021809675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021809675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021809676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021809676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021809677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021809677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021809677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:11.053322 run osmo-stp_10.42.42.5(pid=10968): stdout: | (launched: 2022-12-09_02:18:09.512069) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:11.173246 run osmo-stp_10.42.42.5(pid=10968): stderr: | 20221209021809675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021809675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021809676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021809676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021809677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021809677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021809677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:11.315406 run patchelf(pid=10971): Terminating (SIGINT) 02:18:11.479344 run patchelf(pid=10971): Terminated: ok {rc=0} 02:18:11.597979 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10968): Process ended prematurely: osmo-stp_10.42.42.5(pid=10968) [trial-2353↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10968)] [trial-2353↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:18:11.606775 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 02:18:11.633205 run osmo-hlr_10.42.42.2(pid=10965): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10965)] 02:18:11.680362 run osmo-hlr_10.42.42.2(pid=10965): stdout: | (launched: 2022-12-09_02:18:08.627216) 02:18:11.729129 run osmo-hlr_10.42.42.2(pid=10965): stderr: | 20221209021808801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021808801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021808801 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021808801 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021808801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021808801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021808811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021808820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021808821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021808821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:11.778144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10964): Terminating (SIGTERM) 02:18:11.817724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10967): Terminating (SIGTERM) 02:18:11.857140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10970): Terminating (SIGTERM) 02:18:11.896776 --- ParallelTerminationStrategy: PID 10964 died... 02:18:11.915761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10964): Terminated: ok {rc=0} 02:18:11.959377 --- ParallelTerminationStrategy: PID 10967 died... 02:18:11.977835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10967): Terminated: ok {rc=0} 02:18:12.021788 --- ParallelTerminationStrategy: PID 10970 died... 02:18:12.040091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10970): Terminated: ok {rc=0} 02:18:12.123564 bus /gobi_0: Setting Powered False 02:18:13.221302 bus /gobi_0: Setting Powered False 02:18:14.338773 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_sms:oc2g --------------------------------------------------------------------- 02:18:15.575160 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:15.578857 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 02:18:15.599252 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 02:18:15.606365 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 02:18:15.656033 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 02:18:15.676592 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 02:18:15.683590 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 02:18:16.240346 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 02:18:16.249197 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 02:18:16.265352 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 02:18:16.311989 tst mo_mt_sms.py: using LAC 18379 02:18:16.429070 tst mo_mt_sms.py: using RAC 19 02:18:16.545340 tst mo_mt_sms.py: using CellId 18379 02:18:16.693564 tst mo_mt_sms.py: using BVCI 18380 02:18:16.867583 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 02:18:16.991279 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 02:18:17.107850 tst mo_mt_sms.py:9: start nitb and bts... 02:18:17.340434 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:18:17.985033 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10975): Launched 02:18:18.301408 run osmo-nitb_10.42.42.2(pid=10976): Launched 02:18:18.476262 run osmo-nitb_10.42.42.2(pid=10976): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10976)] 02:18:18.617676 run osmo-nitb_10.42.42.2(pid=10976): stdout: | (launched: 2022-12-09_02:18:18.244512) 02:18:18.760687 run osmo-nitb_10.42.42.2(pid=10976): stderr: | (launched: 2022-12-09_02:18:18.291586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:18:18.903719 run osmo-nitb_10.42.42.2(pid=10976): stdout: | (launched: 2022-12-09_02:18:18.244512) 02:18:19.041513 run osmo-nitb_10.42.42.2(pid=10976): stderr: | (launched: 2022-12-09_02:18:18.291586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10976): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10976) [trial-2353↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10976)] 02:18:19.421561 tst osmo-nitb_10.42.42.2(pid=10976): stdout: | (launched: 2022-12-09_02:18:18.244512) 02:18:19.548752 tst osmo-nitb_10.42.42.2(pid=10976): stderr: | (launched: 2022-12-09_02:18:18.291586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:18:19.698736 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=10976): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10976) [trial-2353↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10976)] [trial-2353↪nitb_sms:oc2g↪mo_mt_sms.py:11] 02:18:19.707756 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 02:18:19.714749 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10975): Terminating (SIGTERM) 02:18:19.925534 --- ParallelTerminationStrategy: PID 10975 died... 02:18:19.947335 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10975): Terminated: ok {rc=0} 02:18:20.035192 bus /sierra_3: Setting Powered False 02:18:21.133977 bus /sierra_3: Setting Powered False 02:18:22.247325 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 sms:oc2g --------------------------------------------------------------------- 02:18:23.427809 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:23.432159 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 02:18:23.453590 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 02:18:23.481176 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 02:18:23.533832 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 02:18:23.554945 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 02:18:23.582804 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 02:18:24.131275 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 sms:oc2g mo_mt_sms.py ---------------------------------------------- 02:18:24.137326 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:18:24.148800 tst sms:oc2g: Using 1 x bts (candidates: 1) 02:18:24.183661 tst mo_mt_sms.py: using LAC 18380 02:18:24.305784 tst mo_mt_sms.py: using RAC 20 02:18:24.427355 tst mo_mt_sms.py: using CellId 18380 02:18:24.550031 tst mo_mt_sms.py: using BVCI 18381 02:18:24.657119 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:18:24.667645 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:18:24.678101 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:18:24.688459 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:18:24.698919 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:18:24.709400 tst sms:oc2g: Using 1 x modem (candidates: 2) 02:18:24.826093 tst sms:oc2g: Using 1 x modem (candidates: 2) 02:18:24.940632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:25.430476 run create_hlr_db(pid=10980): Launched 02:18:25.550077 bus /sierra_2: Setting Powered False 02:18:26.612283 run create_hlr_db(pid=10980): Terminated: ok {rc=0} 02:18:27.032855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10982): Launched 02:18:27.323535 run osmo-hlr_10.42.42.2(pid=10983): Launched 02:18:27.435012 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:27.940116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10985): Launched 02:18:28.230707 run osmo-stp_10.42.42.5(pid=10986): Launched 02:18:28.341748 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:28.870974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10988): Launched 02:18:29.163840 run osmo-msc_10.42.42.6(pid=10989): Launched 02:18:29.327928 run osmo-stp_10.42.42.5(pid=10986): ERR: Terminated: ERROR {rc=1} [trial-2353↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10986)] 02:18:29.453098 run osmo-stp_10.42.42.5(pid=10986): stdout: | (launched: 2022-12-09_02:18:28.177742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:29.577565 run osmo-stp_10.42.42.5(pid=10986): stderr: | 20221209021828343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021828343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021828344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021828344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021828345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021828345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021828345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:29.699782 run osmo-stp_10.42.42.5(pid=10986): stdout: | (launched: 2022-12-09_02:18:28.177742) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:29.816682 run osmo-stp_10.42.42.5(pid=10986): stderr: | 20221209021828343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021828343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021828344 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021828344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021828345 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021828345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021828345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:29.956262 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10986): Process ended prematurely: osmo-stp_10.42.42.5(pid=10986) [trial-2353↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10986)] [trial-2353↪sms:oc2g↪mo_mt_sms.py:16] 02:18:29.964765 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 02:18:29.990611 run osmo-hlr_10.42.42.2(pid=10983): ERR: Terminated: ERROR {rc=237} [trial-2353↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10983)] 02:18:30.038337 run osmo-hlr_10.42.42.2(pid=10983): stdout: | (launched: 2022-12-09_02:18:27.270540) 02:18:30.087408 run osmo-hlr_10.42.42.2(pid=10983): stderr: | 20221209021827439 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021827440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021827440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021827440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021827440 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021827440 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021827468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021827478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021827478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021827478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:30.156058 run osmo-msc_10.42.42.6(pid=10989): ERR: Terminated: ERROR {rc=2} [trial-2353↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10989)] 02:18:30.203532 run osmo-msc_10.42.42.6(pid=10989): stdout: | (launched: 2022-12-09_02:18:29.110487) 02:18:30.252437 run osmo-msc_10.42.42.6(pid=10989): stderr: | 20221209021829378 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021829380 DLGLOBAL DEBUG validating counter group 0x7fe1108bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021829380 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021829380 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021829380 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021829380 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021829382 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021829382 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021829383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021829383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:30.301533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10982): Terminating (SIGTERM) 02:18:30.341087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10985): Terminating (SIGTERM) 02:18:30.380526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10988): Terminating (SIGTERM) 02:18:30.420489 --- ParallelTerminationStrategy: PID 10982 died... 02:18:30.439572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10982): Terminated: ok {rc=0} 02:18:30.483588 --- ParallelTerminationStrategy: PID 10985 died... 02:18:30.502276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10985): Terminated: ok {rc=0} 02:18:30.546166 --- ParallelTerminationStrategy: PID 10988 died... 02:18:30.564630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10988): Terminated: ok {rc=0} 02:18:30.648216 bus /sierra_3: Setting Powered False 02:18:31.742885 bus /sierra_3: Setting Powered False 02:18:32.856493 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_ussd:oc2g --------------------------------------------------------------------- 02:18:34.073808 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:34.078808 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 02:18:34.101811 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 02:18:34.109366 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 02:18:34.145810 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 02:18:34.166820 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 02:18:34.174218 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 02:18:34.692929 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2353 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 02:18:34.698265 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 02:18:34.709433 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 02:18:34.744475 tst assert_extension.py: using LAC 18381 02:18:34.868204 tst assert_extension.py: using RAC 21 02:18:34.991713 tst assert_extension.py: using CellId 18381 02:18:35.111885 tst assert_extension.py: using BVCI 18382 02:18:35.218841 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 02:18:35.334537 tst assert_extension.py:10: start nitb and bts... 02:18:35.539405 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:18:36.136662 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10995): Launched 02:18:36.428467 run osmo-nitb_10.42.42.2(pid=10996): Launched 02:18:36.590506 run osmo-nitb_10.42.42.2(pid=10996): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10996)] 02:18:36.721846 run osmo-nitb_10.42.42.2(pid=10996): stdout: | (launched: 2022-12-09_02:18:36.375285) 02:18:36.854785 run osmo-nitb_10.42.42.2(pid=10996): stderr: | (launched: 2022-12-09_02:18:36.418843) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:18:36.987753 run osmo-nitb_10.42.42.2(pid=10996): stdout: | (launched: 2022-12-09_02:18:36.375285) 02:18:37.116147 run osmo-nitb_10.42.42.2(pid=10996): stderr: | (launched: 2022-12-09_02:18:36.418843) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10996): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10996) [trial-2353↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10996)] 02:18:37.539039 tst osmo-nitb_10.42.42.2(pid=10996): stdout: | (launched: 2022-12-09_02:18:36.375285) 02:18:37.657031 tst osmo-nitb_10.42.42.2(pid=10996): stderr: | (launched: 2022-12-09_02:18:36.418843) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:18:37.795619 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10996): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10996) [trial-2353↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10996)] [trial-2353↪nitb_ussd:oc2g↪assert_extension.py:12] 02:18:37.803804 tst assert_extension.py:12: Test FAILED (3.1 sec) 02:18:37.810267 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10995): Terminating (SIGTERM) 02:18:38.018449 --- ParallelTerminationStrategy: PID 10995 died... 02:18:38.039198 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10995): Terminated: ok {rc=0} 02:18:38.121252 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 ussd:oc2g --------------------------------------------------------------------- 02:18:39.282446 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:39.287280 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 02:18:39.308913 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 02:18:39.337624 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 02:18:39.373364 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 02:18:39.393624 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 02:18:39.420296 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 02:18:39.951391 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2353 ussd:oc2g assert_extension.py ---------------------------------------------- 02:18:39.956833 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:18:39.967872 tst ussd:oc2g: Using 1 x bts (candidates: 1) 02:18:40.004508 tst assert_extension.py: using LAC 18382 02:18:40.135251 tst assert_extension.py: using RAC 22 02:18:40.258347 tst assert_extension.py: using CellId 18382 02:18:40.380740 tst assert_extension.py: using BVCI 18383 02:18:40.495656 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:18:40.506773 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:18:40.517880 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:18:40.528849 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:18:40.539968 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:18:40.551832 tst ussd:oc2g: Using 1 x modem (candidates: 1) 02:18:40.671542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:41.160836 run create_hlr_db(pid=11001): Launched 02:18:41.281184 bus /sierra_2: Setting Powered False 02:18:42.344092 run create_hlr_db(pid=11001): Terminated: ok {rc=0} 02:18:42.782249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11003): Launched 02:18:43.096602 run osmo-hlr_10.42.42.2(pid=11004): Launched 02:18:43.218154 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:43.765330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11006): Launched 02:18:44.080043 run osmo-stp_10.42.42.5(pid=11007): Launched 02:18:44.201220 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:44.769140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11009): Launched 02:18:45.083469 run osmo-msc_10.42.42.6(pid=11010): Launched 02:18:45.260707 run osmo-stp_10.42.42.5(pid=11007): ERR: Terminated: ERROR {rc=1} [trial-2353↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11007)] 02:18:45.395191 run osmo-stp_10.42.42.5(pid=11007): stdout: | (launched: 2022-12-09_02:18:44.022760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:45.529661 run osmo-stp_10.42.42.5(pid=11007): stderr: | 20221209021844211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021844211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021844211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021844212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021844212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021844212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021844212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:45.663312 run osmo-stp_10.42.42.5(pid=11007): stdout: | (launched: 2022-12-09_02:18:44.022760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:45.789037 run osmo-stp_10.42.42.5(pid=11007): stderr: | 20221209021844211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021844211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021844211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021844212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021844212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021844212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021844212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:45.980829 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=11007): Process ended prematurely: osmo-stp_10.42.42.5(pid=11007) [trial-2353↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11007)] [trial-2353↪ussd:oc2g↪assert_extension.py:17] 02:18:45.990235 tst assert_extension.py:17: Test FAILED (6.0 sec) 02:18:46.020536 run osmo-hlr_10.42.42.2(pid=11004): ERR: Terminated: ERROR {rc=237} [trial-2353↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11004)] 02:18:46.074267 run osmo-hlr_10.42.42.2(pid=11004): stdout: | (launched: 2022-12-09_02:18:43.039687) 02:18:46.129875 run osmo-hlr_10.42.42.2(pid=11004): stderr: | 20221209021843234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021843234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021843234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021843234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021843234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021843234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021843262 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021843271 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021843271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021843271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:46.205814 run osmo-msc_10.42.42.6(pid=11010): ERR: Terminated: ERROR {rc=2} [trial-2353↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11010)] 02:18:46.259243 run osmo-msc_10.42.42.6(pid=11010): stdout: | (launched: 2022-12-09_02:18:45.026020) 02:18:46.314074 run osmo-msc_10.42.42.6(pid=11010): stderr: | 20221209021845346 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021845346 DLGLOBAL DEBUG validating counter group 0x7f686e217c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021845346 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021845346 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021845347 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021845347 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021845348 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021845349 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021845349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021845349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:46.368734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11003): Terminating (SIGTERM) 02:18:46.412618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11006): Terminating (SIGTERM) 02:18:46.456492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11009): Terminating (SIGTERM) 02:18:46.500695 --- ParallelTerminationStrategy: PID 11003 died... 02:18:46.521232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11003): Terminated: ok {rc=0} 02:18:46.570493 --- ParallelTerminationStrategy: PID 11006 died... 02:18:46.591064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11006): Terminated: ok {rc=0} 02:18:46.645522 --- ParallelTerminationStrategy: PID 11009 died... 02:18:46.669426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11009): Terminated: ok {rc=0} 02:18:46.772408 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:18:47.973338 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:47.980531 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:18:48.003573 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:18:48.032053 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:18:48.085955 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:18:48.107494 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:18:48.135165 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:18:48.684852 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:18:48.737281 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:48.748621 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:18:48.804550 tst mo_mt_call.py: using LAC 18383 02:18:48.930018 tst mo_mt_call.py: using RAC 23 02:18:49.061077 tst mo_mt_call.py: using CellId 18383 02:18:49.186736 tst mo_mt_call.py: using BVCI 18384 02:18:49.303046 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:49.314589 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:49.325810 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:49.337258 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:49.348798 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:49.360234 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:18:49.478558 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:18:49.598395 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:50.095875 run create_hlr_db(pid=11016): Launched 02:18:50.217622 bus /sierra_2: Setting Powered False 02:18:51.281286 run create_hlr_db(pid=11016): Terminated: ok {rc=0} 02:18:51.707564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11037): Launched 02:18:52.005668 run osmo-hlr_10.42.42.2(pid=11038): Launched 02:18:52.119781 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:52.632846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11040): Launched 02:18:52.930658 run osmo-stp_10.42.42.5(pid=11041): Launched 02:18:53.044461 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:53.584778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11043): Launched 02:18:53.883438 run osmo-msc_10.42.42.6(pid=11045): Launched 02:18:54.050608 run osmo-stp_10.42.42.5(pid=11041): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11041)] 02:18:54.177390 run osmo-stp_10.42.42.5(pid=11041): stdout: | (launched: 2022-12-09_02:18:52.876619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:54.303077 run osmo-stp_10.42.42.5(pid=11041): stderr: | 20221209021853043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021853043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021853043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021853044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021853044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021853044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021853045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:54.427221 run osmo-stp_10.42.42.5(pid=11041): stdout: | (launched: 2022-12-09_02:18:52.876619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:54.546090 run osmo-stp_10.42.42.5(pid=11041): stderr: | 20221209021853043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021853043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021853043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021853044 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021853044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021853044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021853045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:54.688114 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11041): Process ended prematurely: osmo-stp_10.42.42.5(pid=11041) [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11041)] [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:18:54.696809 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:18:54.722929 run osmo-hlr_10.42.42.2(pid=11038): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11038)] 02:18:54.770043 run osmo-hlr_10.42.42.2(pid=11038): stdout: | (launched: 2022-12-09_02:18:51.951453) 02:18:54.818976 run osmo-hlr_10.42.42.2(pid=11038): stderr: | 20221209021852125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021852125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021852125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021852125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021852125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021852126 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021852138 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021852146 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021852147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021852147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:54.886825 run osmo-msc_10.42.42.6(pid=11045): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11045)] 02:18:54.933892 run osmo-msc_10.42.42.6(pid=11045): stdout: | (launched: 2022-12-09_02:18:53.828533) 02:18:54.982207 run osmo-msc_10.42.42.6(pid=11045): stderr: | 20221209021854103 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021854103 DLGLOBAL DEBUG validating counter group 0x7f6bc4acac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021854103 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021854103 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021854103 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021854103 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021854105 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021854105 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021854106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021854106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:55.031151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11037): Terminating (SIGTERM) 02:18:55.069934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11040): Terminating (SIGTERM) 02:18:55.108571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11043): Terminating (SIGTERM) 02:18:55.147708 --- ParallelTerminationStrategy: PID 11037 died... 02:18:55.166569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11037): Terminated: ok {rc=0} 02:18:55.210270 --- ParallelTerminationStrategy: PID 11040 died... 02:18:55.228926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11040): Terminated: ok {rc=0} 02:18:55.273005 --- ParallelTerminationStrategy: PID 11043 died... 02:18:55.291733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11043): Terminated: ok {rc=0} 02:18:55.376068 bus /sierra_3: Setting Powered False 02:18:56.474088 bus /sierra_3: Setting Powered False 02:18:57.589036 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:18:58.734230 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:58.745945 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:18:58.802083 tst mo_mt_call_osmux.py: using LAC 18384 02:18:58.919999 tst mo_mt_call_osmux.py: using RAC 24 02:18:59.039084 tst mo_mt_call_osmux.py: using CellId 18384 02:18:59.157813 tst mo_mt_call_osmux.py: using BVCI 18385 02:18:59.267850 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:59.278926 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:59.290036 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:59.300735 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:59.311498 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:59.322397 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:18:59.441165 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:18:59.559069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:00.022856 run create_hlr_db(pid=11047): Launched 02:19:00.144115 bus /sierra_2: Setting Powered False 02:19:01.227270 run create_hlr_db(pid=11047): Terminated: ok {rc=0} 02:19:01.731515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11049): Launched 02:19:02.049914 run osmo-hlr_10.42.42.2(pid=11050): Launched 02:19:02.239079 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:02.764636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11052): Launched 02:19:03.062957 run osmo-stp_10.42.42.5(pid=11053): Launched 02:19:03.176368 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:03.717217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11055): Launched 02:19:04.014404 run osmo-msc_10.42.42.6(pid=11056): Launched 02:19:04.181365 run osmo-stp_10.42.42.5(pid=11053): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11053)] 02:19:04.307629 run osmo-stp_10.42.42.5(pid=11053): stdout: | (launched: 2022-12-09_02:19:03.008606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:04.433874 run osmo-stp_10.42.42.5(pid=11053): stderr: | 20221209021903176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021903176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021903177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021903177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021903177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021903178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021903178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:04.558101 run osmo-stp_10.42.42.5(pid=11053): stdout: | (launched: 2022-12-09_02:19:03.008606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:04.677140 run osmo-stp_10.42.42.5(pid=11053): stderr: | 20221209021903176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021903176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021903177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021903177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021903177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021903178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021903178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:04.819256 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11053): Process ended prematurely: osmo-stp_10.42.42.5(pid=11053) [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11053)] [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:19:04.828105 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:19:04.854272 run osmo-hlr_10.42.42.2(pid=11050): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11050)] 02:19:04.902220 run osmo-hlr_10.42.42.2(pid=11050): stdout: | (launched: 2022-12-09_02:19:01.985096) 02:19:04.951062 run osmo-hlr_10.42.42.2(pid=11050): stderr: | 20221209021902258 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021902258 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021902258 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021902258 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021902258 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021902258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021902270 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021902279 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021902279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021902279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:05.019562 run osmo-msc_10.42.42.6(pid=11056): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11056)] 02:19:05.067780 run osmo-msc_10.42.42.6(pid=11056): stdout: | (launched: 2022-12-09_02:19:03.960443) 02:19:05.117120 run osmo-msc_10.42.42.6(pid=11056): stderr: | 20221209021904232 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021904232 DLGLOBAL DEBUG validating counter group 0x7f829bcc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021904233 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021904233 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021904233 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021904233 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021904235 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021904235 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021904235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021904235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:05.166872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11049): Terminating (SIGTERM) 02:19:05.206494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11052): Terminating (SIGTERM) 02:19:05.246066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11055): Terminating (SIGTERM) 02:19:05.285936 --- ParallelTerminationStrategy: PID 11049 died... 02:19:05.305147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11049): Terminated: ok {rc=0} 02:19:05.349206 --- ParallelTerminationStrategy: PID 11052 died... 02:19:05.367976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11052): Terminated: ok {rc=0} 02:19:05.411959 --- ParallelTerminationStrategy: PID 11055 died... 02:19:05.430690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11055): Terminated: ok {rc=0} 02:19:05.516040 bus /sierra_3: Setting Powered False 02:19:06.614729 bus /sierra_3: Setting Powered False 02:19:07.730201 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:19:08.962735 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:19:08.968906 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:19:08.989204 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:19:09.017212 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:19:09.069786 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:19:09.090632 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:19:09.116882 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:19:09.669267 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:19:09.721661 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:19:09.733359 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:19:09.790858 tst mo_mt_call.py: using LAC 18385 02:19:09.921636 tst mo_mt_call.py: using RAC 25 02:19:10.039611 tst mo_mt_call.py: using CellId 18385 02:19:10.156133 tst mo_mt_call.py: using BVCI 18386 02:19:10.264917 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:19:10.275959 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:19:10.286769 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:19:10.297534 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:19:10.308202 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:19:10.319002 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:19:10.435852 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:19:10.551497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:11.017200 run create_hlr_db(pid=11062): Launched 02:19:11.139715 bus /sierra_2: Setting Powered False 02:19:12.204443 run create_hlr_db(pid=11062): Terminated: ok {rc=0} 02:19:12.633631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11064): Launched 02:19:12.931247 run osmo-hlr_10.42.42.2(pid=11065): Launched 02:19:13.045298 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:13.573035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11067): Launched 02:19:13.869865 run osmo-stp_10.42.42.5(pid=11068): Launched 02:19:13.983609 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:14.523344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11070): Launched 02:19:14.821312 run osmo-msc_10.42.42.6(pid=11071): Launched 02:19:14.987840 run osmo-stp_10.42.42.5(pid=11068): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11068)] 02:19:15.114583 run osmo-stp_10.42.42.5(pid=11068): stdout: | (launched: 2022-12-09_02:19:13.816036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:15.241237 run osmo-stp_10.42.42.5(pid=11068): stderr: | 20221209021913984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021913984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021913984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021913985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021913985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021913985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021913985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:15.365603 run osmo-stp_10.42.42.5(pid=11068): stdout: | (launched: 2022-12-09_02:19:13.816036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:15.485344 run osmo-stp_10.42.42.5(pid=11068): stderr: | 20221209021913984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021913984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021913984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021913985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021913985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021913985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021913985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:15.627860 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11068): Process ended prematurely: osmo-stp_10.42.42.5(pid=11068) [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11068)] [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:19:15.636570 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:19:15.662833 run osmo-hlr_10.42.42.2(pid=11065): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11065)] 02:19:15.710895 run osmo-hlr_10.42.42.2(pid=11065): stdout: | (launched: 2022-12-09_02:19:12.876917) 02:19:15.760078 run osmo-hlr_10.42.42.2(pid=11065): stderr: | 20221209021913049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021913049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021913049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021913050 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021913050 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021913050 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021913062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021913071 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021913071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021913071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:15.829205 run osmo-msc_10.42.42.6(pid=11071): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11071)] 02:19:15.881133 run osmo-msc_10.42.42.6(pid=11071): stdout: | (launched: 2022-12-09_02:19:14.766595) 02:19:15.934091 run osmo-msc_10.42.42.6(pid=11071): stderr: | 20221209021915035 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021915035 DLGLOBAL DEBUG validating counter group 0x7fb34e3d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021915035 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021915035 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021915036 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021915037 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021915039 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021915039 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021915039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021915039 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:15.984092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11064): Terminating (SIGTERM) 02:19:16.025117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11067): Terminating (SIGTERM) 02:19:16.065502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11070): Terminating (SIGTERM) 02:19:16.106207 --- ParallelTerminationStrategy: PID 11064 died... 02:19:16.125384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11064): Terminated: ok {rc=0} 02:19:16.170841 --- ParallelTerminationStrategy: PID 11067 died... 02:19:16.190043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11067): Terminated: ok {rc=0} 02:19:16.234553 --- ParallelTerminationStrategy: PID 11070 died... 02:19:16.254169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11070): Terminated: ok {rc=0} 02:19:16.339666 bus /sierra_3: Setting Powered False 02:19:17.434329 bus /sierra_3: Setting Powered False 02:19:18.548881 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:19:19.695217 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:19:19.706831 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:19:19.763610 tst mo_mt_call_osmux.py: using LAC 18386 02:19:19.883055 tst mo_mt_call_osmux.py: using RAC 26 02:19:20.002110 tst mo_mt_call_osmux.py: using CellId 18386 02:19:20.123091 tst mo_mt_call_osmux.py: using BVCI 18387 02:19:20.233632 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:19:20.244622 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:19:20.255406 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:19:20.266248 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:19:20.277146 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:19:20.287964 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:19:20.406665 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:19:20.525682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:20.990489 run create_hlr_db(pid=11073): Launched 02:19:21.111988 bus /sierra_2: Setting Powered False 02:19:22.175602 run create_hlr_db(pid=11073): Terminated: ok {rc=0} 02:19:22.620624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11075): Launched 02:19:22.940463 run osmo-hlr_10.42.42.2(pid=11076): Launched 02:19:23.063495 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:23.618002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11078): Launched 02:19:23.938801 run osmo-stp_10.42.42.5(pid=11079): Launched 02:19:24.062555 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:24.643294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11081): Launched 02:19:24.965055 run osmo-msc_10.42.42.6(pid=11082): Launched 02:19:25.145473 run osmo-stp_10.42.42.5(pid=11079): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11079)] 02:19:25.281506 run osmo-stp_10.42.42.5(pid=11079): stdout: | (launched: 2022-12-09_02:19:23.880697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:25.418069 run osmo-stp_10.42.42.5(pid=11079): stderr: | 20221209021924069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021924070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021924070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021924070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021924071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021924071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021924071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:25.553333 run osmo-stp_10.42.42.5(pid=11079): stdout: | (launched: 2022-12-09_02:19:23.880697) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:25.682344 run osmo-stp_10.42.42.5(pid=11079): stderr: | 20221209021924069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021924070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021924070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021924070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021924071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021924071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021924071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:25.835577 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11079): Process ended prematurely: osmo-stp_10.42.42.5(pid=11079) [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11079)] [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:19:25.845232 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:19:25.873432 run osmo-hlr_10.42.42.2(pid=11076): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11076)] 02:19:25.923831 run osmo-hlr_10.42.42.2(pid=11076): stdout: | (launched: 2022-12-09_02:19:22.882859) 02:19:25.975398 run osmo-hlr_10.42.42.2(pid=11076): stderr: | 20221209021923077 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021923077 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021923077 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021923077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021923077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021923077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021923090 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021923098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021923098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021923098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:26.047444 run osmo-msc_10.42.42.6(pid=11082): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11082)] 02:19:26.097598 run osmo-msc_10.42.42.6(pid=11082): stdout: | (launched: 2022-12-09_02:19:24.907375) 02:19:26.149206 run osmo-msc_10.42.42.6(pid=11082): stderr: | 20221209021925224 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021925224 DLGLOBAL DEBUG validating counter group 0x7f2d7a208c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021925225 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021925225 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021925225 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021925225 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021925227 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021925227 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021925227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021925227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:26.201369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11075): Terminating (SIGTERM) 02:19:26.242957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11078): Terminating (SIGTERM) 02:19:26.284534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11081): Terminating (SIGTERM) 02:19:26.326541 --- ParallelTerminationStrategy: PID 11075 died... 02:19:26.346390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11075): Terminated: ok {rc=0} 02:19:26.392846 --- ParallelTerminationStrategy: PID 11078 died... 02:19:26.412335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11078): Terminated: ok {rc=0} 02:19:26.458679 --- ParallelTerminationStrategy: PID 11081 died... 02:19:26.478007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11081): Terminated: ok {rc=0} 02:19:26.564411 bus /sierra_3: Setting Powered False 02:19:27.662560 bus /sierra_3: Setting Powered False 02:19:28.776233 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:19:30.006600 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:19:30.012603 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:19:30.032846 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:19:30.061275 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:19:30.112344 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:19:30.132553 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:19:30.159777 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:19:30.712566 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:19:30.765503 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:30.776719 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:19:30.836025 tst mo_mt_call.py: using LAC 18387 02:19:30.969326 tst mo_mt_call.py: using RAC 27 02:19:31.103079 tst mo_mt_call.py: using CellId 18387 02:19:31.230210 tst mo_mt_call.py: using BVCI 18388 02:19:31.351027 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:31.363576 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:31.377150 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:31.390611 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:31.403018 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:31.416042 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:19:31.539508 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:19:31.661402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:32.180370 run create_hlr_db(pid=11087): Launched 02:19:32.318252 bus /sierra_2: Setting Powered False 02:19:33.382295 run create_hlr_db(pid=11087): Terminated: ok {rc=0} 02:19:33.827293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11089): Launched 02:19:34.148822 run osmo-hlr_10.42.42.2(pid=11090): Launched 02:19:34.273116 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:34.829479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11092): Launched 02:19:35.150479 run osmo-stp_10.42.42.5(pid=11093): Launched 02:19:35.273201 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:35.853615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11095): Launched 02:19:36.174299 run osmo-msc_10.42.42.6(pid=11096): Launched 02:19:36.353940 run osmo-stp_10.42.42.5(pid=11093): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11093)] 02:19:36.489485 run osmo-stp_10.42.42.5(pid=11093): stdout: | (launched: 2022-12-09_02:19:35.092496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:36.625454 run osmo-stp_10.42.42.5(pid=11093): stderr: | 20221209021935281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021935281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021935281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021935282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021935282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021935282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021935282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:36.760548 run osmo-stp_10.42.42.5(pid=11093): stdout: | (launched: 2022-12-09_02:19:35.092496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:36.888931 run osmo-stp_10.42.42.5(pid=11093): stderr: | 20221209021935281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021935281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021935281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021935282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021935282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021935282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021935282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:37.042496 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11093): Process ended prematurely: osmo-stp_10.42.42.5(pid=11093) [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11093)] [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:19:37.051918 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:19:37.080475 run osmo-hlr_10.42.42.2(pid=11090): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11090)] 02:19:37.130732 run osmo-hlr_10.42.42.2(pid=11090): stdout: | (launched: 2022-12-09_02:19:34.090867) 02:19:37.182400 run osmo-hlr_10.42.42.2(pid=11090): stderr: | 20221209021934285 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021934285 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021934285 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021934285 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021934285 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021934285 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021934298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021934307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021934307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021934307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:37.254247 run osmo-msc_10.42.42.6(pid=11096): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11096)] 02:19:37.304234 run osmo-msc_10.42.42.6(pid=11096): stdout: | (launched: 2022-12-09_02:19:36.116690) 02:19:37.355885 run osmo-msc_10.42.42.6(pid=11096): stderr: | 20221209021936433 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021936433 DLGLOBAL DEBUG validating counter group 0x7fae3bdaec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021936433 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021936433 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021936434 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021936434 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021936435 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021936436 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021936436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021936436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:37.407942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11089): Terminating (SIGTERM) 02:19:37.449602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11092): Terminating (SIGTERM) 02:19:37.491263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11095): Terminating (SIGTERM) 02:19:37.533100 --- ParallelTerminationStrategy: PID 11089 died... 02:19:37.553220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11089): Terminated: ok {rc=0} 02:19:37.599585 --- ParallelTerminationStrategy: PID 11092 died... 02:19:37.618977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11092): Terminated: ok {rc=0} 02:19:37.665125 --- ParallelTerminationStrategy: PID 11095 died... 02:19:37.684340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11095): Terminated: ok {rc=0} 02:19:37.770653 bus /sierra_3: Setting Powered False 02:19:38.870242 bus /sierra_3: Setting Powered False 02:19:39.984787 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:19:41.132801 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:41.144810 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:19:41.202197 tst mo_mt_call_osmux.py: using LAC 18388 02:19:41.329959 tst mo_mt_call_osmux.py: using RAC 28 02:19:41.457349 tst mo_mt_call_osmux.py: using CellId 18388 02:19:41.582018 tst mo_mt_call_osmux.py: using BVCI 18389 02:19:41.699312 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:41.710931 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:41.722175 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:41.733682 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:41.745194 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:41.756615 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:19:41.873048 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:19:41.991934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:42.492530 run create_hlr_db(pid=11098): Launched 02:19:42.615460 bus /sierra_2: Setting Powered False 02:19:43.678976 run create_hlr_db(pid=11098): Terminated: ok {rc=0} 02:19:44.126117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11100): Launched 02:19:44.447063 run osmo-hlr_10.42.42.2(pid=11101): Launched 02:19:44.570959 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:45.128142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11103): Launched 02:19:45.448069 run osmo-stp_10.42.42.5(pid=11104): Launched 02:19:45.570880 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:46.181869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11106): Launched 02:19:46.585155 run osmo-msc_10.42.42.6(pid=11107): Launched 02:19:47.098128 run osmo-stp_10.42.42.5(pid=11104): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11104)] 02:19:47.453093 run osmo-stp_10.42.42.5(pid=11104): stdout: | (launched: 2022-12-09_02:19:45.390211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:47.593051 run osmo-stp_10.42.42.5(pid=11104): stderr: | 20221209021945579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021945579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021945580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021945580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021945581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021945581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021945581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:47.729055 run osmo-stp_10.42.42.5(pid=11104): stdout: | (launched: 2022-12-09_02:19:45.390211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:47.858554 run osmo-stp_10.42.42.5(pid=11104): stderr: | 20221209021945579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021945579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021945580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021945580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021945581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021945581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021945581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:48.013312 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11104): Process ended prematurely: osmo-stp_10.42.42.5(pid=11104) [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11104)] [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:19:48.022886 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 02:19:48.052546 run osmo-hlr_10.42.42.2(pid=11101): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11101)] 02:19:48.104340 run osmo-hlr_10.42.42.2(pid=11101): stdout: | (launched: 2022-12-09_02:19:44.389244) 02:19:48.157732 run osmo-hlr_10.42.42.2(pid=11101): stderr: | 20221209021944584 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021944584 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021944584 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021944584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021944584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021944585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021944597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021944605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021944605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021944605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:48.231570 run osmo-msc_10.42.42.6(pid=11107): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11107)] 02:19:48.282796 run osmo-msc_10.42.42.6(pid=11107): stdout: | (launched: 2022-12-09_02:19:46.521696) 02:19:48.335647 run osmo-msc_10.42.42.6(pid=11107): stderr: | 20221209021947141 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021947141 DLGLOBAL DEBUG validating counter group 0x7fdbf3512c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021947141 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021947142 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021947144 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021947144 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021947149 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021947151 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021947152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021947153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:48.389110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11100): Terminating (SIGTERM) 02:19:48.431774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11103): Terminating (SIGTERM) 02:19:48.474692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11106): Terminating (SIGTERM) 02:19:48.517811 --- ParallelTerminationStrategy: PID 11100 died... 02:19:48.537844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11100): Terminated: ok {rc=0} 02:19:48.586195 --- ParallelTerminationStrategy: PID 11103 died... 02:19:48.606101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11103): Terminated: ok {rc=0} 02:19:48.654176 --- ParallelTerminationStrategy: PID 11106 died... 02:19:48.673876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11106): Terminated: ok {rc=0} 02:19:48.762836 bus /sierra_3: Setting Powered False 02:19:49.861096 bus /sierra_3: Setting Powered False 02:19:50.977170 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:19:52.214082 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:19:52.221672 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:19:52.242097 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:19:52.268884 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:19:52.320800 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:19:52.341157 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:19:52.367403 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:19:52.921208 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:19:52.970095 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:52.981073 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:19:53.034938 tst mo_mt_call.py: using LAC 18389 02:19:53.152921 tst mo_mt_call.py: using RAC 29 02:19:53.268997 tst mo_mt_call.py: using CellId 18389 02:19:53.389643 tst mo_mt_call.py: using BVCI 18390 02:19:53.498710 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:53.509783 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:53.520470 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:53.531203 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:53.541917 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:53.552660 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:19:53.671837 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:19:53.791087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:54.254444 run create_hlr_db(pid=11112): Launched 02:19:54.376133 bus /sierra_2: Setting Powered False 02:19:55.436385 run create_hlr_db(pid=11112): Terminated: ok {rc=0} 02:19:55.875035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11114): Launched 02:19:56.196270 run osmo-hlr_10.42.42.2(pid=11115): Launched 02:19:56.319111 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:56.874044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11117): Launched 02:19:57.194534 run osmo-stp_10.42.42.5(pid=11118): Launched 02:19:57.317265 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:57.899306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11120): Launched 02:19:58.220331 run osmo-msc_10.42.42.6(pid=11121): Launched 02:19:58.400334 run osmo-stp_10.42.42.5(pid=11118): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11118)] 02:19:58.535529 run osmo-stp_10.42.42.5(pid=11118): stdout: | (launched: 2022-12-09_02:19:57.136564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:58.671606 run osmo-stp_10.42.42.5(pid=11118): stderr: | 20221209021957328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021957328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021957328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021957329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021957329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021957329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021957329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:58.806140 run osmo-stp_10.42.42.5(pid=11118): stdout: | (launched: 2022-12-09_02:19:57.136564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:58.934644 run osmo-stp_10.42.42.5(pid=11118): stderr: | 20221209021957328 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209021957328 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209021957328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209021957329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209021957329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209021957329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209021957329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:59.088164 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11118): Process ended prematurely: osmo-stp_10.42.42.5(pid=11118) [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11118)] [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:19:59.097579 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:19:59.125886 run osmo-hlr_10.42.42.2(pid=11115): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11115)] 02:19:59.176040 run osmo-hlr_10.42.42.2(pid=11115): stdout: | (launched: 2022-12-09_02:19:56.138636) 02:19:59.227710 run osmo-hlr_10.42.42.2(pid=11115): stderr: | 20221209021956335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209021956335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209021956335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209021956335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209021956335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209021956335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209021956346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209021956354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209021956355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209021956355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:59.299559 run osmo-msc_10.42.42.6(pid=11121): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11121)] 02:19:59.349708 run osmo-msc_10.42.42.6(pid=11121): stdout: | (launched: 2022-12-09_02:19:58.162610) 02:19:59.401267 run osmo-msc_10.42.42.6(pid=11121): stderr: | 20221209021958480 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209021958480 DLGLOBAL DEBUG validating counter group 0x7fc85bbd8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209021958480 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209021958480 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209021958481 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209021958481 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209021958482 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209021958483 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209021958483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209021958483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:59.453368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11114): Terminating (SIGTERM) 02:19:59.494898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11117): Terminating (SIGTERM) 02:19:59.536391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11120): Terminating (SIGTERM) 02:19:59.578083 --- ParallelTerminationStrategy: PID 11114 died... 02:19:59.597784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11114): Terminated: ok {rc=0} 02:19:59.643863 --- ParallelTerminationStrategy: PID 11117 died... 02:19:59.663258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11117): Terminated: ok {rc=0} 02:19:59.709317 --- ParallelTerminationStrategy: PID 11120 died... 02:19:59.728622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11120): Terminated: ok {rc=0} 02:19:59.815510 bus /sierra_3: Setting Powered False 02:20:00.935350 bus /sierra_3: Setting Powered False 02:20:02.091862 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:20:03.252308 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:20:03.264201 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:20:03.322051 tst mo_mt_call_osmux.py: using LAC 18390 02:20:03.449228 tst mo_mt_call_osmux.py: using RAC 30 02:20:03.574868 tst mo_mt_call_osmux.py: using CellId 18390 02:20:03.702210 tst mo_mt_call_osmux.py: using BVCI 18391 02:20:03.821084 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:20:03.832535 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:20:03.843768 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:20:03.855270 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:20:03.866797 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:20:03.878319 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:20:03.993778 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:20:04.115513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:04.614418 run create_hlr_db(pid=11126): Launched 02:20:04.736220 bus /sierra_2: Setting Powered False 02:20:05.800817 run create_hlr_db(pid=11126): Terminated: ok {rc=0} 02:20:06.229248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11128): Launched 02:20:06.526803 run osmo-hlr_10.42.42.2(pid=11129): Launched 02:20:06.642159 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:07.174401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11131): Launched 02:20:07.472031 run osmo-stp_10.42.42.5(pid=11132): Launched 02:20:07.587167 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:08.128239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11134): Launched 02:20:08.425330 run osmo-msc_10.42.42.6(pid=11135): Launched 02:20:08.592358 run osmo-stp_10.42.42.5(pid=11132): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11132)] 02:20:08.718364 run osmo-stp_10.42.42.5(pid=11132): stdout: | (launched: 2022-12-09_02:20:07.417935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:08.844008 run osmo-stp_10.42.42.5(pid=11132): stderr: | 20221209022007586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022007586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022007587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022007587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022007588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022007588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022007588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:08.968305 run osmo-stp_10.42.42.5(pid=11132): stdout: | (launched: 2022-12-09_02:20:07.417935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:09.087418 run osmo-stp_10.42.42.5(pid=11132): stderr: | 20221209022007586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022007586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022007587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022007587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022007588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022007588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022007588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:09.230044 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11132): Process ended prematurely: osmo-stp_10.42.42.5(pid=11132) [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11132)] [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:20:09.238904 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:20:09.265278 run osmo-hlr_10.42.42.2(pid=11129): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11129)] 02:20:09.312553 run osmo-hlr_10.42.42.2(pid=11129): stdout: | (launched: 2022-12-09_02:20:06.472915) 02:20:09.361503 run osmo-hlr_10.42.42.2(pid=11129): stderr: | 20221209022006645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022006645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022006645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022006645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022006645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022006645 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022006657 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022006665 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022006666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022006666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:09.429686 run osmo-msc_10.42.42.6(pid=11135): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11135)] 02:20:09.476585 run osmo-msc_10.42.42.6(pid=11135): stdout: | (launched: 2022-12-09_02:20:08.371117) 02:20:09.525172 run osmo-msc_10.42.42.6(pid=11135): stderr: | 20221209022008641 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022008641 DLGLOBAL DEBUG validating counter group 0x7fe57be37c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022008641 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022008642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022008642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022008642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022008644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022008645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022008645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022008645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:09.574161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11128): Terminating (SIGTERM) 02:20:09.613241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11131): Terminating (SIGTERM) 02:20:09.652334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11134): Terminating (SIGTERM) 02:20:09.691812 --- ParallelTerminationStrategy: PID 11128 died... 02:20:09.710638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11128): Terminated: ok {rc=0} 02:20:09.754710 --- ParallelTerminationStrategy: PID 11131 died... 02:20:09.773276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11131): Terminated: ok {rc=0} 02:20:09.817949 --- ParallelTerminationStrategy: PID 11134 died... 02:20:09.836515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11134): Terminated: ok {rc=0} 02:20:09.920558 bus /sierra_3: Setting Powered False 02:20:11.019951 bus /sierra_3: Setting Powered False 02:20:12.135002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:20:13.368942 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:20:13.375748 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:20:13.397212 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:20:13.425641 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:20:13.479077 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:20:13.500452 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:20:13.528249 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:20:14.075807 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:20:14.123726 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:14.134768 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:20:14.190538 tst mo_mt_call.py: using LAC 18391 02:20:14.309192 tst mo_mt_call.py: using RAC 31 02:20:14.437855 tst mo_mt_call.py: using CellId 18391 02:20:14.565260 tst mo_mt_call.py: using BVCI 18392 02:20:14.682999 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:14.694783 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:14.706219 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:14.717954 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:14.729501 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:14.740910 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:20:14.861364 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:20:14.977360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:15.441716 run create_hlr_db(pid=11141): Launched 02:20:15.564280 bus /sierra_2: Setting Powered False 02:20:16.627369 run create_hlr_db(pid=11141): Terminated: ok {rc=0} 02:20:17.095696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11143): Launched 02:20:17.425611 run osmo-hlr_10.42.42.2(pid=11144): Launched 02:20:17.549997 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:18.110284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11146): Launched 02:20:18.432325 run osmo-stp_10.42.42.5(pid=11147): Launched 02:20:18.556125 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:19.139505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11149): Launched 02:20:19.460735 run osmo-msc_10.42.42.6(pid=11150): Launched 02:20:19.643102 run osmo-stp_10.42.42.5(pid=11147): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11147)] 02:20:19.779331 run osmo-stp_10.42.42.5(pid=11147): stdout: | (launched: 2022-12-09_02:20:18.374111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:19.916154 run osmo-stp_10.42.42.5(pid=11147): stderr: | 20221209022018564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022018565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022018565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022018565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022018566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022018566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022018566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:20.051655 run osmo-stp_10.42.42.5(pid=11147): stdout: | (launched: 2022-12-09_02:20:18.374111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:20.180790 run osmo-stp_10.42.42.5(pid=11147): stderr: | 20221209022018564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022018565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022018565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022018565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022018566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022018566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022018566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:20.334711 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11147): Process ended prematurely: osmo-stp_10.42.42.5(pid=11147) [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11147)] [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:20:20.344309 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:20:20.372583 run osmo-hlr_10.42.42.2(pid=11144): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11144)] 02:20:20.423139 run osmo-hlr_10.42.42.2(pid=11144): stdout: | (launched: 2022-12-09_02:20:17.367788) 02:20:20.475139 run osmo-hlr_10.42.42.2(pid=11144): stderr: | 20221209022017563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022017563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022017563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022017563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022017564 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022017564 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022017577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022017586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022017586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022017586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:20.547430 run osmo-msc_10.42.42.6(pid=11150): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11150)] 02:20:20.598253 run osmo-msc_10.42.42.6(pid=11150): stdout: | (launched: 2022-12-09_02:20:19.402865) 02:20:20.650063 run osmo-msc_10.42.42.6(pid=11150): stderr: | 20221209022019722 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022019723 DLGLOBAL DEBUG validating counter group 0x7f9533b5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022019723 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022019723 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022019723 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022019723 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022019725 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022019725 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022019725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022019725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:20.702244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11143): Terminating (SIGTERM) 02:20:20.744119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11146): Terminating (SIGTERM) 02:20:20.785937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11149): Terminating (SIGTERM) 02:20:20.828077 --- ParallelTerminationStrategy: PID 11143 died... 02:20:20.848041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11143): Terminated: ok {rc=0} 02:20:20.894831 --- ParallelTerminationStrategy: PID 11146 died... 02:20:20.914528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11146): Terminated: ok {rc=0} 02:20:20.960896 --- ParallelTerminationStrategy: PID 11149 died... 02:20:20.980412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11149): Terminated: ok {rc=0} 02:20:21.068916 bus /sierra_3: Setting Powered False 02:20:22.167770 bus /sierra_3: Setting Powered False 02:20:23.283220 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:20:24.430913 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:24.442937 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:20:24.500735 tst mo_mt_call_osmux.py: using LAC 18392 02:20:24.633192 tst mo_mt_call_osmux.py: using RAC 32 02:20:24.759596 tst mo_mt_call_osmux.py: using CellId 18392 02:20:24.883687 tst mo_mt_call_osmux.py: using BVCI 18393 02:20:25.001050 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:25.012560 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:25.023894 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:25.035437 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:25.046926 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:25.058605 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:20:25.178313 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:20:25.294041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:25.758116 run create_hlr_db(pid=11152): Launched 02:20:25.880567 bus /sierra_2: Setting Powered False 02:20:26.940569 run create_hlr_db(pid=11152): Terminated: ok {rc=0} 02:20:27.355578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11154): Launched 02:20:27.653522 run osmo-hlr_10.42.42.2(pid=11155): Launched 02:20:27.766680 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:28.283924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11157): Launched 02:20:28.581307 run osmo-stp_10.42.42.5(pid=11158): Launched 02:20:28.696395 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:29.235462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11160): Launched 02:20:29.533269 run osmo-msc_10.42.42.6(pid=11161): Launched 02:20:29.699918 run osmo-stp_10.42.42.5(pid=11158): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11158)] 02:20:29.825942 run osmo-stp_10.42.42.5(pid=11158): stdout: | (launched: 2022-12-09_02:20:28.526895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:29.951375 run osmo-stp_10.42.42.5(pid=11158): stderr: | 20221209022028695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022028695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022028695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022028696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022028696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022028696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022028696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:30.076152 run osmo-stp_10.42.42.5(pid=11158): stdout: | (launched: 2022-12-09_02:20:28.526895) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:30.194729 run osmo-stp_10.42.42.5(pid=11158): stderr: | 20221209022028695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022028695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022028695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022028696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022028696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022028696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022028696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:30.337207 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11158): Process ended prematurely: osmo-stp_10.42.42.5(pid=11158) [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11158)] [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:20:30.346092 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:20:30.372565 run osmo-hlr_10.42.42.2(pid=11155): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11155)] 02:20:30.420222 run osmo-hlr_10.42.42.2(pid=11155): stdout: | (launched: 2022-12-09_02:20:27.599244) 02:20:30.469305 run osmo-hlr_10.42.42.2(pid=11155): stderr: | 20221209022027772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022027772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022027772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022027772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022027773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022027773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022027785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022027794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022027794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022027794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:30.538216 run osmo-msc_10.42.42.6(pid=11161): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11161)] 02:20:30.585616 run osmo-msc_10.42.42.6(pid=11161): stdout: | (launched: 2022-12-09_02:20:29.478605) 02:20:30.634417 run osmo-msc_10.42.42.6(pid=11161): stderr: | 20221209022029749 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022029749 DLGLOBAL DEBUG validating counter group 0x7fb22ef7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022029749 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022029749 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022029750 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022029751 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022029752 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022029753 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022029753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022029753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:30.683598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11154): Terminating (SIGTERM) 02:20:30.722670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11157): Terminating (SIGTERM) 02:20:30.762231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11160): Terminating (SIGTERM) 02:20:30.802024 --- ParallelTerminationStrategy: PID 11154 died... 02:20:30.821053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11154): Terminated: ok {rc=0} 02:20:30.889988 --- ParallelTerminationStrategy: PID 11157 died... 02:20:30.911615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11157): Terminated: ok {rc=0} 02:20:30.961585 --- ParallelTerminationStrategy: PID 11160 died... 02:20:30.982703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11160): Terminated: ok {rc=0} 02:20:31.074325 bus /sierra_3: Setting Powered False 02:20:32.185579 bus /sierra_3: Setting Powered False 02:20:33.300645 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:20:34.538938 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:20:34.545720 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:20:34.566867 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:20:34.594878 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:20:34.647259 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:20:34.668272 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:20:34.695818 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:20:35.247100 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:20:35.298906 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:35.310330 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:20:35.367855 tst mo_mt_call.py: using LAC 18393 02:20:35.495056 tst mo_mt_call.py: using RAC 33 02:20:35.622152 tst mo_mt_call.py: using CellId 18393 02:20:35.750497 tst mo_mt_call.py: using BVCI 18394 02:20:35.868597 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:35.880062 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:35.891303 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:35.902760 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:35.914304 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:35.925969 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:20:36.042598 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:20:36.161337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:36.658762 run create_hlr_db(pid=11167): Launched 02:20:36.780649 bus /sierra_2: Setting Powered False 02:20:37.844086 run create_hlr_db(pid=11167): Terminated: ok {rc=0} 02:20:38.271072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11169): Launched 02:20:38.568138 run osmo-hlr_10.42.42.2(pid=11170): Launched 02:20:38.683697 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:39.209142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11172): Launched 02:20:39.505387 run osmo-stp_10.42.42.5(pid=11173): Launched 02:20:39.618999 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:40.159504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11175): Launched 02:20:40.457101 run osmo-msc_10.42.42.6(pid=11176): Launched 02:20:40.623470 run osmo-stp_10.42.42.5(pid=11173): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11173)] 02:20:40.749623 run osmo-stp_10.42.42.5(pid=11173): stdout: | (launched: 2022-12-09_02:20:39.451328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:40.875546 run osmo-stp_10.42.42.5(pid=11173): stderr: | 20221209022039619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022039619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022039620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022039620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022039621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022039621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022039621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:40.999542 run osmo-stp_10.42.42.5(pid=11173): stdout: | (launched: 2022-12-09_02:20:39.451328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:41.118541 run osmo-stp_10.42.42.5(pid=11173): stderr: | 20221209022039619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022039619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022039620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022039620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022039621 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022039621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022039621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:41.261242 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11173): Process ended prematurely: osmo-stp_10.42.42.5(pid=11173) [trial-2353↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11173)] [trial-2353↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:20:41.270064 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:20:41.296122 run osmo-hlr_10.42.42.2(pid=11170): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11170)] 02:20:41.343356 run osmo-hlr_10.42.42.2(pid=11170): stdout: | (launched: 2022-12-09_02:20:38.514159) 02:20:41.393310 run osmo-hlr_10.42.42.2(pid=11170): stderr: | 20221209022038685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022038685 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022038685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022038686 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022038686 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022038686 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022038698 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022038706 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022038706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022038706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:41.461847 run osmo-msc_10.42.42.6(pid=11176): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11176)] 02:20:41.509155 run osmo-msc_10.42.42.6(pid=11176): stdout: | (launched: 2022-12-09_02:20:40.402910) 02:20:41.558000 run osmo-msc_10.42.42.6(pid=11176): stderr: | 20221209022040675 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022040676 DLGLOBAL DEBUG validating counter group 0x7fcb8a192c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022040676 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022040676 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022040676 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022040676 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022040678 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022040678 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022040678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022040679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:41.607356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11169): Terminating (SIGTERM) 02:20:41.646244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11172): Terminating (SIGTERM) 02:20:41.685187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11175): Terminating (SIGTERM) 02:20:41.724286 --- ParallelTerminationStrategy: PID 11169 died... 02:20:41.742888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11169): Terminated: ok {rc=0} 02:20:41.786287 --- ParallelTerminationStrategy: PID 11172 died... 02:20:41.804505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11172): Terminated: ok {rc=0} 02:20:41.848442 --- ParallelTerminationStrategy: PID 11175 died... 02:20:41.866809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11175): Terminated: ok {rc=0} 02:20:41.948455 bus /sierra_3: Setting Powered False 02:20:43.042897 bus /sierra_3: Setting Powered False 02:20:44.156653 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:20:45.299346 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:45.311112 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:20:45.367558 tst mo_mt_call_osmux.py: using LAC 18394 02:20:45.487714 tst mo_mt_call_osmux.py: using RAC 34 02:20:45.607664 tst mo_mt_call_osmux.py: using CellId 18394 02:20:45.727150 tst mo_mt_call_osmux.py: using BVCI 18395 02:20:45.848120 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:45.874117 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:45.886395 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:45.897910 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:45.909605 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:45.921327 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:20:46.060361 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:20:46.181769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:46.699356 run create_hlr_db(pid=11178): Launched 02:20:46.840686 bus /sierra_2: Setting Powered False 02:20:47.904200 run create_hlr_db(pid=11178): Terminated: ok {rc=0} 02:20:48.332779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11180): Launched 02:20:48.630956 run osmo-hlr_10.42.42.2(pid=11181): Launched 02:20:48.745932 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:49.263723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11183): Launched 02:20:49.561658 run osmo-stp_10.42.42.5(pid=11184): Launched 02:20:49.674788 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:50.215010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11186): Launched 02:20:50.514231 run osmo-msc_10.42.42.6(pid=11187): Launched 02:20:50.681148 run osmo-stp_10.42.42.5(pid=11184): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11184)] 02:20:50.806368 run osmo-stp_10.42.42.5(pid=11184): stdout: | (launched: 2022-12-09_02:20:49.507037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:50.932203 run osmo-stp_10.42.42.5(pid=11184): stderr: | 20221209022049676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022049676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022049676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022049676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022049677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022049677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022049677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:51.056139 run osmo-stp_10.42.42.5(pid=11184): stdout: | (launched: 2022-12-09_02:20:49.507037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:51.175125 run osmo-stp_10.42.42.5(pid=11184): stderr: | 20221209022049676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022049676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022049676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022049676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022049677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022049677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022049677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:51.317341 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11184): Process ended prematurely: osmo-stp_10.42.42.5(pid=11184) [trial-2353↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11184)] [trial-2353↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:20:51.326062 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:20:51.352287 run osmo-hlr_10.42.42.2(pid=11181): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11181)] 02:20:51.399429 run osmo-hlr_10.42.42.2(pid=11181): stdout: | (launched: 2022-12-09_02:20:48.576741) 02:20:51.448313 run osmo-hlr_10.42.42.2(pid=11181): stderr: | 20221209022048752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022048752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022048753 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022048753 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022048753 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022048753 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022048765 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022048774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022048774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022048774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:51.516857 run osmo-msc_10.42.42.6(pid=11187): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11187)] 02:20:51.564307 run osmo-msc_10.42.42.6(pid=11187): stdout: | (launched: 2022-12-09_02:20:50.459176) 02:20:51.613273 run osmo-msc_10.42.42.6(pid=11187): stderr: | 20221209022050730 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022050730 DLGLOBAL DEBUG validating counter group 0x7f29f6fc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022050730 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022050730 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022050730 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022050730 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022050733 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022050734 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022050734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022050734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:51.662464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11180): Terminating (SIGTERM) 02:20:51.702204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11183): Terminating (SIGTERM) 02:20:51.741834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11186): Terminating (SIGTERM) 02:20:51.781413 --- ParallelTerminationStrategy: PID 11180 died... 02:20:51.800379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11180): Terminated: ok {rc=0} 02:20:51.844230 --- ParallelTerminationStrategy: PID 11183 died... 02:20:51.862840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11183): Terminated: ok {rc=0} 02:20:51.906379 --- ParallelTerminationStrategy: PID 11186 died... 02:20:51.924719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11186): Terminated: ok {rc=0} 02:20:52.009640 bus /sierra_3: Setting Powered False 02:20:53.107355 bus /sierra_3: Setting Powered False 02:20:54.220342 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:20:55.456352 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:20:55.462548 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:20:55.484039 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:20:55.512785 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:20:55.565582 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:20:55.586759 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:20:55.614477 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:20:56.163828 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:20:56.216230 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:56.227755 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:20:56.286424 tst mo_mt_call.py: using LAC 18395 02:20:56.414642 tst mo_mt_call.py: using RAC 35 02:20:56.541614 tst mo_mt_call.py: using CellId 18395 02:20:56.661111 tst mo_mt_call.py: using BVCI 18396 02:20:56.769552 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:56.780423 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:56.790990 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:56.801595 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:56.812130 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:56.822716 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:20:56.942226 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:20:57.061031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:57.561606 run create_hlr_db(pid=11192): Launched 02:20:57.684343 bus /sierra_2: Setting Powered False 02:20:58.749088 run create_hlr_db(pid=11192): Terminated: ok {rc=0} 02:20:59.177246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11194): Launched 02:20:59.476447 run osmo-hlr_10.42.42.2(pid=11195): Launched 02:20:59.591150 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:00.109890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11197): Launched 02:21:00.407890 run osmo-stp_10.42.42.5(pid=11198): Launched 02:21:00.522112 run osmo-msc_10.42.42.6: Starting osmo-msc 02:21:01.094915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11200): Launched 02:21:01.443149 run osmo-msc_10.42.42.6(pid=11201): Launched 02:21:01.772035 run osmo-stp_10.42.42.5(pid=11198): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11198)] 02:21:02.016384 run osmo-stp_10.42.42.5(pid=11198): stdout: | (launched: 2022-12-09_02:21:00.353428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:02.222604 run osmo-stp_10.42.42.5(pid=11198): stderr: | 20221209022100521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022100521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022100521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022100521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022100522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022100522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022100522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:02.359606 run osmo-stp_10.42.42.5(pid=11198): stdout: | (launched: 2022-12-09_02:21:00.353428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:02.488390 run osmo-stp_10.42.42.5(pid=11198): stderr: | 20221209022100521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022100521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022100521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022100521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022100522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022100522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022100522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:02.642958 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11198): Process ended prematurely: osmo-stp_10.42.42.5(pid=11198) [trial-2353↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11198)] [trial-2353↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:21:02.652495 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 02:21:02.681541 run osmo-hlr_10.42.42.2(pid=11195): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11195)] 02:21:02.731874 run osmo-hlr_10.42.42.2(pid=11195): stdout: | (launched: 2022-12-09_02:20:59.421959) 02:21:02.783913 run osmo-hlr_10.42.42.2(pid=11195): stderr: | 20221209022059594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022059594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022059594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022059594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022059594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022059594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022059607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022059617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022059617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022059617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:02.855947 run osmo-msc_10.42.42.6(pid=11201): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11201)] 02:21:02.906365 run osmo-msc_10.42.42.6(pid=11201): stdout: | (launched: 2022-12-09_02:21:01.373993) 02:21:02.958433 run osmo-msc_10.42.42.6(pid=11201): stderr: | 20221209022101849 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022101849 DLGLOBAL DEBUG validating counter group 0x7f73fd321c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022101849 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022101849 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022101850 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022101850 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022101851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022101852 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022101852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022101852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:21:03.010972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11194): Terminating (SIGTERM) 02:21:03.053279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11197): Terminating (SIGTERM) 02:21:03.095661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11200): Terminating (SIGTERM) 02:21:03.138781 --- ParallelTerminationStrategy: PID 11194 died... 02:21:03.159307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11194): Terminated: ok {rc=0} 02:21:03.206731 --- ParallelTerminationStrategy: PID 11197 died... 02:21:03.226735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11197): Terminated: ok {rc=0} 02:21:03.273716 --- ParallelTerminationStrategy: PID 11200 died... 02:21:03.293605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11200): Terminated: ok {rc=0} 02:21:03.382589 bus /sierra_3: Setting Powered False 02:21:04.481445 bus /sierra_3: Setting Powered False 02:21:05.598343 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:21:06.741685 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:21:06.752892 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:21:06.809227 tst mo_mt_call_osmux.py: using LAC 18396 02:21:06.928438 tst mo_mt_call_osmux.py: using RAC 36 02:21:07.047906 tst mo_mt_call_osmux.py: using CellId 18396 02:21:07.167049 tst mo_mt_call_osmux.py: using BVCI 18397 02:21:07.276834 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:21:07.288143 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:21:07.298745 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:21:07.309337 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:21:07.320264 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:21:07.330926 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:21:07.448203 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:21:07.567701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:08.029994 run create_hlr_db(pid=11203): Launched 02:21:08.151253 bus /sierra_2: Setting Powered False 02:21:09.211251 run create_hlr_db(pid=11203): Terminated: ok {rc=0} 02:21:09.649661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11205): Launched 02:21:09.971386 run osmo-hlr_10.42.42.2(pid=11206): Launched 02:21:10.095109 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:10.653641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11208): Launched 02:21:10.974615 run osmo-stp_10.42.42.5(pid=11209): Launched 02:21:11.097799 run osmo-msc_10.42.42.6: Starting osmo-msc 02:21:11.684301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11211): Launched 02:21:12.006543 run osmo-msc_10.42.42.6(pid=11212): Launched 02:21:12.189578 run osmo-stp_10.42.42.5(pid=11209): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11209)] 02:21:12.325294 run osmo-stp_10.42.42.5(pid=11209): stdout: | (launched: 2022-12-09_02:21:10.916531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:12.461454 run osmo-stp_10.42.42.5(pid=11209): stderr: | 20221209022111105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022111105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022111106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022111106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022111106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022111106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022111107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:12.595622 run osmo-stp_10.42.42.5(pid=11209): stdout: | (launched: 2022-12-09_02:21:10.916531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:12.724440 run osmo-stp_10.42.42.5(pid=11209): stderr: | 20221209022111105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022111105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022111106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022111106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022111106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022111106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022111107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:12.878780 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11209): Process ended prematurely: osmo-stp_10.42.42.5(pid=11209) [trial-2353↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11209)] [trial-2353↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:21:12.888341 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:21:12.916831 run osmo-hlr_10.42.42.2(pid=11206): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11206)] 02:21:12.966780 run osmo-hlr_10.42.42.2(pid=11206): stdout: | (launched: 2022-12-09_02:21:09.912793) 02:21:13.018112 run osmo-hlr_10.42.42.2(pid=11206): stderr: | 20221209022110107 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022110107 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022110107 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022110107 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022110107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022110107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022110121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022110129 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022110129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022110129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:13.089955 run osmo-msc_10.42.42.6(pid=11212): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11212)] 02:21:13.140012 run osmo-msc_10.42.42.6(pid=11212): stdout: | (launched: 2022-12-09_02:21:11.948307) 02:21:13.191339 run osmo-msc_10.42.42.6(pid=11212): stderr: | 20221209022112266 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022112266 DLGLOBAL DEBUG validating counter group 0x7fc13de04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022112267 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022112267 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022112267 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022112267 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022112269 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022112269 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022112269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022112269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:21:13.242982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11205): Terminating (SIGTERM) 02:21:13.284520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11208): Terminating (SIGTERM) 02:21:13.326256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11211): Terminating (SIGTERM) 02:21:13.368014 --- ParallelTerminationStrategy: PID 11205 died... 02:21:13.387991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11205): Terminated: ok {rc=0} 02:21:13.434293 --- ParallelTerminationStrategy: PID 11208 died... 02:21:13.453770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11208): Terminated: ok {rc=0} 02:21:13.499987 --- ParallelTerminationStrategy: PID 11211 died... 02:21:13.519422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11211): Terminated: ok {rc=0} 02:21:13.606394 bus /sierra_3: Setting Powered False 02:21:14.703492 bus /sierra_3: Setting Powered False 02:21:15.817492 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 emergency:oc2g --------------------------------------------------------------------- 02:21:17.085294 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:21:17.089988 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 02:21:17.113881 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 02:21:17.145130 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 02:21:17.232429 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 02:21:17.262314 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 02:21:17.291473 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 02:21:17.865376 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2353 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 02:21:17.870668 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:17.881890 tst emergency:oc2g: Using 1 x bts (candidates: 1) 02:21:17.922307 tst emergency_mo_mt_call.py: using LAC 18397 02:21:18.046318 tst emergency_mo_mt_call.py: using RAC 37 02:21:18.169829 tst emergency_mo_mt_call.py: using CellId 18397 02:21:18.292459 tst emergency_mo_mt_call.py: using BVCI 18398 02:21:18.408289 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:18.419509 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:18.430476 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:18.441737 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:18.452928 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:18.463944 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:21:18.578815 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:21:18.696008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:19.187645 run create_hlr_db(pid=11217): Launched 02:21:19.307818 bus /sierra_2: Setting Powered False 02:21:20.371436 run create_hlr_db(pid=11217): Terminated: ok {rc=0} 02:21:20.792938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11219): Launched 02:21:21.086868 run osmo-hlr_10.42.42.2(pid=11220): Launched 02:21:21.198539 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:21.702254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11222): Launched 02:21:21.993801 run osmo-stp_10.42.42.5(pid=11223): Launched 02:21:22.116708 tst emergency_mo_mt_call.py: using MSISDN 6979 02:21:22.268047 run osmo-msc_10.42.42.6: Starting osmo-msc 02:21:22.798470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11225): Launched 02:21:23.090677 run osmo-msc_10.42.42.6(pid=11226): Launched 02:21:23.255246 run osmo-stp_10.42.42.5(pid=11223): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11223)] 02:21:23.379505 run osmo-stp_10.42.42.5(pid=11223): stdout: | (launched: 2022-12-09_02:21:21.940350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:23.503564 run osmo-stp_10.42.42.5(pid=11223): stderr: | 20221209022122108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022122108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022122109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022122109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022122110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022122110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022122110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:23.625523 run osmo-stp_10.42.42.5(pid=11223): stdout: | (launched: 2022-12-09_02:21:21.940350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:23.742244 run osmo-stp_10.42.42.5(pid=11223): stderr: | 20221209022122108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022122108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022122109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022122109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022122110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022122110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022122110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:23.881686 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=11223): Process ended prematurely: osmo-stp_10.42.42.5(pid=11223) [trial-2353↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11223)] [trial-2353↪emergency:oc2g↪emergency_mo_mt_call.py:19] 02:21:23.889719 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 02:21:23.915509 run osmo-hlr_10.42.42.2(pid=11220): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11220)] 02:21:23.962886 run osmo-hlr_10.42.42.2(pid=11220): stdout: | (launched: 2022-12-09_02:21:21.032918) 02:21:24.011915 run osmo-hlr_10.42.42.2(pid=11220): stderr: | 20221209022121207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022121207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022121207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022121207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022121207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022121207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022121224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022121233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022121233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022121233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:24.080455 run osmo-msc_10.42.42.6(pid=11226): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11226)] 02:21:24.128223 run osmo-msc_10.42.42.6(pid=11226): stdout: | (launched: 2022-12-09_02:21:23.037118) 02:21:24.177208 run osmo-msc_10.42.42.6(pid=11226): stderr: | 20221209022123308 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022123308 DLGLOBAL DEBUG validating counter group 0x7f3fe8057c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022123308 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022123308 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022123308 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022123308 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022123311 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022123312 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022123312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022123312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:21:24.226590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11219): Terminating (SIGTERM) 02:21:24.266006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11222): Terminating (SIGTERM) 02:21:24.305490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11225): Terminating (SIGTERM) 02:21:24.345561 --- ParallelTerminationStrategy: PID 11219 died... 02:21:24.364694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11219): Terminated: ok {rc=0} 02:21:24.409186 --- ParallelTerminationStrategy: PID 11222 died... 02:21:24.427891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11222): Terminated: ok {rc=0} 02:21:24.471633 --- ParallelTerminationStrategy: PID 11225 died... 02:21:24.490158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11225): Terminated: ok {rc=0} 02:21:24.575527 bus /sierra_3: Setting Powered False 02:21:25.673845 bus /sierra_3: Setting Powered False 02:21:26.787272 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 02:21:27.872635 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:27.884578 tst emergency:oc2g: Using 1 x bts (candidates: 1) 02:21:27.922841 tst emergency_preemptive_call.py: using LAC 18398 02:21:28.047338 tst emergency_preemptive_call.py: using RAC 38 02:21:28.171941 tst emergency_preemptive_call.py: using CellId 18398 02:21:28.296818 tst emergency_preemptive_call.py: using BVCI 18399 02:21:28.404016 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:28.414590 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:28.424942 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:28.436054 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:28.446576 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:28.457274 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:21:28.575794 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:21:28.690607 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:21:28.810118 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:21:28.925390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:29.420007 run create_hlr_db(pid=11229): Launched 02:21:29.545180 bus /sierra_2: Setting Powered False 02:21:30.604849 run create_hlr_db(pid=11229): Terminated: ok {rc=0} 02:21:31.078361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11231): Launched 02:21:31.411347 run osmo-hlr_10.42.42.2(pid=11232): Launched 02:21:31.644728 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:32.325469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11234): Launched 02:21:32.642922 run osmo-stp_10.42.42.5(pid=11235): Launched 02:21:32.775854 tst emergency_preemptive_call.py: using MSISDN 6980 02:21:32.940124 run osmo-msc_10.42.42.6: Starting osmo-msc 02:21:33.508263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11237): Launched 02:21:33.823850 run osmo-msc_10.42.42.6(pid=11238): Launched 02:21:34.000001 run osmo-stp_10.42.42.5(pid=11235): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11235)] 02:21:34.134796 run osmo-stp_10.42.42.5(pid=11235): stdout: | (launched: 2022-12-09_02:21:32.585555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:34.269237 run osmo-stp_10.42.42.5(pid=11235): stderr: | 20221209022132775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022132775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022132775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022132776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022132776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022132776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022132776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:34.401960 run osmo-stp_10.42.42.5(pid=11235): stdout: | (launched: 2022-12-09_02:21:32.585555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:34.527800 run osmo-stp_10.42.42.5(pid=11235): stderr: | 20221209022132775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022132775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022132775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022132776 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022132776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022132776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022132776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:34.678328 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=11235): Process ended prematurely: osmo-stp_10.42.42.5(pid=11235) [trial-2353↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11235)] [trial-2353↪emergency:oc2g↪emergency_preemptive_call.py:32] 02:21:34.687528 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 02:21:34.715241 run osmo-hlr_10.42.42.2(pid=11232): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11232)] 02:21:34.765660 run osmo-hlr_10.42.42.2(pid=11232): stdout: | (launched: 2022-12-09_02:21:31.345998) 02:21:34.817392 run osmo-hlr_10.42.42.2(pid=11232): stderr: | 20221209022131586 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022131586 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022131586 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022131586 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022131586 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022131586 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022131603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022131620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022131620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022131620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:34.889484 run osmo-msc_10.42.42.6(pid=11238): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11238)] 02:21:34.939410 run osmo-msc_10.42.42.6(pid=11238): stdout: | (launched: 2022-12-09_02:21:33.766623) 02:21:34.990777 run osmo-msc_10.42.42.6(pid=11238): stderr: | 20221209022134083 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022134083 DLGLOBAL DEBUG validating counter group 0x7f6564bf3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022134083 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022134083 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022134083 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022134084 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022134085 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022134086 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022134086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022134086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:21:35.042762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11231): Terminating (SIGTERM) 02:21:35.084248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11234): Terminating (SIGTERM) 02:21:35.126298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11237): Terminating (SIGTERM) 02:21:35.168134 --- ParallelTerminationStrategy: PID 11231 died... 02:21:35.188092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11231): Terminated: ok {rc=0} 02:21:35.234384 --- ParallelTerminationStrategy: PID 11234 died... 02:21:35.253740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11234): Terminated: ok {rc=0} 02:21:35.299719 --- ParallelTerminationStrategy: PID 11237 died... 02:21:35.319314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11237): Terminated: ok {rc=0} 02:21:35.406747 bus /sierra_9: Setting Powered False 02:21:36.505218 bus /sierra_9: Setting Powered False 02:21:37.622161 bus /sierra_8: Setting Powered False 02:21:38.721338 bus /sierra_8: Setting Powered False 02:21:39.835256 bus /sierra_3: Setting Powered False 02:21:40.934992 bus /sierra_3: Setting Powered False 02:21:42.050461 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:oc2g --------------------------------------------------------------------- 02:21:43.308726 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:21:43.313959 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 02:21:43.334189 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 02:21:43.372574 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 02:21:43.458838 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 02:21:43.478981 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 02:21:43.516685 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 02:21:44.105400 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 02:21:44.154062 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:44.164470 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:21:44.198604 tst cs_paging_gprs_active.py: using LAC 18399 02:21:44.317106 tst cs_paging_gprs_active.py: using RAC 39 02:21:44.434535 tst cs_paging_gprs_active.py: using CellId 18399 02:21:44.552047 tst cs_paging_gprs_active.py: using BVCI 18400 02:21:44.661327 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:44.671740 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:44.682090 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:44.692306 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:44.702511 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:44.712654 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:44.722976 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:44.733160 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:44.743434 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:44.862277 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:44.978225 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:21:45.178851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:45.479038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11244): Launched 02:21:45.738979 run iperf3-srv_10.42.42.10(pid=11245): Launched 02:21:45.864692 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:21:46.100319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:46.439067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11246): Launched 02:21:46.741652 run iperf3-srv_10.42.42.10(pid=11247): Launched 02:21:46.872850 tst cs_paging_gprs_active.py:38: start network... 02:21:47.098019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:47.602681 run create_hlr_db(pid=11248): Launched 02:21:47.729536 bus /sierra_2: Setting Powered False 02:21:48.790044 run create_hlr_db(pid=11248): Terminated: ok {rc=0} 02:21:49.228918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11250): Launched 02:21:49.550766 run osmo-hlr_10.42.42.2(pid=11251): Launched 02:21:49.673931 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:50.225902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11253): Launched 02:21:50.548016 run osmo-stp_10.42.42.5(pid=11254): Launched 02:21:50.671069 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:21:51.226373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11256): Launched 02:21:51.349147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:21:51.621158 run patchelf(pid=11257): Launched 02:21:51.799874 run osmo-stp_10.42.42.5(pid=11254): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11254)] 02:21:51.936015 run osmo-stp_10.42.42.5(pid=11254): stdout: | (launched: 2022-12-09_02:21:50.489561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:52.074190 run osmo-stp_10.42.42.5(pid=11254): stderr: | 20221209022150678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022150678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022150678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022150679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022150679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022150679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022150679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:52.212701 run osmo-stp_10.42.42.5(pid=11254): stdout: | (launched: 2022-12-09_02:21:50.489561) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:52.345044 run osmo-stp_10.42.42.5(pid=11254): stderr: | 20221209022150678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022150678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022150678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022150679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022150679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022150679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022150679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:52.501717 run patchelf(pid=11257): Terminating (SIGINT) 02:21:52.682529 run patchelf(pid=11257): Terminated: ok {rc=0} 02:21:52.812809 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11254): Process ended prematurely: osmo-stp_10.42.42.5(pid=11254) [trial-2353↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11254)] [trial-2353↪gprs:oc2g↪cs_paging_gprs_active.py:38] 02:21:52.822716 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:21:52.851656 run osmo-hlr_10.42.42.2(pid=11251): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11251)] 02:21:52.902347 run osmo-hlr_10.42.42.2(pid=11251): stdout: | (launched: 2022-12-09_02:21:49.492332) 02:21:52.954490 run osmo-hlr_10.42.42.2(pid=11251): stderr: | 20221209022149688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022149688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022149688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022149688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022149688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022149688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022149700 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022149709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022149709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022149709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:53.007005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11244): Terminating (SIGTERM) 02:21:53.049154 run iperf3-srv_10.42.42.10(pid=11245): Terminating (SIGTERM) 02:21:53.091298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11246): Terminating (SIGTERM) 02:21:53.133870 run iperf3-srv_10.42.42.10(pid=11247): Terminating (SIGTERM) 02:21:53.175947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11250): Terminating (SIGTERM) 02:21:53.218353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11253): Terminating (SIGTERM) 02:21:53.260430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11256): Terminating (SIGTERM) 02:21:53.302656 --- ParallelTerminationStrategy: PID 11244 died... 02:21:53.322826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11244): Terminated: ok {rc=0} 02:21:53.369758 --- ParallelTerminationStrategy: PID 11245 died... 02:21:53.389381 run iperf3-srv_10.42.42.10(pid=11245): Terminated {rc=256} 02:21:53.435706 --- ParallelTerminationStrategy: PID 11246 died... 02:21:53.455357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11246): Terminated: ok {rc=0} 02:21:53.501826 --- ParallelTerminationStrategy: PID 11247 died... 02:21:53.521370 run iperf3-srv_10.42.42.10(pid=11247): Terminated {rc=256} 02:21:53.567739 --- ParallelTerminationStrategy: PID 11250 died... 02:21:53.587257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11250): Terminated: ok {rc=0} 02:21:53.633462 --- ParallelTerminationStrategy: PID 11253 died... 02:21:53.653172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11253): Terminated: ok {rc=0} 02:21:53.699842 --- ParallelTerminationStrategy: PID 11256 died... 02:21:53.719549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11256): Terminated: ok {rc=0} 02:21:53.807265 bus /gobi_0: Setting Powered False 02:21:54.904363 bus /gobi_0: Setting Powered False 02:21:56.019306 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g iperf3.py ---------------------------------------------- 02:21:57.168320 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:57.180057 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:21:57.216666 tst iperf3.py: using LAC 18400 02:21:57.344529 tst iperf3.py: using RAC 40 02:21:57.470334 tst iperf3.py: using CellId 18400 02:21:57.596273 tst iperf3.py: using BVCI 18401 02:21:57.715203 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:57.726183 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:57.737040 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:57.747949 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:57.758909 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:57.769793 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:57.780748 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:57.791859 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:57.803049 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:57.920897 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:21:58.123457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:58.424209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11258): Launched 02:21:58.685503 run iperf3-srv_10.42.42.10(pid=11259): Launched 02:21:58.797495 tst iperf3.py:8: start network... 02:21:58.996800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:59.460090 run create_hlr_db(pid=11260): Launched 02:21:59.582859 bus /gobi_6: Setting Powered False 02:22:00.642392 run create_hlr_db(pid=11260): Terminated: ok {rc=0} 02:22:01.107571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11262): Launched 02:22:01.457676 run osmo-hlr_10.42.42.2(pid=11263): Launched 02:22:01.650394 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:02.389389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11265): Launched 02:22:02.687524 run osmo-stp_10.42.42.5(pid=11266): Launched 02:22:02.801492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:03.317518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11268): Launched 02:22:03.431275 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:03.683833 run patchelf(pid=11269): Launched 02:22:03.849296 run osmo-stp_10.42.42.5(pid=11266): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11266)] 02:22:03.975276 run osmo-stp_10.42.42.5(pid=11266): stdout: | (launched: 2022-12-09_02:22:02.633115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:04.103370 run osmo-stp_10.42.42.5(pid=11266): stderr: | 20221209022202804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022202804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022202805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022202805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022202805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022202806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022202806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:04.231729 run osmo-stp_10.42.42.5(pid=11266): stdout: | (launched: 2022-12-09_02:22:02.633115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:04.354062 run osmo-stp_10.42.42.5(pid=11266): stderr: | 20221209022202804 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022202804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022202805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022202805 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022202805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022202806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022202806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:04.499225 run patchelf(pid=11269): Terminating (SIGINT) 02:22:04.666564 run patchelf(pid=11269): Terminated: ok {rc=0} 02:22:04.788293 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11266): Process ended prematurely: osmo-stp_10.42.42.5(pid=11266) [trial-2353↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11266)] [trial-2353↪gprs:oc2g↪iperf3.py:8] 02:22:04.797550 tst iperf3.py:8: Test FAILED (7.7 sec) 02:22:04.824378 run osmo-hlr_10.42.42.2(pid=11263): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11263)] 02:22:04.871653 run osmo-hlr_10.42.42.2(pid=11263): stdout: | (launched: 2022-12-09_02:22:01.385686) 02:22:04.920576 run osmo-hlr_10.42.42.2(pid=11263): stderr: | 20221209022201754 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022201755 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022201755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022201755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022201755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022201755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022201783 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022201808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022201809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022201809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:04.969824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11258): Terminating (SIGTERM) 02:22:05.009333 run iperf3-srv_10.42.42.10(pid=11259): Terminating (SIGTERM) 02:22:05.048537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11262): Terminating (SIGTERM) 02:22:05.087862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11265): Terminating (SIGTERM) 02:22:05.127122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11268): Terminating (SIGTERM) 02:22:05.166602 --- ParallelTerminationStrategy: PID 11258 died... 02:22:05.185557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11258): Terminated: ok {rc=0} 02:22:05.229241 --- ParallelTerminationStrategy: PID 11259 died... 02:22:05.247624 run iperf3-srv_10.42.42.10(pid=11259): Terminated {rc=256} 02:22:05.291129 --- ParallelTerminationStrategy: PID 11262 died... 02:22:05.309632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11262): Terminated: ok {rc=0} 02:22:05.353182 --- ParallelTerminationStrategy: PID 11265 died... 02:22:05.371544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11265): Terminated: ok {rc=0} 02:22:05.415040 --- ParallelTerminationStrategy: PID 11268 died... 02:22:05.433509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11268): Terminated: ok {rc=0} 02:22:05.515778 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g iperf3m4.py ---------------------------------------------- 02:22:06.664261 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:06.675985 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:22:06.714960 tst iperf3m4.py: using LAC 18401 02:22:06.842612 tst iperf3m4.py: using RAC 41 02:22:06.969333 tst iperf3m4.py: using CellId 18401 02:22:07.096743 tst iperf3m4.py: using BVCI 18402 02:22:07.217243 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:07.228130 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:07.238966 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:07.250516 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:07.261940 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:07.273302 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:07.285474 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:07.296330 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:07.308153 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:22:07.429854 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:22:07.548736 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:22:07.667618 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:22:07.786396 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:22:08.003747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:08.328424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11270): Launched 02:22:08.608593 run iperf3-srv_10.42.42.10(pid=11271): Launched 02:22:08.729315 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:22:08.946597 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:09.270026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11272): Launched 02:22:09.548549 run iperf3-srv_10.42.42.10(pid=11273): Launched 02:22:09.669157 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:22:09.885708 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:10.209287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11274): Launched 02:22:10.488551 run iperf3-srv_10.42.42.10(pid=11275): Launched 02:22:10.608887 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:22:10.826356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:11.149845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11276): Launched 02:22:11.428806 run iperf3-srv_10.42.42.10(pid=11277): Launched 02:22:11.549636 tst iperf3m4.py:8: start network... 02:22:11.766229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:12.268070 run create_hlr_db(pid=11278): Launched 02:22:12.390701 bus /gobi_6: Setting Powered False 02:22:13.454569 run create_hlr_db(pid=11278): Terminated: ok {rc=0} 02:22:13.901615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11280): Launched 02:22:14.223166 run osmo-hlr_10.42.42.2(pid=11281): Launched 02:22:14.346551 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:14.899011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11283): Launched 02:22:15.220727 run osmo-stp_10.42.42.5(pid=11284): Launched 02:22:15.344052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:15.928094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11286): Launched 02:22:16.059108 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:16.329341 run patchelf(pid=11287): Launched 02:22:16.535226 run osmo-stp_10.42.42.5(pid=11284): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11284)] 02:22:16.668890 run osmo-stp_10.42.42.5(pid=11284): stdout: | (launched: 2022-12-09_02:22:15.162410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:16.804192 run osmo-stp_10.42.42.5(pid=11284): stderr: | 20221209022215350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022215350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022215350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022215351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022215351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022215351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022215351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:16.940104 run osmo-stp_10.42.42.5(pid=11284): stdout: | (launched: 2022-12-09_02:22:15.162410) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:17.067736 run osmo-stp_10.42.42.5(pid=11284): stderr: | 20221209022215350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022215350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022215350 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022215351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022215351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022215351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022215351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:17.219226 run patchelf(pid=11287): Terminating (SIGINT) 02:22:17.389237 run patchelf(pid=11287): Terminated: ok {rc=0} 02:22:17.511446 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11284): Process ended prematurely: osmo-stp_10.42.42.5(pid=11284) [trial-2353↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11284)] [trial-2353↪gprs:oc2g↪iperf3m4.py:8] 02:22:17.521438 tst iperf3m4.py:8: Test FAILED (10.9 sec) 02:22:17.548776 run osmo-hlr_10.42.42.2(pid=11281): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11281)] 02:22:17.596895 run osmo-hlr_10.42.42.2(pid=11281): stdout: | (launched: 2022-12-09_02:22:14.164805) 02:22:17.645990 run osmo-hlr_10.42.42.2(pid=11281): stderr: | 20221209022214359 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022214359 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022214360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022214360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022214360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022214360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022214372 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022214380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022214381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022214381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:17.695492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11270): Terminating (SIGTERM) 02:22:17.735164 run iperf3-srv_10.42.42.10(pid=11271): Terminating (SIGTERM) 02:22:17.774675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11272): Terminating (SIGTERM) 02:22:17.814296 run iperf3-srv_10.42.42.10(pid=11273): Terminating (SIGTERM) 02:22:17.853981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11274): Terminating (SIGTERM) 02:22:17.893625 run iperf3-srv_10.42.42.10(pid=11275): Terminating (SIGTERM) 02:22:17.933069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11276): Terminating (SIGTERM) 02:22:17.972447 run iperf3-srv_10.42.42.10(pid=11277): Terminating (SIGTERM) 02:22:18.011793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11280): Terminating (SIGTERM) 02:22:18.051262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11283): Terminating (SIGTERM) 02:22:18.091075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11286): Terminating (SIGTERM) 02:22:18.130759 --- ParallelTerminationStrategy: PID 11270 died... 02:22:18.149916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11270): Terminated: ok {rc=0} 02:22:18.194357 --- ParallelTerminationStrategy: PID 11271 died... 02:22:18.212877 run iperf3-srv_10.42.42.10(pid=11271): Terminated {rc=256} 02:22:18.256665 --- ParallelTerminationStrategy: PID 11272 died... 02:22:18.275537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11272): Terminated: ok {rc=0} 02:22:18.319450 --- ParallelTerminationStrategy: PID 11273 died... 02:22:18.338400 run iperf3-srv_10.42.42.10(pid=11273): Terminated {rc=256} 02:22:18.382274 --- ParallelTerminationStrategy: PID 11274 died... 02:22:18.401068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11274): Terminated: ok {rc=0} 02:22:18.444829 --- ParallelTerminationStrategy: PID 11275 died... 02:22:18.464024 run iperf3-srv_10.42.42.10(pid=11275): Terminated {rc=256} 02:22:18.508534 --- ParallelTerminationStrategy: PID 11276 died... 02:22:18.527484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11276): Terminated: ok {rc=0} 02:22:18.571574 --- ParallelTerminationStrategy: PID 11277 died... 02:22:18.590473 run iperf3-srv_10.42.42.10(pid=11277): Terminated {rc=256} 02:22:18.635089 --- ParallelTerminationStrategy: PID 11280 died... 02:22:18.654139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11280): Terminated: ok {rc=0} 02:22:18.698959 --- ParallelTerminationStrategy: PID 11283 died... 02:22:18.717954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11283): Terminated: ok {rc=0} 02:22:18.762093 --- ParallelTerminationStrategy: PID 11286 died... 02:22:18.780909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11286): Terminated: ok {rc=0} 02:22:18.866051 bus /gobi_4: Setting Powered False 02:22:19.963438 bus /gobi_4: Setting Powered False 02:22:21.076762 bus /gobi_1: Setting Powered False 02:22:22.176000 bus /gobi_1: Setting Powered False 02:22:23.292826 bus /gobi_0: Setting Powered False 02:22:24.390917 bus /gobi_0: Setting Powered False 02:22:25.503446 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g ping.py ---------------------------------------------- 02:22:26.605988 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:26.617868 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:22:26.654850 tst ping.py: using LAC 18402 02:22:26.781397 tst ping.py: using RAC 42 02:22:26.906569 tst ping.py: using CellId 18402 02:22:27.034958 tst ping.py: using BVCI 18403 02:22:27.152798 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:27.164069 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:27.174986 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:27.186307 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:27.197661 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:27.208735 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:27.219946 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:27.230940 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:22:27.349553 tst ping.py:19: start network... 02:22:27.565753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:28.061047 run create_hlr_db(pid=11288): Launched 02:22:28.182403 bus /gobi_6: Setting Powered False 02:22:29.245611 run create_hlr_db(pid=11288): Terminated: ok {rc=0} 02:22:29.690747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11290): Launched 02:22:30.011152 run osmo-hlr_10.42.42.2(pid=11291): Launched 02:22:30.133608 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:30.684542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11293): Launched 02:22:31.029853 run osmo-stp_10.42.42.5(pid=11294): Launched 02:22:31.295150 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:31.948149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11296): Launched 02:22:32.073876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:32.349739 run patchelf(pid=11297): Launched 02:22:32.527119 run osmo-stp_10.42.42.5(pid=11294): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11294)] 02:22:32.662085 run osmo-stp_10.42.42.5(pid=11294): stdout: | (launched: 2022-12-09_02:22:30.967048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:32.799184 run osmo-stp_10.42.42.5(pid=11294): stderr: | 20221209022231260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022231261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022231261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022231261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022231262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022231262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022231262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:32.936052 run osmo-stp_10.42.42.5(pid=11294): stdout: | (launched: 2022-12-09_02:22:30.967048) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:33.067828 run osmo-stp_10.42.42.5(pid=11294): stderr: | 20221209022231260 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022231261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022231261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022231261 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022231262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022231262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022231262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:33.224006 run patchelf(pid=11297): Terminating (SIGINT) 02:22:33.402993 run patchelf(pid=11297): Terminated: ok {rc=0} 02:22:33.532007 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11294): Process ended prematurely: osmo-stp_10.42.42.5(pid=11294) [trial-2353↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11294)] [trial-2353↪gprs:oc2g↪ping.py:22] 02:22:33.541486 tst ping.py:22: Test FAILED (6.9 sec) 02:22:33.570286 run osmo-hlr_10.42.42.2(pid=11291): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11291)] 02:22:33.620603 run osmo-hlr_10.42.42.2(pid=11291): stdout: | (launched: 2022-12-09_02:22:29.952044) 02:22:33.672605 run osmo-hlr_10.42.42.2(pid=11291): stderr: | 20221209022230149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022230149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022230149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022230149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022230149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022230149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022230162 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022230170 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022230170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022230170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:33.725084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11290): Terminating (SIGTERM) 02:22:33.767495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11293): Terminating (SIGTERM) 02:22:33.809856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11296): Terminating (SIGTERM) 02:22:33.852344 --- ParallelTerminationStrategy: PID 11290 died... 02:22:33.872561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11290): Terminated: ok {rc=0} 02:22:33.919463 --- ParallelTerminationStrategy: PID 11293 died... 02:22:33.939271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11293): Terminated: ok {rc=0} 02:22:33.985864 --- ParallelTerminationStrategy: PID 11296 died... 02:22:34.005760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11296): Terminated: ok {rc=0} 02:22:34.094568 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 02:22:35.183076 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:35.195267 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:22:35.231315 tst ping_idle_ping.py: using LAC 18403 02:22:35.365558 tst ping_idle_ping.py: using RAC 43 02:22:35.503749 tst ping_idle_ping.py: using CellId 18403 02:22:35.631683 tst ping_idle_ping.py: using BVCI 18404 02:22:35.751341 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:35.762784 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:35.774451 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:35.785710 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:35.796770 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:35.808064 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:35.819311 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:35.830533 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:22:35.948660 tst ping_idle_ping.py:24: start network... 02:22:36.164807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:36.664883 run create_hlr_db(pid=11298): Launched 02:22:36.787293 bus /gobi_6: Setting Powered False 02:22:37.850922 run create_hlr_db(pid=11298): Terminated: ok {rc=0} 02:22:38.277763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11300): Launched 02:22:38.575882 run osmo-hlr_10.42.42.2(pid=11301): Launched 02:22:38.689339 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:39.204494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11303): Launched 02:22:39.503291 run osmo-stp_10.42.42.5(pid=11304): Launched 02:22:39.616343 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:40.130535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11306): Launched 02:22:40.243316 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:40.495135 run patchelf(pid=11307): Launched 02:22:40.659950 run osmo-stp_10.42.42.5(pid=11304): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11304)] 02:22:40.785701 run osmo-stp_10.42.42.5(pid=11304): stdout: | (launched: 2022-12-09_02:22:39.448195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:40.913654 run osmo-stp_10.42.42.5(pid=11304): stderr: | 20221209022239618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022239618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022239619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022239619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022239620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022239620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022239620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:41.042461 run osmo-stp_10.42.42.5(pid=11304): stdout: | (launched: 2022-12-09_02:22:39.448195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:41.164627 run osmo-stp_10.42.42.5(pid=11304): stderr: | 20221209022239618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022239618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022239619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022239619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022239620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022239620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022239620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:41.309230 run patchelf(pid=11307): Terminating (SIGINT) 02:22:41.476083 run patchelf(pid=11307): Terminated: ok {rc=0} 02:22:41.596171 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11304): Process ended prematurely: osmo-stp_10.42.42.5(pid=11304) [trial-2353↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11304)] [trial-2353↪gprs:oc2g↪ping_idle_ping.py:27] 02:22:41.605139 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:22:41.631761 run osmo-hlr_10.42.42.2(pid=11301): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11301)] 02:22:41.679114 run osmo-hlr_10.42.42.2(pid=11301): stdout: | (launched: 2022-12-09_02:22:38.520481) 02:22:41.728125 run osmo-hlr_10.42.42.2(pid=11301): stderr: | 20221209022238695 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022238695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022238695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022238695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022238695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022238695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022238707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022238718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022238718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022238718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:41.777734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11300): Terminating (SIGTERM) 02:22:41.817126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11303): Terminating (SIGTERM) 02:22:41.856866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11306): Terminating (SIGTERM) 02:22:41.897074 --- ParallelTerminationStrategy: PID 11300 died... 02:22:41.916164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11300): Terminated: ok {rc=0} 02:22:41.959979 --- ParallelTerminationStrategy: PID 11303 died... 02:22:41.978623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11303): Terminated: ok {rc=0} 02:22:42.022220 --- ParallelTerminationStrategy: PID 11306 died... 02:22:42.041012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11306): Terminated: ok {rc=0} 02:22:42.125824 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 02:22:43.414329 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:22:43.419876 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:22:43.440701 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:22:43.479309 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:22:43.565551 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:22:43.585849 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:22:43.623927 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:22:44.217333 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:22:44.265246 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.277408 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:22:44.312540 tst cs_paging_gprs_active.py: using LAC 18404 02:22:44.429370 tst cs_paging_gprs_active.py: using RAC 44 02:22:44.546679 tst cs_paging_gprs_active.py: using CellId 18404 02:22:44.665391 tst cs_paging_gprs_active.py: using BVCI 18405 02:22:44.784152 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.795650 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.806976 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.818634 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.830176 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.841805 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.853670 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.865260 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.876661 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:44.994494 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:45.109619 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:22:45.311029 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:45.612867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11311): Launched 02:22:45.901766 run iperf3-srv_10.42.42.10(pid=11312): Launched 02:22:46.024407 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:22:46.230102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:46.550875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11313): Launched 02:22:46.826500 run iperf3-srv_10.42.42.10(pid=11314): Launched 02:22:46.989374 tst cs_paging_gprs_active.py:38: start network... 02:22:47.227581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:47.729514 run create_hlr_db(pid=11315): Launched 02:22:47.851969 bus /gobi_6: Setting Powered False 02:22:48.914893 run create_hlr_db(pid=11315): Terminated: ok {rc=0} 02:22:49.361837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11317): Launched 02:22:49.680305 run osmo-hlr_10.42.42.2(pid=11318): Launched 02:22:49.801847 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:50.354919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11320): Launched 02:22:50.673596 run osmo-stp_10.42.42.5(pid=11321): Launched 02:22:50.794650 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:51.345367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11323): Launched 02:22:51.466913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:51.736087 run patchelf(pid=11324): Launched 02:22:51.912869 run osmo-stp_10.42.42.5(pid=11321): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11321)] 02:22:52.048044 run osmo-stp_10.42.42.5(pid=11321): stdout: | (launched: 2022-12-09_02:22:50.615460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:52.185198 run osmo-stp_10.42.42.5(pid=11321): stderr: | 20221209022250808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022250808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022250808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022250808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022250809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022250809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022250809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:52.322012 run osmo-stp_10.42.42.5(pid=11321): stdout: | (launched: 2022-12-09_02:22:50.615460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:52.453032 run osmo-stp_10.42.42.5(pid=11321): stderr: | 20221209022250808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022250808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022250808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022250808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022250809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022250809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022250809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:52.608536 run patchelf(pid=11324): Terminating (SIGINT) 02:22:52.786902 run patchelf(pid=11324): Terminated: ok {rc=0} 02:22:52.915607 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11321): Process ended prematurely: osmo-stp_10.42.42.5(pid=11321) [trial-2353↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11321)] [trial-2353↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:22:52.925761 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:22:52.954193 run osmo-hlr_10.42.42.2(pid=11318): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11318)] 02:22:53.003959 run osmo-hlr_10.42.42.2(pid=11318): stdout: | (launched: 2022-12-09_02:22:49.622280) 02:22:53.055600 run osmo-hlr_10.42.42.2(pid=11318): stderr: | 20221209022249821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022249821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022249822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022249822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022249822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022249822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022249835 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022249843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022249843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022249843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:53.107905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11311): Terminating (SIGTERM) 02:22:53.150103 run iperf3-srv_10.42.42.10(pid=11312): Terminating (SIGTERM) 02:22:53.192134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11313): Terminating (SIGTERM) 02:22:53.234110 run iperf3-srv_10.42.42.10(pid=11314): Terminating (SIGTERM) 02:22:53.275907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11317): Terminating (SIGTERM) 02:22:53.317836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11320): Terminating (SIGTERM) 02:22:53.359724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11323): Terminating (SIGTERM) 02:22:53.401895 --- ParallelTerminationStrategy: PID 11311 died... 02:22:53.421601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11311): Terminated: ok {rc=0} 02:22:53.468290 --- ParallelTerminationStrategy: PID 11312 died... 02:22:53.487533 run iperf3-srv_10.42.42.10(pid=11312): Terminated {rc=256} 02:22:53.533728 --- ParallelTerminationStrategy: PID 11313 died... 02:22:53.553087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11313): Terminated: ok {rc=0} 02:22:53.599242 --- ParallelTerminationStrategy: PID 11314 died... 02:22:53.618491 run iperf3-srv_10.42.42.10(pid=11314): Terminated {rc=256} 02:22:53.664800 --- ParallelTerminationStrategy: PID 11317 died... 02:22:53.684597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11317): Terminated: ok {rc=0} 02:22:53.731050 --- ParallelTerminationStrategy: PID 11320 died... 02:22:53.750549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11320): Terminated: ok {rc=0} 02:22:53.797204 --- ParallelTerminationStrategy: PID 11323 died... 02:22:53.816813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11323): Terminated: ok {rc=0} 02:22:53.904730 bus /gobi_0: Setting Powered False 02:22:55.003863 bus /gobi_0: Setting Powered False 02:22:56.116275 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:22:57.263968 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:57.275923 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:22:57.314596 tst iperf3.py: using LAC 18405 02:22:57.441185 tst iperf3.py: using RAC 45 02:22:57.566081 tst iperf3.py: using CellId 18405 02:22:57.691066 tst iperf3.py: using BVCI 18406 02:22:57.807037 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:57.818301 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:57.829404 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:57.840762 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:57.851973 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:57.863149 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:57.874461 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:57.885735 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:57.897202 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:58.014652 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:22:58.215130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:58.514686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11325): Launched 02:22:58.773158 run iperf3-srv_10.42.42.10(pid=11326): Launched 02:22:58.884290 tst iperf3.py:8: start network... 02:22:59.083440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:59.546628 run create_hlr_db(pid=11327): Launched 02:22:59.670802 bus /gobi_6: Setting Powered False 02:23:00.733718 run create_hlr_db(pid=11327): Terminated: ok {rc=0} 02:23:01.210817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11329): Launched 02:23:01.616456 run osmo-hlr_10.42.42.2(pid=11358): Launched 02:23:01.850603 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:02.630739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11387): Launched 02:23:03.014699 run osmo-stp_10.42.42.5(pid=11406): Launched 02:23:03.287365 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:04.109444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11511): Launched 02:23:04.268663 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:04.600442 run patchelf(pid=11571): Launched 02:23:04.837353 run osmo-stp_10.42.42.5(pid=11406): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11406)] 02:23:04.988853 run osmo-stp_10.42.42.5(pid=11406): stdout: | (launched: 2022-12-09_02:23:02.947530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:05.137274 run osmo-stp_10.42.42.5(pid=11406): stderr: | 20221209022303288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022303288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022303288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022303292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022303293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022303293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022303293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:05.278140 run osmo-stp_10.42.42.5(pid=11406): stdout: | (launched: 2022-12-09_02:23:02.947530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:05.413412 run osmo-stp_10.42.42.5(pid=11406): stderr: | 20221209022303288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022303288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022303288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022303292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022303293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022303293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022303293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:05.574729 run patchelf(pid=11571): Terminating (SIGINT) 02:23:05.759484 run patchelf(pid=11571): Terminated: ok {rc=0} 02:23:05.893378 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11406): Process ended prematurely: osmo-stp_10.42.42.5(pid=11406) [trial-2353↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11406)] [trial-2353↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 02:23:05.904569 tst iperf3.py:8: Test FAILED (8.7 sec) 02:23:05.936728 run osmo-hlr_10.42.42.2(pid=11358): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11358)] 02:23:05.989677 run osmo-hlr_10.42.42.2(pid=11358): stdout: | (launched: 2022-12-09_02:23:01.536256) 02:23:06.044039 run osmo-hlr_10.42.42.2(pid=11358): stderr: | 20221209022301922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022301922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022301922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022301922 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022301922 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022301922 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022301940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022301957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022301958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022301958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:06.099245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11325): Terminating (SIGTERM) 02:23:06.144042 run iperf3-srv_10.42.42.10(pid=11326): Terminating (SIGTERM) 02:23:06.191945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11329): Terminating (SIGTERM) 02:23:06.237432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11387): Terminating (SIGTERM) 02:23:06.283599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11511): Terminating (SIGTERM) 02:23:06.330175 --- ParallelTerminationStrategy: PID 11325 died... 02:23:06.351475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11325): Terminated: ok {rc=0} 02:23:06.402827 --- ParallelTerminationStrategy: PID 11326 died... 02:23:06.423407 run iperf3-srv_10.42.42.10(pid=11326): Terminated {rc=256} 02:23:06.473794 --- ParallelTerminationStrategy: PID 11329 died... 02:23:06.494583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11329): Terminated: ok {rc=0} 02:23:06.545197 --- ParallelTerminationStrategy: PID 11387 died... 02:23:06.566587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11387): Terminated: ok {rc=0} 02:23:06.616230 --- ParallelTerminationStrategy: PID 11511 died... 02:23:06.637123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11511): Terminated: ok {rc=0} 02:23:06.730594 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:23:07.885700 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:07.899252 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:23:07.940250 tst iperf3m4.py: using LAC 18406 02:23:08.068405 tst iperf3m4.py: using RAC 46 02:23:08.197367 tst iperf3m4.py: using CellId 18406 02:23:08.326193 tst iperf3m4.py: using BVCI 18407 02:23:08.447583 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:08.459970 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:08.473655 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:08.486778 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:08.498788 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:08.511957 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:08.527272 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:08.540143 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:08.553727 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:23:08.680028 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:23:08.805355 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:23:08.931122 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:23:09.053954 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:23:09.276071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:09.609458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11608): Launched 02:23:09.911176 run iperf3-srv_10.42.42.10(pid=11609): Launched 02:23:10.051666 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:23:10.277060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:10.614670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11610): Launched 02:23:10.920230 run iperf3-srv_10.42.42.10(pid=11611): Launched 02:23:11.058516 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:23:11.283184 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:11.617724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11612): Launched 02:23:11.918289 run iperf3-srv_10.42.42.10(pid=11613): Launched 02:23:12.055635 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:23:12.280742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:12.617781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11614): Launched 02:23:12.898839 run iperf3-srv_10.42.42.10(pid=11615): Launched 02:23:13.028049 tst iperf3m4.py:8: start network... 02:23:13.233804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:13.711971 run create_hlr_db(pid=11616): Launched 02:23:13.869272 bus /gobi_6: Setting Powered False 02:23:14.930731 run create_hlr_db(pid=11616): Terminated: ok {rc=0} 02:23:15.372343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11618): Launched 02:23:15.699002 run osmo-hlr_10.42.42.2(pid=11619): Launched 02:23:15.939822 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:16.641380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11621): Launched 02:23:16.994586 run osmo-stp_10.42.42.5(pid=11622): Launched 02:23:17.164622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:17.930182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11624): Launched 02:23:18.091248 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:18.377540 run patchelf(pid=11625): Launched 02:23:18.574313 run osmo-stp_10.42.42.5(pid=11622): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11622)] 02:23:18.715860 run osmo-stp_10.42.42.5(pid=11622): stdout: | (launched: 2022-12-09_02:23:16.937987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:18.860250 run osmo-stp_10.42.42.5(pid=11622): stderr: | 20221209022317274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022317274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022317275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022317275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022317275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022317276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022317276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:19.004268 run osmo-stp_10.42.42.5(pid=11622): stdout: | (launched: 2022-12-09_02:23:16.937987) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:19.141654 run osmo-stp_10.42.42.5(pid=11622): stderr: | 20221209022317274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022317274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022317275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022317275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022317275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022317276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022317276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:19.305557 run patchelf(pid=11625): Terminating (SIGINT) 02:23:19.493550 run patchelf(pid=11625): Terminated: ok {rc=0} 02:23:19.628926 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11622): Process ended prematurely: osmo-stp_10.42.42.5(pid=11622) [trial-2353↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11622)] [trial-2353↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 02:23:19.640444 tst iperf3m4.py:8: Test FAILED (11.8 sec) 02:23:19.673487 run osmo-hlr_10.42.42.2(pid=11619): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11619)] 02:23:19.726434 run osmo-hlr_10.42.42.2(pid=11619): stdout: | (launched: 2022-12-09_02:23:15.638027) 02:23:19.781887 run osmo-hlr_10.42.42.2(pid=11619): stderr: | 20221209022315976 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022315976 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022315976 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022315976 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022315985 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022315985 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022315998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022316006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022316006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022316006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:19.837363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11608): Terminating (SIGTERM) 02:23:19.882463 run iperf3-srv_10.42.42.10(pid=11609): Terminating (SIGTERM) 02:23:19.930675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11610): Terminating (SIGTERM) 02:23:19.976020 run iperf3-srv_10.42.42.10(pid=11611): Terminating (SIGTERM) 02:23:20.023436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11612): Terminating (SIGTERM) 02:23:20.068481 run iperf3-srv_10.42.42.10(pid=11613): Terminating (SIGTERM) 02:23:20.115902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11614): Terminating (SIGTERM) 02:23:20.161060 run iperf3-srv_10.42.42.10(pid=11615): Terminating (SIGTERM) 02:23:20.208924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11618): Terminating (SIGTERM) 02:23:20.254049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11621): Terminating (SIGTERM) 02:23:20.300635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11624): Terminating (SIGTERM) 02:23:20.347630 --- ParallelTerminationStrategy: PID 11608 died... 02:23:20.368581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11608): Terminated: ok {rc=0} 02:23:20.420298 --- ParallelTerminationStrategy: PID 11609 died... 02:23:20.441112 run iperf3-srv_10.42.42.10(pid=11609): Terminated {rc=256} 02:23:20.491179 --- ParallelTerminationStrategy: PID 11610 died... 02:23:20.511908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11610): Terminated: ok {rc=0} 02:23:20.561660 --- ParallelTerminationStrategy: PID 11611 died... 02:23:20.582302 run iperf3-srv_10.42.42.10(pid=11611): Terminated {rc=256} 02:23:20.631914 --- ParallelTerminationStrategy: PID 11612 died... 02:23:20.652662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11612): Terminated: ok {rc=0} 02:23:20.702803 --- ParallelTerminationStrategy: PID 11613 died... 02:23:20.723543 run iperf3-srv_10.42.42.10(pid=11613): Terminated {rc=256} 02:23:20.773227 --- ParallelTerminationStrategy: PID 11614 died... 02:23:20.795313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11614): Terminated: ok {rc=0} 02:23:20.845108 --- ParallelTerminationStrategy: PID 11615 died... 02:23:20.865757 run iperf3-srv_10.42.42.10(pid=11615): Terminated {rc=256} 02:23:20.915827 --- ParallelTerminationStrategy: PID 11618 died... 02:23:20.936615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11618): Terminated: ok {rc=0} 02:23:20.986637 --- ParallelTerminationStrategy: PID 11621 died... 02:23:21.010287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11621): Terminated: ok {rc=0} 02:23:21.059896 --- ParallelTerminationStrategy: PID 11624 died... 02:23:21.080679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11624): Terminated: ok {rc=0} 02:23:21.173632 bus /gobi_4: Setting Powered False 02:23:22.277617 bus /gobi_4: Setting Powered False 02:23:23.399111 bus /gobi_1: Setting Powered False 02:23:24.497535 bus /gobi_1: Setting Powered False 02:23:25.614986 bus /gobi_0: Setting Powered False 02:23:26.713638 bus /gobi_0: Setting Powered False 02:23:27.829538 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 02:23:28.932262 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:28.944298 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:23:28.983245 tst ping.py: using LAC 18407 02:23:29.113719 tst ping.py: using RAC 47 02:23:29.245474 tst ping.py: using CellId 18407 02:23:29.370101 tst ping.py: using BVCI 18408 02:23:29.487023 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:29.498675 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:29.509894 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:29.521263 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:29.532515 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:29.543796 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:29.555327 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:29.566700 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:23:29.681600 tst ping.py:19: start network... 02:23:29.882452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:30.347438 run create_hlr_db(pid=11627): Launched 02:23:30.470244 bus /gobi_6: Setting Powered False 02:23:31.561673 run create_hlr_db(pid=11627): Terminated: ok {rc=0} 02:23:32.064094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11629): Launched 02:23:32.389885 run osmo-hlr_10.42.42.2(pid=11630): Launched 02:23:32.514919 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:33.073190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11632): Launched 02:23:33.394679 run osmo-stp_10.42.42.5(pid=11633): Launched 02:23:33.517188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:34.072772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11635): Launched 02:23:34.195476 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:34.466876 run patchelf(pid=11636): Launched 02:23:34.647018 run osmo-stp_10.42.42.5(pid=11633): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11633)] 02:23:34.783206 run osmo-stp_10.42.42.5(pid=11633): stdout: | (launched: 2022-12-09_02:23:33.335565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:34.921665 run osmo-stp_10.42.42.5(pid=11633): stderr: | 20221209022333527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022333528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022333528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022333528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022333530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022333531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022333531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:35.059698 run osmo-stp_10.42.42.5(pid=11633): stdout: | (launched: 2022-12-09_02:23:33.335565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:35.192558 run osmo-stp_10.42.42.5(pid=11633): stderr: | 20221209022333527 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022333528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022333528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022333528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022333530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022333531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022333531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:35.349923 run patchelf(pid=11636): Terminating (SIGINT) 02:23:35.530291 run patchelf(pid=11636): Terminated: ok {rc=0} 02:23:35.660037 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11633): Process ended prematurely: osmo-stp_10.42.42.5(pid=11633) [trial-2353↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11633)] [trial-2353↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 02:23:35.669693 tst ping.py:22: Test FAILED (6.7 sec) 02:23:35.698299 run osmo-hlr_10.42.42.2(pid=11630): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11630)] 02:23:35.748875 run osmo-hlr_10.42.42.2(pid=11630): stdout: | (launched: 2022-12-09_02:23:32.331215) 02:23:35.801352 run osmo-hlr_10.42.42.2(pid=11630): stderr: | 20221209022332529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022332529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022332529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022332529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022332529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022332529 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022332542 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022332550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022332550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022332550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:35.854099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11629): Terminating (SIGTERM) 02:23:35.896473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11632): Terminating (SIGTERM) 02:23:35.938841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11635): Terminating (SIGTERM) 02:23:35.981343 --- ParallelTerminationStrategy: PID 11629 died... 02:23:36.001628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11629): Terminated: ok {rc=0} 02:23:36.048875 --- ParallelTerminationStrategy: PID 11632 died... 02:23:36.069133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11632): Terminated: ok {rc=0} 02:23:36.116161 --- ParallelTerminationStrategy: PID 11635 died... 02:23:36.135898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11635): Terminated: ok {rc=0} 02:23:36.225320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:23:37.313448 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:37.326252 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:23:37.366642 tst ping_idle_ping.py: using LAC 18408 02:23:37.491771 tst ping_idle_ping.py: using RAC 48 02:23:37.618863 tst ping_idle_ping.py: using CellId 18408 02:23:37.747025 tst ping_idle_ping.py: using BVCI 18409 02:23:37.864212 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:37.875555 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:37.886809 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:37.898205 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:37.909573 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:37.920827 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:37.932871 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:37.944378 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:23:38.062056 tst ping_idle_ping.py:24: start network... 02:23:38.263305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:38.733709 run create_hlr_db(pid=11637): Launched 02:23:38.857637 bus /gobi_6: Setting Powered False 02:23:39.917805 run create_hlr_db(pid=11637): Terminated: ok {rc=0} 02:23:40.360912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11639): Launched 02:23:40.684566 run osmo-hlr_10.42.42.2(pid=11640): Launched 02:23:40.807977 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:41.367961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11642): Launched 02:23:41.690419 run osmo-stp_10.42.42.5(pid=11643): Launched 02:23:41.815990 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:42.374114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11645): Launched 02:23:42.498798 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:42.772148 run patchelf(pid=11646): Launched 02:23:42.951800 run osmo-stp_10.42.42.5(pid=11643): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11643)] 02:23:43.089190 run osmo-stp_10.42.42.5(pid=11643): stdout: | (launched: 2022-12-09_02:23:41.631335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:43.228296 run osmo-stp_10.42.42.5(pid=11643): stderr: | 20221209022341826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022341826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022341826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022341826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022341827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022341827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022341827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:43.367253 run osmo-stp_10.42.42.5(pid=11643): stdout: | (launched: 2022-12-09_02:23:41.631335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:43.500374 run osmo-stp_10.42.42.5(pid=11643): stderr: | 20221209022341826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022341826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022341826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022341826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022341827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022341827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022341827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:43.658293 run patchelf(pid=11646): Terminating (SIGINT) 02:23:43.839120 run patchelf(pid=11646): Terminated: ok {rc=0} 02:23:43.969229 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11643): Process ended prematurely: osmo-stp_10.42.42.5(pid=11643) [trial-2353↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11643)] [trial-2353↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 02:23:43.978932 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:23:44.007684 run osmo-hlr_10.42.42.2(pid=11640): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11640)] 02:23:44.058696 run osmo-hlr_10.42.42.2(pid=11640): stdout: | (launched: 2022-12-09_02:23:40.625433) 02:23:44.111893 run osmo-hlr_10.42.42.2(pid=11640): stderr: | 20221209022340825 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022340825 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022340825 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022340825 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022340825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022340825 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022340838 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022340849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022340849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022340849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:44.165667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11639): Terminating (SIGTERM) 02:23:44.208888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11642): Terminating (SIGTERM) 02:23:44.251861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11645): Terminating (SIGTERM) 02:23:44.294944 --- ParallelTerminationStrategy: PID 11639 died... 02:23:44.315322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11639): Terminated: ok {rc=0} 02:23:44.363295 --- ParallelTerminationStrategy: PID 11642 died... 02:23:44.383043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11642): Terminated: ok {rc=0} 02:23:44.430049 --- ParallelTerminationStrategy: PID 11645 died... 02:23:44.449863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11645): Terminated: ok {rc=0} 02:23:44.538238 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:23:45.850233 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:23:45.857561 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:23:45.884627 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:23:45.940048 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:23:46.047268 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:23:46.076813 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:23:46.118198 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:23:46.698688 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:23:46.753116 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:46.765129 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:23:46.825789 tst cs_paging_gprs_active.py: using LAC 18409 02:23:46.957190 tst cs_paging_gprs_active.py: using RAC 49 02:23:47.087514 tst cs_paging_gprs_active.py: using CellId 18409 02:23:47.212222 tst cs_paging_gprs_active.py: using BVCI 18410 02:23:47.324875 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.336016 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.346835 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.358144 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.369449 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.380733 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.392201 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.403287 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:47.414571 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:47.536585 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:47.655930 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:23:47.863905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:48.173400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11650): Launched 02:23:48.440465 run iperf3-srv_10.42.42.10(pid=11651): Launched 02:23:48.556326 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:23:48.763361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:49.072479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11652): Launched 02:23:49.340244 run iperf3-srv_10.42.42.10(pid=11653): Launched 02:23:49.455414 tst cs_paging_gprs_active.py:38: start network... 02:23:49.662271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:50.138683 run create_hlr_db(pid=11654): Launched 02:23:50.265865 bus /gobi_6: Setting Powered False 02:23:51.326670 run create_hlr_db(pid=11654): Terminated: ok {rc=0} 02:23:51.776190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11656): Launched 02:23:52.104300 run osmo-hlr_10.42.42.2(pid=11657): Launched 02:23:52.231043 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:52.799965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11659): Launched 02:23:53.130063 run osmo-stp_10.42.42.5(pid=11660): Launched 02:23:53.256052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:53.822321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11662): Launched 02:23:53.947579 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:54.226686 run patchelf(pid=11663): Launched 02:23:54.409265 run osmo-stp_10.42.42.5(pid=11660): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11660)] 02:23:54.547962 run osmo-stp_10.42.42.5(pid=11660): stdout: | (launched: 2022-12-09_02:23:53.069097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:54.688027 run osmo-stp_10.42.42.5(pid=11660): stderr: | 20221209022353261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022353261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022353262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022353262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022353263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022353263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022353263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:54.828237 run osmo-stp_10.42.42.5(pid=11660): stdout: | (launched: 2022-12-09_02:23:53.069097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:54.962715 run osmo-stp_10.42.42.5(pid=11660): stderr: | 20221209022353261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022353261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022353262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022353262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022353263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022353263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022353263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:55.122466 run patchelf(pid=11663): Terminating (SIGINT) 02:23:55.306217 run patchelf(pid=11663): Terminated: ok {rc=0} 02:23:55.438680 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11660): Process ended prematurely: osmo-stp_10.42.42.5(pid=11660) [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11660)] [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:23:55.448690 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:23:55.477453 run osmo-hlr_10.42.42.2(pid=11657): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11657)] 02:23:55.527366 run osmo-hlr_10.42.42.2(pid=11657): stdout: | (launched: 2022-12-09_02:23:52.044724) 02:23:55.579210 run osmo-hlr_10.42.42.2(pid=11657): stderr: | 20221209022352244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022352244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022352245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022352245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022352245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022352245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022352257 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022352265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022352265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022352265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:55.631490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11650): Terminating (SIGTERM) 02:23:55.673276 run iperf3-srv_10.42.42.10(pid=11651): Terminating (SIGTERM) 02:23:55.714917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11652): Terminating (SIGTERM) 02:23:55.756774 run iperf3-srv_10.42.42.10(pid=11653): Terminating (SIGTERM) 02:23:55.798550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11656): Terminating (SIGTERM) 02:23:55.840631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11659): Terminating (SIGTERM) 02:23:55.882413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11662): Terminating (SIGTERM) 02:23:55.924344 --- ParallelTerminationStrategy: PID 11650 died... 02:23:55.944264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11650): Terminated: ok {rc=0} 02:23:55.990618 --- ParallelTerminationStrategy: PID 11651 died... 02:23:56.009825 run iperf3-srv_10.42.42.10(pid=11651): Terminated {rc=256} 02:23:56.055900 --- ParallelTerminationStrategy: PID 11652 died... 02:23:56.075492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11652): Terminated: ok {rc=0} 02:23:56.121691 --- ParallelTerminationStrategy: PID 11653 died... 02:23:56.140899 run iperf3-srv_10.42.42.10(pid=11653): Terminated {rc=256} 02:23:56.187189 --- ParallelTerminationStrategy: PID 11656 died... 02:23:56.206830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11656): Terminated: ok {rc=0} 02:23:56.253364 --- ParallelTerminationStrategy: PID 11659 died... 02:23:56.272793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11659): Terminated: ok {rc=0} 02:23:56.318745 --- ParallelTerminationStrategy: PID 11662 died... 02:23:56.338272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11662): Terminated: ok {rc=0} 02:23:56.425885 bus /gobi_0: Setting Powered False 02:23:57.523852 bus /gobi_0: Setting Powered False 02:23:58.639322 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:23:59.789070 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:59.801295 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:23:59.863646 tst iperf3.py: using LAC 18410 02:23:59.995941 tst iperf3.py: using RAC 50 02:24:00.123954 tst iperf3.py: using CellId 18410 02:24:00.251397 tst iperf3.py: using BVCI 18411 02:24:00.370616 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:00.382277 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:00.393458 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:00.404825 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:00.416097 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:00.427566 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:00.439154 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:00.450583 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:00.462168 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:24:00.582487 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:24:00.803512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:01.145712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11664): Launched 02:24:01.437736 run iperf3-srv_10.42.42.10(pid=11665): Launched 02:24:01.573363 tst iperf3.py:8: start network... 02:24:01.802120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:02.321950 run create_hlr_db(pid=11666): Launched 02:24:02.447390 bus /gobi_6: Setting Powered False 02:24:03.511358 run create_hlr_db(pid=11666): Terminated: ok {rc=0} 02:24:03.966785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11668): Launched 02:24:04.294805 run osmo-hlr_10.42.42.2(pid=11669): Launched 02:24:04.420090 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:04.983343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11671): Launched 02:24:05.311591 run osmo-stp_10.42.42.5(pid=11672): Launched 02:24:05.437705 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:06.003221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11674): Launched 02:24:06.127890 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:06.405296 run patchelf(pid=11675): Launched 02:24:06.586947 run osmo-stp_10.42.42.5(pid=11672): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11672)] 02:24:06.725194 run osmo-stp_10.42.42.5(pid=11672): stdout: | (launched: 2022-12-09_02:24:05.251336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:06.865406 run osmo-stp_10.42.42.5(pid=11672): stderr: | 20221209022405446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022405446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022405446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022405447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022405447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022405447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022405447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:07.005655 run osmo-stp_10.42.42.5(pid=11672): stdout: | (launched: 2022-12-09_02:24:05.251336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:07.140368 run osmo-stp_10.42.42.5(pid=11672): stderr: | 20221209022405446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022405446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022405446 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022405447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022405447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022405447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022405447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:07.300075 run patchelf(pid=11675): Terminating (SIGINT) 02:24:07.483579 run patchelf(pid=11675): Terminated: ok {rc=0} 02:24:07.616205 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11672): Process ended prematurely: osmo-stp_10.42.42.5(pid=11672) [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11672)] [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 02:24:07.626515 tst iperf3.py:8: Test FAILED (7.9 sec) 02:24:07.655568 run osmo-hlr_10.42.42.2(pid=11669): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11669)] 02:24:07.706528 run osmo-hlr_10.42.42.2(pid=11669): stdout: | (launched: 2022-12-09_02:24:04.235151) 02:24:07.759295 run osmo-hlr_10.42.42.2(pid=11669): stderr: | 20221209022404434 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022404434 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022404434 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022404434 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022404435 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022404435 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022404449 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022404457 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022404458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022404458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:07.812107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11664): Terminating (SIGTERM) 02:24:07.855104 run iperf3-srv_10.42.42.10(pid=11665): Terminating (SIGTERM) 02:24:07.898754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11668): Terminating (SIGTERM) 02:24:07.941407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11671): Terminating (SIGTERM) 02:24:07.983613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11674): Terminating (SIGTERM) 02:24:08.025981 --- ParallelTerminationStrategy: PID 11664 died... 02:24:08.046039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11664): Terminated: ok {rc=0} 02:24:08.093374 --- ParallelTerminationStrategy: PID 11665 died... 02:24:08.112919 run iperf3-srv_10.42.42.10(pid=11665): Terminated {rc=256} 02:24:08.159884 --- ParallelTerminationStrategy: PID 11668 died... 02:24:08.179574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11668): Terminated: ok {rc=0} 02:24:08.226778 --- ParallelTerminationStrategy: PID 11671 died... 02:24:08.246506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11671): Terminated: ok {rc=0} 02:24:08.293135 --- ParallelTerminationStrategy: PID 11674 died... 02:24:08.312700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11674): Terminated: ok {rc=0} 02:24:08.402079 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:24:09.553704 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:09.565982 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:24:09.622735 tst iperf3m4.py: using LAC 18411 02:24:09.751949 tst iperf3m4.py: using RAC 51 02:24:09.873411 tst iperf3m4.py: using CellId 18411 02:24:09.995558 tst iperf3m4.py: using BVCI 18412 02:24:10.108080 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:10.119087 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:10.130115 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:10.140815 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:10.151557 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:10.162241 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:10.173209 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:10.183882 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:10.194764 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:24:10.315592 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:24:10.441711 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:24:10.563804 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:24:10.681635 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:24:10.888239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:11.197202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11676): Launched 02:24:11.464390 run iperf3-srv_10.42.42.10(pid=11677): Launched 02:24:11.579297 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:24:11.785059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:12.096336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11678): Launched 02:24:12.362756 run iperf3-srv_10.42.42.10(pid=11679): Launched 02:24:12.477452 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:24:12.682928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:12.990997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11680): Launched 02:24:13.257625 run iperf3-srv_10.42.42.10(pid=11681): Launched 02:24:13.372280 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:24:13.577560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:13.885376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11682): Launched 02:24:14.152465 run iperf3-srv_10.42.42.10(pid=11683): Launched 02:24:14.267292 tst iperf3m4.py:8: start network... 02:24:14.472485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:14.948842 run create_hlr_db(pid=11684): Launched 02:24:15.073437 bus /gobi_6: Setting Powered False 02:24:16.168444 run create_hlr_db(pid=11684): Terminated: ok {rc=0} 02:24:16.655933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11686): Launched 02:24:17.009860 run osmo-hlr_10.42.42.2(pid=11687): Launched 02:24:17.221327 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:17.749652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11689): Launched 02:24:18.057585 run osmo-stp_10.42.42.5(pid=11690): Launched 02:24:18.174751 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:18.723706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11692): Launched 02:24:18.840767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:19.100868 run patchelf(pid=11693): Launched 02:24:19.272127 run osmo-stp_10.42.42.5(pid=11690): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11690)] 02:24:19.401873 run osmo-stp_10.42.42.5(pid=11690): stdout: | (launched: 2022-12-09_02:24:18.001209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:19.533363 run osmo-stp_10.42.42.5(pid=11690): stderr: | 20221209022418175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022418175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022418175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022418176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022418176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022418176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022418176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:19.664717 run osmo-stp_10.42.42.5(pid=11690): stdout: | (launched: 2022-12-09_02:24:18.001209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:19.791114 run osmo-stp_10.42.42.5(pid=11690): stderr: | 20221209022418175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022418175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022418175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022418176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022418176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022418176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022418176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:19.940882 run patchelf(pid=11693): Terminating (SIGINT) 02:24:20.112943 run patchelf(pid=11693): Terminated: ok {rc=0} 02:24:20.237088 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11690): Process ended prematurely: osmo-stp_10.42.42.5(pid=11690) [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11690)] [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:24:20.246783 tst iperf3m4.py:8: Test FAILED (10.7 sec) 02:24:20.274471 run osmo-hlr_10.42.42.2(pid=11687): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11687)] 02:24:20.322353 run osmo-hlr_10.42.42.2(pid=11687): stdout: | (launched: 2022-12-09_02:24:16.946920) 02:24:20.371972 run osmo-hlr_10.42.42.2(pid=11687): stderr: | 20221209022417151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022417151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022417151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022417151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022417151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022417151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022417165 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022417173 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022417173 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022417173 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:20.422037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11676): Terminating (SIGTERM) 02:24:20.462182 run iperf3-srv_10.42.42.10(pid=11677): Terminating (SIGTERM) 02:24:20.502011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11678): Terminating (SIGTERM) 02:24:20.542072 run iperf3-srv_10.42.42.10(pid=11679): Terminating (SIGTERM) 02:24:20.582038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11680): Terminating (SIGTERM) 02:24:20.622206 run iperf3-srv_10.42.42.10(pid=11681): Terminating (SIGTERM) 02:24:20.662184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11682): Terminating (SIGTERM) 02:24:20.702227 run iperf3-srv_10.42.42.10(pid=11683): Terminating (SIGTERM) 02:24:20.742007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11686): Terminating (SIGTERM) 02:24:20.781970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11689): Terminating (SIGTERM) 02:24:20.821895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11692): Terminating (SIGTERM) 02:24:20.862109 --- ParallelTerminationStrategy: PID 11676 died... 02:24:20.881161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11676): Terminated: ok {rc=0} 02:24:20.925723 --- ParallelTerminationStrategy: PID 11677 died... 02:24:20.944353 run iperf3-srv_10.42.42.10(pid=11677): Terminated {rc=256} 02:24:20.988403 --- ParallelTerminationStrategy: PID 11678 died... 02:24:21.007123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11678): Terminated: ok {rc=0} 02:24:21.051432 --- ParallelTerminationStrategy: PID 11679 died... 02:24:21.070288 run iperf3-srv_10.42.42.10(pid=11679): Terminated {rc=256} 02:24:21.114573 --- ParallelTerminationStrategy: PID 11680 died... 02:24:21.133295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11680): Terminated: ok {rc=0} 02:24:21.177254 --- ParallelTerminationStrategy: PID 11681 died... 02:24:21.196026 run iperf3-srv_10.42.42.10(pid=11681): Terminated {rc=256} 02:24:21.240198 --- ParallelTerminationStrategy: PID 11682 died... 02:24:21.258911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11682): Terminated: ok {rc=0} 02:24:21.302884 --- ParallelTerminationStrategy: PID 11683 died... 02:24:21.321697 run iperf3-srv_10.42.42.10(pid=11683): Terminated {rc=256} 02:24:21.365845 --- ParallelTerminationStrategy: PID 11686 died... 02:24:21.384517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11686): Terminated: ok {rc=0} 02:24:21.428768 --- ParallelTerminationStrategy: PID 11689 died... 02:24:21.447556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11689): Terminated: ok {rc=0} 02:24:21.491374 --- ParallelTerminationStrategy: PID 11692 died... 02:24:21.510164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11692): Terminated: ok {rc=0} 02:24:21.596338 bus /gobi_4: Setting Powered False 02:24:22.695704 bus /gobi_4: Setting Powered False 02:24:23.811995 bus /gobi_1: Setting Powered False 02:24:24.910708 bus /gobi_1: Setting Powered False 02:24:26.027455 bus /gobi_0: Setting Powered False 02:24:27.128828 bus /gobi_0: Setting Powered False 02:24:28.246123 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:24:29.348265 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:29.360504 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:24:29.420382 tst ping.py: using LAC 18412 02:24:29.548838 tst ping.py: using RAC 52 02:24:29.676664 tst ping.py: using CellId 18412 02:24:29.802095 tst ping.py: using BVCI 18413 02:24:29.920261 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:29.931728 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:29.942904 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:29.954308 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:29.965759 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:29.977227 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:29.988795 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:30.000184 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:24:30.120103 tst ping.py:19: start network... 02:24:30.321826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:30.789539 run create_hlr_db(pid=11695): Launched 02:24:30.950773 bus /gobi_6: Setting Powered False 02:24:32.015280 run create_hlr_db(pid=11695): Terminated: ok {rc=0} 02:24:32.472392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11697): Launched 02:24:32.796517 run osmo-hlr_10.42.42.2(pid=11698): Launched 02:24:32.919651 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:33.482633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11700): Launched 02:24:33.804385 run osmo-stp_10.42.42.5(pid=11701): Launched 02:24:33.928869 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:34.488802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11703): Launched 02:24:34.614471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:34.887609 run patchelf(pid=11704): Launched 02:24:35.067608 run osmo-stp_10.42.42.5(pid=11701): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11701)] 02:24:35.205198 run osmo-stp_10.42.42.5(pid=11701): stdout: | (launched: 2022-12-09_02:24:33.745474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:35.344404 run osmo-stp_10.42.42.5(pid=11701): stderr: | 20221209022433940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022433940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022433940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022433941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022433941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022433941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022433942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:35.483281 run osmo-stp_10.42.42.5(pid=11701): stdout: | (launched: 2022-12-09_02:24:33.745474) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:35.616156 run osmo-stp_10.42.42.5(pid=11701): stderr: | 20221209022433940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022433940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022433940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022433941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022433941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022433941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022433942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:35.773991 run patchelf(pid=11704): Terminating (SIGINT) 02:24:35.955728 run patchelf(pid=11704): Terminated: ok {rc=0} 02:24:36.086626 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11701): Process ended prematurely: osmo-stp_10.42.42.5(pid=11701) [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11701)] [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 02:24:36.096216 tst ping.py:22: Test FAILED (6.7 sec) 02:24:36.125078 run osmo-hlr_10.42.42.2(pid=11698): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11698)] 02:24:36.175722 run osmo-hlr_10.42.42.2(pid=11698): stdout: | (launched: 2022-12-09_02:24:32.737650) 02:24:36.228368 run osmo-hlr_10.42.42.2(pid=11698): stderr: | 20221209022432940 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022432940 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022432940 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022432940 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022432940 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022432940 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022432952 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022432960 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022432961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022432961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:36.281477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11697): Terminating (SIGTERM) 02:24:36.323966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11700): Terminating (SIGTERM) 02:24:36.366601 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11703): Terminating (SIGTERM) 02:24:36.409345 --- ParallelTerminationStrategy: PID 11697 died... 02:24:36.429695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11697): Terminated: ok {rc=0} 02:24:36.477116 --- ParallelTerminationStrategy: PID 11700 died... 02:24:36.496825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11700): Terminated: ok {rc=0} 02:24:36.543849 --- ParallelTerminationStrategy: PID 11703 died... 02:24:36.563587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11703): Terminated: ok {rc=0} 02:24:36.652370 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:24:37.741098 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:37.753713 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:24:37.814336 tst ping_idle_ping.py: using LAC 18413 02:24:37.942549 tst ping_idle_ping.py: using RAC 53 02:24:38.070656 tst ping_idle_ping.py: using CellId 18413 02:24:38.197409 tst ping_idle_ping.py: using BVCI 18414 02:24:38.316268 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:38.327881 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:38.339186 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:38.350783 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:38.362271 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:38.373674 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:38.385404 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:38.396803 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:24:38.512759 tst ping_idle_ping.py:24: start network... 02:24:38.716650 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:39.189370 run create_hlr_db(pid=11705): Launched 02:24:39.313362 bus /gobi_6: Setting Powered False 02:24:40.373730 run create_hlr_db(pid=11705): Terminated: ok {rc=0} 02:24:40.797361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11707): Launched 02:24:41.100254 run osmo-hlr_10.42.42.2(pid=11708): Launched 02:24:41.215986 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:41.737775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11710): Launched 02:24:42.041338 run osmo-stp_10.42.42.5(pid=11711): Launched 02:24:42.156635 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:42.693196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11713): Launched 02:24:42.808601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:43.064536 run patchelf(pid=11714): Launched 02:24:43.232826 run osmo-stp_10.42.42.5(pid=11711): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11711)] 02:24:43.360923 run osmo-stp_10.42.42.5(pid=11711): stdout: | (launched: 2022-12-09_02:24:41.984933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:43.490856 run osmo-stp_10.42.42.5(pid=11711): stderr: | 20221209022442158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022442158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022442158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022442159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022442159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022442159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022442159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:43.620825 run osmo-stp_10.42.42.5(pid=11711): stdout: | (launched: 2022-12-09_02:24:41.984933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:43.744789 run osmo-stp_10.42.42.5(pid=11711): stderr: | 20221209022442158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022442158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022442158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022442159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022442159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022442159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022442159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:43.891955 run patchelf(pid=11714): Terminating (SIGINT) 02:24:44.062686 run patchelf(pid=11714): Terminated: ok {rc=0} 02:24:44.184841 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11711): Process ended prematurely: osmo-stp_10.42.42.5(pid=11711) [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11711)] [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:24:44.193741 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:24:44.220393 run osmo-hlr_10.42.42.2(pid=11708): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11708)] 02:24:44.268495 run osmo-hlr_10.42.42.2(pid=11708): stdout: | (launched: 2022-12-09_02:24:41.044585) 02:24:44.318142 run osmo-hlr_10.42.42.2(pid=11708): stderr: | 20221209022441222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022441222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022441222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022441222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022441222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022441222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022441234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022441243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022441243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022441243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:44.368286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11707): Terminating (SIGTERM) 02:24:44.408580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11710): Terminating (SIGTERM) 02:24:44.448805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11713): Terminating (SIGTERM) 02:24:44.489473 --- ParallelTerminationStrategy: PID 11707 died... 02:24:44.508776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11707): Terminated: ok {rc=0} 02:24:44.553315 --- ParallelTerminationStrategy: PID 11710 died... 02:24:44.572107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11710): Terminated: ok {rc=0} 02:24:44.616859 --- ParallelTerminationStrategy: PID 11713 died... 02:24:44.636062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11713): Terminated: ok {rc=0} 02:24:44.722661 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:24:46.057263 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:24:46.067110 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:24:46.098688 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:24:46.150354 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:24:46.269137 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:24:46.298396 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:24:46.349631 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:24:46.920932 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:24:46.973224 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:46.985143 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:24:47.042862 tst cs_paging_gprs_active.py: using LAC 18414 02:24:47.194623 tst cs_paging_gprs_active.py: using RAC 54 02:24:47.319724 tst cs_paging_gprs_active.py: using CellId 18414 02:24:47.444854 tst cs_paging_gprs_active.py: using BVCI 18415 02:24:47.557737 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.569272 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.580108 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.590818 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.601626 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.612427 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.623393 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.634213 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:47.645185 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:47.765619 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:47.885694 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:24:48.094749 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:48.404426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11718): Launched 02:24:48.671926 run iperf3-srv_10.42.42.10(pid=11719): Launched 02:24:48.786694 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:24:48.992179 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:49.300096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11720): Launched 02:24:49.568523 run iperf3-srv_10.42.42.10(pid=11721): Launched 02:24:49.683509 tst cs_paging_gprs_active.py:38: start network... 02:24:49.889541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:50.365719 run create_hlr_db(pid=11722): Launched 02:24:50.490959 bus /gobi_6: Setting Powered False 02:24:51.552014 run create_hlr_db(pid=11722): Terminated: ok {rc=0} 02:24:52.000385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11724): Launched 02:24:52.330017 run osmo-hlr_10.42.42.2(pid=11725): Launched 02:24:52.457569 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:53.026382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11727): Launched 02:24:53.357809 run osmo-stp_10.42.42.5(pid=11728): Launched 02:24:53.485029 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:54.053939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11730): Launched 02:24:54.180620 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:54.458638 run patchelf(pid=11731): Launched 02:24:54.642348 run osmo-stp_10.42.42.5(pid=11728): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11728)] 02:24:54.781208 run osmo-stp_10.42.42.5(pid=11728): stdout: | (launched: 2022-12-09_02:24:53.297912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:54.921788 run osmo-stp_10.42.42.5(pid=11728): stderr: | 20221209022453490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022453490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022453491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022453491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022453491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022453491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022453491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:55.062365 run osmo-stp_10.42.42.5(pid=11728): stdout: | (launched: 2022-12-09_02:24:53.297912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:55.197340 run osmo-stp_10.42.42.5(pid=11728): stderr: | 20221209022453490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022453490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022453491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022453491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022453491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022453491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022453491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:55.357872 run patchelf(pid=11731): Terminating (SIGINT) 02:24:55.541315 run patchelf(pid=11731): Terminated: ok {rc=0} 02:24:55.674039 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11728): Process ended prematurely: osmo-stp_10.42.42.5(pid=11728) [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11728)] [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:24:55.684363 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:24:55.713215 run osmo-hlr_10.42.42.2(pid=11725): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11725)] 02:24:55.763591 run osmo-hlr_10.42.42.2(pid=11725): stdout: | (launched: 2022-12-09_02:24:52.269735) 02:24:55.815430 run osmo-hlr_10.42.42.2(pid=11725): stderr: | 20221209022452469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022452469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022452469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022452469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022452469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022452469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022452484 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022452492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022452493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022452493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:55.867832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11718): Terminating (SIGTERM) 02:24:55.910004 run iperf3-srv_10.42.42.10(pid=11719): Terminating (SIGTERM) 02:24:55.951845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11720): Terminating (SIGTERM) 02:24:55.993887 run iperf3-srv_10.42.42.10(pid=11721): Terminating (SIGTERM) 02:24:56.035696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11724): Terminating (SIGTERM) 02:24:56.077734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11727): Terminating (SIGTERM) 02:24:56.119890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11730): Terminating (SIGTERM) 02:24:56.161952 --- ParallelTerminationStrategy: PID 11718 died... 02:24:56.181901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11718): Terminated: ok {rc=0} 02:24:56.228515 --- ParallelTerminationStrategy: PID 11719 died... 02:24:56.247902 run iperf3-srv_10.42.42.10(pid=11719): Terminated {rc=256} 02:24:56.294086 --- ParallelTerminationStrategy: PID 11720 died... 02:24:56.313453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11720): Terminated: ok {rc=0} 02:24:56.360252 --- ParallelTerminationStrategy: PID 11721 died... 02:24:56.379581 run iperf3-srv_10.42.42.10(pid=11721): Terminated {rc=256} 02:24:56.425850 --- ParallelTerminationStrategy: PID 11724 died... 02:24:56.445339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11724): Terminated: ok {rc=0} 02:24:56.491666 --- ParallelTerminationStrategy: PID 11727 died... 02:24:56.511028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11727): Terminated: ok {rc=0} 02:24:56.557373 --- ParallelTerminationStrategy: PID 11730 died... 02:24:56.576809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11730): Terminated: ok {rc=0} 02:24:56.665374 bus /gobi_0: Setting Powered False 02:24:57.764429 bus /gobi_0: Setting Powered False 02:24:58.879827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:25:00.025492 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:00.037112 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:25:00.096307 tst iperf3.py: using LAC 18415 02:25:00.220435 tst iperf3.py: using RAC 55 02:25:00.342889 tst iperf3.py: using CellId 18415 02:25:00.464202 tst iperf3.py: using BVCI 18416 02:25:00.577368 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:00.588458 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:00.599338 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:00.610240 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:00.620859 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:00.631987 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:00.642994 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:00.653828 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:00.664719 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:25:00.779554 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:25:00.988460 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:25:01.303344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11732): Launched 02:25:01.655709 run iperf3-srv_10.42.42.10(pid=11733): Launched 02:25:01.827121 tst iperf3.py:8: start network... 02:25:02.060587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:02.544939 run create_hlr_db(pid=11737): Launched 02:25:02.670411 bus /gobi_6: Setting Powered False 02:25:03.731448 run create_hlr_db(pid=11737): Terminated: ok {rc=0} 02:25:04.179512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11739): Launched 02:25:04.509587 run osmo-hlr_10.42.42.2(pid=11740): Launched 02:25:04.636130 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:05.208522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11742): Launched 02:25:05.537677 run osmo-stp_10.42.42.5(pid=11743): Launched 02:25:05.663694 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:25:06.230495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11745): Launched 02:25:06.357150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:25:06.635543 run patchelf(pid=11746): Launched 02:25:06.817171 run osmo-stp_10.42.42.5(pid=11743): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11743)] 02:25:06.955416 run osmo-stp_10.42.42.5(pid=11743): stdout: | (launched: 2022-12-09_02:25:05.477686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:07.095788 run osmo-stp_10.42.42.5(pid=11743): stderr: | 20221209022505672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022505672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022505672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022505672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022505673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022505673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022505673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:07.236595 run osmo-stp_10.42.42.5(pid=11743): stdout: | (launched: 2022-12-09_02:25:05.477686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:07.371139 run osmo-stp_10.42.42.5(pid=11743): stderr: | 20221209022505672 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022505672 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022505672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022505672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022505673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022505673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022505673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:07.530739 run patchelf(pid=11746): Terminating (SIGINT) 02:25:07.714102 run patchelf(pid=11746): Terminated: ok {rc=0} 02:25:07.846454 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11743): Process ended prematurely: osmo-stp_10.42.42.5(pid=11743) [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11743)] [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 02:25:07.856734 tst iperf3.py:8: Test FAILED (7.9 sec) 02:25:07.885699 run osmo-hlr_10.42.42.2(pid=11740): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11740)] 02:25:07.935799 run osmo-hlr_10.42.42.2(pid=11740): stdout: | (launched: 2022-12-09_02:25:04.449297) 02:25:07.987660 run osmo-hlr_10.42.42.2(pid=11740): stderr: | 20221209022504648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022504648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022504648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022504648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022504648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022504648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022504660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022504669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022504670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022504670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:08.040065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11732): Terminating (SIGTERM) 02:25:08.082065 run iperf3-srv_10.42.42.10(pid=11733): Terminating (SIGTERM) 02:25:08.124043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11739): Terminating (SIGTERM) 02:25:08.166081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11742): Terminating (SIGTERM) 02:25:08.208212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11745): Terminating (SIGTERM) 02:25:08.251044 --- ParallelTerminationStrategy: PID 11732 died... 02:25:08.271171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11732): Terminated: ok {rc=0} 02:25:08.318270 --- ParallelTerminationStrategy: PID 11733 died... 02:25:08.338004 run iperf3-srv_10.42.42.10(pid=11733): Terminated {rc=256} 02:25:08.384629 --- ParallelTerminationStrategy: PID 11739 died... 02:25:08.404170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11739): Terminated: ok {rc=0} 02:25:08.450609 --- ParallelTerminationStrategy: PID 11742 died... 02:25:08.470033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11742): Terminated: ok {rc=0} 02:25:08.516550 --- ParallelTerminationStrategy: PID 11745 died... 02:25:08.536235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11745): Terminated: ok {rc=0} 02:25:08.624627 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:25:09.775301 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:09.787313 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:25:09.846223 tst iperf3m4.py: using LAC 18416 02:25:09.978685 tst iperf3m4.py: using RAC 56 02:25:10.106581 tst iperf3m4.py: using CellId 18416 02:25:10.233850 tst iperf3m4.py: using BVCI 18417 02:25:10.354071 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:10.365677 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:10.376805 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:10.388301 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:10.399661 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:10.411130 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:10.422776 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:10.434202 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:10.445862 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:25:10.564126 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:25:10.688441 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:25:10.810479 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:25:10.929383 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:25:11.152755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:25:11.483324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11747): Launched 02:25:11.770358 run iperf3-srv_10.42.42.10(pid=11748): Launched 02:25:11.894905 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:25:12.116767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:25:12.447256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11749): Launched 02:25:12.734547 run iperf3-srv_10.42.42.10(pid=11750): Launched 02:25:12.859296 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:25:13.081351 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:25:13.413202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11751): Launched 02:25:13.698193 run iperf3-srv_10.42.42.10(pid=11752): Launched 02:25:13.822660 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:25:14.044450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:25:14.374669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11753): Launched 02:25:14.661419 run iperf3-srv_10.42.42.10(pid=11754): Launched 02:25:14.783917 tst iperf3m4.py:8: start network... 02:25:15.005237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:15.516171 run create_hlr_db(pid=11755): Launched 02:25:15.641488 bus /gobi_6: Setting Powered False 02:25:16.701439 run create_hlr_db(pid=11755): Terminated: ok {rc=0} 02:25:17.171362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11757): Launched 02:25:17.513409 run osmo-hlr_10.42.42.2(pid=11758): Launched 02:25:17.642195 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:18.211238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11760): Launched 02:25:18.541062 run osmo-stp_10.42.42.5(pid=11761): Launched 02:25:18.666792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:25:19.235230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11763): Launched 02:25:19.362257 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:25:19.639961 run patchelf(pid=11764): Launched 02:25:19.823729 run osmo-stp_10.42.42.5(pid=11761): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11761)] 02:25:19.962133 run osmo-stp_10.42.42.5(pid=11761): stdout: | (launched: 2022-12-09_02:25:18.481051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:20.102422 run osmo-stp_10.42.42.5(pid=11761): stderr: | 20221209022518675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022518675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022518675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022518675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022518678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022518678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022518678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:20.243460 run osmo-stp_10.42.42.5(pid=11761): stdout: | (launched: 2022-12-09_02:25:18.481051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:20.378233 run osmo-stp_10.42.42.5(pid=11761): stderr: | 20221209022518675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022518675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022518675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022518675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022518678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022518678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022518678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:20.537753 run patchelf(pid=11764): Terminating (SIGINT) 02:25:20.721086 run patchelf(pid=11764): Terminated: ok {rc=0} 02:25:20.853119 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11761): Process ended prematurely: osmo-stp_10.42.42.5(pid=11761) [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11761)] [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:25:20.863517 tst iperf3m4.py:8: Test FAILED (11.1 sec) 02:25:20.893253 run osmo-hlr_10.42.42.2(pid=11758): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11758)] 02:25:20.943674 run osmo-hlr_10.42.42.2(pid=11758): stdout: | (launched: 2022-12-09_02:25:17.453327) 02:25:20.995878 run osmo-hlr_10.42.42.2(pid=11758): stderr: | 20221209022517652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022517652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022517652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022517653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022517653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022517653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022517665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022517673 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022517673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022517673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:21.048493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11747): Terminating (SIGTERM) 02:25:21.091013 run iperf3-srv_10.42.42.10(pid=11748): Terminating (SIGTERM) 02:25:21.133323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11749): Terminating (SIGTERM) 02:25:21.175735 run iperf3-srv_10.42.42.10(pid=11750): Terminating (SIGTERM) 02:25:21.218223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11751): Terminating (SIGTERM) 02:25:21.261075 run iperf3-srv_10.42.42.10(pid=11752): Terminating (SIGTERM) 02:25:21.303518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11753): Terminating (SIGTERM) 02:25:21.346011 run iperf3-srv_10.42.42.10(pid=11754): Terminating (SIGTERM) 02:25:21.388259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11757): Terminating (SIGTERM) 02:25:21.430809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11760): Terminating (SIGTERM) 02:25:21.473203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11763): Terminating (SIGTERM) 02:25:21.515597 --- ParallelTerminationStrategy: PID 11747 died... 02:25:21.535682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11747): Terminated: ok {rc=0} 02:25:21.582683 --- ParallelTerminationStrategy: PID 11748 died... 02:25:21.602338 run iperf3-srv_10.42.42.10(pid=11748): Terminated {rc=256} 02:25:21.648897 --- ParallelTerminationStrategy: PID 11749 died... 02:25:21.668859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11749): Terminated: ok {rc=0} 02:25:21.715695 --- ParallelTerminationStrategy: PID 11750 died... 02:25:21.735299 run iperf3-srv_10.42.42.10(pid=11750): Terminated {rc=256} 02:25:21.781725 --- ParallelTerminationStrategy: PID 11751 died... 02:25:21.801409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11751): Terminated: ok {rc=0} 02:25:21.848108 --- ParallelTerminationStrategy: PID 11752 died... 02:25:21.867800 run iperf3-srv_10.42.42.10(pid=11752): Terminated {rc=256} 02:25:21.914541 --- ParallelTerminationStrategy: PID 11753 died... 02:25:21.934210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11753): Terminated: ok {rc=0} 02:25:21.981536 --- ParallelTerminationStrategy: PID 11754 died... 02:25:22.001377 run iperf3-srv_10.42.42.10(pid=11754): Terminated {rc=256} 02:25:22.048257 --- ParallelTerminationStrategy: PID 11757 died... 02:25:22.068110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11757): Terminated: ok {rc=0} 02:25:22.115145 --- ParallelTerminationStrategy: PID 11760 died... 02:25:22.134891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11760): Terminated: ok {rc=0} 02:25:22.181744 --- ParallelTerminationStrategy: PID 11763 died... 02:25:22.201557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11763): Terminated: ok {rc=0} 02:25:22.291104 bus /gobi_4: Setting Powered False 02:25:23.391386 bus /gobi_4: Setting Powered False 02:25:24.508907 bus /gobi_1: Setting Powered False 02:25:25.606099 bus /gobi_1: Setting Powered False 02:25:26.722049 bus /gobi_0: Setting Powered False 02:25:27.821514 bus /gobi_0: Setting Powered False 02:25:28.938423 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:25:30.044391 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:30.056516 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:25:30.116838 tst ping.py: using LAC 18417 02:25:30.244929 tst ping.py: using RAC 57 02:25:30.373373 tst ping.py: using CellId 18417 02:25:30.501405 tst ping.py: using BVCI 18418 02:25:30.619587 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:30.631262 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:30.642640 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:30.654268 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:30.665846 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:30.677233 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:30.688896 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:30.700367 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:25:30.822901 tst ping.py:19: start network... 02:25:31.045173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:31.558220 run create_hlr_db(pid=11765): Launched 02:25:31.714656 bus /gobi_6: Setting Powered False 02:25:32.774533 run create_hlr_db(pid=11765): Terminated: ok {rc=0} 02:25:33.218865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11768): Launched 02:25:33.542625 run osmo-hlr_10.42.42.2(pid=11769): Launched 02:25:33.666142 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:34.223985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11771): Launched 02:25:34.547224 run osmo-stp_10.42.42.5(pid=11772): Launched 02:25:34.671698 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:25:35.229690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11774): Launched 02:25:35.353046 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:25:35.626276 run patchelf(pid=11775): Launched 02:25:35.805238 run osmo-stp_10.42.42.5(pid=11772): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11772)] 02:25:35.941704 run osmo-stp_10.42.42.5(pid=11772): stdout: | (launched: 2022-12-09_02:25:34.488360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:36.080216 run osmo-stp_10.42.42.5(pid=11772): stderr: | 20221209022534683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022534683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022534683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022534684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022534684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022534684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022534684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:36.218673 run osmo-stp_10.42.42.5(pid=11772): stdout: | (launched: 2022-12-09_02:25:34.488360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:36.351764 run osmo-stp_10.42.42.5(pid=11772): stderr: | 20221209022534683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022534683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022534683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022534684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022534684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022534684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022534684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:36.509027 run patchelf(pid=11775): Terminating (SIGINT) 02:25:36.688679 run patchelf(pid=11775): Terminated: ok {rc=0} 02:25:36.818528 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11772): Process ended prematurely: osmo-stp_10.42.42.5(pid=11772) [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11772)] [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 02:25:36.828231 tst ping.py:22: Test FAILED (6.8 sec) 02:25:36.857011 run osmo-hlr_10.42.42.2(pid=11769): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11769)] 02:25:36.907426 run osmo-hlr_10.42.42.2(pid=11769): stdout: | (launched: 2022-12-09_02:25:33.482589) 02:25:36.959746 run osmo-hlr_10.42.42.2(pid=11769): stderr: | 20221209022533681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022533681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022533681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022533681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022533681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022533681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022533694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022533702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022533702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022533702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:37.012308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11768): Terminating (SIGTERM) 02:25:37.054853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11771): Terminating (SIGTERM) 02:25:37.097170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11774): Terminating (SIGTERM) 02:25:37.139819 --- ParallelTerminationStrategy: PID 11768 died... 02:25:37.160072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11768): Terminated: ok {rc=0} 02:25:37.207672 --- ParallelTerminationStrategy: PID 11771 died... 02:25:37.227392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11771): Terminated: ok {rc=0} 02:25:37.275084 --- ParallelTerminationStrategy: PID 11774 died... 02:25:37.295091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11774): Terminated: ok {rc=0} 02:25:37.385312 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:25:38.473040 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:38.485501 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:25:38.546066 tst ping_idle_ping.py: using LAC 18418 02:25:38.674200 tst ping_idle_ping.py: using RAC 58 02:25:38.801691 tst ping_idle_ping.py: using CellId 18418 02:25:38.933650 tst ping_idle_ping.py: using BVCI 18419 02:25:39.045471 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:39.056662 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:39.067656 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:39.078699 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:39.089707 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:39.100535 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:39.111551 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:39.122382 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:25:39.242287 tst ping_idle_ping.py:24: start network... 02:25:39.460689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:39.969768 run create_hlr_db(pid=11776): Launched 02:25:40.094578 bus /gobi_6: Setting Powered False 02:25:41.158305 run create_hlr_db(pid=11776): Terminated: ok {rc=0} 02:25:41.590772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11778): Launched 02:25:41.892660 run osmo-hlr_10.42.42.2(pid=11779): Launched 02:25:42.007853 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:42.530353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11781): Launched 02:25:42.832529 run osmo-stp_10.42.42.5(pid=11782): Launched 02:25:42.948430 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:25:43.473413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11784): Launched 02:25:43.589213 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:25:43.845684 run patchelf(pid=11785): Launched 02:25:44.013433 run osmo-stp_10.42.42.5(pid=11782): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11782)] 02:25:44.140804 run osmo-stp_10.42.42.5(pid=11782): stdout: | (launched: 2022-12-09_02:25:42.776822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:44.270565 run osmo-stp_10.42.42.5(pid=11782): stderr: | 20221209022542947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022542948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022542948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022542948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022542950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022542951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022542951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:44.400288 run osmo-stp_10.42.42.5(pid=11782): stdout: | (launched: 2022-12-09_02:25:42.776822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:44.524887 run osmo-stp_10.42.42.5(pid=11782): stderr: | 20221209022542947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022542948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022542948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022542948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022542950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022542951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022542951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:44.671682 run patchelf(pid=11785): Terminating (SIGINT) 02:25:44.840582 run patchelf(pid=11785): Terminated: ok {rc=0} 02:25:44.962636 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11782): Process ended prematurely: osmo-stp_10.42.42.5(pid=11782) [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11782)] [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:25:44.971509 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 02:25:44.998027 run osmo-hlr_10.42.42.2(pid=11779): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11779)] 02:25:45.045934 run osmo-hlr_10.42.42.2(pid=11779): stdout: | (launched: 2022-12-09_02:25:41.837166) 02:25:45.095365 run osmo-hlr_10.42.42.2(pid=11779): stderr: | 20221209022542013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022542013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022542013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022542013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022542013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022542013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022542025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022542034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022542034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022542034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:45.145433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11778): Terminating (SIGTERM) 02:25:45.185566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11781): Terminating (SIGTERM) 02:25:45.225540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11784): Terminating (SIGTERM) 02:25:45.266184 --- ParallelTerminationStrategy: PID 11778 died... 02:25:45.285420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11778): Terminated: ok {rc=0} 02:25:45.330468 --- ParallelTerminationStrategy: PID 11781 died... 02:25:45.349052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11781): Terminated: ok {rc=0} 02:25:45.393117 --- ParallelTerminationStrategy: PID 11784 died... 02:25:45.411713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11784): Terminated: ok {rc=0} 02:25:45.495341 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:25:46.820303 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:46.828295 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:25:46.858507 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:25:46.896498 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:25:46.953428 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:25:46.976163 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:25:47.016729 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:25:47.570556 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:25:47.576075 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:47.587882 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:25:47.647163 tst switch_tch_pdch.py: using LAC 18419 02:25:47.777641 tst switch_tch_pdch.py: using RAC 59 02:25:47.897391 tst switch_tch_pdch.py: using CellId 18419 02:25:48.016319 tst switch_tch_pdch.py: using BVCI 18420 02:25:48.125981 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:48.137357 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:48.148343 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:48.159512 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:48.170409 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:48.181424 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:48.192510 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:48.203503 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:25:48.323326 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:25:48.445688 tst switch_tch_pdch.py:51: start network... 02:25:48.663688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:49.162873 run create_hlr_db(pid=11790): Launched 02:25:49.286839 bus /gobi_6: Setting Powered False 02:25:50.350081 run create_hlr_db(pid=11790): Terminated: ok {rc=0} 02:25:50.782069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11792): Launched 02:25:51.086541 run osmo-hlr_10.42.42.2(pid=11793): Launched 02:25:51.200925 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:51.721319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11795): Launched 02:25:52.023371 run osmo-stp_10.42.42.5(pid=11796): Launched 02:25:52.138579 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:25:52.662235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11798): Launched 02:25:52.779521 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:25:53.034451 run patchelf(pid=11799): Launched 02:25:53.201600 run osmo-stp_10.42.42.5(pid=11796): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11796)] 02:25:53.329073 run osmo-stp_10.42.42.5(pid=11796): stdout: | (launched: 2022-12-09_02:25:51.967045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:53.458468 run osmo-stp_10.42.42.5(pid=11796): stderr: | 20221209022552139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022552139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022552139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022552140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022552140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022552140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022552140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:53.587707 run osmo-stp_10.42.42.5(pid=11796): stdout: | (launched: 2022-12-09_02:25:51.967045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:53.711177 run osmo-stp_10.42.42.5(pid=11796): stderr: | 20221209022552139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022552139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022552139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022552140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022552140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022552140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022552140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:53.857792 run patchelf(pid=11799): Terminating (SIGINT) 02:25:54.026336 run patchelf(pid=11799): Terminated: ok {rc=0} 02:25:54.148028 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11796): Process ended prematurely: osmo-stp_10.42.42.5(pid=11796) [trial-2353↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11796)] [trial-2353↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:25:54.156841 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 02:25:54.183256 run osmo-hlr_10.42.42.2(pid=11793): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11793)] 02:25:54.230926 run osmo-hlr_10.42.42.2(pid=11793): stdout: | (launched: 2022-12-09_02:25:51.030797) 02:25:54.280247 run osmo-hlr_10.42.42.2(pid=11793): stderr: | 20221209022551208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022551208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022551208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022551208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022551208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022551208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022551223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022551234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022551234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022551234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:54.330003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11792): Terminating (SIGTERM) 02:25:54.369726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11795): Terminating (SIGTERM) 02:25:54.409605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11798): Terminating (SIGTERM) 02:25:54.449703 --- ParallelTerminationStrategy: PID 11792 died... 02:25:54.468826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11792): Terminated: ok {rc=0} 02:25:54.512709 --- ParallelTerminationStrategy: PID 11795 died... 02:25:54.531307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11795): Terminated: ok {rc=0} 02:25:54.575494 --- ParallelTerminationStrategy: PID 11798 died... 02:25:54.594139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11798): Terminated: ok {rc=0} 02:25:54.679855 bus /gobi_0: Setting Powered False 02:25:55.780004 bus /gobi_0: Setting Powered False 02:25:56.895815 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:25:58.134418 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:58.140128 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:25:58.160691 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:25:58.195991 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:25:58.248717 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:25:58.269286 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:25:58.303385 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:25:58.859453 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:25:58.864375 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:58.875396 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:25:58.936265 tst switch_tch_pdch.py: using LAC 18420 02:25:59.054419 tst switch_tch_pdch.py: using RAC 60 02:25:59.173691 tst switch_tch_pdch.py: using CellId 18420 02:25:59.301307 tst switch_tch_pdch.py: using BVCI 18421 02:25:59.421607 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:59.433353 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:59.444624 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:59.456331 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:59.467949 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:59.479598 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:59.491410 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:59.502985 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:25:59.621510 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:25:59.741561 tst switch_tch_pdch.py:51: start network... 02:25:59.959585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:00.433175 run create_hlr_db(pid=11804): Launched 02:26:00.555461 bus /gobi_6: Setting Powered False 02:26:01.614209 run create_hlr_db(pid=11804): Terminated: ok {rc=0} 02:26:02.022744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11806): Launched 02:26:02.339443 run osmo-hlr_10.42.42.2(pid=11807): Launched 02:26:02.455503 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:02.948923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11809): Launched 02:26:03.249561 run osmo-stp_10.42.42.5(pid=11810): Launched 02:26:03.364342 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:26:03.858257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11812): Launched 02:26:03.973698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:26:04.227487 run patchelf(pid=11813): Launched 02:26:04.394156 run osmo-stp_10.42.42.5(pid=11810): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11810)] 02:26:04.520803 run osmo-stp_10.42.42.5(pid=11810): stdout: | (launched: 2022-12-09_02:26:03.194243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:04.649686 run osmo-stp_10.42.42.5(pid=11810): stderr: | 20221209022603366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022603366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022603367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022603367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022603368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022603368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022603368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:04.778160 run osmo-stp_10.42.42.5(pid=11810): stdout: | (launched: 2022-12-09_02:26:03.194243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:04.900933 run osmo-stp_10.42.42.5(pid=11810): stderr: | 20221209022603366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022603366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022603367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022603367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022603368 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022603368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022603368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:05.046734 run patchelf(pid=11813): Terminating (SIGINT) 02:26:05.214270 run patchelf(pid=11813): Terminated: ok {rc=0} 02:26:05.335202 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11810): Process ended prematurely: osmo-stp_10.42.42.5(pid=11810) [trial-2353↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11810)] [trial-2353↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:26:05.344159 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 02:26:05.370528 run osmo-hlr_10.42.42.2(pid=11807): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11807)] 02:26:05.417958 run osmo-hlr_10.42.42.2(pid=11807): stdout: | (launched: 2022-12-09_02:26:02.283575) 02:26:05.467223 run osmo-hlr_10.42.42.2(pid=11807): stderr: | 20221209022602460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022602460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022602460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022602460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022602460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022602460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022602476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022602486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022602486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022602486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:05.516426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11806): Terminating (SIGTERM) 02:26:05.556429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11809): Terminating (SIGTERM) 02:26:05.595730 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11812): Terminating (SIGTERM) 02:26:05.635151 --- ParallelTerminationStrategy: PID 11806 died... 02:26:05.654091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11806): Terminated: ok {rc=0} 02:26:05.698217 --- ParallelTerminationStrategy: PID 11809 died... 02:26:05.716677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11809): Terminated: ok {rc=0} 02:26:05.760849 --- ParallelTerminationStrategy: PID 11812 died... 02:26:05.779437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11812): Terminated: ok {rc=0} 02:26:05.864434 bus /gobi_0: Setting Powered False 02:26:06.964257 bus /gobi_0: Setting Powered False 02:26:08.079369 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_sms:trx-b200 --------------------------------------------------------------------- 02:26:09.312520 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:26:09.316358 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 02:26:09.349223 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 02:26:09.355881 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 02:26:09.407528 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 02:26:09.440286 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 02:26:09.446977 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 02:26:09.988225 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 02:26:09.994805 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 02:26:10.006618 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 02:26:10.059240 tst mo_mt_sms.py: using LAC 18421 02:26:10.186150 tst mo_mt_sms.py: using RAC 61 02:26:10.314272 tst mo_mt_sms.py: using CellId 18421 02:26:10.440159 tst mo_mt_sms.py: using BVCI 18422 02:26:10.557332 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 02:26:10.674697 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 02:26:10.788592 tst mo_mt_sms.py:9: start nitb and bts... 02:26:10.990699 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:26:11.606021 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11818): Launched 02:26:11.910414 run osmo-nitb_10.42.42.2(pid=11819): Launched 02:26:12.077116 run osmo-nitb_10.42.42.2(pid=11819): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11819)] 02:26:12.212698 run osmo-nitb_10.42.42.2(pid=11819): stdout: | (launched: 2022-12-09_02:26:11.853961) 02:26:12.349503 run osmo-nitb_10.42.42.2(pid=11819): stderr: | (launched: 2022-12-09_02:26:11.898872) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:26:12.486128 run osmo-nitb_10.42.42.2(pid=11819): stdout: | (launched: 2022-12-09_02:26:11.853961) 02:26:12.617139 run osmo-nitb_10.42.42.2(pid=11819): stderr: | (launched: 2022-12-09_02:26:11.898872) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11819): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11819) [trial-2353↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11819)] 02:26:13.024620 tst osmo-nitb_10.42.42.2(pid=11819): stdout: | (launched: 2022-12-09_02:26:11.853961) 02:26:13.146357 tst osmo-nitb_10.42.42.2(pid=11819): stderr: | (launched: 2022-12-09_02:26:11.898872) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:26:13.290167 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=11819): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11819) [trial-2353↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11819)] [trial-2353↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 02:26:13.298632 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 02:26:13.305148 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11818): Terminating (SIGTERM) 02:26:13.515227 --- ParallelTerminationStrategy: PID 11818 died... 02:26:13.536133 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11818): Terminated: ok {rc=0} 02:26:13.620601 bus /sierra_3: Setting Powered False 02:26:14.719361 bus /sierra_3: Setting Powered False 02:26:15.849394 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 sms:trx-b200 --------------------------------------------------------------------- 02:26:17.080499 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:26:17.085940 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 02:26:17.124815 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 02:26:17.154723 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 02:26:17.211738 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 02:26:17.248001 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 02:26:17.278400 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 02:26:17.817964 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 02:26:17.823370 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:17.834552 tst sms:trx-b200: Using 1 x bts (candidates: 1) 02:26:17.885937 tst mo_mt_sms.py: using LAC 18422 02:26:18.010610 tst mo_mt_sms.py: using RAC 62 02:26:18.136184 tst mo_mt_sms.py: using CellId 18422 02:26:18.260716 tst mo_mt_sms.py: using BVCI 18423 02:26:18.378474 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:18.389631 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:18.400495 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:18.411615 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:18.422831 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:18.434183 tst sms:trx-b200: Using 1 x modem (candidates: 2) 02:26:18.550066 tst sms:trx-b200: Using 1 x modem (candidates: 2) 02:26:18.667679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:19.136154 run create_hlr_db(pid=11823): Launched 02:26:19.259494 bus /sierra_2: Setting Powered False 02:26:20.319221 run create_hlr_db(pid=11823): Terminated: ok {rc=0} 02:26:20.740800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11825): Launched 02:26:21.043899 run osmo-hlr_10.42.42.2(pid=11826): Launched 02:26:21.157870 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:21.690673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11828): Launched 02:26:21.989834 run osmo-stp_10.42.42.5(pid=11829): Launched 02:26:22.104720 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:22.649450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11831): Launched 02:26:22.951029 run osmo-msc_10.42.42.6(pid=11832): Launched 02:26:23.121639 run osmo-stp_10.42.42.5(pid=11829): ERR: Terminated: ERROR {rc=1} [trial-2353↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11829)] 02:26:23.249294 run osmo-stp_10.42.42.5(pid=11829): stdout: | (launched: 2022-12-09_02:26:21.935240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:23.376039 run osmo-stp_10.42.42.5(pid=11829): stderr: | 20221209022622104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022622104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022622105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022622105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022622106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022622106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022622106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:23.500860 run osmo-stp_10.42.42.5(pid=11829): stdout: | (launched: 2022-12-09_02:26:21.935240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:23.620523 run osmo-stp_10.42.42.5(pid=11829): stderr: | 20221209022622104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022622104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022622105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022622105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022622106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022622106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022622106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:23.763561 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=11829): Process ended prematurely: osmo-stp_10.42.42.5(pid=11829) [trial-2353↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11829)] [trial-2353↪sms:trx-b200↪mo_mt_sms.py:16] 02:26:23.771819 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 02:26:23.797494 run osmo-hlr_10.42.42.2(pid=11826): ERR: Terminated: ERROR {rc=237} [trial-2353↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11826)] 02:26:23.845416 run osmo-hlr_10.42.42.2(pid=11826): stdout: | (launched: 2022-12-09_02:26:20.987568) 02:26:23.894888 run osmo-hlr_10.42.42.2(pid=11826): stderr: | 20221209022621167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022621167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022621167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022621167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022621167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022621167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022621179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022621190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022621190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022621190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:23.963548 run osmo-msc_10.42.42.6(pid=11832): ERR: Terminated: ERROR {rc=2} [trial-2353↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11832)] 02:26:24.011269 run osmo-msc_10.42.42.6(pid=11832): stdout: | (launched: 2022-12-09_02:26:22.895599) 02:26:24.060774 run osmo-msc_10.42.42.6(pid=11832): stderr: | 20221209022623167 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022623168 DLGLOBAL DEBUG validating counter group 0x7fa7a6b8ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022623168 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022623168 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022623168 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022623168 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022623171 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022623171 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022623172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022623172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:24.110399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11825): Terminating (SIGTERM) 02:26:24.150142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11828): Terminating (SIGTERM) 02:26:24.190230 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11831): Terminating (SIGTERM) 02:26:24.230048 --- ParallelTerminationStrategy: PID 11825 died... 02:26:24.249201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11825): Terminated: ok {rc=0} 02:26:24.293200 --- ParallelTerminationStrategy: PID 11828 died... 02:26:24.311658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11828): Terminated: ok {rc=0} 02:26:24.355447 --- ParallelTerminationStrategy: PID 11831 died... 02:26:24.374151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11831): Terminated: ok {rc=0} 02:26:24.460105 bus /sierra_3: Setting Powered False 02:26:25.560561 bus /sierra_3: Setting Powered False 02:26:26.676778 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_ussd:trx-b200 --------------------------------------------------------------------- 02:26:27.903620 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:26:27.907320 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 02:26:27.940752 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 02:26:27.947549 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 02:26:27.982648 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 02:26:28.015928 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 02:26:28.022607 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 02:26:28.543613 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2353 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 02:26:28.549102 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 02:26:28.560461 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 02:26:28.610254 tst assert_extension.py: using LAC 18423 02:26:28.738698 tst assert_extension.py: using RAC 63 02:26:28.864585 tst assert_extension.py: using CellId 18423 02:26:28.991700 tst assert_extension.py: using BVCI 18424 02:26:29.108863 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 02:26:29.223596 tst assert_extension.py:10: start nitb and bts... 02:26:29.426122 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:26:30.043519 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11838): Launched 02:26:30.344386 run osmo-nitb_10.42.42.2(pid=11839): Launched 02:26:30.510998 run osmo-nitb_10.42.42.2(pid=11839): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11839)] 02:26:30.645333 run osmo-nitb_10.42.42.2(pid=11839): stdout: | (launched: 2022-12-09_02:26:30.288914) 02:26:30.781529 run osmo-nitb_10.42.42.2(pid=11839): stderr: | (launched: 2022-12-09_02:26:30.333826) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:26:30.956718 run osmo-nitb_10.42.42.2(pid=11839): stdout: | (launched: 2022-12-09_02:26:30.288914) 02:26:31.100440 run osmo-nitb_10.42.42.2(pid=11839): stderr: | (launched: 2022-12-09_02:26:30.333826) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11839): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11839) [trial-2353↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11839)] 02:26:31.457449 tst osmo-nitb_10.42.42.2(pid=11839): stdout: | (launched: 2022-12-09_02:26:30.288914) 02:26:31.593147 tst osmo-nitb_10.42.42.2(pid=11839): stderr: | (launched: 2022-12-09_02:26:30.333826) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:26:31.751603 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=11839): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11839) [trial-2353↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11839)] [trial-2353↪nitb_ussd:trx-b200↪assert_extension.py:12] 02:26:31.761311 tst assert_extension.py:12: Test FAILED (3.2 sec) 02:26:31.769401 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11838): Terminating (SIGTERM) 02:26:31.983434 --- ParallelTerminationStrategy: PID 11838 died... 02:26:32.003841 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11838): Terminated: ok {rc=0} 02:26:32.096115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 ussd:trx-b200 --------------------------------------------------------------------- 02:26:33.280148 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:26:33.284415 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 02:26:33.320502 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 02:26:33.349197 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 02:26:33.385471 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 02:26:33.420185 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 02:26:33.448410 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 02:26:33.975821 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2353 ussd:trx-b200 assert_extension.py ---------------------------------------------- 02:26:33.981363 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:33.992375 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 02:26:34.047387 tst assert_extension.py: using LAC 18424 02:26:34.174554 tst assert_extension.py: using RAC 64 02:26:34.299795 tst assert_extension.py: using CellId 18424 02:26:34.425427 tst assert_extension.py: using BVCI 18425 02:26:34.536458 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:34.547362 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:34.558489 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:34.569414 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:34.580336 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:34.591245 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 02:26:34.709972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:35.211558 run create_hlr_db(pid=11843): Launched 02:26:35.334661 bus /sierra_2: Setting Powered False 02:26:36.398240 run create_hlr_db(pid=11843): Terminated: ok {rc=0} 02:26:36.848264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11845): Launched 02:26:37.170324 run osmo-hlr_10.42.42.2(pid=11847): Launched 02:26:37.294691 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:37.853067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11849): Launched 02:26:38.174831 run osmo-stp_10.42.42.5(pid=11850): Launched 02:26:38.300318 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:38.881615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11852): Launched 02:26:39.205464 run osmo-msc_10.42.42.6(pid=11853): Launched 02:26:39.388119 run osmo-stp_10.42.42.5(pid=11850): ERR: Terminated: ERROR {rc=1} [trial-2353↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11850)] 02:26:39.524794 run osmo-stp_10.42.42.5(pid=11850): stdout: | (launched: 2022-12-09_02:26:38.115914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:39.661631 run osmo-stp_10.42.42.5(pid=11850): stderr: | 20221209022638306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022638306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022638306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022638307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022638307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022638307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022638307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:39.797269 run osmo-stp_10.42.42.5(pid=11850): stdout: | (launched: 2022-12-09_02:26:38.115914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:39.925795 run osmo-stp_10.42.42.5(pid=11850): stderr: | 20221209022638306 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022638306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022638306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022638307 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022638307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022638307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022638307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:40.079453 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=11850): Process ended prematurely: osmo-stp_10.42.42.5(pid=11850) [trial-2353↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11850)] [trial-2353↪ussd:trx-b200↪assert_extension.py:17] 02:26:40.088405 tst assert_extension.py:17: Test FAILED (6.1 sec) 02:26:40.116454 run osmo-hlr_10.42.42.2(pid=11847): ERR: Terminated: ERROR {rc=237} [trial-2353↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11847)] 02:26:40.167216 run osmo-hlr_10.42.42.2(pid=11847): stdout: | (launched: 2022-12-09_02:26:37.111284) 02:26:40.219742 run osmo-hlr_10.42.42.2(pid=11847): stderr: | 20221209022637307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022637307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022637307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022637307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022637307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022637308 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022637320 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022637329 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022637329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022637329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:40.293126 run osmo-msc_10.42.42.6(pid=11853): ERR: Terminated: ERROR {rc=2} [trial-2353↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11853)] 02:26:40.344064 run osmo-msc_10.42.42.6(pid=11853): stdout: | (launched: 2022-12-09_02:26:39.146498) 02:26:40.396439 run osmo-msc_10.42.42.6(pid=11853): stderr: | 20221209022639468 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022639468 DLGLOBAL DEBUG validating counter group 0x7fe19d705c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022639468 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022639468 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022639469 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022639469 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022639470 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022639471 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022639471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022639471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:40.449427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11845): Terminating (SIGTERM) 02:26:40.491833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11849): Terminating (SIGTERM) 02:26:40.534102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11852): Terminating (SIGTERM) 02:26:40.576695 --- ParallelTerminationStrategy: PID 11845 died... 02:26:40.596891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11845): Terminated: ok {rc=0} 02:26:40.643954 --- ParallelTerminationStrategy: PID 11849 died... 02:26:40.663610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11849): Terminated: ok {rc=0} 02:26:40.710834 --- ParallelTerminationStrategy: PID 11852 died... 02:26:40.730494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11852): Terminated: ok {rc=0} 02:26:40.819434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:26:42.038332 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:26:42.045313 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:26:42.078883 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:26:42.105644 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:26:42.158408 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:26:42.191733 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:26:42.218153 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:26:42.769117 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:26:42.819682 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:42.831059 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:26:42.900728 tst mo_mt_call.py: using LAC 18425 02:26:43.022664 tst mo_mt_call.py: using RAC 65 02:26:43.145206 tst mo_mt_call.py: using CellId 18425 02:26:43.267036 tst mo_mt_call.py: using BVCI 18426 02:26:43.380413 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:43.391449 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:43.402330 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:43.413785 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:43.425201 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:43.436534 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:26:43.552412 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:26:43.672622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:44.184431 run create_hlr_db(pid=11858): Launched 02:26:44.310198 bus /sierra_2: Setting Powered False 02:26:45.375317 run create_hlr_db(pid=11858): Terminated: ok {rc=0} 02:26:45.814898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11860): Launched 02:26:46.149454 run osmo-hlr_10.42.42.2(pid=11861): Launched 02:26:46.315391 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:47.085758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11863): Launched 02:26:47.411439 run osmo-stp_10.42.42.5(pid=11864): Launched 02:26:47.562139 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:48.159118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11866): Launched 02:26:48.489085 run osmo-msc_10.42.42.6(pid=11867): Launched 02:26:48.675781 run osmo-stp_10.42.42.5(pid=11864): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11864)] 02:26:48.814789 run osmo-stp_10.42.42.5(pid=11864): stdout: | (launched: 2022-12-09_02:26:47.351894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:48.955868 run osmo-stp_10.42.42.5(pid=11864): stderr: | 20221209022647573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022647573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022647573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022647574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022647574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022647574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022647574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:49.093772 run osmo-stp_10.42.42.5(pid=11864): stdout: | (launched: 2022-12-09_02:26:47.351894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:49.225191 run osmo-stp_10.42.42.5(pid=11864): stderr: | 20221209022647573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022647573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022647573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022647574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022647574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022647574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022647574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:49.383131 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11864): Process ended prematurely: osmo-stp_10.42.42.5(pid=11864) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11864)] [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:26:49.392685 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 02:26:49.421299 run osmo-hlr_10.42.42.2(pid=11861): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11861)] 02:26:49.472401 run osmo-hlr_10.42.42.2(pid=11861): stdout: | (launched: 2022-12-09_02:26:46.090808) 02:26:49.525243 run osmo-hlr_10.42.42.2(pid=11861): stderr: | 20221209022646490 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022646490 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022646490 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022646490 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022646490 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022646490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022646505 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022646529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022646529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022646529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:49.598612 run osmo-msc_10.42.42.6(pid=11867): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11867)] 02:26:49.649874 run osmo-msc_10.42.42.6(pid=11867): stdout: | (launched: 2022-12-09_02:26:48.429254) 02:26:49.702466 run osmo-msc_10.42.42.6(pid=11867): stderr: | 20221209022648753 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022648753 DLGLOBAL DEBUG validating counter group 0x7f10c4fb2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022648753 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022648753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022648753 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022648754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022648755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022648756 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022648756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022648756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:49.755703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11860): Terminating (SIGTERM) 02:26:49.798337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11863): Terminating (SIGTERM) 02:26:49.840992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11866): Terminating (SIGTERM) 02:26:49.883856 --- ParallelTerminationStrategy: PID 11860 died... 02:26:49.903979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11860): Terminated: ok {rc=0} 02:26:49.951178 --- ParallelTerminationStrategy: PID 11863 died... 02:26:49.970931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11863): Terminated: ok {rc=0} 02:26:50.018063 --- ParallelTerminationStrategy: PID 11866 died... 02:26:50.037776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11866): Terminated: ok {rc=0} 02:26:50.127223 bus /sierra_3: Setting Powered False 02:26:51.227702 bus /sierra_3: Setting Powered False 02:26:52.348385 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:26:53.496796 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:53.508805 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:26:53.578631 tst mo_mt_call_osmux.py: using LAC 18426 02:26:53.700078 tst mo_mt_call_osmux.py: using RAC 66 02:26:53.830750 tst mo_mt_call_osmux.py: using CellId 18426 02:26:53.961799 tst mo_mt_call_osmux.py: using BVCI 18427 02:26:54.076087 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:54.087495 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:54.098829 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:54.110142 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:54.121574 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:54.132816 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:26:54.249068 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:26:54.370365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:54.882042 run create_hlr_db(pid=11869): Launched 02:26:55.008922 bus /sierra_2: Setting Powered False 02:26:56.073831 run create_hlr_db(pid=11869): Terminated: ok {rc=0} 02:26:56.512620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11871): Launched 02:26:56.820203 run osmo-hlr_10.42.42.2(pid=11872): Launched 02:26:56.938151 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:57.482609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11874): Launched 02:26:57.790176 run osmo-stp_10.42.42.5(pid=11875): Launched 02:26:57.908011 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:58.464587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11877): Launched 02:26:58.770939 run osmo-msc_10.42.42.6(pid=11878): Launched 02:26:58.942472 run osmo-stp_10.42.42.5(pid=11875): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11875)] 02:26:59.073146 run osmo-stp_10.42.42.5(pid=11875): stdout: | (launched: 2022-12-09_02:26:57.733847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:59.202160 run osmo-stp_10.42.42.5(pid=11875): stderr: | 20221209022657903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022657903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022657904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022657904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022657905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022657905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022657905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:59.330196 run osmo-stp_10.42.42.5(pid=11875): stdout: | (launched: 2022-12-09_02:26:57.733847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:59.452630 run osmo-stp_10.42.42.5(pid=11875): stderr: | 20221209022657903 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022657903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022657904 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022657904 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022657905 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022657905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022657905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:59.598992 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11875): Process ended prematurely: osmo-stp_10.42.42.5(pid=11875) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11875)] [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:26:59.608055 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:26:59.634780 run osmo-hlr_10.42.42.2(pid=11872): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11872)] 02:26:59.683246 run osmo-hlr_10.42.42.2(pid=11872): stdout: | (launched: 2022-12-09_02:26:56.763532) 02:26:59.733529 run osmo-hlr_10.42.42.2(pid=11872): stderr: | 20221209022656945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022656945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022656945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022656945 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022656945 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022656946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022656958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022656967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022656967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022656967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:59.802981 run osmo-msc_10.42.42.6(pid=11878): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11878)] 02:26:59.851221 run osmo-msc_10.42.42.6(pid=11878): stdout: | (launched: 2022-12-09_02:26:58.714732) 02:26:59.900746 run osmo-msc_10.42.42.6(pid=11878): stderr: | 20221209022658989 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022658989 DLGLOBAL DEBUG validating counter group 0x7efe218cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022658989 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022658989 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022658989 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022658990 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022658991 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022658993 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022658993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022658993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:59.950845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11871): Terminating (SIGTERM) 02:26:59.990806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11874): Terminating (SIGTERM) 02:27:00.030953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11877): Terminating (SIGTERM) 02:27:00.071422 --- ParallelTerminationStrategy: PID 11871 died... 02:27:00.090702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11871): Terminated: ok {rc=0} 02:27:00.135175 --- ParallelTerminationStrategy: PID 11874 died... 02:27:00.153974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11874): Terminated: ok {rc=0} 02:27:00.198183 --- ParallelTerminationStrategy: PID 11877 died... 02:27:00.217046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11877): Terminated: ok {rc=0} 02:27:00.301759 bus /sierra_3: Setting Powered False 02:27:01.406877 bus /sierra_3: Setting Powered False 02:27:02.533062 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:27:03.784867 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:27:03.791532 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:27:03.825113 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:27:03.851892 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:27:03.904300 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:27:03.937766 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:27:03.964856 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:27:04.515393 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:27:04.564741 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:27:04.576046 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:27:04.645184 tst mo_mt_call.py: using LAC 18427 02:27:04.765797 tst mo_mt_call.py: using RAC 67 02:27:04.886810 tst mo_mt_call.py: using CellId 18427 02:27:05.009202 tst mo_mt_call.py: using BVCI 18428 02:27:05.121728 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:27:05.132841 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:27:05.144007 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:27:05.155200 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:27:05.166570 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:27:05.177794 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:27:05.296600 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:27:05.416349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:05.926015 run create_hlr_db(pid=11883): Launched 02:27:06.052041 bus /sierra_2: Setting Powered False 02:27:07.116305 run create_hlr_db(pid=11883): Terminated: ok {rc=0} 02:27:07.555154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11885): Launched 02:27:07.863426 run osmo-hlr_10.42.42.2(pid=11886): Launched 02:27:07.981163 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:08.509375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11888): Launched 02:27:08.815348 run osmo-stp_10.42.42.5(pid=11889): Launched 02:27:08.934734 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:09.491002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11891): Launched 02:27:09.799161 run osmo-msc_10.42.42.6(pid=11892): Launched 02:27:09.970575 run osmo-stp_10.42.42.5(pid=11889): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11889)] 02:27:10.100074 run osmo-stp_10.42.42.5(pid=11889): stdout: | (launched: 2022-12-09_02:27:08.759189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:10.229506 run osmo-stp_10.42.42.5(pid=11889): stderr: | 20221209022708930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022708930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022708930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022708931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022708931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022708931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022708931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:10.356895 run osmo-stp_10.42.42.5(pid=11889): stdout: | (launched: 2022-12-09_02:27:08.759189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:10.478553 run osmo-stp_10.42.42.5(pid=11889): stderr: | 20221209022708930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022708930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022708930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022708931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022708931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022708931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022708931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:10.624594 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11889): Process ended prematurely: osmo-stp_10.42.42.5(pid=11889) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11889)] [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:27:10.633832 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:27:10.660433 run osmo-hlr_10.42.42.2(pid=11886): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11886)] 02:27:10.708761 run osmo-hlr_10.42.42.2(pid=11886): stdout: | (launched: 2022-12-09_02:27:07.806654) 02:27:10.758673 run osmo-hlr_10.42.42.2(pid=11886): stderr: | 20221209022707987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022707987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022707987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022707987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022707987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022707987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022707999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022708008 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022708009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022708009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:10.827531 run osmo-msc_10.42.42.6(pid=11892): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11892)] 02:27:10.875314 run osmo-msc_10.42.42.6(pid=11892): stdout: | (launched: 2022-12-09_02:27:09.742375) 02:27:10.924745 run osmo-msc_10.42.42.6(pid=11892): stderr: | 20221209022710019 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022710019 DLGLOBAL DEBUG validating counter group 0x7f05e9595c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022710020 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022710020 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022710021 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022710021 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022710023 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022710023 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022710023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022710023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:10.974557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11885): Terminating (SIGTERM) 02:27:11.014515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11888): Terminating (SIGTERM) 02:27:11.054571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11891): Terminating (SIGTERM) 02:27:11.094692 --- ParallelTerminationStrategy: PID 11885 died... 02:27:11.113960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11885): Terminated: ok {rc=0} 02:27:11.158831 --- ParallelTerminationStrategy: PID 11888 died... 02:27:11.177882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11888): Terminated: ok {rc=0} 02:27:11.222433 --- ParallelTerminationStrategy: PID 11891 died... 02:27:11.241228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11891): Terminated: ok {rc=0} 02:27:11.328779 bus /sierra_3: Setting Powered False 02:27:12.429361 bus /sierra_3: Setting Powered False 02:27:13.545865 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:27:14.693980 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:27:14.706019 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:27:14.777710 tst mo_mt_call_osmux.py: using LAC 18428 02:27:14.900365 tst mo_mt_call_osmux.py: using RAC 68 02:27:15.028232 tst mo_mt_call_osmux.py: using CellId 18428 02:27:15.149573 tst mo_mt_call_osmux.py: using BVCI 18429 02:27:15.271431 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:27:15.283541 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:27:15.295223 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:27:15.307106 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:27:15.319008 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:27:15.330957 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:27:15.447266 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:27:15.564563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:16.064392 run create_hlr_db(pid=11894): Launched 02:27:16.227221 bus /sierra_2: Setting Powered False 02:27:17.293646 run create_hlr_db(pid=11894): Terminated: ok {rc=0} 02:27:17.734071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11896): Launched 02:27:18.041851 run osmo-hlr_10.42.42.2(pid=11897): Launched 02:27:18.158915 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:18.692294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11899): Launched 02:27:18.998388 run osmo-stp_10.42.42.5(pid=11900): Launched 02:27:19.115160 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:19.677170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11902): Launched 02:27:19.985299 run osmo-msc_10.42.42.6(pid=11903): Launched 02:27:20.157244 run osmo-stp_10.42.42.5(pid=11900): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11900)] 02:27:20.287363 run osmo-stp_10.42.42.5(pid=11900): stdout: | (launched: 2022-12-09_02:27:18.942312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:20.417265 run osmo-stp_10.42.42.5(pid=11900): stderr: | 20221209022719113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022719113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022719113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022719114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022719114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022719114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022719114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:20.545660 run osmo-stp_10.42.42.5(pid=11900): stdout: | (launched: 2022-12-09_02:27:18.942312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:20.668245 run osmo-stp_10.42.42.5(pid=11900): stderr: | 20221209022719113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022719113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022719113 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022719114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022719114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022719114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022719114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:20.815536 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11900): Process ended prematurely: osmo-stp_10.42.42.5(pid=11900) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11900)] [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:27:20.824695 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:27:20.851435 run osmo-hlr_10.42.42.2(pid=11897): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11897)] 02:27:20.899642 run osmo-hlr_10.42.42.2(pid=11897): stdout: | (launched: 2022-12-09_02:27:17.984919) 02:27:20.949696 run osmo-hlr_10.42.42.2(pid=11897): stderr: | 20221209022718162 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022718162 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022718162 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022718162 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022718162 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022718162 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022718174 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022718183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022718184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022718184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:21.018942 run osmo-msc_10.42.42.6(pid=11903): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11903)] 02:27:21.066908 run osmo-msc_10.42.42.6(pid=11903): stdout: | (launched: 2022-12-09_02:27:19.928827) 02:27:21.116495 run osmo-msc_10.42.42.6(pid=11903): stderr: | 20221209022720199 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022720199 DLGLOBAL DEBUG validating counter group 0x7fa62159bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022720199 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022720199 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022720199 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022720200 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022720201 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022720202 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022720202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022720202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:21.166137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11896): Terminating (SIGTERM) 02:27:21.206098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11899): Terminating (SIGTERM) 02:27:21.246508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11902): Terminating (SIGTERM) 02:27:21.286817 --- ParallelTerminationStrategy: PID 11896 died... 02:27:21.306082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11896): Terminated: ok {rc=0} 02:27:21.350561 --- ParallelTerminationStrategy: PID 11899 died... 02:27:21.369248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11899): Terminated: ok {rc=0} 02:27:21.413570 --- ParallelTerminationStrategy: PID 11902 died... 02:27:21.432334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11902): Terminated: ok {rc=0} 02:27:21.517078 bus /sierra_3: Setting Powered False 02:27:22.615581 bus /sierra_3: Setting Powered False 02:27:23.732159 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:27:24.983971 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:27:24.992546 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:27:25.027595 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:27:25.055478 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:27:25.110527 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:27:25.143910 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:27:25.170704 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:27:25.723305 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:27:25.775834 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:25.787175 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:27:25.856595 tst mo_mt_call.py: using LAC 18429 02:27:25.987005 tst mo_mt_call.py: using RAC 69 02:27:26.115909 tst mo_mt_call.py: using CellId 18429 02:27:26.238696 tst mo_mt_call.py: using BVCI 18430 02:27:26.352206 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:26.363879 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:26.375092 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:26.386042 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:26.397252 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:26.408357 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:27:26.531101 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:27:26.652918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:27.163833 run create_hlr_db(pid=11908): Launched 02:27:27.289488 bus /sierra_2: Setting Powered False 02:27:28.353976 run create_hlr_db(pid=11908): Terminated: ok {rc=0} 02:27:28.792019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11910): Launched 02:27:29.121799 run osmo-hlr_10.42.42.2(pid=11911): Launched 02:27:29.245661 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:29.788473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11913): Launched 02:27:30.095464 run osmo-stp_10.42.42.5(pid=11914): Launched 02:27:30.212624 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:30.768698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11916): Launched 02:27:31.099805 run osmo-msc_10.42.42.6(pid=11917): Launched 02:27:31.600481 run osmo-stp_10.42.42.5(pid=11914): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11914)] 02:27:31.791398 run osmo-stp_10.42.42.5(pid=11914): stdout: | (launched: 2022-12-09_02:27:30.038544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:31.931988 run osmo-stp_10.42.42.5(pid=11914): stderr: | 20221209022730209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022730209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022730209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022730209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022730212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022730212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022730212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:32.081181 run osmo-stp_10.42.42.5(pid=11914): stdout: | (launched: 2022-12-09_02:27:30.038544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:32.235795 run osmo-stp_10.42.42.5(pid=11914): stderr: | 20221209022730209 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022730209 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022730209 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022730209 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022730212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022730212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022730212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:32.397490 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11914): Process ended prematurely: osmo-stp_10.42.42.5(pid=11914) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11914)] [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:27:32.407311 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 02:27:32.435907 run osmo-hlr_10.42.42.2(pid=11911): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11911)] 02:27:32.486887 run osmo-hlr_10.42.42.2(pid=11911): stdout: | (launched: 2022-12-09_02:27:29.062048) 02:27:32.539653 run osmo-hlr_10.42.42.2(pid=11911): stderr: | 20221209022729244 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022729244 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022729245 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022729245 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022729245 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022729245 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022729257 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022729265 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022729265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022729266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:32.612448 run osmo-msc_10.42.42.6(pid=11917): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11917)] 02:27:32.663083 run osmo-msc_10.42.42.6(pid=11917): stdout: | (launched: 2022-12-09_02:27:31.041720) 02:27:32.715185 run osmo-msc_10.42.42.6(pid=11917): stderr: | 20221209022731428 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022731428 DLGLOBAL DEBUG validating counter group 0x7f95dfc37c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022731428 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022731428 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022731428 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022731429 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022731430 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022731431 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022731431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022731431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:32.767740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11910): Terminating (SIGTERM) 02:27:32.809848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11913): Terminating (SIGTERM) 02:27:32.852173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11916): Terminating (SIGTERM) 02:27:32.894712 --- ParallelTerminationStrategy: PID 11910 died... 02:27:32.914808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11910): Terminated: ok {rc=0} 02:27:32.961651 --- ParallelTerminationStrategy: PID 11913 died... 02:27:32.981281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11913): Terminated: ok {rc=0} 02:27:33.028425 --- ParallelTerminationStrategy: PID 11916 died... 02:27:33.048173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11916): Terminated: ok {rc=0} 02:27:33.137908 bus /sierra_3: Setting Powered False 02:27:34.236111 bus /sierra_3: Setting Powered False 02:27:35.352776 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:27:36.498017 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:36.509818 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:27:36.582146 tst mo_mt_call_osmux.py: using LAC 18430 02:27:36.704383 tst mo_mt_call_osmux.py: using RAC 70 02:27:36.824766 tst mo_mt_call_osmux.py: using CellId 18430 02:27:36.944655 tst mo_mt_call_osmux.py: using BVCI 18431 02:27:37.056666 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:37.068018 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:37.079223 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:37.090494 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:37.101829 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:37.112872 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:27:37.230186 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:27:37.352809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:37.865584 run create_hlr_db(pid=11919): Launched 02:27:37.990981 bus /sierra_2: Setting Powered False 02:27:39.054993 run create_hlr_db(pid=11919): Terminated: ok {rc=0} 02:27:39.493139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11921): Launched 02:27:39.800094 run osmo-hlr_10.42.42.2(pid=11922): Launched 02:27:39.918306 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:40.462002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11924): Launched 02:27:40.768844 run osmo-stp_10.42.42.5(pid=11925): Launched 02:27:40.886599 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:41.442626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11927): Launched 02:27:41.749485 run osmo-msc_10.42.42.6(pid=11928): Launched 02:27:41.921127 run osmo-stp_10.42.42.5(pid=11925): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11925)] 02:27:42.051702 run osmo-stp_10.42.42.5(pid=11925): stdout: | (launched: 2022-12-09_02:27:40.712336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:42.181425 run osmo-stp_10.42.42.5(pid=11925): stderr: | 20221209022740884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022740884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022740885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022740885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022740886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022740886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022740886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:42.308811 run osmo-stp_10.42.42.5(pid=11925): stdout: | (launched: 2022-12-09_02:27:40.712336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:42.430899 run osmo-stp_10.42.42.5(pid=11925): stderr: | 20221209022740884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022740884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022740885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022740885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022740886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022740886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022740886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:42.576756 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11925): Process ended prematurely: osmo-stp_10.42.42.5(pid=11925) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11925)] [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:27:42.585603 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:27:42.611745 run osmo-hlr_10.42.42.2(pid=11922): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11922)] 02:27:42.659257 run osmo-hlr_10.42.42.2(pid=11922): stdout: | (launched: 2022-12-09_02:27:39.743851) 02:27:42.709085 run osmo-hlr_10.42.42.2(pid=11922): stderr: | 20221209022739921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022739921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022739921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022739921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022739921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022739921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022739934 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022739943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022739943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022739943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:42.777697 run osmo-msc_10.42.42.6(pid=11928): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11928)] 02:27:42.825114 run osmo-msc_10.42.42.6(pid=11928): stdout: | (launched: 2022-12-09_02:27:41.692862) 02:27:42.874035 run osmo-msc_10.42.42.6(pid=11928): stderr: | 20221209022741966 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022741966 DLGLOBAL DEBUG validating counter group 0x7fac80233c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022741967 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022741967 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022741967 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022741967 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022741969 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022741969 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022741969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022741969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:42.923459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11921): Terminating (SIGTERM) 02:27:42.962813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11924): Terminating (SIGTERM) 02:27:43.002392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11927): Terminating (SIGTERM) 02:27:43.042090 --- ParallelTerminationStrategy: PID 11921 died... 02:27:43.061093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11921): Terminated: ok {rc=0} 02:27:43.105028 --- ParallelTerminationStrategy: PID 11924 died... 02:27:43.123625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11924): Terminated: ok {rc=0} 02:27:43.167208 --- ParallelTerminationStrategy: PID 11927 died... 02:27:43.185726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11927): Terminated: ok {rc=0} 02:27:43.268499 bus /sierra_3: Setting Powered False 02:27:44.366428 bus /sierra_3: Setting Powered False 02:27:45.482448 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:27:46.737845 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:27:46.746924 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:27:46.785877 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:27:46.816003 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:27:46.872723 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:27:46.931282 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:27:46.977951 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:27:47.484457 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:27:47.534863 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:47.546175 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:27:47.614558 tst mo_mt_call.py: using LAC 18431 02:27:47.734236 tst mo_mt_call.py: using RAC 71 02:27:47.854894 tst mo_mt_call.py: using CellId 18431 02:27:47.975204 tst mo_mt_call.py: using BVCI 18432 02:27:48.086663 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:48.098022 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:48.109250 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:48.120246 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:48.131516 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:48.143032 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:27:48.263059 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:27:48.379025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:48.857222 run create_hlr_db(pid=11933): Launched 02:27:48.982067 bus /sierra_2: Setting Powered False 02:27:50.043228 run create_hlr_db(pid=11933): Terminated: ok {rc=0} 02:27:50.493280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11935): Launched 02:27:50.823369 run osmo-hlr_10.42.42.2(pid=11936): Launched 02:27:50.951469 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:51.522746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11938): Launched 02:27:51.851781 run osmo-stp_10.42.42.5(pid=11939): Launched 02:27:51.978704 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:52.578442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11941): Launched 02:27:52.907950 run osmo-msc_10.42.42.6(pid=11942): Launched 02:27:53.092274 run osmo-stp_10.42.42.5(pid=11939): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11939)] 02:27:53.231860 run osmo-stp_10.42.42.5(pid=11939): stdout: | (launched: 2022-12-09_02:27:51.791591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:53.372130 run osmo-stp_10.42.42.5(pid=11939): stderr: | 20221209022751987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022751987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022751987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022751988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022751988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022751988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022751988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:53.510349 run osmo-stp_10.42.42.5(pid=11939): stdout: | (launched: 2022-12-09_02:27:51.791591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:53.641598 run osmo-stp_10.42.42.5(pid=11939): stderr: | 20221209022751987 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022751987 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022751987 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022751988 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022751988 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022751988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022751988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:53.798087 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11939): Process ended prematurely: osmo-stp_10.42.42.5(pid=11939) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11939)] [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:27:53.807705 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:27:53.835670 run osmo-hlr_10.42.42.2(pid=11936): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11936)] 02:27:53.886370 run osmo-hlr_10.42.42.2(pid=11936): stdout: | (launched: 2022-12-09_02:27:50.763418) 02:27:53.938442 run osmo-hlr_10.42.42.2(pid=11936): stderr: | 20221209022750962 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022750962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022750962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022750963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022750963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022750963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022750975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022750984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022750984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022750984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:54.010916 run osmo-msc_10.42.42.6(pid=11942): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11942)] 02:27:54.061327 run osmo-msc_10.42.42.6(pid=11942): stdout: | (launched: 2022-12-09_02:27:52.847548) 02:27:54.113438 run osmo-msc_10.42.42.6(pid=11942): stderr: | 20221209022753172 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022753173 DLGLOBAL DEBUG validating counter group 0x7fb7abd27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022753173 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022753173 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022753173 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022753173 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022753175 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022753175 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022753175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022753176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:54.165909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11935): Terminating (SIGTERM) 02:27:54.207823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11938): Terminating (SIGTERM) 02:27:54.249829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11941): Terminating (SIGTERM) 02:27:54.292005 --- ParallelTerminationStrategy: PID 11935 died... 02:27:54.312360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11935): Terminated: ok {rc=0} 02:27:54.359261 --- ParallelTerminationStrategy: PID 11938 died... 02:27:54.378740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11938): Terminated: ok {rc=0} 02:27:54.425468 --- ParallelTerminationStrategy: PID 11941 died... 02:27:54.445053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11941): Terminated: ok {rc=0} 02:27:54.534059 bus /sierra_3: Setting Powered False 02:27:55.634839 bus /sierra_3: Setting Powered False 02:27:56.751316 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:27:57.902338 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:57.914625 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:27:57.987670 tst mo_mt_call_osmux.py: using LAC 18432 02:27:58.118252 tst mo_mt_call_osmux.py: using RAC 72 02:27:58.247422 tst mo_mt_call_osmux.py: using CellId 18432 02:27:58.376329 tst mo_mt_call_osmux.py: using BVCI 18433 02:27:58.495799 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:58.507485 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:58.518965 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:58.530830 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:58.542812 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:58.554766 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:27:58.676644 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:27:58.796263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:59.275168 run create_hlr_db(pid=11945): Launched 02:27:59.401420 bus /sierra_2: Setting Powered False 02:28:00.462827 run create_hlr_db(pid=11945): Terminated: ok {rc=0} 02:28:00.930154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11947): Launched 02:28:01.278374 run osmo-hlr_10.42.42.2(pid=11948): Launched 02:28:01.636871 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:02.291105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11950): Launched 02:28:02.617383 run osmo-stp_10.42.42.5(pid=11951): Launched 02:28:02.735878 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:03.294756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11953): Launched 02:28:03.603797 run osmo-msc_10.42.42.6(pid=11954): Launched 02:28:03.776635 run osmo-stp_10.42.42.5(pid=11951): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11951)] 02:28:03.906429 run osmo-stp_10.42.42.5(pid=11951): stdout: | (launched: 2022-12-09_02:28:02.561134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:04.035970 run osmo-stp_10.42.42.5(pid=11951): stderr: | 20221209022802731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022802731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022802731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022802732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022802732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022802732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022802732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:04.163722 run osmo-stp_10.42.42.5(pid=11951): stdout: | (launched: 2022-12-09_02:28:02.561134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:04.286064 run osmo-stp_10.42.42.5(pid=11951): stderr: | 20221209022802731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022802731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022802731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022802732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022802732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022802732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022802732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:04.432790 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11951): Process ended prematurely: osmo-stp_10.42.42.5(pid=11951) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11951)] [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:28:04.442028 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 02:28:04.468406 run osmo-hlr_10.42.42.2(pid=11948): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11948)] 02:28:04.516312 run osmo-hlr_10.42.42.2(pid=11948): stdout: | (launched: 2022-12-09_02:28:01.215116) 02:28:04.566133 run osmo-hlr_10.42.42.2(pid=11948): stderr: | 20221209022801440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022801440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022801440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022801440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022801441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022801441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022801456 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022801480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022801481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022801481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:04.635142 run osmo-msc_10.42.42.6(pid=11954): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11954)] 02:28:04.683174 run osmo-msc_10.42.42.6(pid=11954): stdout: | (launched: 2022-12-09_02:28:03.546048) 02:28:04.733235 run osmo-msc_10.42.42.6(pid=11954): stderr: | 20221209022803821 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022803821 DLGLOBAL DEBUG validating counter group 0x7f69dd44ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022803821 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022803821 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022803821 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022803821 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022803823 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022803823 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022803824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022803824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:04.783096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11947): Terminating (SIGTERM) 02:28:04.822892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11950): Terminating (SIGTERM) 02:28:04.863261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11953): Terminating (SIGTERM) 02:28:04.903523 --- ParallelTerminationStrategy: PID 11947 died... 02:28:04.922808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11947): Terminated: ok {rc=0} 02:28:04.967560 --- ParallelTerminationStrategy: PID 11950 died... 02:28:04.986427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11950): Terminated: ok {rc=0} 02:28:05.030539 --- ParallelTerminationStrategy: PID 11953 died... 02:28:05.049327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11953): Terminated: ok {rc=0} 02:28:05.135620 bus /sierra_3: Setting Powered False 02:28:06.236094 bus /sierra_3: Setting Powered False 02:28:07.348874 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:28:08.600876 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:28:08.607274 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:28:08.640563 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:28:08.667289 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:28:08.719014 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:28:08.752028 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:28:08.778619 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:28:09.329980 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:28:09.379160 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:28:09.390378 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:28:09.459875 tst mo_mt_call.py: using LAC 18433 02:28:09.581592 tst mo_mt_call.py: using RAC 73 02:28:09.703014 tst mo_mt_call.py: using CellId 18433 02:28:09.824703 tst mo_mt_call.py: using BVCI 18434 02:28:09.935909 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:28:09.947072 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:28:09.958151 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:28:09.972313 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:28:09.986143 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:28:09.997718 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:28:10.116629 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:28:10.234254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:10.712230 run create_hlr_db(pid=11959): Launched 02:28:10.837270 bus /sierra_2: Setting Powered False 02:28:11.898754 run create_hlr_db(pid=11959): Terminated: ok {rc=0} 02:28:12.347977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11961): Launched 02:28:12.677886 run osmo-hlr_10.42.42.2(pid=11962): Launched 02:28:12.805525 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:13.374886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11964): Launched 02:28:13.702977 run osmo-stp_10.42.42.5(pid=11965): Launched 02:28:13.829285 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:14.423553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11967): Launched 02:28:14.753463 run osmo-msc_10.42.42.6(pid=11968): Launched 02:28:14.935857 run osmo-stp_10.42.42.5(pid=11965): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11965)] 02:28:15.073534 run osmo-stp_10.42.42.5(pid=11965): stdout: | (launched: 2022-12-09_02:28:13.643173) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:15.211819 run osmo-stp_10.42.42.5(pid=11965): stderr: | 20221209022813837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022813838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022813838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022813838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022813839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022813839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022813839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:15.350047 run osmo-stp_10.42.42.5(pid=11965): stdout: | (launched: 2022-12-09_02:28:13.643173) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:15.480780 run osmo-stp_10.42.42.5(pid=11965): stderr: | 20221209022813837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022813838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022813838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022813838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022813839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022813839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022813839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:15.636848 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11965): Process ended prematurely: osmo-stp_10.42.42.5(pid=11965) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11965)] [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:28:15.646537 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:28:15.674756 run osmo-hlr_10.42.42.2(pid=11962): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11962)] 02:28:15.725052 run osmo-hlr_10.42.42.2(pid=11962): stdout: | (launched: 2022-12-09_02:28:12.618261) 02:28:15.776761 run osmo-hlr_10.42.42.2(pid=11962): stderr: | 20221209022812819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022812819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022812819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022812820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022812820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022812820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022812832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022812841 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022812841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022812841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:15.864255 run osmo-msc_10.42.42.6(pid=11968): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11968)] 02:28:15.915025 run osmo-msc_10.42.42.6(pid=11968): stdout: | (launched: 2022-12-09_02:28:14.692185) 02:28:15.968643 run osmo-msc_10.42.42.6(pid=11968): stderr: | 20221209022815020 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022815020 DLGLOBAL DEBUG validating counter group 0x7f41319c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022815020 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022815020 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022815020 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022815021 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022815022 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022815023 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022815023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022815023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:16.022831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11961): Terminating (SIGTERM) 02:28:16.065513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11964): Terminating (SIGTERM) 02:28:16.110264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11967): Terminating (SIGTERM) 02:28:16.155940 --- ParallelTerminationStrategy: PID 11961 died... 02:28:16.176025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11961): Terminated: ok {rc=0} 02:28:16.224754 --- ParallelTerminationStrategy: PID 11964 died... 02:28:16.244683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11964): Terminated: ok {rc=0} 02:28:16.292563 --- ParallelTerminationStrategy: PID 11967 died... 02:28:16.312339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11967): Terminated: ok {rc=0} 02:28:16.407332 bus /sierra_3: Setting Powered False 02:28:17.515125 bus /sierra_3: Setting Powered False 02:28:18.632084 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:28:19.780305 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:28:19.792267 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:28:19.862835 tst mo_mt_call_osmux.py: using LAC 18434 02:28:19.987065 tst mo_mt_call_osmux.py: using RAC 74 02:28:20.106715 tst mo_mt_call_osmux.py: using CellId 18434 02:28:20.227580 tst mo_mt_call_osmux.py: using BVCI 18435 02:28:20.340922 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:28:20.352256 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:28:20.363301 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:28:20.374369 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:28:20.385599 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:28:20.396680 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:28:20.516729 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:28:20.636191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:21.115398 run create_hlr_db(pid=11970): Launched 02:28:21.239998 bus /sierra_2: Setting Powered False 02:28:22.300402 run create_hlr_db(pid=11970): Terminated: ok {rc=0} 02:28:22.728764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11972): Launched 02:28:23.037099 run osmo-hlr_10.42.42.2(pid=11973): Launched 02:28:23.154244 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:23.681733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11975): Launched 02:28:23.988271 run osmo-stp_10.42.42.5(pid=11976): Launched 02:28:24.105812 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:24.662916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11978): Launched 02:28:24.970661 run osmo-msc_10.42.42.6(pid=11979): Launched 02:28:25.145220 run osmo-stp_10.42.42.5(pid=11976): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11976)] 02:28:25.275238 run osmo-stp_10.42.42.5(pid=11976): stdout: | (launched: 2022-12-09_02:28:23.932059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:25.405328 run osmo-stp_10.42.42.5(pid=11976): stderr: | 20221209022824104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022824104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022824104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022824104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022824105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022824105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022824105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:25.533155 run osmo-stp_10.42.42.5(pid=11976): stdout: | (launched: 2022-12-09_02:28:23.932059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:25.655349 run osmo-stp_10.42.42.5(pid=11976): stderr: | 20221209022824104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022824104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022824104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022824104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022824105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022824105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022824105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:25.802867 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11976): Process ended prematurely: osmo-stp_10.42.42.5(pid=11976) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11976)] [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:28:25.811742 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:28:25.837880 run osmo-hlr_10.42.42.2(pid=11973): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11973)] 02:28:25.885185 run osmo-hlr_10.42.42.2(pid=11973): stdout: | (launched: 2022-12-09_02:28:22.980507) 02:28:25.934265 run osmo-hlr_10.42.42.2(pid=11973): stderr: | 20221209022823158 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022823158 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022823158 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022823158 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022823158 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022823159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022823172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022823183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022823183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022823183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:26.002882 run osmo-msc_10.42.42.6(pid=11979): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11979)] 02:28:26.050137 run osmo-msc_10.42.42.6(pid=11979): stdout: | (launched: 2022-12-09_02:28:24.914208) 02:28:26.099049 run osmo-msc_10.42.42.6(pid=11979): stderr: | 20221209022825190 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022825190 DLGLOBAL DEBUG validating counter group 0x7fc3cdf13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022825190 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022825190 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022825190 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022825191 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022825192 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022825193 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022825193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022825193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:26.148068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11972): Terminating (SIGTERM) 02:28:26.187246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11975): Terminating (SIGTERM) 02:28:26.226564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11978): Terminating (SIGTERM) 02:28:26.266140 --- ParallelTerminationStrategy: PID 11972 died... 02:28:26.284883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11972): Terminated: ok {rc=0} 02:28:26.328680 --- ParallelTerminationStrategy: PID 11975 died... 02:28:26.347156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11975): Terminated: ok {rc=0} 02:28:26.390437 --- ParallelTerminationStrategy: PID 11978 died... 02:28:26.408782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11978): Terminated: ok {rc=0} 02:28:26.491595 bus /sierra_3: Setting Powered False 02:28:27.589632 bus /sierra_3: Setting Powered False 02:28:28.707697 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:28:29.956426 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:28:29.963118 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:28:29.996685 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:28:30.023541 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:28:30.075114 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:28:30.108181 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:28:30.134801 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:28:30.692536 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:28:30.741768 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:30.753049 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:28:30.822561 tst mo_mt_call.py: using LAC 18435 02:28:30.973271 tst mo_mt_call.py: using RAC 75 02:28:31.107204 tst mo_mt_call.py: using CellId 18435 02:28:31.241781 tst mo_mt_call.py: using BVCI 18436 02:28:31.369156 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:31.382225 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:31.396347 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:31.410258 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:31.423033 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:31.436682 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:28:31.565732 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:28:31.712232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:32.257973 run create_hlr_db(pid=11984): Launched 02:28:32.386842 bus /sierra_2: Setting Powered False 02:28:33.451844 run create_hlr_db(pid=11984): Terminated: ok {rc=0} 02:28:33.891040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11986): Launched 02:28:34.199282 run osmo-hlr_10.42.42.2(pid=11987): Launched 02:28:34.316351 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:34.858039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11989): Launched 02:28:35.164885 run osmo-stp_10.42.42.5(pid=11990): Launched 02:28:35.282125 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:35.837445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11992): Launched 02:28:36.145561 run osmo-msc_10.42.42.6(pid=11993): Launched 02:28:36.317982 run osmo-stp_10.42.42.5(pid=11990): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11990)] 02:28:36.448335 run osmo-stp_10.42.42.5(pid=11990): stdout: | (launched: 2022-12-09_02:28:35.108459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:36.577801 run osmo-stp_10.42.42.5(pid=11990): stderr: | 20221209022835279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022835279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022835279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022835280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022835282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022835282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022835282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:36.705260 run osmo-stp_10.42.42.5(pid=11990): stdout: | (launched: 2022-12-09_02:28:35.108459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:36.827420 run osmo-stp_10.42.42.5(pid=11990): stderr: | 20221209022835279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022835279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022835279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022835280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022835282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022835282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022835282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:36.973173 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11990): Process ended prematurely: osmo-stp_10.42.42.5(pid=11990) [trial-2353↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11990)] [trial-2353↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:28:36.981994 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:28:37.008301 run osmo-hlr_10.42.42.2(pid=11987): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11987)] 02:28:37.055976 run osmo-hlr_10.42.42.2(pid=11987): stdout: | (launched: 2022-12-09_02:28:34.142717) 02:28:37.105310 run osmo-hlr_10.42.42.2(pid=11987): stderr: | 20221209022834321 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022834321 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022834321 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022834321 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022834321 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022834321 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022834333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022834343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022834343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022834343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:37.174073 run osmo-msc_10.42.42.6(pid=11993): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11993)] 02:28:37.221489 run osmo-msc_10.42.42.6(pid=11993): stdout: | (launched: 2022-12-09_02:28:36.088244) 02:28:37.270673 run osmo-msc_10.42.42.6(pid=11993): stderr: | 20221209022836363 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022836363 DLGLOBAL DEBUG validating counter group 0x7f60823bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022836364 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022836364 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022836364 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022836364 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022836366 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022836366 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022836366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022836366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:37.320177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11986): Terminating (SIGTERM) 02:28:37.359780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11989): Terminating (SIGTERM) 02:28:37.399182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11992): Terminating (SIGTERM) 02:28:37.438845 --- ParallelTerminationStrategy: PID 11986 died... 02:28:37.457843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11986): Terminated: ok {rc=0} 02:28:37.501498 --- ParallelTerminationStrategy: PID 11989 died... 02:28:37.520145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11989): Terminated: ok {rc=0} 02:28:37.564068 --- ParallelTerminationStrategy: PID 11992 died... 02:28:37.582648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11992): Terminated: ok {rc=0} 02:28:37.668350 bus /sierra_3: Setting Powered False 02:28:38.767563 bus /sierra_3: Setting Powered False 02:28:39.884137 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:28:41.035498 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:41.048156 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:28:41.121156 tst mo_mt_call_osmux.py: using LAC 18436 02:28:41.251756 tst mo_mt_call_osmux.py: using RAC 76 02:28:41.381104 tst mo_mt_call_osmux.py: using CellId 18436 02:28:41.511760 tst mo_mt_call_osmux.py: using BVCI 18437 02:28:41.631943 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:41.643853 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:41.655714 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:41.667498 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:41.679502 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:41.691381 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:28:41.813204 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:28:41.933310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:42.413024 run create_hlr_db(pid=11995): Launched 02:28:42.540049 bus /sierra_2: Setting Powered False 02:28:43.602137 run create_hlr_db(pid=11995): Terminated: ok {rc=0} 02:28:44.031799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11997): Launched 02:28:44.340902 run osmo-hlr_10.42.42.2(pid=11998): Launched 02:28:44.458898 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:44.987723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12000): Launched 02:28:45.296210 run osmo-stp_10.42.42.5(pid=12001): Launched 02:28:45.414493 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:45.994567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12003): Launched 02:28:46.319899 run osmo-msc_10.42.42.6(pid=12004): Launched 02:28:46.731619 run osmo-stp_10.42.42.5(pid=12001): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12001)] 02:28:46.957516 run osmo-stp_10.42.42.5(pid=12001): stdout: | (launched: 2022-12-09_02:28:45.239865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:47.098706 run osmo-stp_10.42.42.5(pid=12001): stderr: | 20221209022845411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022845411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022845411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022845412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022845414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022845414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022845414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:47.240280 run osmo-stp_10.42.42.5(pid=12001): stdout: | (launched: 2022-12-09_02:28:45.239865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:47.372486 run osmo-stp_10.42.42.5(pid=12001): stderr: | 20221209022845411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022845411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022845411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022845412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022845414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022845414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022845414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:47.530544 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12001): Process ended prematurely: osmo-stp_10.42.42.5(pid=12001) [trial-2353↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12001)] [trial-2353↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:28:47.540393 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 02:28:47.569297 run osmo-hlr_10.42.42.2(pid=11998): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11998)] 02:28:47.620251 run osmo-hlr_10.42.42.2(pid=11998): stdout: | (launched: 2022-12-09_02:28:44.284449) 02:28:47.672872 run osmo-hlr_10.42.42.2(pid=11998): stderr: | 20221209022844464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022844464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022844464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022844464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022844464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022844464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022844476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022844486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022844486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022844486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:47.746204 run osmo-msc_10.42.42.6(pid=12004): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12004)] 02:28:47.797056 run osmo-msc_10.42.42.6(pid=12004): stdout: | (launched: 2022-12-09_02:28:46.261812) 02:28:47.849190 run osmo-msc_10.42.42.6(pid=12004): stderr: | 20221209022846693 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022846693 DLGLOBAL DEBUG validating counter group 0x7f57494a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022846693 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022846694 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022846694 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022846694 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022846697 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022846698 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022846698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022846698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:47.901744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11997): Terminating (SIGTERM) 02:28:47.944079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12000): Terminating (SIGTERM) 02:28:47.986640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12003): Terminating (SIGTERM) 02:28:48.029372 --- ParallelTerminationStrategy: PID 11997 died... 02:28:48.049631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11997): Terminated: ok {rc=0} 02:28:48.097083 --- ParallelTerminationStrategy: PID 12000 died... 02:28:48.116763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12000): Terminated: ok {rc=0} 02:28:48.163743 --- ParallelTerminationStrategy: PID 12003 died... 02:28:48.183593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12003): Terminated: ok {rc=0} 02:28:48.272408 bus /sierra_3: Setting Powered False 02:28:49.370444 bus /sierra_3: Setting Powered False 02:28:50.485747 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:28:51.740218 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:28:51.746621 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:28:51.782205 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:28:51.810082 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:28:51.863848 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:28:51.898329 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:28:51.926240 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:28:52.475282 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:28:52.528540 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:52.540278 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:28:52.612289 tst mo_mt_call.py: using LAC 18437 02:28:52.742771 tst mo_mt_call.py: using RAC 77 02:28:52.878955 tst mo_mt_call.py: using CellId 18437 02:28:53.009153 tst mo_mt_call.py: using BVCI 18438 02:28:53.130109 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:53.141721 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:53.153093 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:53.164707 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:53.176351 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:53.188002 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:28:53.309103 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:28:53.431246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:53.945103 run create_hlr_db(pid=12009): Launched 02:28:54.070456 bus /sierra_2: Setting Powered False 02:28:55.134910 run create_hlr_db(pid=12009): Terminated: ok {rc=0} 02:28:55.577264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12011): Launched 02:28:55.885641 run osmo-hlr_10.42.42.2(pid=12012): Launched 02:28:56.004397 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:56.554406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12014): Launched 02:28:56.863036 run osmo-stp_10.42.42.5(pid=12015): Launched 02:28:56.980770 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:57.538750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12017): Launched 02:28:57.847424 run osmo-msc_10.42.42.6(pid=12018): Launched 02:28:58.020437 run osmo-stp_10.42.42.5(pid=12015): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12015)] 02:28:58.152419 run osmo-stp_10.42.42.5(pid=12015): stdout: | (launched: 2022-12-09_02:28:56.806364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:58.281925 run osmo-stp_10.42.42.5(pid=12015): stderr: | 20221209022856979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022856979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022856980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022856980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022856981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022856981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022856981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:58.409597 run osmo-stp_10.42.42.5(pid=12015): stdout: | (launched: 2022-12-09_02:28:56.806364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:58.532191 run osmo-stp_10.42.42.5(pid=12015): stderr: | 20221209022856979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022856979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022856980 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022856980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022856981 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022856981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022856981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:58.678737 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12015): Process ended prematurely: osmo-stp_10.42.42.5(pid=12015) [trial-2353↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12015)] [trial-2353↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:28:58.687748 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:28:58.714031 run osmo-hlr_10.42.42.2(pid=12012): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12012)] 02:28:58.761838 run osmo-hlr_10.42.42.2(pid=12012): stdout: | (launched: 2022-12-09_02:28:55.828876) 02:28:58.811349 run osmo-hlr_10.42.42.2(pid=12012): stderr: | 20221209022856009 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022856009 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022856009 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022856009 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022856009 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022856009 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022856022 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022856030 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022856031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022856031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:58.880531 run osmo-msc_10.42.42.6(pid=12018): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12018)] 02:28:58.928631 run osmo-msc_10.42.42.6(pid=12018): stdout: | (launched: 2022-12-09_02:28:57.790747) 02:28:58.977941 run osmo-msc_10.42.42.6(pid=12018): stderr: | 20221209022858067 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022858067 DLGLOBAL DEBUG validating counter group 0x7f7c6389dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022858067 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022858067 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022858067 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022858067 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022858069 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022858069 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022858070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022858070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:59.027442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12011): Terminating (SIGTERM) 02:28:59.067205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12014): Terminating (SIGTERM) 02:28:59.106793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12017): Terminating (SIGTERM) 02:28:59.146952 --- ParallelTerminationStrategy: PID 12011 died... 02:28:59.166113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12011): Terminated: ok {rc=0} 02:28:59.210929 --- ParallelTerminationStrategy: PID 12014 died... 02:28:59.229722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12014): Terminated: ok {rc=0} 02:28:59.273743 --- ParallelTerminationStrategy: PID 12017 died... 02:28:59.292486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12017): Terminated: ok {rc=0} 02:28:59.378931 bus /sierra_3: Setting Powered False 02:29:00.477867 bus /sierra_3: Setting Powered False 02:29:01.594964 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:29:02.761468 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:29:02.773683 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:29:02.847053 tst mo_mt_call_osmux.py: using LAC 18438 02:29:02.976867 tst mo_mt_call_osmux.py: using RAC 78 02:29:03.107840 tst mo_mt_call_osmux.py: using CellId 18438 02:29:03.235976 tst mo_mt_call_osmux.py: using BVCI 18439 02:29:03.356504 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:29:03.368213 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:29:03.379705 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:29:03.391427 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:29:03.403397 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:29:03.415199 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:29:03.534773 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:29:03.655991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:04.169636 run create_hlr_db(pid=12020): Launched 02:29:04.296207 bus /sierra_2: Setting Powered False 02:29:05.362209 run create_hlr_db(pid=12020): Terminated: ok {rc=0} 02:29:05.800770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12022): Launched 02:29:06.111352 run osmo-hlr_10.42.42.2(pid=12023): Launched 02:29:06.229798 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:06.777123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12025): Launched 02:29:07.086310 run osmo-stp_10.42.42.5(pid=12026): Launched 02:29:07.204250 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:07.763357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12028): Launched 02:29:08.072295 run osmo-msc_10.42.42.6(pid=12029): Launched 02:29:08.246521 run osmo-stp_10.42.42.5(pid=12026): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12026)] 02:29:08.379566 run osmo-stp_10.42.42.5(pid=12026): stdout: | (launched: 2022-12-09_02:29:07.029769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:08.509339 run osmo-stp_10.42.42.5(pid=12026): stderr: | 20221209022907202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022907202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022907202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022907203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022907203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022907203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022907203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:08.637471 run osmo-stp_10.42.42.5(pid=12026): stdout: | (launched: 2022-12-09_02:29:07.029769) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:08.760114 run osmo-stp_10.42.42.5(pid=12026): stderr: | 20221209022907202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022907202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022907202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022907203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022907203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022907203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022907203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:08.907369 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12026): Process ended prematurely: osmo-stp_10.42.42.5(pid=12026) [trial-2353↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12026)] [trial-2353↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:29:08.916460 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:29:08.943518 run osmo-hlr_10.42.42.2(pid=12023): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12023)] 02:29:08.991840 run osmo-hlr_10.42.42.2(pid=12023): stdout: | (launched: 2022-12-09_02:29:06.054010) 02:29:09.041688 run osmo-hlr_10.42.42.2(pid=12023): stderr: | 20221209022906231 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022906231 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022906231 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022906232 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022906232 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022906232 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022906244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022906252 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022906252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022906252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:09.110968 run osmo-msc_10.42.42.6(pid=12029): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12029)] 02:29:09.158862 run osmo-msc_10.42.42.6(pid=12029): stdout: | (launched: 2022-12-09_02:29:08.015339) 02:29:09.208057 run osmo-msc_10.42.42.6(pid=12029): stderr: | 20221209022908291 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022908291 DLGLOBAL DEBUG validating counter group 0x7f400129bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022908291 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022908291 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022908291 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022908291 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022908293 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022908293 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022908294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022908294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:09.257934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12022): Terminating (SIGTERM) 02:29:09.297767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12025): Terminating (SIGTERM) 02:29:09.337748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12028): Terminating (SIGTERM) 02:29:09.378263 --- ParallelTerminationStrategy: PID 12022 died... 02:29:09.397489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12022): Terminated: ok {rc=0} 02:29:09.441842 --- ParallelTerminationStrategy: PID 12025 died... 02:29:09.460407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12025): Terminated: ok {rc=0} 02:29:09.504659 --- ParallelTerminationStrategy: PID 12028 died... 02:29:09.523420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12028): Terminated: ok {rc=0} 02:29:09.610189 bus /sierra_3: Setting Powered False 02:29:10.711177 bus /sierra_3: Setting Powered False 02:29:11.828803 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 02:29:13.080156 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:29:13.085154 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 02:29:13.118554 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 02:29:13.145490 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 02:29:13.198846 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 02:29:13.232615 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 02:29:13.259463 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 02:29:13.808139 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 02:29:13.858010 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:29:13.869261 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 02:29:13.923846 tst mo_mt_call.py: using LAC 18439 02:29:14.044884 tst mo_mt_call.py: using RAC 79 02:29:14.170607 tst mo_mt_call.py: using CellId 18439 02:29:14.292375 tst mo_mt_call.py: using BVCI 18440 02:29:14.404737 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:29:14.415892 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:29:14.426917 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:29:14.437991 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:29:14.448911 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:29:14.460038 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 02:29:14.579802 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 02:29:14.697187 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:15.179133 run create_hlr_db(pid=12034): Launched 02:29:15.304887 bus /sierra_2: Setting Powered False 02:29:16.367997 run create_hlr_db(pid=12034): Terminated: ok {rc=0} 02:29:16.807348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12036): Launched 02:29:17.183185 run osmo-hlr_10.42.42.2(pid=12037): Launched 02:29:17.312418 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:17.844375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12039): Launched 02:29:18.154867 run osmo-stp_10.42.42.5(pid=12040): Launched 02:29:18.272867 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:18.830095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12042): Launched 02:29:19.138827 run osmo-msc_10.42.42.6(pid=12043): Launched 02:29:19.310795 run osmo-stp_10.42.42.5(pid=12040): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12040)] 02:29:19.440453 run osmo-stp_10.42.42.5(pid=12040): stdout: | (launched: 2022-12-09_02:29:18.096438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:19.570538 run osmo-stp_10.42.42.5(pid=12040): stderr: | 20221209022918271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022918271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022918271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022918272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022918272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022918272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022918273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:19.697823 run osmo-stp_10.42.42.5(pid=12040): stdout: | (launched: 2022-12-09_02:29:18.096438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:19.819894 run osmo-stp_10.42.42.5(pid=12040): stderr: | 20221209022918271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022918271 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022918271 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022918272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022918272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022918272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022918273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:19.966198 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12040): Process ended prematurely: osmo-stp_10.42.42.5(pid=12040) [trial-2353↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12040)] [trial-2353↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 02:29:19.975067 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:29:20.001127 run osmo-hlr_10.42.42.2(pid=12037): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12037)] 02:29:20.048652 run osmo-hlr_10.42.42.2(pid=12037): stdout: | (launched: 2022-12-09_02:29:17.116765) 02:29:20.097796 run osmo-hlr_10.42.42.2(pid=12037): stderr: | 20221209022917312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022917312 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022917312 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022917312 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022917312 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022917312 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022917325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022917333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022917333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022917333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:20.166332 run osmo-msc_10.42.42.6(pid=12043): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12043)] 02:29:20.214525 run osmo-msc_10.42.42.6(pid=12043): stdout: | (launched: 2022-12-09_02:29:19.082187) 02:29:20.263511 run osmo-msc_10.42.42.6(pid=12043): stderr: | 20221209022919355 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022919355 DLGLOBAL DEBUG validating counter group 0x7fbd41672c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022919356 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022919356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022919356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022919356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022919359 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022919360 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022919360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022919360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:20.312759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12036): Terminating (SIGTERM) 02:29:20.352100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12039): Terminating (SIGTERM) 02:29:20.391622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12042): Terminating (SIGTERM) 02:29:20.431745 --- ParallelTerminationStrategy: PID 12036 died... 02:29:20.450840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12036): Terminated: ok {rc=0} 02:29:20.494869 --- ParallelTerminationStrategy: PID 12039 died... 02:29:20.513391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12039): Terminated: ok {rc=0} 02:29:20.557519 --- ParallelTerminationStrategy: PID 12042 died... 02:29:20.576311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12042): Terminated: ok {rc=0} 02:29:20.662015 bus /sierra_3: Setting Powered False 02:29:21.762684 bus /sierra_3: Setting Powered False 02:29:22.878276 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 02:29:24.026052 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:29:24.038024 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 02:29:24.088362 tst mo_mt_call_osmux.py: using LAC 18440 02:29:24.214358 tst mo_mt_call_osmux.py: using RAC 80 02:29:24.336174 tst mo_mt_call_osmux.py: using CellId 18440 02:29:24.456765 tst mo_mt_call_osmux.py: using BVCI 18441 02:29:24.570173 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:29:24.581333 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:29:24.592149 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:29:24.603117 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:29:24.614273 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:29:24.625318 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 02:29:24.745825 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 02:29:24.865940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:25.347696 run create_hlr_db(pid=12045): Launched 02:29:25.473523 bus /sierra_2: Setting Powered False 02:29:26.534613 run create_hlr_db(pid=12045): Terminated: ok {rc=0} 02:29:26.985160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12047): Launched 02:29:27.315291 run osmo-hlr_10.42.42.2(pid=12048): Launched 02:29:27.444807 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:28.013681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12050): Launched 02:29:28.344695 run osmo-stp_10.42.42.5(pid=12051): Launched 02:29:28.471732 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:29.070948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12053): Launched 02:29:29.402524 run osmo-msc_10.42.42.6(pid=12054): Launched 02:29:29.588815 run osmo-stp_10.42.42.5(pid=12051): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12051)] 02:29:29.728096 run osmo-stp_10.42.42.5(pid=12051): stdout: | (launched: 2022-12-09_02:29:28.284238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:29.867846 run osmo-stp_10.42.42.5(pid=12051): stderr: | 20221209022928481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022928481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022928481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022928482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022928482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022928482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022928482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:30.005737 run osmo-stp_10.42.42.5(pid=12051): stdout: | (launched: 2022-12-09_02:29:28.284238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:30.137503 run osmo-stp_10.42.42.5(pid=12051): stderr: | 20221209022928481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022928481 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022928481 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022928482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022928482 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022928482 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022928482 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:30.295646 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12051): Process ended prematurely: osmo-stp_10.42.42.5(pid=12051) [trial-2353↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12051)] [trial-2353↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 02:29:30.305527 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:29:30.334207 run osmo-hlr_10.42.42.2(pid=12048): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12048)] 02:29:30.385363 run osmo-hlr_10.42.42.2(pid=12048): stdout: | (launched: 2022-12-09_02:29:27.255298) 02:29:30.437652 run osmo-hlr_10.42.42.2(pid=12048): stderr: | 20221209022927456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022927456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022927456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022927456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022927456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022927456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022927468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022927477 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022927478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022927478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:30.510392 run osmo-msc_10.42.42.6(pid=12054): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12054)] 02:29:30.561109 run osmo-msc_10.42.42.6(pid=12054): stdout: | (launched: 2022-12-09_02:29:29.342140) 02:29:30.613118 run osmo-msc_10.42.42.6(pid=12054): stderr: | 20221209022929665 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022929665 DLGLOBAL DEBUG validating counter group 0x7f097623cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022929665 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022929665 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022929666 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022929666 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022929667 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022929668 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022929668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022929668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:30.665349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12047): Terminating (SIGTERM) 02:29:30.707500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12050): Terminating (SIGTERM) 02:29:30.749751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12053): Terminating (SIGTERM) 02:29:30.792118 --- ParallelTerminationStrategy: PID 12047 died... 02:29:30.812236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12047): Terminated: ok {rc=0} 02:29:30.875187 --- ParallelTerminationStrategy: PID 12050 died... 02:29:30.895269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12050): Terminated: ok {rc=0} 02:29:30.942878 --- ParallelTerminationStrategy: PID 12053 died... 02:29:30.963552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12053): Terminated: ok {rc=0} 02:29:31.056150 bus /sierra_3: Setting Powered False 02:29:32.156367 bus /sierra_3: Setting Powered False 02:29:33.277606 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 02:29:34.529469 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:29:34.535465 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 02:29:34.569239 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 02:29:34.596104 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 02:29:34.648200 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 02:29:34.681485 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 02:29:34.708284 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 02:29:35.261702 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 02:29:35.311303 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:35.323056 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:29:35.378313 tst mo_mt_call.py: using LAC 18441 02:29:35.499546 tst mo_mt_call.py: using RAC 81 02:29:35.630174 tst mo_mt_call.py: using CellId 18441 02:29:35.759574 tst mo_mt_call.py: using BVCI 18442 02:29:35.880042 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:35.892112 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:35.903999 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:35.916172 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:35.928106 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:35.940017 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:29:36.060000 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:29:36.182761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:36.665538 run create_hlr_db(pid=12059): Launched 02:29:36.791380 bus /sierra_2: Setting Powered False 02:29:37.852273 run create_hlr_db(pid=12059): Terminated: ok {rc=0} 02:29:38.283289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12061): Launched 02:29:38.593025 run osmo-hlr_10.42.42.2(pid=12062): Launched 02:29:38.711205 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:39.260634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12064): Launched 02:29:39.569596 run osmo-stp_10.42.42.5(pid=12065): Launched 02:29:39.687362 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:40.246651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12067): Launched 02:29:40.557160 run osmo-msc_10.42.42.6(pid=12068): Launched 02:29:40.729929 run osmo-stp_10.42.42.5(pid=12065): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12065)] 02:29:40.861323 run osmo-stp_10.42.42.5(pid=12065): stdout: | (launched: 2022-12-09_02:29:39.512830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:40.991593 run osmo-stp_10.42.42.5(pid=12065): stderr: | 20221209022939685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022939685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022939685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022939686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022939686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022939686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022939686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:41.119589 run osmo-stp_10.42.42.5(pid=12065): stdout: | (launched: 2022-12-09_02:29:39.512830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:41.242352 run osmo-stp_10.42.42.5(pid=12065): stderr: | 20221209022939685 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022939685 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022939685 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022939686 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022939686 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022939686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022939686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:41.389177 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12065): Process ended prematurely: osmo-stp_10.42.42.5(pid=12065) [trial-2353↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12065)] [trial-2353↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 02:29:41.398466 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:29:41.424903 run osmo-hlr_10.42.42.2(pid=12062): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12062)] 02:29:41.472536 run osmo-hlr_10.42.42.2(pid=12062): stdout: | (launched: 2022-12-09_02:29:38.536406) 02:29:41.522060 run osmo-hlr_10.42.42.2(pid=12062): stderr: | 20221209022938717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022938717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022938717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022938717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022938717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022938717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022938729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022938739 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022938740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022938740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:41.590632 run osmo-msc_10.42.42.6(pid=12068): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12068)] 02:29:41.637993 run osmo-msc_10.42.42.6(pid=12068): stdout: | (launched: 2022-12-09_02:29:40.499168) 02:29:41.687021 run osmo-msc_10.42.42.6(pid=12068): stderr: | 20221209022940772 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022940772 DLGLOBAL DEBUG validating counter group 0x7f0db18b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022940772 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022940772 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022940773 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022940773 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022940774 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022940775 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022940775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022940775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:41.736486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12061): Terminating (SIGTERM) 02:29:41.776074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12064): Terminating (SIGTERM) 02:29:41.815762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12067): Terminating (SIGTERM) 02:29:41.855613 --- ParallelTerminationStrategy: PID 12061 died... 02:29:41.874701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12061): Terminated: ok {rc=0} 02:29:41.918760 --- ParallelTerminationStrategy: PID 12064 died... 02:29:41.937268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12064): Terminated: ok {rc=0} 02:29:41.981607 --- ParallelTerminationStrategy: PID 12067 died... 02:29:42.000171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12067): Terminated: ok {rc=0} 02:29:42.083271 bus /sierra_3: Setting Powered False 02:29:43.178264 bus /sierra_3: Setting Powered False 02:29:44.290993 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 02:29:45.434099 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:45.446337 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:29:45.500321 tst mo_mt_call_osmux.py: using LAC 18442 02:29:45.629756 tst mo_mt_call_osmux.py: using RAC 82 02:29:45.752734 tst mo_mt_call_osmux.py: using CellId 18442 02:29:45.876023 tst mo_mt_call_osmux.py: using BVCI 18443 02:29:46.018275 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:46.031310 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:46.045177 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:46.059878 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:46.073718 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:46.086669 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:29:46.211312 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:29:46.374844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:46.871171 run create_hlr_db(pid=12070): Launched 02:29:47.030580 bus /sierra_2: Setting Powered False 02:29:48.091607 run create_hlr_db(pid=12070): Terminated: ok {rc=0} 02:29:48.522700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12072): Launched 02:29:48.830943 run osmo-hlr_10.42.42.2(pid=12073): Launched 02:29:48.947731 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:49.494206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12075): Launched 02:29:49.802100 run osmo-stp_10.42.42.5(pid=12076): Launched 02:29:49.922315 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:50.480784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12078): Launched 02:29:50.790126 run osmo-msc_10.42.42.6(pid=12079): Launched 02:29:50.962553 run osmo-stp_10.42.42.5(pid=12076): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12076)] 02:29:51.092572 run osmo-stp_10.42.42.5(pid=12076): stdout: | (launched: 2022-12-09_02:29:49.745582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:51.222031 run osmo-stp_10.42.42.5(pid=12076): stderr: | 20221209022949917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022949917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022949917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022949917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022949918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022949918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022949918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:51.349631 run osmo-stp_10.42.42.5(pid=12076): stdout: | (launched: 2022-12-09_02:29:49.745582) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:51.471889 run osmo-stp_10.42.42.5(pid=12076): stderr: | 20221209022949917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209022949917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209022949917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209022949917 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209022949918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209022949918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209022949918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:51.618479 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12076): Process ended prematurely: osmo-stp_10.42.42.5(pid=12076) [trial-2353↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12076)] [trial-2353↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 02:29:51.627422 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:29:51.653842 run osmo-hlr_10.42.42.2(pid=12073): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12073)] 02:29:51.701706 run osmo-hlr_10.42.42.2(pid=12073): stdout: | (launched: 2022-12-09_02:29:48.774472) 02:29:51.751130 run osmo-hlr_10.42.42.2(pid=12073): stderr: | 20221209022948951 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022948951 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022948951 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022948951 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022948951 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022948951 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022948963 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022948974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022948974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022948975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:51.820115 run osmo-msc_10.42.42.6(pid=12079): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12079)] 02:29:51.867685 run osmo-msc_10.42.42.6(pid=12079): stdout: | (launched: 2022-12-09_02:29:50.733211) 02:29:51.916672 run osmo-msc_10.42.42.6(pid=12079): stderr: | 20221209022951008 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209022951008 DLGLOBAL DEBUG validating counter group 0x7f60534c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209022951008 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209022951008 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209022951008 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209022951008 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209022951010 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209022951010 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209022951011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209022951011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:51.966680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12072): Terminating (SIGTERM) 02:29:52.006356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12075): Terminating (SIGTERM) 02:29:52.046097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12078): Terminating (SIGTERM) 02:29:52.086191 --- ParallelTerminationStrategy: PID 12072 died... 02:29:52.105450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12072): Terminated: ok {rc=0} 02:29:52.149335 --- ParallelTerminationStrategy: PID 12075 died... 02:29:52.167925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12075): Terminated: ok {rc=0} 02:29:52.211630 --- ParallelTerminationStrategy: PID 12078 died... 02:29:52.230332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12078): Terminated: ok {rc=0} 02:29:52.313774 bus /sierra_3: Setting Powered False 02:29:53.413137 bus /sierra_3: Setting Powered False 02:29:54.528198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 emergency:trx-b200 --------------------------------------------------------------------- 02:29:55.782496 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:29:55.786931 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 02:29:55.819941 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 02:29:55.846844 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 02:29:55.931757 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 02:29:55.965085 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 02:29:55.991599 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 02:29:56.576457 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2353 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 02:29:56.581478 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:56.592126 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 02:29:56.641304 tst emergency_mo_mt_call.py: using LAC 18443 02:29:56.760929 tst emergency_mo_mt_call.py: using RAC 83 02:29:56.884790 tst emergency_mo_mt_call.py: using CellId 18443 02:29:57.004834 tst emergency_mo_mt_call.py: using BVCI 18444 02:29:57.115072 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:57.126052 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:57.136667 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:57.147294 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:57.157881 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:57.168353 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:57.284349 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:57.405686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:57.910165 run create_hlr_db(pid=12084): Launched 02:29:58.034882 bus /sierra_2: Setting Powered False 02:29:59.098276 run create_hlr_db(pid=12084): Terminated: ok {rc=0} 02:29:59.534449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12086): Launched 02:29:59.837424 run osmo-hlr_10.42.42.2(pid=12087): Launched 02:29:59.952800 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:00.490103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12089): Launched 02:30:00.794903 run osmo-stp_10.42.42.5(pid=12090): Launched 02:30:00.929190 tst emergency_mo_mt_call.py: using MSISDN 6981 02:30:01.277718 run osmo-msc_10.42.42.6: Starting osmo-msc 02:30:01.966201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12095): Launched 02:30:02.282756 run osmo-msc_10.42.42.6(pid=12096): Launched 02:30:02.497118 run osmo-stp_10.42.42.5(pid=12090): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12090)] 02:30:02.626935 run osmo-stp_10.42.42.5(pid=12090): stdout: | (launched: 2022-12-09_02:30:00.738932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:02.755562 run osmo-stp_10.42.42.5(pid=12090): stderr: | 20221209023001013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023001013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023001014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023001014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023001014 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023001014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023001015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:02.881897 run osmo-stp_10.42.42.5(pid=12090): stdout: | (launched: 2022-12-09_02:30:00.738932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:03.002485 run osmo-stp_10.42.42.5(pid=12090): stderr: | 20221209023001013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023001013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023001014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023001014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023001014 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023001014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023001015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:03.146786 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12090): Process ended prematurely: osmo-stp_10.42.42.5(pid=12090) [trial-2353↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12090)] [trial-2353↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 02:30:03.155215 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 02:30:03.181378 run osmo-hlr_10.42.42.2(pid=12087): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12087)] 02:30:03.229141 run osmo-hlr_10.42.42.2(pid=12087): stdout: | (launched: 2022-12-09_02:29:59.781574) 02:30:03.278563 run osmo-hlr_10.42.42.2(pid=12087): stderr: | 20221209022959962 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209022959962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209022959962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209022959963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209022959963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209022959963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209022959975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209022959985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209022959986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209022959986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:03.348065 run osmo-msc_10.42.42.6(pid=12096): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12096)] 02:30:03.395737 run osmo-msc_10.42.42.6(pid=12096): stdout: | (launched: 2022-12-09_02:30:02.225816) 02:30:03.445189 run osmo-msc_10.42.42.6(pid=12096): stderr: | 20221209023002577 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023002577 DLGLOBAL DEBUG validating counter group 0x7f1aea3d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023002578 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023002578 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023002578 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023002578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023002580 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023002581 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023002581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023002581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:30:03.494408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12086): Terminating (SIGTERM) 02:30:03.534065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12089): Terminating (SIGTERM) 02:30:03.573693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12095): Terminating (SIGTERM) 02:30:03.613617 --- ParallelTerminationStrategy: PID 12086 died... 02:30:03.632664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12086): Terminated: ok {rc=0} 02:30:03.676455 --- ParallelTerminationStrategy: PID 12089 died... 02:30:03.695033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12089): Terminated: ok {rc=0} 02:30:03.738595 --- ParallelTerminationStrategy: PID 12095 died... 02:30:03.757147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12095): Terminated: ok {rc=0} 02:30:03.842923 bus /sierra_3: Setting Powered False 02:30:04.941705 bus /sierra_3: Setting Powered False 02:30:06.057457 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 02:30:07.145391 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:30:07.156814 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 02:30:07.208170 tst emergency_preemptive_call.py: using LAC 18444 02:30:07.328504 tst emergency_preemptive_call.py: using RAC 84 02:30:07.447515 tst emergency_preemptive_call.py: using CellId 18444 02:30:07.568345 tst emergency_preemptive_call.py: using BVCI 18445 02:30:07.679572 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:30:07.690550 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:30:07.701185 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:30:07.711760 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:30:07.722398 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:30:07.733201 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:30:07.853994 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:30:07.975854 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:30:08.096336 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:30:08.217876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:08.723933 run create_hlr_db(pid=12098): Launched 02:30:08.848560 bus /sierra_2: Setting Powered False 02:30:09.912624 run create_hlr_db(pid=12098): Terminated: ok {rc=0} 02:30:10.347093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12100): Launched 02:30:10.653146 run osmo-hlr_10.42.42.2(pid=12101): Launched 02:30:10.768333 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:11.289193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12103): Launched 02:30:11.592222 run osmo-stp_10.42.42.5(pid=12104): Launched 02:30:11.717240 tst emergency_preemptive_call.py: using MSISDN 6982 02:30:11.871709 run osmo-msc_10.42.42.6: Starting osmo-msc 02:30:12.414565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12106): Launched 02:30:12.717136 run osmo-msc_10.42.42.6(pid=12107): Launched 02:30:12.886089 run osmo-stp_10.42.42.5(pid=12104): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12104)] 02:30:13.014114 run osmo-stp_10.42.42.5(pid=12104): stdout: | (launched: 2022-12-09_02:30:11.536242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:13.141649 run osmo-stp_10.42.42.5(pid=12104): stderr: | 20221209023011707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023011707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023011708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023011708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023011708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023011709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023011709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:13.267602 run osmo-stp_10.42.42.5(pid=12104): stdout: | (launched: 2022-12-09_02:30:11.536242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:13.387451 run osmo-stp_10.42.42.5(pid=12104): stderr: | 20221209023011707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023011707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023011708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023011708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023011708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023011709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023011709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:13.531392 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12104): Process ended prematurely: osmo-stp_10.42.42.5(pid=12104) [trial-2353↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12104)] [trial-2353↪emergency:trx-b200↪emergency_preemptive_call.py:32] 02:30:13.539850 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 02:30:13.566557 run osmo-hlr_10.42.42.2(pid=12101): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12101)] 02:30:13.614797 run osmo-hlr_10.42.42.2(pid=12101): stdout: | (launched: 2022-12-09_02:30:10.597157) 02:30:13.664657 run osmo-hlr_10.42.42.2(pid=12101): stderr: | 20221209023010776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023010776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023010776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023010776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023010776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023010776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023010790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023010799 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023010799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023010799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:13.734573 run osmo-msc_10.42.42.6(pid=12107): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12107)] 02:30:13.782742 run osmo-msc_10.42.42.6(pid=12107): stdout: | (launched: 2022-12-09_02:30:12.661413) 02:30:13.832479 run osmo-msc_10.42.42.6(pid=12107): stderr: | 20221209023012933 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023012933 DLGLOBAL DEBUG validating counter group 0x7fcc1a403c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023012934 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023012934 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023012934 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023012934 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023012936 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023012937 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023012937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023012937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:30:13.882357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12100): Terminating (SIGTERM) 02:30:13.922194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12103): Terminating (SIGTERM) 02:30:13.961945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12106): Terminating (SIGTERM) 02:30:14.002150 --- ParallelTerminationStrategy: PID 12100 died... 02:30:14.020921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12100): Terminated: ok {rc=0} 02:30:14.065215 --- ParallelTerminationStrategy: PID 12103 died... 02:30:14.083836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12103): Terminated: ok {rc=0} 02:30:14.127898 --- ParallelTerminationStrategy: PID 12106 died... 02:30:14.146611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12106): Terminated: ok {rc=0} 02:30:14.232524 bus /sierra_9: Setting Powered False 02:30:15.332029 bus /sierra_9: Setting Powered False 02:30:16.453298 bus /sierra_8: Setting Powered False 02:30:17.560673 bus /sierra_8: Setting Powered False 02:30:18.677695 bus /sierra_3: Setting Powered False 02:30:19.776506 bus /sierra_3: Setting Powered False 02:30:20.894911 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-b200 --------------------------------------------------------------------- 02:30:22.181059 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:30:22.185904 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 02:30:22.221080 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 02:30:22.260793 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 02:30:22.350429 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 02:30:22.384820 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 02:30:22.424402 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 02:30:23.020039 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 02:30:23.076545 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:23.087799 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:30:23.136732 tst cs_paging_gprs_active.py: using LAC 18445 02:30:23.265144 tst cs_paging_gprs_active.py: using RAC 85 02:30:23.394484 tst cs_paging_gprs_active.py: using CellId 18445 02:30:23.522149 tst cs_paging_gprs_active.py: using BVCI 18446 02:30:23.642203 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:23.653482 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:23.664426 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:23.675753 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:23.686953 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:23.698200 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:23.709682 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:23.720854 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:23.732182 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:23.855935 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:23.976298 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:30:24.201089 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:24.534549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12112): Launched 02:30:24.824680 run iperf3-srv_10.42.42.10(pid=12113): Launched 02:30:24.948546 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:30:25.171931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:25.504731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12114): Launched 02:30:25.793551 run iperf3-srv_10.42.42.10(pid=12115): Launched 02:30:25.917698 tst cs_paging_gprs_active.py:38: start network... 02:30:26.140838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:26.654669 run create_hlr_db(pid=12116): Launched 02:30:26.780929 bus /sierra_2: Setting Powered False 02:30:27.846056 run create_hlr_db(pid=12116): Terminated: ok {rc=0} 02:30:28.287546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12118): Launched 02:30:28.598889 run osmo-hlr_10.42.42.2(pid=12119): Launched 02:30:28.718656 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:29.264604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12121): Launched 02:30:29.573651 run osmo-stp_10.42.42.5(pid=12122): Launched 02:30:29.691590 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:30.226822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12124): Launched 02:30:30.345190 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:30.607793 run patchelf(pid=12125): Launched 02:30:30.780161 run osmo-stp_10.42.42.5(pid=12122): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12122)] 02:30:30.921155 run osmo-stp_10.42.42.5(pid=12122): stdout: | (launched: 2022-12-09_02:30:29.517148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:31.055608 run osmo-stp_10.42.42.5(pid=12122): stderr: | 20221209023029688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023029688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023029688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023029689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023029689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023029689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023029689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:31.191174 run osmo-stp_10.42.42.5(pid=12122): stdout: | (launched: 2022-12-09_02:30:29.517148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:31.321544 run osmo-stp_10.42.42.5(pid=12122): stderr: | 20221209023029688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023029688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023029688 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023029689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023029689 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023029689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023029689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:31.475364 run patchelf(pid=12125): Terminating (SIGINT) 02:30:31.651642 run patchelf(pid=12125): Terminated: ok {rc=0} 02:30:31.779189 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12122): Process ended prematurely: osmo-stp_10.42.42.5(pid=12122) [trial-2353↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12122)] [trial-2353↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 02:30:31.789590 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 02:30:31.818588 run osmo-hlr_10.42.42.2(pid=12119): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12119)] 02:30:31.867675 run osmo-hlr_10.42.42.2(pid=12119): stdout: | (launched: 2022-12-09_02:30:28.541301) 02:30:31.918500 run osmo-hlr_10.42.42.2(pid=12119): stderr: | 20221209023028717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023028717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023028717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023028717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023028717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023028717 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023028729 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023028737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023028737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023028738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:31.972289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12112): Terminating (SIGTERM) 02:30:32.029287 run iperf3-srv_10.42.42.10(pid=12113): Terminating (SIGTERM) 02:30:32.082959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12114): Terminating (SIGTERM) 02:30:32.125393 run iperf3-srv_10.42.42.10(pid=12115): Terminating (SIGTERM) 02:30:32.169243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12118): Terminating (SIGTERM) 02:30:32.210413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12121): Terminating (SIGTERM) 02:30:32.251057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12124): Terminating (SIGTERM) 02:30:32.292397 --- ParallelTerminationStrategy: PID 12112 died... 02:30:32.311679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12112): Terminated: ok {rc=0} 02:30:32.356371 --- ParallelTerminationStrategy: PID 12113 died... 02:30:32.375246 run iperf3-srv_10.42.42.10(pid=12113): Terminated {rc=256} 02:30:32.419209 --- ParallelTerminationStrategy: PID 12114 died... 02:30:32.437784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12114): Terminated: ok {rc=0} 02:30:32.482131 --- ParallelTerminationStrategy: PID 12115 died... 02:30:32.500721 run iperf3-srv_10.42.42.10(pid=12115): Terminated {rc=256} 02:30:32.544637 --- ParallelTerminationStrategy: PID 12118 died... 02:30:32.563415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12118): Terminated: ok {rc=0} 02:30:32.607190 --- ParallelTerminationStrategy: PID 12121 died... 02:30:32.625694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12121): Terminated: ok {rc=0} 02:30:32.669651 --- ParallelTerminationStrategy: PID 12124 died... 02:30:32.688512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12124): Terminated: ok {rc=0} 02:30:32.774618 bus /gobi_0: Setting Powered False 02:30:33.874733 bus /gobi_0: Setting Powered False 02:30:34.991562 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200 iperf3.py ---------------------------------------------- 02:30:36.143899 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:36.155989 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:30:36.212908 tst iperf3.py: using LAC 18446 02:30:36.342895 tst iperf3.py: using RAC 86 02:30:36.472238 tst iperf3.py: using CellId 18446 02:30:36.602214 tst iperf3.py: using BVCI 18447 02:30:36.723963 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:36.735510 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:36.746767 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:36.758467 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:36.770053 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:36.781653 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:36.793649 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:36.805516 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:36.817786 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:36.935570 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:30:37.159314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:37.491416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12126): Launched 02:30:37.781729 run iperf3-srv_10.42.42.10(pid=12127): Launched 02:30:37.905968 tst iperf3.py:8: start network... 02:30:38.129988 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:38.642732 run create_hlr_db(pid=12128): Launched 02:30:38.769054 bus /gobi_6: Setting Powered False 02:30:39.834011 run create_hlr_db(pid=12128): Terminated: ok {rc=0} 02:30:40.290727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12130): Launched 02:30:40.619371 run osmo-hlr_10.42.42.2(pid=12131): Launched 02:30:40.746118 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:41.316260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12133): Launched 02:30:41.647716 run osmo-stp_10.42.42.5(pid=12134): Launched 02:30:41.774712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:42.359899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12136): Launched 02:30:42.477825 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:42.739342 run patchelf(pid=12137): Launched 02:30:42.911735 run osmo-stp_10.42.42.5(pid=12134): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12134)] 02:30:43.042364 run osmo-stp_10.42.42.5(pid=12134): stdout: | (launched: 2022-12-09_02:30:41.587168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:43.174649 run osmo-stp_10.42.42.5(pid=12134): stderr: | 20221209023041780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023041780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023041780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023041781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023041783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023041783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023041783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:43.307110 run osmo-stp_10.42.42.5(pid=12134): stdout: | (launched: 2022-12-09_02:30:41.587168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:43.433916 run osmo-stp_10.42.42.5(pid=12134): stderr: | 20221209023041780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023041780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023041780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023041781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023041783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023041783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023041783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:43.583860 run patchelf(pid=12137): Terminating (SIGINT) 02:30:43.756642 run patchelf(pid=12137): Terminated: ok {rc=0} 02:30:43.881356 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12134): Process ended prematurely: osmo-stp_10.42.42.5(pid=12134) [trial-2353↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12134)] [trial-2353↪gprs:trx-b200↪iperf3.py:8] 02:30:43.890702 tst iperf3.py:8: Test FAILED (7.8 sec) 02:30:43.917904 run osmo-hlr_10.42.42.2(pid=12131): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12131)] 02:30:43.965698 run osmo-hlr_10.42.42.2(pid=12131): stdout: | (launched: 2022-12-09_02:30:40.559645) 02:30:44.014747 run osmo-hlr_10.42.42.2(pid=12131): stderr: | 20221209023040759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023040759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023040759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023040759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023040760 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023040760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023040781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023040790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023040790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023040790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:44.064202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12126): Terminating (SIGTERM) 02:30:44.104272 run iperf3-srv_10.42.42.10(pid=12127): Terminating (SIGTERM) 02:30:44.144376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12130): Terminating (SIGTERM) 02:30:44.184439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12133): Terminating (SIGTERM) 02:30:44.224349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12136): Terminating (SIGTERM) 02:30:44.264661 --- ParallelTerminationStrategy: PID 12126 died... 02:30:44.284206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12126): Terminated: ok {rc=0} 02:30:44.328628 --- ParallelTerminationStrategy: PID 12127 died... 02:30:44.347402 run iperf3-srv_10.42.42.10(pid=12127): Terminated {rc=256} 02:30:44.391818 --- ParallelTerminationStrategy: PID 12130 died... 02:30:44.410614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12130): Terminated: ok {rc=0} 02:30:44.454688 --- ParallelTerminationStrategy: PID 12133 died... 02:30:44.473471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12133): Terminated: ok {rc=0} 02:30:44.517618 --- ParallelTerminationStrategy: PID 12136 died... 02:30:44.536353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12136): Terminated: ok {rc=0} 02:30:44.622514 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 02:30:45.772058 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:45.788216 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:30:45.838622 tst iperf3m4.py: using LAC 18447 02:30:45.986483 tst iperf3m4.py: using RAC 87 02:30:46.129189 tst iperf3m4.py: using CellId 18447 02:30:46.261697 tst iperf3m4.py: using BVCI 18448 02:30:46.390718 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.404402 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.417654 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.429764 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.443570 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.455732 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.469262 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.483345 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.495465 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:46.627809 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:46.770609 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:46.916503 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:47.051795 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:30:47.288279 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:47.624687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12138): Launched 02:30:47.912858 run iperf3-srv_10.42.42.10(pid=12139): Launched 02:30:48.036639 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:30:48.259677 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:48.593285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12140): Launched 02:30:48.881838 run iperf3-srv_10.42.42.10(pid=12141): Launched 02:30:49.005724 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:30:49.228149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:49.560247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12142): Launched 02:30:49.847378 run iperf3-srv_10.42.42.10(pid=12143): Launched 02:30:49.972254 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:30:50.195533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:50.529450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12144): Launched 02:30:50.816535 run iperf3-srv_10.42.42.10(pid=12145): Launched 02:30:50.940305 tst iperf3m4.py:8: start network... 02:30:51.163302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:51.677650 run create_hlr_db(pid=12146): Launched 02:30:51.805157 bus /gobi_6: Setting Powered False 02:30:52.869082 run create_hlr_db(pid=12146): Terminated: ok {rc=0} 02:30:53.309172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12148): Launched 02:30:53.617860 run osmo-hlr_10.42.42.2(pid=12149): Launched 02:30:53.735625 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:54.269690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12151): Launched 02:30:54.580386 run osmo-stp_10.42.42.5(pid=12152): Launched 02:30:54.699396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:55.233335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12154): Launched 02:30:55.351373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:55.613655 run patchelf(pid=12155): Launched 02:30:55.785159 run osmo-stp_10.42.42.5(pid=12152): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12152)] 02:30:55.916707 run osmo-stp_10.42.42.5(pid=12152): stdout: | (launched: 2022-12-09_02:30:54.522902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:56.049445 run osmo-stp_10.42.42.5(pid=12152): stderr: | 20221209023054697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023054697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023054697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023054697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023054698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023054698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023054698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:56.182116 run osmo-stp_10.42.42.5(pid=12152): stdout: | (launched: 2022-12-09_02:30:54.522902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:56.308734 run osmo-stp_10.42.42.5(pid=12152): stderr: | 20221209023054697 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023054697 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023054697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023054697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023054698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023054698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023054698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:56.459651 run patchelf(pid=12155): Terminating (SIGINT) 02:30:56.633442 run patchelf(pid=12155): Terminated: ok {rc=0} 02:30:56.758592 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12152): Process ended prematurely: osmo-stp_10.42.42.5(pid=12152) [trial-2353↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12152)] [trial-2353↪gprs:trx-b200↪iperf3m4.py:8] 02:30:56.768050 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:30:56.795679 run osmo-hlr_10.42.42.2(pid=12149): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12149)] 02:30:56.843710 run osmo-hlr_10.42.42.2(pid=12149): stdout: | (launched: 2022-12-09_02:30:53.561275) 02:30:56.893456 run osmo-hlr_10.42.42.2(pid=12149): stderr: | 20221209023053739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023053739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023053739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023053739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023053739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023053739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023053752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023053762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023053762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023053762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:56.943848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12138): Terminating (SIGTERM) 02:30:56.984645 run iperf3-srv_10.42.42.10(pid=12139): Terminating (SIGTERM) 02:30:57.024878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12140): Terminating (SIGTERM) 02:30:57.065494 run iperf3-srv_10.42.42.10(pid=12141): Terminating (SIGTERM) 02:30:57.105913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12142): Terminating (SIGTERM) 02:30:57.146354 run iperf3-srv_10.42.42.10(pid=12143): Terminating (SIGTERM) 02:30:57.186671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12144): Terminating (SIGTERM) 02:30:57.226928 run iperf3-srv_10.42.42.10(pid=12145): Terminating (SIGTERM) 02:30:57.267130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12148): Terminating (SIGTERM) 02:30:57.307523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12151): Terminating (SIGTERM) 02:30:57.347809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12154): Terminating (SIGTERM) 02:30:57.388358 --- ParallelTerminationStrategy: PID 12138 died... 02:30:57.407767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12138): Terminated: ok {rc=0} 02:30:57.452639 --- ParallelTerminationStrategy: PID 12139 died... 02:30:57.471639 run iperf3-srv_10.42.42.10(pid=12139): Terminated {rc=256} 02:30:57.521636 --- ParallelTerminationStrategy: PID 12140 died... 02:30:57.541741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12140): Terminated: ok {rc=0} 02:30:57.589224 --- ParallelTerminationStrategy: PID 12141 died... 02:30:57.608862 run iperf3-srv_10.42.42.10(pid=12141): Terminated {rc=256} 02:30:57.655776 --- ParallelTerminationStrategy: PID 12142 died... 02:30:57.675677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12142): Terminated: ok {rc=0} 02:30:57.722834 --- ParallelTerminationStrategy: PID 12143 died... 02:30:57.742528 run iperf3-srv_10.42.42.10(pid=12143): Terminated {rc=256} 02:30:57.789801 --- ParallelTerminationStrategy: PID 12144 died... 02:30:57.809537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12144): Terminated: ok {rc=0} 02:30:57.856452 --- ParallelTerminationStrategy: PID 12145 died... 02:30:57.876331 run iperf3-srv_10.42.42.10(pid=12145): Terminated {rc=256} 02:30:57.923348 --- ParallelTerminationStrategy: PID 12148 died... 02:30:57.943128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12148): Terminated: ok {rc=0} 02:30:57.990083 --- ParallelTerminationStrategy: PID 12151 died... 02:30:58.010041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12151): Terminated: ok {rc=0} 02:30:58.057140 --- ParallelTerminationStrategy: PID 12154 died... 02:30:58.076826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12154): Terminated: ok {rc=0} 02:30:58.167206 bus /gobi_4: Setting Powered False 02:30:59.266577 bus /gobi_4: Setting Powered False 02:31:00.383162 bus /gobi_1: Setting Powered False 02:31:01.479849 bus /gobi_1: Setting Powered False 02:31:02.597151 bus /gobi_0: Setting Powered False 02:31:03.696719 bus /gobi_0: Setting Powered False 02:31:04.812723 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200 ping.py ---------------------------------------------- 02:31:05.919459 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:05.931333 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:31:05.982642 tst ping.py: using LAC 18448 02:31:06.110036 tst ping.py: using RAC 88 02:31:06.235955 tst ping.py: using CellId 18448 02:31:06.362184 tst ping.py: using BVCI 18449 02:31:06.481441 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:06.492516 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:06.503613 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:06.514852 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:06.526012 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:06.537115 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:06.548408 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:06.559703 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:31:06.676150 tst ping.py:19: start network... 02:31:06.880040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:07.352663 run create_hlr_db(pid=12156): Launched 02:31:07.476851 bus /gobi_6: Setting Powered False 02:31:08.538167 run create_hlr_db(pid=12156): Terminated: ok {rc=0} 02:31:08.982605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12158): Launched 02:31:09.308348 run osmo-hlr_10.42.42.2(pid=12159): Launched 02:31:09.433334 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:09.998213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12161): Launched 02:31:10.322427 run osmo-stp_10.42.42.5(pid=12162): Launched 02:31:10.448199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:11.007551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12164): Launched 02:31:11.131805 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:11.406013 run patchelf(pid=12165): Launched 02:31:11.586369 run osmo-stp_10.42.42.5(pid=12162): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12162)] 02:31:11.722957 run osmo-stp_10.42.42.5(pid=12162): stdout: | (launched: 2022-12-09_02:31:10.263268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:11.861603 run osmo-stp_10.42.42.5(pid=12162): stderr: | 20221209023110456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023110456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023110456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023110456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023110457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023110457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023110457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:12.000178 run osmo-stp_10.42.42.5(pid=12162): stdout: | (launched: 2022-12-09_02:31:10.263268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:12.133613 run osmo-stp_10.42.42.5(pid=12162): stderr: | 20221209023110456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023110456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023110456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023110456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023110457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023110457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023110457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:12.291241 run patchelf(pid=12165): Terminating (SIGINT) 02:31:12.473218 run patchelf(pid=12165): Terminated: ok {rc=0} 02:31:12.604120 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12162): Process ended prematurely: osmo-stp_10.42.42.5(pid=12162) [trial-2353↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12162)] [trial-2353↪gprs:trx-b200↪ping.py:22] 02:31:12.613764 tst ping.py:22: Test FAILED (6.7 sec) 02:31:12.642107 run osmo-hlr_10.42.42.2(pid=12159): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12159)] 02:31:12.692459 run osmo-hlr_10.42.42.2(pid=12159): stdout: | (launched: 2022-12-09_02:31:09.248756) 02:31:12.744293 run osmo-hlr_10.42.42.2(pid=12159): stderr: | 20221209023109450 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023109450 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023109450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023109450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023109450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023109450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023109463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023109473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023109473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023109473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:12.796612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12158): Terminating (SIGTERM) 02:31:12.838718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12161): Terminating (SIGTERM) 02:31:12.880657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12164): Terminating (SIGTERM) 02:31:12.922520 --- ParallelTerminationStrategy: PID 12158 died... 02:31:12.942685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12158): Terminated: ok {rc=0} 02:31:12.989537 --- ParallelTerminationStrategy: PID 12161 died... 02:31:13.009118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12161): Terminated: ok {rc=0} 02:31:13.055330 --- ParallelTerminationStrategy: PID 12164 died... 02:31:13.074814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12164): Terminated: ok {rc=0} 02:31:13.164043 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 02:31:14.251031 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:14.262938 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:31:14.319625 tst ping_idle_ping.py: using LAC 18449 02:31:14.446758 tst ping_idle_ping.py: using RAC 89 02:31:14.572812 tst ping_idle_ping.py: using CellId 18449 02:31:14.698971 tst ping_idle_ping.py: using BVCI 18450 02:31:14.819355 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:14.830553 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:14.841669 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:14.853014 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:14.864171 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:14.875416 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:14.886724 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:31:14.898151 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:31:15.018553 tst ping_idle_ping.py:24: start network... 02:31:15.237912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:15.745291 run create_hlr_db(pid=12166): Launched 02:31:15.890718 bus /gobi_6: Setting Powered False 02:31:16.954977 run create_hlr_db(pid=12166): Terminated: ok {rc=0} 02:31:17.415167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12168): Launched 02:31:17.742259 run osmo-hlr_10.42.42.2(pid=12169): Launched 02:31:17.866205 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:18.430015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12171): Launched 02:31:18.754132 run osmo-stp_10.42.42.5(pid=12172): Launched 02:31:18.879425 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:19.441819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12174): Launched 02:31:19.562346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:19.818732 run patchelf(pid=12175): Launched 02:31:19.989513 run osmo-stp_10.42.42.5(pid=12172): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12172)] 02:31:20.117522 run osmo-stp_10.42.42.5(pid=12172): stdout: | (launched: 2022-12-09_02:31:18.694687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:20.247450 run osmo-stp_10.42.42.5(pid=12172): stderr: | 20221209023118888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023118888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023118889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023118889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023118890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023118890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023118890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:20.377526 run osmo-stp_10.42.42.5(pid=12172): stdout: | (launched: 2022-12-09_02:31:18.694687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:20.502042 run osmo-stp_10.42.42.5(pid=12172): stderr: | 20221209023118888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023118888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023118889 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023118889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023118890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023118890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023118890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:20.649524 run patchelf(pid=12175): Terminating (SIGINT) 02:31:20.819339 run patchelf(pid=12175): Terminated: ok {rc=0} 02:31:20.942060 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12172): Process ended prematurely: osmo-stp_10.42.42.5(pid=12172) [trial-2353↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12172)] [trial-2353↪gprs:trx-b200↪ping_idle_ping.py:27] 02:31:20.950892 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:31:20.977587 run osmo-hlr_10.42.42.2(pid=12169): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12169)] 02:31:21.024704 run osmo-hlr_10.42.42.2(pid=12169): stdout: | (launched: 2022-12-09_02:31:17.682330) 02:31:21.073641 run osmo-hlr_10.42.42.2(pid=12169): stderr: | 20221209023117882 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023117882 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023117882 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023117882 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023117882 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023117882 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023117894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023117902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023117902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023117902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:21.123174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12168): Terminating (SIGTERM) 02:31:21.163925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12171): Terminating (SIGTERM) 02:31:21.203937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12174): Terminating (SIGTERM) 02:31:21.244334 --- ParallelTerminationStrategy: PID 12168 died... 02:31:21.263690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12168): Terminated: ok {rc=0} 02:31:21.308299 --- ParallelTerminationStrategy: PID 12171 died... 02:31:21.327078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12171): Terminated: ok {rc=0} 02:31:21.371201 --- ParallelTerminationStrategy: PID 12174 died... 02:31:21.390434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12174): Terminated: ok {rc=0} 02:31:21.476823 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 02:31:22.786488 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:31:22.792104 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:31:22.825960 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:31:22.864297 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:31:22.950947 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:31:22.984176 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:31:23.022248 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:31:23.623556 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:31:23.677436 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:23.688757 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:31:23.743706 tst cs_paging_gprs_active.py: using LAC 18450 02:31:23.872464 tst cs_paging_gprs_active.py: using RAC 90 02:31:23.999187 tst cs_paging_gprs_active.py: using CellId 18450 02:31:24.128567 tst cs_paging_gprs_active.py: using BVCI 18451 02:31:24.248452 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:24.260414 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:24.271793 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:24.283320 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:24.294823 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:24.306254 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:24.317946 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:24.329455 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:24.341133 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:24.461383 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:24.580539 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:31:24.789439 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:25.102406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12180): Launched 02:31:25.373203 run iperf3-srv_10.42.42.10(pid=12181): Launched 02:31:25.489612 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:31:25.697338 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:26.009298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12182): Launched 02:31:26.279715 run iperf3-srv_10.42.42.10(pid=12183): Launched 02:31:26.395937 tst cs_paging_gprs_active.py:38: start network... 02:31:26.604452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:27.084860 run create_hlr_db(pid=12184): Launched 02:31:27.214545 bus /gobi_6: Setting Powered False 02:31:28.279877 run create_hlr_db(pid=12184): Terminated: ok {rc=0} 02:31:28.739317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12186): Launched 02:31:29.071512 run osmo-hlr_10.42.42.2(pid=12187): Launched 02:31:29.198629 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:29.770862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12189): Launched 02:31:30.085658 run osmo-stp_10.42.42.5(pid=12190): Launched 02:31:30.203498 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:30.752813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12192): Launched 02:31:30.903829 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:31.190340 run patchelf(pid=12193): Launched 02:31:31.420004 run osmo-stp_10.42.42.5(pid=12190): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12190)] 02:31:31.566019 run osmo-stp_10.42.42.5(pid=12190): stdout: | (launched: 2022-12-09_02:31:30.029067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:31.712786 run osmo-stp_10.42.42.5(pid=12190): stderr: | 20221209023130201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023130201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023130201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023130202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023130204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023130204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023130204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:31.859961 run osmo-stp_10.42.42.5(pid=12190): stdout: | (launched: 2022-12-09_02:31:30.029067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:31.992674 run osmo-stp_10.42.42.5(pid=12190): stderr: | 20221209023130201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023130201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023130201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023130202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023130204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023130204 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023130204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:32.147397 run patchelf(pid=12193): Terminating (SIGINT) 02:31:32.324576 run patchelf(pid=12193): Terminated: ok {rc=0} 02:31:32.450252 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12190): Process ended prematurely: osmo-stp_10.42.42.5(pid=12190) [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12190)] [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:31:32.460076 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 02:31:32.487440 run osmo-hlr_10.42.42.2(pid=12187): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12187)] 02:31:32.536168 run osmo-hlr_10.42.42.2(pid=12187): stdout: | (launched: 2022-12-09_02:31:29.011595) 02:31:32.586538 run osmo-hlr_10.42.42.2(pid=12187): stderr: | 20221209023129213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023129213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023129213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023129213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023129213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023129213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023129226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023129234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023129234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023129234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:32.636661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12180): Terminating (SIGTERM) 02:31:32.677076 run iperf3-srv_10.42.42.10(pid=12181): Terminating (SIGTERM) 02:31:32.717137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12182): Terminating (SIGTERM) 02:31:32.757211 run iperf3-srv_10.42.42.10(pid=12183): Terminating (SIGTERM) 02:31:32.797276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12186): Terminating (SIGTERM) 02:31:32.837733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12189): Terminating (SIGTERM) 02:31:32.877908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12192): Terminating (SIGTERM) 02:31:32.918189 --- ParallelTerminationStrategy: PID 12180 died... 02:31:32.937437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12180): Terminated: ok {rc=0} 02:31:32.981631 --- ParallelTerminationStrategy: PID 12181 died... 02:31:33.000156 run iperf3-srv_10.42.42.10(pid=12181): Terminated {rc=256} 02:31:33.043959 --- ParallelTerminationStrategy: PID 12182 died... 02:31:33.063026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12182): Terminated: ok {rc=0} 02:31:33.107205 --- ParallelTerminationStrategy: PID 12183 died... 02:31:33.125868 run iperf3-srv_10.42.42.10(pid=12183): Terminated {rc=256} 02:31:33.169506 --- ParallelTerminationStrategy: PID 12186 died... 02:31:33.188246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12186): Terminated: ok {rc=0} 02:31:33.232575 --- ParallelTerminationStrategy: PID 12189 died... 02:31:33.251650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12189): Terminated: ok {rc=0} 02:31:33.295746 --- ParallelTerminationStrategy: PID 12192 died... 02:31:33.314786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12192): Terminated: ok {rc=0} 02:31:33.400671 bus /gobi_0: Setting Powered False 02:31:34.501364 bus /gobi_0: Setting Powered False 02:31:35.617531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:31:36.766440 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:36.778119 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:31:36.831692 tst iperf3.py: using LAC 18451 02:31:36.953987 tst iperf3.py: using RAC 91 02:31:37.075246 tst iperf3.py: using CellId 18451 02:31:37.199076 tst iperf3.py: using BVCI 18452 02:31:37.313626 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.324494 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.335205 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.345875 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.356567 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.367383 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.378217 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.388800 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.399651 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:37.515131 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:31:37.723018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:38.033420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12194): Launched 02:31:38.302723 run iperf3-srv_10.42.42.10(pid=12195): Launched 02:31:38.418320 tst iperf3.py:8: start network... 02:31:38.624841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:39.102943 run create_hlr_db(pid=12196): Launched 02:31:39.229922 bus /gobi_6: Setting Powered False 02:31:40.291455 run create_hlr_db(pid=12196): Terminated: ok {rc=0} 02:31:40.740706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12198): Launched 02:31:41.071944 run osmo-hlr_10.42.42.2(pid=12199): Launched 02:31:41.198691 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:41.771143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12201): Launched 02:31:42.103128 run osmo-stp_10.42.42.5(pid=12202): Launched 02:31:42.230347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:42.802112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12204): Launched 02:31:42.928788 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:43.209159 run patchelf(pid=12205): Launched 02:31:43.392112 run osmo-stp_10.42.42.5(pid=12202): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12202)] 02:31:43.531698 run osmo-stp_10.42.42.5(pid=12202): stdout: | (launched: 2022-12-09_02:31:42.042722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:43.672460 run osmo-stp_10.42.42.5(pid=12202): stderr: | 20221209023142237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023142237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023142237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023142238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023142238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023142238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023142238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:43.813685 run osmo-stp_10.42.42.5(pid=12202): stdout: | (launched: 2022-12-09_02:31:42.042722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:43.948680 run osmo-stp_10.42.42.5(pid=12202): stderr: | 20221209023142237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023142237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023142237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023142238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023142238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023142238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023142238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:44.108298 run patchelf(pid=12205): Terminating (SIGINT) 02:31:44.292482 run patchelf(pid=12205): Terminated: ok {rc=0} 02:31:44.425255 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12202): Process ended prematurely: osmo-stp_10.42.42.5(pid=12202) [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12202)] [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 02:31:44.435786 tst iperf3.py:8: Test FAILED (7.7 sec) 02:31:44.465206 run osmo-hlr_10.42.42.2(pid=12199): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12199)] 02:31:44.515287 run osmo-hlr_10.42.42.2(pid=12199): stdout: | (launched: 2022-12-09_02:31:41.011899) 02:31:44.566968 run osmo-hlr_10.42.42.2(pid=12199): stderr: | 20221209023141215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023141215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023141215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023141215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023141215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023141215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023141229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023141237 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023141237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023141237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:44.619221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12194): Terminating (SIGTERM) 02:31:44.660866 run iperf3-srv_10.42.42.10(pid=12195): Terminating (SIGTERM) 02:31:44.702723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12198): Terminating (SIGTERM) 02:31:44.744660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12201): Terminating (SIGTERM) 02:31:44.786598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12204): Terminating (SIGTERM) 02:31:44.828604 --- ParallelTerminationStrategy: PID 12194 died... 02:31:44.848488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12194): Terminated: ok {rc=0} 02:31:44.894689 --- ParallelTerminationStrategy: PID 12195 died... 02:31:44.913905 run iperf3-srv_10.42.42.10(pid=12195): Terminated {rc=256} 02:31:44.959904 --- ParallelTerminationStrategy: PID 12198 died... 02:31:44.979389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12198): Terminated: ok {rc=0} 02:31:45.025606 --- ParallelTerminationStrategy: PID 12201 died... 02:31:45.045115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12201): Terminated: ok {rc=0} 02:31:45.091544 --- ParallelTerminationStrategy: PID 12204 died... 02:31:45.111193 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12204): Terminated: ok {rc=0} 02:31:45.199490 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:31:46.347458 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:46.361185 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:31:46.412411 tst iperf3m4.py: using LAC 18452 02:31:46.534610 tst iperf3m4.py: using RAC 92 02:31:46.669103 tst iperf3m4.py: using CellId 18452 02:31:46.801292 tst iperf3m4.py: using BVCI 18453 02:31:46.915266 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:46.926930 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:46.938739 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:46.952231 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:46.963657 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:46.974978 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:46.988256 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:46.999857 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:47.011261 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:47.129106 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:47.254858 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:47.379084 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:47.502595 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:31:47.725851 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:48.057882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12206): Launched 02:31:48.346999 run iperf3-srv_10.42.42.10(pid=12207): Launched 02:31:48.473164 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:31:48.696642 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:49.029752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12208): Launched 02:31:49.317267 run iperf3-srv_10.42.42.10(pid=12209): Launched 02:31:49.442206 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:31:49.669300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:50.000276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12210): Launched 02:31:50.286276 run iperf3-srv_10.42.42.10(pid=12211): Launched 02:31:50.409762 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:31:50.631767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:50.963096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12212): Launched 02:31:51.249414 run iperf3-srv_10.42.42.10(pid=12213): Launched 02:31:51.372928 tst iperf3m4.py:8: start network... 02:31:51.595076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:52.107276 run create_hlr_db(pid=12215): Launched 02:31:52.232722 bus /gobi_6: Setting Powered False 02:31:53.298218 run create_hlr_db(pid=12215): Terminated: ok {rc=0} 02:31:53.755996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12217): Launched 02:31:54.067694 run osmo-hlr_10.42.42.2(pid=12218): Launched 02:31:54.185685 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:54.733623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12220): Launched 02:31:55.040099 run osmo-stp_10.42.42.5(pid=12221): Launched 02:31:55.157239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:55.692354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12223): Launched 02:31:55.809295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:56.069650 run patchelf(pid=12224): Launched 02:31:56.240300 run osmo-stp_10.42.42.5(pid=12221): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12221)] 02:31:56.369794 run osmo-stp_10.42.42.5(pid=12221): stdout: | (launched: 2022-12-09_02:31:54.983277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:56.501099 run osmo-stp_10.42.42.5(pid=12221): stderr: | 20221209023155157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023155157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023155158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023155158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023155159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023155159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023155159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:56.632465 run osmo-stp_10.42.42.5(pid=12221): stdout: | (launched: 2022-12-09_02:31:54.983277) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:56.757829 run osmo-stp_10.42.42.5(pid=12221): stderr: | 20221209023155157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023155157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023155158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023155158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023155159 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023155159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023155159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:56.906973 run patchelf(pid=12224): Terminating (SIGINT) 02:31:57.079101 run patchelf(pid=12224): Terminated: ok {rc=0} 02:31:57.202974 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12221): Process ended prematurely: osmo-stp_10.42.42.5(pid=12221) [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12221)] [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 02:31:57.212368 tst iperf3m4.py:8: Test FAILED (10.9 sec) 02:31:57.240301 run osmo-hlr_10.42.42.2(pid=12218): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12218)] 02:31:57.287967 run osmo-hlr_10.42.42.2(pid=12218): stdout: | (launched: 2022-12-09_02:31:54.010917) 02:31:57.337228 run osmo-hlr_10.42.42.2(pid=12218): stderr: | 20221209023154190 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023154190 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023154190 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023154190 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023154190 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023154190 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023154202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023154212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023154213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023154213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:57.386868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12206): Terminating (SIGTERM) 02:31:57.427194 run iperf3-srv_10.42.42.10(pid=12207): Terminating (SIGTERM) 02:31:57.467084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12208): Terminating (SIGTERM) 02:31:57.507030 run iperf3-srv_10.42.42.10(pid=12209): Terminating (SIGTERM) 02:31:57.546701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12210): Terminating (SIGTERM) 02:31:57.586675 run iperf3-srv_10.42.42.10(pid=12211): Terminating (SIGTERM) 02:31:57.626740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12212): Terminating (SIGTERM) 02:31:57.666624 run iperf3-srv_10.42.42.10(pid=12213): Terminating (SIGTERM) 02:31:57.706108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12217): Terminating (SIGTERM) 02:31:57.746010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12220): Terminating (SIGTERM) 02:31:57.785966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12223): Terminating (SIGTERM) 02:31:57.826121 --- ParallelTerminationStrategy: PID 12206 died... 02:31:57.845334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12206): Terminated: ok {rc=0} 02:31:57.889965 --- ParallelTerminationStrategy: PID 12207 died... 02:31:57.908765 run iperf3-srv_10.42.42.10(pid=12207): Terminated {rc=256} 02:31:57.952786 --- ParallelTerminationStrategy: PID 12208 died... 02:31:57.971653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12208): Terminated: ok {rc=0} 02:31:58.016406 --- ParallelTerminationStrategy: PID 12209 died... 02:31:58.035172 run iperf3-srv_10.42.42.10(pid=12209): Terminated {rc=256} 02:31:58.079089 --- ParallelTerminationStrategy: PID 12210 died... 02:31:58.097709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12210): Terminated: ok {rc=0} 02:31:58.141694 --- ParallelTerminationStrategy: PID 12211 died... 02:31:58.160479 run iperf3-srv_10.42.42.10(pid=12211): Terminated {rc=256} 02:31:58.204324 --- ParallelTerminationStrategy: PID 12212 died... 02:31:58.222874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12212): Terminated: ok {rc=0} 02:31:58.266782 --- ParallelTerminationStrategy: PID 12213 died... 02:31:58.285572 run iperf3-srv_10.42.42.10(pid=12213): Terminated {rc=256} 02:31:58.329533 --- ParallelTerminationStrategy: PID 12217 died... 02:31:58.348297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12217): Terminated: ok {rc=0} 02:31:58.392427 --- ParallelTerminationStrategy: PID 12220 died... 02:31:58.411276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12220): Terminated: ok {rc=0} 02:31:58.455194 --- ParallelTerminationStrategy: PID 12223 died... 02:31:58.473874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12223): Terminated: ok {rc=0} 02:31:58.559821 bus /gobi_4: Setting Powered False 02:31:59.660665 bus /gobi_4: Setting Powered False 02:32:00.776752 bus /gobi_1: Setting Powered False 02:32:01.877582 bus /gobi_1: Setting Powered False 02:32:02.991868 bus /gobi_0: Setting Powered False 02:32:04.089732 bus /gobi_0: Setting Powered False 02:32:05.207067 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 02:32:06.309965 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:06.322066 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:32:06.374241 tst ping.py: using LAC 18453 02:32:06.501369 tst ping.py: using RAC 93 02:32:06.626189 tst ping.py: using CellId 18453 02:32:06.756298 tst ping.py: using BVCI 18454 02:32:06.874745 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:06.886217 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:06.897451 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:06.908770 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:06.920100 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:06.931291 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:06.942842 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:06.954203 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:32:07.070771 tst ping.py:19: start network... 02:32:07.283883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:07.775743 run create_hlr_db(pid=12226): Launched 02:32:07.896032 bus /gobi_6: Setting Powered False 02:32:08.958215 run create_hlr_db(pid=12226): Terminated: ok {rc=0} 02:32:09.381688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12228): Launched 02:32:09.677362 run osmo-hlr_10.42.42.2(pid=12229): Launched 02:32:09.790172 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:10.317390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12231): Launched 02:32:10.612764 run osmo-stp_10.42.42.5(pid=12232): Launched 02:32:10.725864 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:11.236170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12234): Launched 02:32:11.349098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:11.601163 run patchelf(pid=12235): Launched 02:32:11.765119 run osmo-stp_10.42.42.5(pid=12232): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12232)] 02:32:11.890015 run osmo-stp_10.42.42.5(pid=12232): stdout: | (launched: 2022-12-09_02:32:10.558273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:12.017116 run osmo-stp_10.42.42.5(pid=12232): stderr: | 20221209023210728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023210728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023210728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023210729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023210729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023210729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023210729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:12.143703 run osmo-stp_10.42.42.5(pid=12232): stdout: | (launched: 2022-12-09_02:32:10.558273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:12.264695 run osmo-stp_10.42.42.5(pid=12232): stderr: | 20221209023210728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023210728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023210728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023210729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023210729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023210729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023210729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:12.408784 run patchelf(pid=12235): Terminating (SIGINT) 02:32:12.574403 run patchelf(pid=12235): Terminated: ok {rc=0} 02:32:12.694142 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12232): Process ended prematurely: osmo-stp_10.42.42.5(pid=12232) [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12232)] [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 02:32:12.702895 tst ping.py:22: Test FAILED (6.4 sec) 02:32:12.729451 run osmo-hlr_10.42.42.2(pid=12229): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12229)] 02:32:12.776406 run osmo-hlr_10.42.42.2(pid=12229): stdout: | (launched: 2022-12-09_02:32:09.623055) 02:32:12.825338 run osmo-hlr_10.42.42.2(pid=12229): stderr: | 20221209023209798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023209798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023209798 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023209798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023209798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023209798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023209810 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023209818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023209819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023209819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:12.874877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12228): Terminating (SIGTERM) 02:32:12.914580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12231): Terminating (SIGTERM) 02:32:12.954251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12234): Terminating (SIGTERM) 02:32:12.994275 --- ParallelTerminationStrategy: PID 12228 died... 02:32:13.013463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12228): Terminated: ok {rc=0} 02:32:13.057474 --- ParallelTerminationStrategy: PID 12231 died... 02:32:13.075902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12231): Terminated: ok {rc=0} 02:32:13.119889 --- ParallelTerminationStrategy: PID 12234 died... 02:32:13.138381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12234): Terminated: ok {rc=0} 02:32:13.223662 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:32:14.312870 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:14.324739 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:32:14.376126 tst ping_idle_ping.py: using LAC 18454 02:32:14.504692 tst ping_idle_ping.py: using RAC 94 02:32:14.631753 tst ping_idle_ping.py: using CellId 18454 02:32:14.757182 tst ping_idle_ping.py: using BVCI 18455 02:32:14.873336 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:14.884828 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:14.896062 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:14.907556 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:14.919050 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:14.930506 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:14.942154 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:32:14.953537 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:32:15.069986 tst ping_idle_ping.py:24: start network... 02:32:15.268638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:15.730746 run create_hlr_db(pid=12236): Launched 02:32:15.871938 bus /gobi_6: Setting Powered False 02:32:16.947223 run create_hlr_db(pid=12236): Terminated: ok {rc=0} 02:32:17.416016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12238): Launched 02:32:17.736202 run osmo-hlr_10.42.42.2(pid=12239): Launched 02:32:17.858240 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:18.412223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12241): Launched 02:32:18.731920 run osmo-stp_10.42.42.5(pid=12242): Launched 02:32:18.854145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:19.406096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12244): Launched 02:32:19.529103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:19.799988 run patchelf(pid=12245): Launched 02:32:19.977336 run osmo-stp_10.42.42.5(pid=12242): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12242)] 02:32:20.112611 run osmo-stp_10.42.42.5(pid=12242): stdout: | (launched: 2022-12-09_02:32:18.673853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:20.249843 run osmo-stp_10.42.42.5(pid=12242): stderr: | 20221209023218865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023218866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023218866 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023218866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023218868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023218869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023218869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:20.387121 run osmo-stp_10.42.42.5(pid=12242): stdout: | (launched: 2022-12-09_02:32:18.673853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:20.519003 run osmo-stp_10.42.42.5(pid=12242): stderr: | 20221209023218865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023218866 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023218866 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023218866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023218868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023218869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023218869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:20.674506 run patchelf(pid=12245): Terminating (SIGINT) 02:32:20.853890 run patchelf(pid=12245): Terminated: ok {rc=0} 02:32:20.983516 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12242): Process ended prematurely: osmo-stp_10.42.42.5(pid=12242) [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12242)] [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 02:32:20.992817 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:32:21.021518 run osmo-hlr_10.42.42.2(pid=12239): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12239)] 02:32:21.071884 run osmo-hlr_10.42.42.2(pid=12239): stdout: | (launched: 2022-12-09_02:32:17.678220) 02:32:21.123889 run osmo-hlr_10.42.42.2(pid=12239): stderr: | 20221209023217876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023217876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023217876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023217876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023217876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023217876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023217889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023217898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023217898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023217898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:21.176386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12238): Terminating (SIGTERM) 02:32:21.218449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12241): Terminating (SIGTERM) 02:32:21.260370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12244): Terminating (SIGTERM) 02:32:21.302639 --- ParallelTerminationStrategy: PID 12238 died... 02:32:21.322634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12238): Terminated: ok {rc=0} 02:32:21.369349 --- ParallelTerminationStrategy: PID 12241 died... 02:32:21.388656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12241): Terminated: ok {rc=0} 02:32:21.435243 --- ParallelTerminationStrategy: PID 12244 died... 02:32:21.455068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12244): Terminated: ok {rc=0} 02:32:21.543901 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:32:22.847374 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:32:22.853390 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:32:22.887729 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:32:22.926798 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:32:23.013880 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:32:23.046968 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:32:23.085485 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:32:23.679996 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:32:23.729795 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:23.740738 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:32:23.809549 tst cs_paging_gprs_active.py: using LAC 18455 02:32:23.930199 tst cs_paging_gprs_active.py: using RAC 95 02:32:24.049382 tst cs_paging_gprs_active.py: using CellId 18455 02:32:24.170080 tst cs_paging_gprs_active.py: using BVCI 18456 02:32:24.278441 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:24.289347 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:24.300010 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:24.310714 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:24.321322 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:24.331962 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:24.342882 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:24.353851 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:24.364732 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:24.485420 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:24.601604 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:32:24.804058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:25.106362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12249): Launched 02:32:25.368212 run iperf3-srv_10.42.42.10(pid=12250): Launched 02:32:25.480459 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:32:25.682258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:25.982934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12251): Launched 02:32:26.244006 run iperf3-srv_10.42.42.10(pid=12252): Launched 02:32:26.356901 tst cs_paging_gprs_active.py:38: start network... 02:32:26.558883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:27.025175 run create_hlr_db(pid=12253): Launched 02:32:27.147307 bus /gobi_6: Setting Powered False 02:32:28.207188 run create_hlr_db(pid=12253): Terminated: ok {rc=0} 02:32:28.647496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12255): Launched 02:32:28.971639 run osmo-hlr_10.42.42.2(pid=12256): Launched 02:32:29.095567 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:29.655070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12258): Launched 02:32:29.977972 run osmo-stp_10.42.42.5(pid=12259): Launched 02:32:30.102036 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:30.659724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12261): Launched 02:32:30.783518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:31.067388 run patchelf(pid=12262): Launched 02:32:31.250698 run osmo-stp_10.42.42.5(pid=12259): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12259)] 02:32:31.382961 run osmo-stp_10.42.42.5(pid=12259): stdout: | (launched: 2022-12-09_02:32:29.919434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:31.538084 run osmo-stp_10.42.42.5(pid=12259): stderr: | 20221209023230109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023230109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023230110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023230110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023230111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023230111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023230111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:31.672172 run osmo-stp_10.42.42.5(pid=12259): stdout: | (launched: 2022-12-09_02:32:29.919434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:31.801936 run osmo-stp_10.42.42.5(pid=12259): stderr: | 20221209023230109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023230109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023230110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023230110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023230111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023230111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023230111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:31.954814 run patchelf(pid=12262): Terminating (SIGINT) 02:32:32.131339 run patchelf(pid=12262): Terminated: ok {rc=0} 02:32:32.265010 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12259): Process ended prematurely: osmo-stp_10.42.42.5(pid=12259) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12259)] [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:32:32.276098 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 02:32:32.307713 run osmo-hlr_10.42.42.2(pid=12256): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12256)] 02:32:32.360072 run osmo-hlr_10.42.42.2(pid=12256): stdout: | (launched: 2022-12-09_02:32:28.913114) 02:32:32.413664 run osmo-hlr_10.42.42.2(pid=12256): stderr: | 20221209023229109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023229109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023229109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023229109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023229109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023229109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023229124 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023229134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023229134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023229134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:32.466998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12249): Terminating (SIGTERM) 02:32:32.509943 run iperf3-srv_10.42.42.10(pid=12250): Terminating (SIGTERM) 02:32:32.552509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12251): Terminating (SIGTERM) 02:32:32.595054 run iperf3-srv_10.42.42.10(pid=12252): Terminating (SIGTERM) 02:32:32.637437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12255): Terminating (SIGTERM) 02:32:32.679963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12258): Terminating (SIGTERM) 02:32:32.722557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12261): Terminating (SIGTERM) 02:32:32.765379 --- ParallelTerminationStrategy: PID 12249 died... 02:32:32.785021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12249): Terminated: ok {rc=0} 02:32:32.833018 --- ParallelTerminationStrategy: PID 12250 died... 02:32:32.852405 run iperf3-srv_10.42.42.10(pid=12250): Terminated {rc=256} 02:32:32.899844 --- ParallelTerminationStrategy: PID 12251 died... 02:32:32.919515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12251): Terminated: ok {rc=0} 02:32:32.966945 --- ParallelTerminationStrategy: PID 12252 died... 02:32:32.986320 run iperf3-srv_10.42.42.10(pid=12252): Terminated {rc=256} 02:32:33.033650 --- ParallelTerminationStrategy: PID 12255 died... 02:32:33.053146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12255): Terminated: ok {rc=0} 02:32:33.100589 --- ParallelTerminationStrategy: PID 12258 died... 02:32:33.120131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12258): Terminated: ok {rc=0} 02:32:33.167273 --- ParallelTerminationStrategy: PID 12261 died... 02:32:33.186822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12261): Terminated: ok {rc=0} 02:32:33.275403 bus /gobi_0: Setting Powered False 02:32:34.373720 bus /gobi_0: Setting Powered False 02:32:35.489265 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:32:36.638353 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:36.650229 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:32:36.727073 tst iperf3.py: using LAC 18456 02:32:36.852678 tst iperf3.py: using RAC 96 02:32:36.977380 tst iperf3.py: using CellId 18456 02:32:37.102384 tst iperf3.py: using BVCI 18457 02:32:37.219985 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:37.231347 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:37.242498 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:37.253981 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:37.265252 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:37.276582 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:37.288058 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:37.299373 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:37.311000 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:37.427436 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:32:37.630274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:37.932613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12265): Launched 02:32:38.194824 run iperf3-srv_10.42.42.10(pid=12266): Launched 02:32:38.307457 tst iperf3.py:8: start network... 02:32:38.508514 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:38.975116 run create_hlr_db(pid=12267): Launched 02:32:39.098465 bus /gobi_6: Setting Powered False 02:32:40.158655 run create_hlr_db(pid=12267): Terminated: ok {rc=0} 02:32:40.576217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12269): Launched 02:32:40.878580 run osmo-hlr_10.42.42.2(pid=12270): Launched 02:32:40.991873 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:41.504036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12272): Launched 02:32:41.800692 run osmo-stp_10.42.42.5(pid=12273): Launched 02:32:41.914044 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:42.427860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12275): Launched 02:32:42.541498 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:42.793023 run patchelf(pid=12276): Launched 02:32:42.958283 run osmo-stp_10.42.42.5(pid=12273): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12273)] 02:32:43.083826 run osmo-stp_10.42.42.5(pid=12273): stdout: | (launched: 2022-12-09_02:32:41.746246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:43.211239 run osmo-stp_10.42.42.5(pid=12273): stderr: | 20221209023241915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023241915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023241916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023241916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023241917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023241917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023241917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:43.338954 run osmo-stp_10.42.42.5(pid=12273): stdout: | (launched: 2022-12-09_02:32:41.746246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:43.460914 run osmo-stp_10.42.42.5(pid=12273): stderr: | 20221209023241915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023241915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023241916 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023241916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023241917 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023241917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023241917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:43.605686 run patchelf(pid=12276): Terminating (SIGINT) 02:32:43.772281 run patchelf(pid=12276): Terminated: ok {rc=0} 02:32:43.893643 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12273): Process ended prematurely: osmo-stp_10.42.42.5(pid=12273) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12273)] [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 02:32:43.902897 tst iperf3.py:8: Test FAILED (7.3 sec) 02:32:43.929629 run osmo-hlr_10.42.42.2(pid=12270): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12270)] 02:32:43.977112 run osmo-hlr_10.42.42.2(pid=12270): stdout: | (launched: 2022-12-09_02:32:40.824628) 02:32:44.025797 run osmo-hlr_10.42.42.2(pid=12270): stderr: | 20221209023241001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023241001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023241001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023241001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023241001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023241002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023241016 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023241025 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023241025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023241025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:44.074878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12265): Terminating (SIGTERM) 02:32:44.113950 run iperf3-srv_10.42.42.10(pid=12266): Terminating (SIGTERM) 02:32:44.152811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12269): Terminating (SIGTERM) 02:32:44.192010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12272): Terminating (SIGTERM) 02:32:44.231209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12275): Terminating (SIGTERM) 02:32:44.270828 --- ParallelTerminationStrategy: PID 12265 died... 02:32:44.289371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12265): Terminated: ok {rc=0} 02:32:44.333221 --- ParallelTerminationStrategy: PID 12266 died... 02:32:44.351584 run iperf3-srv_10.42.42.10(pid=12266): Terminated {rc=256} 02:32:44.395184 --- ParallelTerminationStrategy: PID 12269 died... 02:32:44.413532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12269): Terminated: ok {rc=0} 02:32:44.456748 --- ParallelTerminationStrategy: PID 12272 died... 02:32:44.475245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12272): Terminated: ok {rc=0} 02:32:44.519118 --- ParallelTerminationStrategy: PID 12275 died... 02:32:44.537526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12275): Terminated: ok {rc=0} 02:32:44.623130 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:32:45.770332 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:45.781761 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:32:45.868412 tst iperf3m4.py: using LAC 18457 02:32:45.991243 tst iperf3m4.py: using RAC 97 02:32:46.109864 tst iperf3m4.py: using CellId 18457 02:32:46.257524 tst iperf3m4.py: using BVCI 18458 02:32:46.370106 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:46.381633 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:46.392776 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:46.404082 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:46.415345 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:46.426602 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:46.437991 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:46.449183 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:46.460309 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:46.586163 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:46.729139 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:46.855646 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:46.997515 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:32:47.256020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:47.560644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12277): Launched 02:32:47.821736 run iperf3-srv_10.42.42.10(pid=12278): Launched 02:32:47.933678 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:32:48.133544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:48.433015 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12279): Launched 02:32:48.693031 run iperf3-srv_10.42.42.10(pid=12280): Launched 02:32:48.804613 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:32:49.004252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:49.304120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12281): Launched 02:32:49.563814 run iperf3-srv_10.42.42.10(pid=12282): Launched 02:32:49.675533 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:32:49.875664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:50.175097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12283): Launched 02:32:50.433783 run iperf3-srv_10.42.42.10(pid=12284): Launched 02:32:50.545250 tst iperf3m4.py:8: start network... 02:32:50.744876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:51.206718 run create_hlr_db(pid=12285): Launched 02:32:51.329528 bus /gobi_6: Setting Powered False 02:32:52.389646 run create_hlr_db(pid=12285): Terminated: ok {rc=0} 02:32:52.827533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12287): Launched 02:32:53.147055 run osmo-hlr_10.42.42.2(pid=12288): Launched 02:32:53.270374 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:53.822653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12290): Launched 02:32:54.142634 run osmo-stp_10.42.42.5(pid=12291): Launched 02:32:54.264909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:54.818346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12293): Launched 02:32:54.940883 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:55.212017 run patchelf(pid=12294): Launched 02:32:55.389989 run osmo-stp_10.42.42.5(pid=12291): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12291)] 02:32:55.525884 run osmo-stp_10.42.42.5(pid=12291): stdout: | (launched: 2022-12-09_02:32:54.084593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:55.663288 run osmo-stp_10.42.42.5(pid=12291): stderr: | 20221209023254274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023254274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023254274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023254274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023254275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023254275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023254275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:55.800763 run osmo-stp_10.42.42.5(pid=12291): stdout: | (launched: 2022-12-09_02:32:54.084593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:55.932368 run osmo-stp_10.42.42.5(pid=12291): stderr: | 20221209023254274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023254274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023254274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023254274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023254275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023254275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023254275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:56.088354 run patchelf(pid=12294): Terminating (SIGINT) 02:32:56.267997 run patchelf(pid=12294): Terminated: ok {rc=0} 02:32:56.397405 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12291): Process ended prematurely: osmo-stp_10.42.42.5(pid=12291) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12291)] [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:32:56.407415 tst iperf3m4.py:8: Test FAILED (10.7 sec) 02:32:56.436588 run osmo-hlr_10.42.42.2(pid=12288): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12288)] 02:32:56.487297 run osmo-hlr_10.42.42.2(pid=12288): stdout: | (launched: 2022-12-09_02:32:53.089326) 02:32:56.539302 run osmo-hlr_10.42.42.2(pid=12288): stderr: | 20221209023253285 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023253285 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023253285 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023253285 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023253285 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023253285 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023253309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023253318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023253318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023253318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:56.591460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12277): Terminating (SIGTERM) 02:32:56.633584 run iperf3-srv_10.42.42.10(pid=12278): Terminating (SIGTERM) 02:32:56.675601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12279): Terminating (SIGTERM) 02:32:56.717811 run iperf3-srv_10.42.42.10(pid=12280): Terminating (SIGTERM) 02:32:56.759669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12281): Terminating (SIGTERM) 02:32:56.801888 run iperf3-srv_10.42.42.10(pid=12282): Terminating (SIGTERM) 02:32:56.843809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12283): Terminating (SIGTERM) 02:32:56.885884 run iperf3-srv_10.42.42.10(pid=12284): Terminating (SIGTERM) 02:32:56.927734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12287): Terminating (SIGTERM) 02:32:56.969626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12290): Terminating (SIGTERM) 02:32:57.011683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12293): Terminating (SIGTERM) 02:32:57.054072 --- ParallelTerminationStrategy: PID 12277 died... 02:32:57.074195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12277): Terminated: ok {rc=0} 02:32:57.121316 --- ParallelTerminationStrategy: PID 12278 died... 02:32:57.140738 run iperf3-srv_10.42.42.10(pid=12278): Terminated {rc=256} 02:32:57.187312 --- ParallelTerminationStrategy: PID 12279 died... 02:32:57.206856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12279): Terminated: ok {rc=0} 02:32:57.253462 --- ParallelTerminationStrategy: PID 12280 died... 02:32:57.273153 run iperf3-srv_10.42.42.10(pid=12280): Terminated {rc=256} 02:32:57.319258 --- ParallelTerminationStrategy: PID 12281 died... 02:32:57.338829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12281): Terminated: ok {rc=0} 02:32:57.385342 --- ParallelTerminationStrategy: PID 12282 died... 02:32:57.404769 run iperf3-srv_10.42.42.10(pid=12282): Terminated {rc=256} 02:32:57.451028 --- ParallelTerminationStrategy: PID 12283 died... 02:32:57.470692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12283): Terminated: ok {rc=0} 02:32:57.517441 --- ParallelTerminationStrategy: PID 12284 died... 02:32:57.537030 run iperf3-srv_10.42.42.10(pid=12284): Terminated {rc=256} 02:32:57.583366 --- ParallelTerminationStrategy: PID 12287 died... 02:32:57.602921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12287): Terminated: ok {rc=0} 02:32:57.649255 --- ParallelTerminationStrategy: PID 12290 died... 02:32:57.668549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12290): Terminated: ok {rc=0} 02:32:57.715794 --- ParallelTerminationStrategy: PID 12293 died... 02:32:57.735520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12293): Terminated: ok {rc=0} 02:32:57.823356 bus /gobi_4: Setting Powered False 02:32:58.922944 bus /gobi_4: Setting Powered False 02:33:00.039897 bus /gobi_1: Setting Powered False 02:33:01.138524 bus /gobi_1: Setting Powered False 02:33:02.251794 bus /gobi_0: Setting Powered False 02:33:03.347557 bus /gobi_0: Setting Powered False 02:33:04.462992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:33:05.567494 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:05.579467 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:33:05.652269 tst ping.py: using LAC 18458 02:33:05.778216 tst ping.py: using RAC 98 02:33:05.901406 tst ping.py: using CellId 18458 02:33:06.026247 tst ping.py: using BVCI 18459 02:33:06.141597 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:06.153077 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:06.164241 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:06.175768 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:06.187054 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:06.198379 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:06.209976 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:06.221439 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:33:06.337680 tst ping.py:19: start network... 02:33:06.551326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:07.039054 run create_hlr_db(pid=12296): Launched 02:33:07.159323 bus /gobi_6: Setting Powered False 02:33:08.221672 run create_hlr_db(pid=12296): Terminated: ok {rc=0} 02:33:08.643682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12298): Launched 02:33:08.936213 run osmo-hlr_10.42.42.2(pid=12299): Launched 02:33:09.047831 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:09.558826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12301): Launched 02:33:09.851032 run osmo-stp_10.42.42.5(pid=12302): Launched 02:33:09.962469 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:10.470357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12304): Launched 02:33:10.582181 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:10.829602 run patchelf(pid=12305): Launched 02:33:10.991851 run osmo-stp_10.42.42.5(pid=12302): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12302)] 02:33:11.116060 run osmo-stp_10.42.42.5(pid=12302): stdout: | (launched: 2022-12-09_02:33:09.797764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:11.242364 run osmo-stp_10.42.42.5(pid=12302): stderr: | 20221209023309965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023309965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023309966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023309966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023309967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023309967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023309967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:11.368303 run osmo-stp_10.42.42.5(pid=12302): stdout: | (launched: 2022-12-09_02:33:09.797764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:11.488762 run osmo-stp_10.42.42.5(pid=12302): stderr: | 20221209023309965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023309965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023309966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023309966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023309967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023309967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023309967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:11.631760 run patchelf(pid=12305): Terminating (SIGINT) 02:33:11.796592 run patchelf(pid=12305): Terminated: ok {rc=0} 02:33:11.915235 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12302): Process ended prematurely: osmo-stp_10.42.42.5(pid=12302) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12302)] [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 02:33:11.923853 tst ping.py:22: Test FAILED (6.3 sec) 02:33:11.950616 run osmo-hlr_10.42.42.2(pid=12299): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12299)] 02:33:11.998434 run osmo-hlr_10.42.42.2(pid=12299): stdout: | (launched: 2022-12-09_02:33:08.882852) 02:33:12.048362 run osmo-hlr_10.42.42.2(pid=12299): stderr: | 20221209023309058 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023309058 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023309058 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023309058 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023309058 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023309058 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023309071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023309079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023309079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023309079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:12.098240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12298): Terminating (SIGTERM) 02:33:12.138093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12301): Terminating (SIGTERM) 02:33:12.177779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12304): Terminating (SIGTERM) 02:33:12.217729 --- ParallelTerminationStrategy: PID 12298 died... 02:33:12.237009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12298): Terminated: ok {rc=0} 02:33:12.281305 --- ParallelTerminationStrategy: PID 12301 died... 02:33:12.299989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12301): Terminated: ok {rc=0} 02:33:12.344052 --- ParallelTerminationStrategy: PID 12304 died... 02:33:12.362769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12304): Terminated: ok {rc=0} 02:33:12.445994 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:33:13.530608 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:13.542074 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:33:13.612886 tst ping_idle_ping.py: using LAC 18459 02:33:13.731418 tst ping_idle_ping.py: using RAC 99 02:33:13.849632 tst ping_idle_ping.py: using CellId 18459 02:33:13.966383 tst ping_idle_ping.py: using BVCI 18460 02:33:14.076936 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:14.087971 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:14.098749 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:14.109557 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:14.120233 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:14.130967 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:14.141872 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:33:14.152583 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:33:14.271368 tst ping_idle_ping.py:24: start network... 02:33:14.486230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:14.984818 run create_hlr_db(pid=12306): Launched 02:33:15.105431 bus /gobi_6: Setting Powered False 02:33:16.196900 run create_hlr_db(pid=12306): Terminated: ok {rc=0} 02:33:16.633741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12308): Launched 02:33:16.953910 run osmo-hlr_10.42.42.2(pid=12309): Launched 02:33:17.218179 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:17.760896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12311): Launched 02:33:18.074963 run osmo-stp_10.42.42.5(pid=12312): Launched 02:33:18.195496 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:18.740922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12314): Launched 02:33:18.861779 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:19.128363 run patchelf(pid=12315): Launched 02:33:19.304006 run osmo-stp_10.42.42.5(pid=12312): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12312)] 02:33:19.437985 run osmo-stp_10.42.42.5(pid=12312): stdout: | (launched: 2022-12-09_02:33:18.018353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:19.573915 run osmo-stp_10.42.42.5(pid=12312): stderr: | 20221209023318207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023318207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023318208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023318208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023318210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023318211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023318211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:19.709510 run osmo-stp_10.42.42.5(pid=12312): stdout: | (launched: 2022-12-09_02:33:18.018353) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:19.839318 run osmo-stp_10.42.42.5(pid=12312): stderr: | 20221209023318207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023318207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023318208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023318208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023318210 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023318211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023318211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:19.992563 run patchelf(pid=12315): Terminating (SIGINT) 02:33:20.169037 run patchelf(pid=12315): Terminated: ok {rc=0} 02:33:20.296390 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12312): Process ended prematurely: osmo-stp_10.42.42.5(pid=12312) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12312)] [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:33:20.305926 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 02:33:20.334037 run osmo-hlr_10.42.42.2(pid=12309): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12309)] 02:33:20.384208 run osmo-hlr_10.42.42.2(pid=12309): stdout: | (launched: 2022-12-09_02:33:16.889566) 02:33:20.436486 run osmo-hlr_10.42.42.2(pid=12309): stderr: | 20221209023317176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023317176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023317176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023317177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023317177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023317177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023317194 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023317211 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023317211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023317211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:20.489428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12308): Terminating (SIGTERM) 02:33:20.531502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12311): Terminating (SIGTERM) 02:33:20.573906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12314): Terminating (SIGTERM) 02:33:20.616265 --- ParallelTerminationStrategy: PID 12308 died... 02:33:20.636172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12308): Terminated: ok {rc=0} 02:33:20.683347 --- ParallelTerminationStrategy: PID 12311 died... 02:33:20.703004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12311): Terminated: ok {rc=0} 02:33:20.749506 --- ParallelTerminationStrategy: PID 12314 died... 02:33:20.768910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12314): Terminated: ok {rc=0} 02:33:20.857001 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:33:22.160752 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:33:22.167188 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:33:22.201911 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:33:22.240335 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:33:22.326383 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:33:22.359329 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:33:22.397556 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:33:22.996179 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:33:23.048748 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:23.060303 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:33:23.132742 tst cs_paging_gprs_active.py: using LAC 18460 02:33:23.260380 tst cs_paging_gprs_active.py: using RAC 100 02:33:23.386397 tst cs_paging_gprs_active.py: using CellId 18460 02:33:23.515966 tst cs_paging_gprs_active.py: using BVCI 18461 02:33:23.634578 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:23.645980 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:23.657200 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:23.668725 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:23.680182 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:23.691996 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:23.703808 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:23.715499 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:23.727310 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:23.844142 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:23.960324 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:33:24.164243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:24.465580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12319): Launched 02:33:24.725962 run iperf3-srv_10.42.42.10(pid=12320): Launched 02:33:24.838085 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:33:25.038892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:25.338130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12321): Launched 02:33:25.597520 run iperf3-srv_10.42.42.10(pid=12322): Launched 02:33:25.709274 tst cs_paging_gprs_active.py:38: start network... 02:33:25.909576 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:26.372926 run create_hlr_db(pid=12323): Launched 02:33:26.495465 bus /gobi_6: Setting Powered False 02:33:27.555104 run create_hlr_db(pid=12323): Terminated: ok {rc=0} 02:33:27.991827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12325): Launched 02:33:28.312837 run osmo-hlr_10.42.42.2(pid=12326): Launched 02:33:28.436035 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:28.985208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12328): Launched 02:33:29.304665 run osmo-stp_10.42.42.5(pid=12329): Launched 02:33:29.429925 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:29.985276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12331): Launched 02:33:30.108026 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:30.379688 run patchelf(pid=12332): Launched 02:33:30.558607 run osmo-stp_10.42.42.5(pid=12329): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12329)] 02:33:30.694767 run osmo-stp_10.42.42.5(pid=12329): stdout: | (launched: 2022-12-09_02:33:29.246678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:30.834994 run osmo-stp_10.42.42.5(pid=12329): stderr: | 20221209023329439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023329439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023329439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023329440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023329440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023329440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023329440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:30.968707 run osmo-stp_10.42.42.5(pid=12329): stdout: | (launched: 2022-12-09_02:33:29.246678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:31.095100 run osmo-stp_10.42.42.5(pid=12329): stderr: | 20221209023329439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023329439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023329439 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023329440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023329440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023329440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023329440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:31.246848 run patchelf(pid=12332): Terminating (SIGINT) 02:33:31.420163 run patchelf(pid=12332): Terminated: ok {rc=0} 02:33:31.545128 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12329): Process ended prematurely: osmo-stp_10.42.42.5(pid=12329) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12329)] [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:33:31.556159 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:33:31.584304 run osmo-hlr_10.42.42.2(pid=12326): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12326)] 02:33:31.633130 run osmo-hlr_10.42.42.2(pid=12326): stdout: | (launched: 2022-12-09_02:33:28.254767) 02:33:31.684017 run osmo-hlr_10.42.42.2(pid=12326): stderr: | 20221209023328452 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023328452 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023328452 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023328452 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023328452 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023328452 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023328463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023328472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023328472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023328472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:31.734509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12319): Terminating (SIGTERM) 02:33:31.776124 run iperf3-srv_10.42.42.10(pid=12320): Terminating (SIGTERM) 02:33:31.817736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12321): Terminating (SIGTERM) 02:33:31.858162 run iperf3-srv_10.42.42.10(pid=12322): Terminating (SIGTERM) 02:33:31.899734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12325): Terminating (SIGTERM) 02:33:31.941559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12328): Terminating (SIGTERM) 02:33:31.986066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12331): Terminating (SIGTERM) 02:33:32.027796 --- ParallelTerminationStrategy: PID 12319 died... 02:33:32.048394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12319): Terminated: ok {rc=0} 02:33:32.095069 --- ParallelTerminationStrategy: PID 12320 died... 02:33:32.114739 run iperf3-srv_10.42.42.10(pid=12320): Terminated {rc=256} 02:33:32.160197 --- ParallelTerminationStrategy: PID 12321 died... 02:33:32.179725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12321): Terminated: ok {rc=0} 02:33:32.224209 --- ParallelTerminationStrategy: PID 12322 died... 02:33:32.243628 run iperf3-srv_10.42.42.10(pid=12322): Terminated {rc=256} 02:33:32.287788 --- ParallelTerminationStrategy: PID 12325 died... 02:33:32.307034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12325): Terminated: ok {rc=0} 02:33:32.350674 --- ParallelTerminationStrategy: PID 12328 died... 02:33:32.370229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12328): Terminated: ok {rc=0} 02:33:32.413464 --- ParallelTerminationStrategy: PID 12331 died... 02:33:32.431729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12331): Terminated: ok {rc=0} 02:33:32.516104 bus /gobi_0: Setting Powered False 02:33:33.615629 bus /gobi_0: Setting Powered False 02:33:34.730068 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:33:35.877817 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:35.889929 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:33:35.965190 tst iperf3.py: using LAC 18461 02:33:36.092755 tst iperf3.py: using RAC 101 02:33:36.218950 tst iperf3.py: using CellId 18461 02:33:36.345579 tst iperf3.py: using BVCI 18462 02:33:36.454878 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.465967 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.476713 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.487610 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.498444 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.509497 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.520279 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.530908 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.541741 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:36.658920 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:33:36.876783 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:37.198762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12333): Launched 02:33:37.477592 run iperf3-srv_10.42.42.10(pid=12334): Launched 02:33:37.598769 tst iperf3.py:8: start network... 02:33:37.815612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:38.312235 run create_hlr_db(pid=12335): Launched 02:33:38.435292 bus /gobi_6: Setting Powered False 02:33:39.499330 run create_hlr_db(pid=12335): Terminated: ok {rc=0} 02:33:39.943922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12337): Launched 02:33:40.264656 run osmo-hlr_10.42.42.2(pid=12338): Launched 02:33:40.388025 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:40.938530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12340): Launched 02:33:41.257202 run osmo-stp_10.42.42.5(pid=12341): Launched 02:33:41.380643 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:41.934003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12343): Launched 02:33:42.055802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:42.326643 run patchelf(pid=12344): Launched 02:33:42.504436 run osmo-stp_10.42.42.5(pid=12341): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12341)] 02:33:42.639695 run osmo-stp_10.42.42.5(pid=12341): stdout: | (launched: 2022-12-09_02:33:41.199448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:42.777138 run osmo-stp_10.42.42.5(pid=12341): stderr: | 20221209023341390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023341390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023341390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023341390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023341391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023341391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023341391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:42.914919 run osmo-stp_10.42.42.5(pid=12341): stdout: | (launched: 2022-12-09_02:33:41.199448) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:43.046369 run osmo-stp_10.42.42.5(pid=12341): stderr: | 20221209023341390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023341390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023341390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023341390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023341391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023341391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023341391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:43.202415 run patchelf(pid=12344): Terminating (SIGINT) 02:33:43.381781 run patchelf(pid=12344): Terminated: ok {rc=0} 02:33:43.510933 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12341): Process ended prematurely: osmo-stp_10.42.42.5(pid=12341) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12341)] [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 02:33:43.521039 tst iperf3.py:8: Test FAILED (7.7 sec) 02:33:43.549852 run osmo-hlr_10.42.42.2(pid=12338): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12338)] 02:33:43.599951 run osmo-hlr_10.42.42.2(pid=12338): stdout: | (launched: 2022-12-09_02:33:40.206553) 02:33:43.651542 run osmo-hlr_10.42.42.2(pid=12338): stderr: | 20221209023340404 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023340404 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023340404 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023340404 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023340404 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023340404 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023340417 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023340425 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023340425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023340425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:43.703592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12333): Terminating (SIGTERM) 02:33:43.745399 run iperf3-srv_10.42.42.10(pid=12334): Terminating (SIGTERM) 02:33:43.787496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12337): Terminating (SIGTERM) 02:33:43.829719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12340): Terminating (SIGTERM) 02:33:43.872016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12343): Terminating (SIGTERM) 02:33:43.914335 --- ParallelTerminationStrategy: PID 12333 died... 02:33:43.934376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12333): Terminated: ok {rc=0} 02:33:43.981215 --- ParallelTerminationStrategy: PID 12334 died... 02:33:44.000822 run iperf3-srv_10.42.42.10(pid=12334): Terminated {rc=256} 02:33:44.047237 --- ParallelTerminationStrategy: PID 12337 died... 02:33:44.066897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12337): Terminated: ok {rc=0} 02:33:44.113531 --- ParallelTerminationStrategy: PID 12340 died... 02:33:44.133262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12340): Terminated: ok {rc=0} 02:33:44.179810 --- ParallelTerminationStrategy: PID 12343 died... 02:33:44.199324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12343): Terminated: ok {rc=0} 02:33:44.287176 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:33:45.437204 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:45.449338 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:33:45.522616 tst iperf3m4.py: using LAC 18462 02:33:45.650253 tst iperf3m4.py: using RAC 102 02:33:45.775396 tst iperf3m4.py: using CellId 18462 02:33:45.911698 tst iperf3m4.py: using BVCI 18463 02:33:46.056391 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:46.071819 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:46.087798 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:46.103672 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:46.119341 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:46.135232 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:46.151314 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:46.167524 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:46.184181 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:46.334697 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:46.467136 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:46.595018 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:46.751475 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:33:46.960401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:47.283581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12346): Launched 02:33:47.559276 run iperf3-srv_10.42.42.10(pid=12347): Launched 02:33:47.679795 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:33:47.897101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:48.219088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12348): Launched 02:33:48.499337 run iperf3-srv_10.42.42.10(pid=12349): Launched 02:33:48.619643 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:33:48.836568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:49.159707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12350): Launched 02:33:49.437632 run iperf3-srv_10.42.42.10(pid=12351): Launched 02:33:49.558451 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:33:49.774706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:50.096393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12352): Launched 02:33:50.374626 run iperf3-srv_10.42.42.10(pid=12353): Launched 02:33:50.494747 tst iperf3m4.py:8: start network... 02:33:50.711166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:51.207979 run create_hlr_db(pid=12354): Launched 02:33:51.329330 bus /gobi_6: Setting Powered False 02:33:52.392368 run create_hlr_db(pid=12354): Terminated: ok {rc=0} 02:33:52.838325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12356): Launched 02:33:53.158489 run osmo-hlr_10.42.42.2(pid=12357): Launched 02:33:53.281498 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:53.834495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12359): Launched 02:33:54.154161 run osmo-stp_10.42.42.5(pid=12360): Launched 02:33:54.276646 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:54.830191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12362): Launched 02:33:54.952913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:55.223987 run patchelf(pid=12363): Launched 02:33:55.401853 run osmo-stp_10.42.42.5(pid=12360): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12360)] 02:33:55.537773 run osmo-stp_10.42.42.5(pid=12360): stdout: | (launched: 2022-12-09_02:33:54.096166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:55.675490 run osmo-stp_10.42.42.5(pid=12360): stderr: | 20221209023354282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023354282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023354283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023354283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023354284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023354284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023354284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:55.813142 run osmo-stp_10.42.42.5(pid=12360): stdout: | (launched: 2022-12-09_02:33:54.096166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:55.945199 run osmo-stp_10.42.42.5(pid=12360): stderr: | 20221209023354282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023354282 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023354283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023354283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023354284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023354284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023354284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:56.101118 run patchelf(pid=12363): Terminating (SIGINT) 02:33:56.279970 run patchelf(pid=12363): Terminated: ok {rc=0} 02:33:56.409186 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12360): Process ended prematurely: osmo-stp_10.42.42.5(pid=12360) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12360)] [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:33:56.419200 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:33:56.448511 run osmo-hlr_10.42.42.2(pid=12357): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12357)] 02:33:56.498979 run osmo-hlr_10.42.42.2(pid=12357): stdout: | (launched: 2022-12-09_02:33:53.099333) 02:33:56.551056 run osmo-hlr_10.42.42.2(pid=12357): stderr: | 20221209023353295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023353295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023353295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023353295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023353295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023353295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023353310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023353319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023353319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023353319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:56.603403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12346): Terminating (SIGTERM) 02:33:56.645592 run iperf3-srv_10.42.42.10(pid=12347): Terminating (SIGTERM) 02:33:56.687336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12348): Terminating (SIGTERM) 02:33:56.729361 run iperf3-srv_10.42.42.10(pid=12349): Terminating (SIGTERM) 02:33:56.771167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12350): Terminating (SIGTERM) 02:33:56.812677 run iperf3-srv_10.42.42.10(pid=12351): Terminating (SIGTERM) 02:33:56.854004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12352): Terminating (SIGTERM) 02:33:56.895722 run iperf3-srv_10.42.42.10(pid=12353): Terminating (SIGTERM) 02:33:56.936943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12356): Terminating (SIGTERM) 02:33:56.978530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12359): Terminating (SIGTERM) 02:33:57.020168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12362): Terminating (SIGTERM) 02:33:57.062336 --- ParallelTerminationStrategy: PID 12346 died... 02:33:57.082263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12346): Terminated: ok {rc=0} 02:33:57.128744 --- ParallelTerminationStrategy: PID 12347 died... 02:33:57.148104 run iperf3-srv_10.42.42.10(pid=12347): Terminated {rc=256} 02:33:57.194464 --- ParallelTerminationStrategy: PID 12348 died... 02:33:57.213817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12348): Terminated: ok {rc=0} 02:33:57.259983 --- ParallelTerminationStrategy: PID 12349 died... 02:33:57.279325 run iperf3-srv_10.42.42.10(pid=12349): Terminated {rc=256} 02:33:57.325261 --- ParallelTerminationStrategy: PID 12350 died... 02:33:57.344580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12350): Terminated: ok {rc=0} 02:33:57.391311 --- ParallelTerminationStrategy: PID 12351 died... 02:33:57.410645 run iperf3-srv_10.42.42.10(pid=12351): Terminated {rc=256} 02:33:57.456531 --- ParallelTerminationStrategy: PID 12352 died... 02:33:57.475940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12352): Terminated: ok {rc=0} 02:33:57.523262 --- ParallelTerminationStrategy: PID 12353 died... 02:33:57.542743 run iperf3-srv_10.42.42.10(pid=12353): Terminated {rc=256} 02:33:57.589183 --- ParallelTerminationStrategy: PID 12356 died... 02:33:57.608405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12356): Terminated: ok {rc=0} 02:33:57.654352 --- ParallelTerminationStrategy: PID 12359 died... 02:33:57.673595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12359): Terminated: ok {rc=0} 02:33:57.719117 --- ParallelTerminationStrategy: PID 12362 died... 02:33:57.738645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12362): Terminated: ok {rc=0} 02:33:57.825681 bus /gobi_4: Setting Powered False 02:33:58.923487 bus /gobi_4: Setting Powered False 02:34:00.039389 bus /gobi_1: Setting Powered False 02:34:01.140214 bus /gobi_1: Setting Powered False 02:34:02.257342 bus /gobi_0: Setting Powered False 02:34:03.354853 bus /gobi_0: Setting Powered False 02:34:04.471673 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:34:05.571974 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:05.583486 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:34:05.656857 tst ping.py: using LAC 18463 02:34:05.773344 tst ping.py: using RAC 103 02:34:05.888813 tst ping.py: using CellId 18463 02:34:06.003837 tst ping.py: using BVCI 18464 02:34:06.111604 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:06.122779 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:06.133746 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:06.144809 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:06.155924 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:06.167034 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:06.178116 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:06.189269 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:34:06.303621 tst ping.py:19: start network... 02:34:06.499626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:06.952005 run create_hlr_db(pid=12364): Launched 02:34:07.071237 bus /gobi_6: Setting Powered False 02:34:08.133109 run create_hlr_db(pid=12364): Terminated: ok {rc=0} 02:34:08.571783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12366): Launched 02:34:08.886037 run osmo-hlr_10.42.42.2(pid=12367): Launched 02:34:09.006559 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:09.560019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12369): Launched 02:34:09.873864 run osmo-stp_10.42.42.5(pid=12370): Launched 02:34:09.994390 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:10.537693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12372): Launched 02:34:10.658301 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:10.923412 run patchelf(pid=12373): Launched 02:34:11.097847 run osmo-stp_10.42.42.5(pid=12370): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12370)] 02:34:11.231156 run osmo-stp_10.42.42.5(pid=12370): stdout: | (launched: 2022-12-09_02:34:09.817182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:11.366062 run osmo-stp_10.42.42.5(pid=12370): stderr: | 20221209023410011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023410011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023410011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023410012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023410012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023410013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023410013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:11.501518 run osmo-stp_10.42.42.5(pid=12370): stdout: | (launched: 2022-12-09_02:34:09.817182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:11.630836 run osmo-stp_10.42.42.5(pid=12370): stderr: | 20221209023410011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023410011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023410011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023410012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023410012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023410013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023410013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:11.783971 run patchelf(pid=12373): Terminating (SIGINT) 02:34:11.959807 run patchelf(pid=12373): Terminated: ok {rc=0} 02:34:12.086868 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12370): Process ended prematurely: osmo-stp_10.42.42.5(pid=12370) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12370)] [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 02:34:12.096148 tst ping.py:22: Test FAILED (6.5 sec) 02:34:12.124444 run osmo-hlr_10.42.42.2(pid=12367): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12367)] 02:34:12.174275 run osmo-hlr_10.42.42.2(pid=12367): stdout: | (launched: 2022-12-09_02:34:08.828928) 02:34:12.225695 run osmo-hlr_10.42.42.2(pid=12367): stderr: | 20221209023409025 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023409025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023409025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023409025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023409025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023409025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023409038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023409046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023409046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023409046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:12.277551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12366): Terminating (SIGTERM) 02:34:12.319094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12369): Terminating (SIGTERM) 02:34:12.360744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12372): Terminating (SIGTERM) 02:34:12.403102 --- ParallelTerminationStrategy: PID 12366 died... 02:34:12.422994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12366): Terminated: ok {rc=0} 02:34:12.469144 --- ParallelTerminationStrategy: PID 12369 died... 02:34:12.488371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12369): Terminated: ok {rc=0} 02:34:12.534817 --- ParallelTerminationStrategy: PID 12372 died... 02:34:12.554202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12372): Terminated: ok {rc=0} 02:34:12.642746 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:34:13.730012 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:13.742441 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:34:13.816151 tst ping_idle_ping.py: using LAC 18464 02:34:13.940895 tst ping_idle_ping.py: using RAC 104 02:34:14.064487 tst ping_idle_ping.py: using CellId 18464 02:34:14.188064 tst ping_idle_ping.py: using BVCI 18465 02:34:14.303079 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:14.314447 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:14.325736 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:14.337251 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:14.348509 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:14.359931 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:14.371404 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:34:14.382763 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:34:14.501853 tst ping_idle_ping.py:24: start network... 02:34:14.701864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:15.160909 run create_hlr_db(pid=12375): Launched 02:34:15.282709 bus /gobi_6: Setting Powered False 02:34:16.340722 run create_hlr_db(pid=12375): Terminated: ok {rc=0} 02:34:16.778639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12377): Launched 02:34:17.090193 run osmo-hlr_10.42.42.2(pid=12378): Launched 02:34:17.280594 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:17.783022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12380): Launched 02:34:18.075121 run osmo-stp_10.42.42.5(pid=12381): Launched 02:34:18.186331 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:18.691162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12383): Launched 02:34:18.802442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:19.048898 run patchelf(pid=12384): Launched 02:34:19.211443 run osmo-stp_10.42.42.5(pid=12381): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12381)] 02:34:19.335425 run osmo-stp_10.42.42.5(pid=12381): stdout: | (launched: 2022-12-09_02:34:18.021759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:19.461283 run osmo-stp_10.42.42.5(pid=12381): stderr: | 20221209023418191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023418191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023418192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023418192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023418193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023418193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023418193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:19.587569 run osmo-stp_10.42.42.5(pid=12381): stdout: | (launched: 2022-12-09_02:34:18.021759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:19.707453 run osmo-stp_10.42.42.5(pid=12381): stderr: | 20221209023418191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023418191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023418192 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023418192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023418193 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023418193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023418193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:19.849971 run patchelf(pid=12384): Terminating (SIGINT) 02:34:20.014078 run patchelf(pid=12384): Terminated: ok {rc=0} 02:34:20.132312 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12381): Process ended prematurely: osmo-stp_10.42.42.5(pid=12381) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12381)] [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:34:20.141062 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:34:20.167183 run osmo-hlr_10.42.42.2(pid=12378): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12378)] 02:34:20.213693 run osmo-hlr_10.42.42.2(pid=12378): stdout: | (launched: 2022-12-09_02:34:17.028233) 02:34:20.262093 run osmo-hlr_10.42.42.2(pid=12378): stderr: | 20221209023417236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023417236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023417236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023417236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023417237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023417237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023417249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023417257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023417257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023417257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:20.310912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12377): Terminating (SIGTERM) 02:34:20.350035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12380): Terminating (SIGTERM) 02:34:20.389062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12383): Terminating (SIGTERM) 02:34:20.428212 --- ParallelTerminationStrategy: PID 12377 died... 02:34:20.446514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12377): Terminated: ok {rc=0} 02:34:20.489661 --- ParallelTerminationStrategy: PID 12380 died... 02:34:20.507978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12380): Terminated: ok {rc=0} 02:34:20.550922 --- ParallelTerminationStrategy: PID 12383 died... 02:34:20.569504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12383): Terminated: ok {rc=0} 02:34:20.652428 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 02:34:21.959336 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:34:21.966216 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 02:34:22.000931 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 02:34:22.040832 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 02:34:22.130676 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 02:34:22.165169 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 02:34:22.203304 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 02:34:22.798793 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 02:34:22.847069 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:22.858646 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:34:22.910615 tst cs_paging_gprs_active.py: using LAC 18465 02:34:23.031174 tst cs_paging_gprs_active.py: using RAC 105 02:34:23.156759 tst cs_paging_gprs_active.py: using CellId 18465 02:34:23.274111 tst cs_paging_gprs_active.py: using BVCI 18466 02:34:23.382229 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:23.393762 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:23.404849 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:23.416172 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:23.427390 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:23.438464 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:23.449761 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:23.460707 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:23.471899 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:23.589966 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:23.710275 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:34:23.927318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:24.248558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12388): Launched 02:34:24.528042 run iperf3-srv_10.42.42.10(pid=12389): Launched 02:34:24.649091 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:34:24.865904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:25.187768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12390): Launched 02:34:25.466335 run iperf3-srv_10.42.42.10(pid=12391): Launched 02:34:25.587269 tst cs_paging_gprs_active.py:38: start network... 02:34:25.804300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:26.300627 run create_hlr_db(pid=12392): Launched 02:34:26.422915 bus /gobi_6: Setting Powered False 02:34:27.487365 run create_hlr_db(pid=12392): Terminated: ok {rc=0} 02:34:27.913785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12394): Launched 02:34:28.210564 run osmo-hlr_10.42.42.2(pid=12395): Launched 02:34:28.324044 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:28.837416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12397): Launched 02:34:29.135399 run osmo-stp_10.42.42.5(pid=12398): Launched 02:34:29.249241 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:29.764891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12400): Launched 02:34:29.878735 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:30.130902 run patchelf(pid=12401): Launched 02:34:30.296543 run osmo-stp_10.42.42.5(pid=12398): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12398)] 02:34:30.423073 run osmo-stp_10.42.42.5(pid=12398): stdout: | (launched: 2022-12-09_02:34:29.080768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:30.550876 run osmo-stp_10.42.42.5(pid=12398): stderr: | 20221209023429248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023429248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023429248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023429249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023429249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023429249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023429249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:30.679516 run osmo-stp_10.42.42.5(pid=12398): stdout: | (launched: 2022-12-09_02:34:29.080768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:30.801797 run osmo-stp_10.42.42.5(pid=12398): stderr: | 20221209023429248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023429248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023429248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023429249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023429249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023429249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023429249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:30.973936 run patchelf(pid=12401): Terminating (SIGINT) 02:34:31.159648 run patchelf(pid=12401): Terminated: ok {rc=0} 02:34:31.294266 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12398): Process ended prematurely: osmo-stp_10.42.42.5(pid=12398) [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12398)] [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 02:34:31.307072 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:34:31.341205 run osmo-hlr_10.42.42.2(pid=12395): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12395)] 02:34:31.400108 run osmo-hlr_10.42.42.2(pid=12395): stdout: | (launched: 2022-12-09_02:34:28.156366) 02:34:31.461700 run osmo-hlr_10.42.42.2(pid=12395): stderr: | 20221209023428330 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023428330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023428330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023428330 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023428330 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023428330 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023428342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023428351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023428351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023428351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:31.523838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12388): Terminating (SIGTERM) 02:34:31.574689 run iperf3-srv_10.42.42.10(pid=12389): Terminating (SIGTERM) 02:34:31.628116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12390): Terminating (SIGTERM) 02:34:31.678798 run iperf3-srv_10.42.42.10(pid=12391): Terminating (SIGTERM) 02:34:31.729943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12394): Terminating (SIGTERM) 02:34:31.778848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12397): Terminating (SIGTERM) 02:34:31.827231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12400): Terminating (SIGTERM) 02:34:31.874367 --- ParallelTerminationStrategy: PID 12388 died... 02:34:31.895541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12388): Terminated: ok {rc=0} 02:34:31.947602 --- ParallelTerminationStrategy: PID 12389 died... 02:34:31.969698 run iperf3-srv_10.42.42.10(pid=12389): Terminated {rc=256} 02:34:32.019432 --- ParallelTerminationStrategy: PID 12390 died... 02:34:32.040765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12390): Terminated: ok {rc=0} 02:34:32.090694 --- ParallelTerminationStrategy: PID 12391 died... 02:34:32.111220 run iperf3-srv_10.42.42.10(pid=12391): Terminated {rc=256} 02:34:32.162109 --- ParallelTerminationStrategy: PID 12394 died... 02:34:32.182844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12394): Terminated: ok {rc=0} 02:34:32.233395 --- ParallelTerminationStrategy: PID 12397 died... 02:34:32.254346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12397): Terminated: ok {rc=0} 02:34:32.301666 --- ParallelTerminationStrategy: PID 12400 died... 02:34:32.320899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12400): Terminated: ok {rc=0} 02:34:32.408729 bus /gobi_0: Setting Powered False 02:34:33.507230 bus /gobi_0: Setting Powered False 02:34:34.625130 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 02:34:35.770549 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:35.782569 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:34:35.841372 tst iperf3.py: using LAC 18466 02:34:35.958994 tst iperf3.py: using RAC 106 02:34:36.085713 tst iperf3.py: using CellId 18466 02:34:36.213305 tst iperf3.py: using BVCI 18467 02:34:36.330903 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.342873 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.354713 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.366981 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.379220 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.391345 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.403757 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.416032 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.428401 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:36.547083 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:34:36.750283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:37.051471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12402): Launched 02:34:37.312423 run iperf3-srv_10.42.42.10(pid=12403): Launched 02:34:37.424773 tst iperf3.py:8: start network... 02:34:37.625907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:38.089994 run create_hlr_db(pid=12404): Launched 02:34:38.211997 bus /gobi_6: Setting Powered False 02:34:39.271249 run create_hlr_db(pid=12404): Terminated: ok {rc=0} 02:34:39.708368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12406): Launched 02:34:40.028521 run osmo-hlr_10.42.42.2(pid=12407): Launched 02:34:40.151922 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:40.703730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12409): Launched 02:34:41.024676 run osmo-stp_10.42.42.5(pid=12410): Launched 02:34:41.149413 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:41.703209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12412): Launched 02:34:41.826165 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:42.097660 run patchelf(pid=12413): Launched 02:34:42.275784 run osmo-stp_10.42.42.5(pid=12410): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12410)] 02:34:42.411841 run osmo-stp_10.42.42.5(pid=12410): stdout: | (launched: 2022-12-09_02:34:40.966737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:42.549907 run osmo-stp_10.42.42.5(pid=12410): stderr: | 20221209023441157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023441157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023441157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023441158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023441158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023441158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023441158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:42.687514 run osmo-stp_10.42.42.5(pid=12410): stdout: | (launched: 2022-12-09_02:34:40.966737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:42.819626 run osmo-stp_10.42.42.5(pid=12410): stderr: | 20221209023441157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023441157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023441157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023441158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023441158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023441158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023441158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:42.975669 run patchelf(pid=12413): Terminating (SIGINT) 02:34:43.155842 run patchelf(pid=12413): Terminated: ok {rc=0} 02:34:43.285505 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12410): Process ended prematurely: osmo-stp_10.42.42.5(pid=12410) [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12410)] [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 02:34:43.295515 tst iperf3.py:8: Test FAILED (7.6 sec) 02:34:43.324313 run osmo-hlr_10.42.42.2(pid=12407): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12407)] 02:34:43.374008 run osmo-hlr_10.42.42.2(pid=12407): stdout: | (launched: 2022-12-09_02:34:39.970629) 02:34:43.425439 run osmo-hlr_10.42.42.2(pid=12407): stderr: | 20221209023440167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023440167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023440167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023440167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023440167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023440167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023440179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023440187 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023440188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023440188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:43.477421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12402): Terminating (SIGTERM) 02:34:43.519283 run iperf3-srv_10.42.42.10(pid=12403): Terminating (SIGTERM) 02:34:43.560715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12406): Terminating (SIGTERM) 02:34:43.602992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12409): Terminating (SIGTERM) 02:34:43.644719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12412): Terminating (SIGTERM) 02:34:43.686364 --- ParallelTerminationStrategy: PID 12402 died... 02:34:43.706091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12402): Terminated: ok {rc=0} 02:34:43.752240 --- ParallelTerminationStrategy: PID 12403 died... 02:34:43.771433 run iperf3-srv_10.42.42.10(pid=12403): Terminated {rc=256} 02:34:43.817275 --- ParallelTerminationStrategy: PID 12406 died... 02:34:43.836514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12406): Terminated: ok {rc=0} 02:34:43.882504 --- ParallelTerminationStrategy: PID 12409 died... 02:34:43.901910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12409): Terminated: ok {rc=0} 02:34:43.947816 --- ParallelTerminationStrategy: PID 12412 died... 02:34:43.967085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12412): Terminated: ok {rc=0} 02:34:44.053799 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 02:34:45.202059 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:45.214896 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:34:45.268940 tst iperf3m4.py: using LAC 18467 02:34:45.396277 tst iperf3m4.py: using RAC 107 02:34:45.522225 tst iperf3m4.py: using CellId 18467 02:34:45.650107 tst iperf3m4.py: using BVCI 18468 02:34:45.768412 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:45.780282 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:45.791866 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:45.803722 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:45.815560 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:45.827685 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:45.840107 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:45.852340 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:45.864550 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:45.998497 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:46.142785 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:46.271403 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:46.421507 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:34:46.665859 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:47.002484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12414): Launched 02:34:47.295358 run iperf3-srv_10.42.42.10(pid=12415): Launched 02:34:47.424567 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:34:47.642619 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:47.966296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12416): Launched 02:34:48.245107 run iperf3-srv_10.42.42.10(pid=12417): Launched 02:34:48.365709 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:34:48.583171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:48.906076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12418): Launched 02:34:49.184591 run iperf3-srv_10.42.42.10(pid=12419): Launched 02:34:49.304569 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:34:49.521632 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:49.843935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12420): Launched 02:34:50.121984 run iperf3-srv_10.42.42.10(pid=12421): Launched 02:34:50.241844 tst iperf3m4.py:8: start network... 02:34:50.458428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:50.957862 run create_hlr_db(pid=12422): Launched 02:34:51.079928 bus /gobi_6: Setting Powered False 02:34:52.142795 run create_hlr_db(pid=12422): Terminated: ok {rc=0} 02:34:52.588078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12424): Launched 02:34:52.908685 run osmo-hlr_10.42.42.2(pid=12425): Launched 02:34:53.032121 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:53.589864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12427): Launched 02:34:53.910175 run osmo-stp_10.42.42.5(pid=12428): Launched 02:34:54.032715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:54.587604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12430): Launched 02:34:54.706119 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:54.977386 run patchelf(pid=12431): Launched 02:34:55.156144 run osmo-stp_10.42.42.5(pid=12428): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12428)] 02:34:55.291760 run osmo-stp_10.42.42.5(pid=12428): stdout: | (launched: 2022-12-09_02:34:53.852297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:55.429530 run osmo-stp_10.42.42.5(pid=12428): stderr: | 20221209023454039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023454040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023454040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023454040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023454041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023454041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023454041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:55.567759 run osmo-stp_10.42.42.5(pid=12428): stdout: | (launched: 2022-12-09_02:34:53.852297) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:55.700040 run osmo-stp_10.42.42.5(pid=12428): stderr: | 20221209023454039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023454040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023454040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023454040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023454041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023454041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023454041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:55.856566 run patchelf(pid=12431): Terminating (SIGINT) 02:34:56.036027 run patchelf(pid=12431): Terminated: ok {rc=0} 02:34:56.165886 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12428): Process ended prematurely: osmo-stp_10.42.42.5(pid=12428) [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12428)] [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 02:34:56.176171 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:34:56.205403 run osmo-hlr_10.42.42.2(pid=12425): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12425)] 02:34:56.255453 run osmo-hlr_10.42.42.2(pid=12425): stdout: | (launched: 2022-12-09_02:34:52.850481) 02:34:56.307129 run osmo-hlr_10.42.42.2(pid=12425): stderr: | 20221209023453046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023453046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023453046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023453046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023453046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023453046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023453058 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023453066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023453066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023453066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:56.359220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12414): Terminating (SIGTERM) 02:34:56.401074 run iperf3-srv_10.42.42.10(pid=12415): Terminating (SIGTERM) 02:34:56.442934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12416): Terminating (SIGTERM) 02:34:56.484716 run iperf3-srv_10.42.42.10(pid=12417): Terminating (SIGTERM) 02:34:56.526640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12418): Terminating (SIGTERM) 02:34:56.568552 run iperf3-srv_10.42.42.10(pid=12419): Terminating (SIGTERM) 02:34:56.610238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12420): Terminating (SIGTERM) 02:34:56.652086 run iperf3-srv_10.42.42.10(pid=12421): Terminating (SIGTERM) 02:34:56.693667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12424): Terminating (SIGTERM) 02:34:56.735288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12427): Terminating (SIGTERM) 02:34:56.776812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12430): Terminating (SIGTERM) 02:34:56.818847 --- ParallelTerminationStrategy: PID 12414 died... 02:34:56.838822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12414): Terminated: ok {rc=0} 02:34:56.885575 --- ParallelTerminationStrategy: PID 12415 died... 02:34:56.905130 run iperf3-srv_10.42.42.10(pid=12415): Terminated {rc=256} 02:34:56.951115 --- ParallelTerminationStrategy: PID 12416 died... 02:34:56.970681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12416): Terminated: ok {rc=0} 02:34:57.016879 --- ParallelTerminationStrategy: PID 12417 died... 02:34:57.036613 run iperf3-srv_10.42.42.10(pid=12417): Terminated {rc=256} 02:34:57.082777 --- ParallelTerminationStrategy: PID 12418 died... 02:34:57.102363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12418): Terminated: ok {rc=0} 02:34:57.148579 --- ParallelTerminationStrategy: PID 12419 died... 02:34:57.168089 run iperf3-srv_10.42.42.10(pid=12419): Terminated {rc=256} 02:34:57.214218 --- ParallelTerminationStrategy: PID 12420 died... 02:34:57.233701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12420): Terminated: ok {rc=0} 02:34:57.279296 --- ParallelTerminationStrategy: PID 12421 died... 02:34:57.299037 run iperf3-srv_10.42.42.10(pid=12421): Terminated {rc=256} 02:34:57.345221 --- ParallelTerminationStrategy: PID 12424 died... 02:34:57.364678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12424): Terminated: ok {rc=0} 02:34:57.411072 --- ParallelTerminationStrategy: PID 12427 died... 02:34:57.430695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12427): Terminated: ok {rc=0} 02:34:57.477188 --- ParallelTerminationStrategy: PID 12430 died... 02:34:57.496664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12430): Terminated: ok {rc=0} 02:34:57.585216 bus /gobi_4: Setting Powered False 02:34:58.684457 bus /gobi_4: Setting Powered False 02:34:59.799384 bus /gobi_1: Setting Powered False 02:35:00.900420 bus /gobi_1: Setting Powered False 02:35:02.025768 bus /gobi_0: Setting Powered False 02:35:03.140519 bus /gobi_0: Setting Powered False 02:35:04.255190 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 02:35:05.357733 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:05.370123 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:35:05.429052 tst ping.py: using LAC 18468 02:35:05.552725 tst ping.py: using RAC 108 02:35:05.675248 tst ping.py: using CellId 18468 02:35:05.797357 tst ping.py: using BVCI 18469 02:35:05.912278 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:05.924133 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:05.935780 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:05.947587 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:05.959273 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:05.971202 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:05.983187 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:05.995155 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:35:06.110072 tst ping.py:19: start network... 02:35:06.306879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:06.762421 run create_hlr_db(pid=12435): Launched 02:35:06.883794 bus /gobi_6: Setting Powered False 02:35:07.941736 run create_hlr_db(pid=12435): Terminated: ok {rc=0} 02:35:08.371825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12437): Launched 02:35:08.687632 run osmo-hlr_10.42.42.2(pid=12438): Launched 02:35:08.808664 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:09.354056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12440): Launched 02:35:09.668697 run osmo-stp_10.42.42.5(pid=12441): Launched 02:35:09.788872 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:35:10.333395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12443): Launched 02:35:10.454430 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:35:10.722051 run patchelf(pid=12444): Launched 02:35:10.897114 run osmo-stp_10.42.42.5(pid=12441): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12441)] 02:35:11.031450 run osmo-stp_10.42.42.5(pid=12441): stdout: | (launched: 2022-12-09_02:35:09.611548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:11.166937 run osmo-stp_10.42.42.5(pid=12441): stderr: | 20221209023509802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023509802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023509803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023509803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023509803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023509803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023509804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:11.302903 run osmo-stp_10.42.42.5(pid=12441): stdout: | (launched: 2022-12-09_02:35:09.611548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:11.432852 run osmo-stp_10.42.42.5(pid=12441): stderr: | 20221209023509802 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023509802 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023509803 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023509803 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023509803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023509803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023509804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:11.587449 run patchelf(pid=12444): Terminating (SIGINT) 02:35:11.763989 run patchelf(pid=12444): Terminated: ok {rc=0} 02:35:11.891469 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12441): Process ended prematurely: osmo-stp_10.42.42.5(pid=12441) [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12441)] [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 02:35:11.900875 tst ping.py:22: Test FAILED (6.5 sec) 02:35:11.929407 run osmo-hlr_10.42.42.2(pid=12438): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12438)] 02:35:11.979498 run osmo-hlr_10.42.42.2(pid=12438): stdout: | (launched: 2022-12-09_02:35:08.630421) 02:35:12.031369 run osmo-hlr_10.42.42.2(pid=12438): stderr: | 20221209023508827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023508828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023508828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023508828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023508828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023508828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023508840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023508848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023508848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023508848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:12.083468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12437): Terminating (SIGTERM) 02:35:12.125132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12440): Terminating (SIGTERM) 02:35:12.166933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12443): Terminating (SIGTERM) 02:35:12.209040 --- ParallelTerminationStrategy: PID 12437 died... 02:35:12.229044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12437): Terminated: ok {rc=0} 02:35:12.275375 --- ParallelTerminationStrategy: PID 12440 died... 02:35:12.294835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12440): Terminated: ok {rc=0} 02:35:12.340923 --- ParallelTerminationStrategy: PID 12443 died... 02:35:12.360431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12443): Terminated: ok {rc=0} 02:35:12.447680 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 02:35:13.535802 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:13.548209 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:35:13.603607 tst ping_idle_ping.py: using LAC 18469 02:35:13.729600 tst ping_idle_ping.py: using RAC 109 02:35:13.853555 tst ping_idle_ping.py: using CellId 18469 02:35:13.977628 tst ping_idle_ping.py: using BVCI 18470 02:35:14.085250 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:14.096607 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:14.107832 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:14.118994 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:14.130133 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:14.141336 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:14.152621 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:35:14.163756 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:35:14.280586 tst ping_idle_ping.py:24: start network... 02:35:14.494694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:14.988701 run create_hlr_db(pid=12445): Launched 02:35:15.109957 bus /gobi_6: Setting Powered False 02:35:16.186334 run create_hlr_db(pid=12445): Terminated: ok {rc=0} 02:35:16.714477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12447): Launched 02:35:17.143435 run osmo-hlr_10.42.42.2(pid=12448): Launched 02:35:17.310536 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:17.866867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12450): Launched 02:35:18.182418 run osmo-stp_10.42.42.5(pid=12451): Launched 02:35:18.302624 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:35:18.848717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12453): Launched 02:35:18.969827 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:35:19.237470 run patchelf(pid=12454): Launched 02:35:19.412879 run osmo-stp_10.42.42.5(pid=12451): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12451)] 02:35:19.547442 run osmo-stp_10.42.42.5(pid=12451): stdout: | (launched: 2022-12-09_02:35:18.125334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:19.683778 run osmo-stp_10.42.42.5(pid=12451): stderr: | 20221209023518314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023518314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023518315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023518315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023518315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023518315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023518316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:19.819535 run osmo-stp_10.42.42.5(pid=12451): stdout: | (launched: 2022-12-09_02:35:18.125334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:19.949926 run osmo-stp_10.42.42.5(pid=12451): stderr: | 20221209023518314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023518314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023518315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023518315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023518315 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023518315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023518316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:20.104259 run patchelf(pid=12454): Terminating (SIGINT) 02:35:20.281732 run patchelf(pid=12454): Terminated: ok {rc=0} 02:35:20.409253 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12451): Process ended prematurely: osmo-stp_10.42.42.5(pid=12451) [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12451)] [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 02:35:20.418807 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 02:35:20.446849 run osmo-hlr_10.42.42.2(pid=12448): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12448)] 02:35:20.497247 run osmo-hlr_10.42.42.2(pid=12448): stdout: | (launched: 2022-12-09_02:35:17.060715) 02:35:20.549508 run osmo-hlr_10.42.42.2(pid=12448): stderr: | 20221209023517434 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023517435 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023517435 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023517435 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023517435 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023517435 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023517447 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023517456 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023517456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023517456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:20.602110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12447): Terminating (SIGTERM) 02:35:20.643920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12450): Terminating (SIGTERM) 02:35:20.686132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12453): Terminating (SIGTERM) 02:35:20.728398 --- ParallelTerminationStrategy: PID 12447 died... 02:35:20.748386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12447): Terminated: ok {rc=0} 02:35:20.795147 --- ParallelTerminationStrategy: PID 12450 died... 02:35:20.814778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12450): Terminated: ok {rc=0} 02:35:20.861113 --- ParallelTerminationStrategy: PID 12453 died... 02:35:20.880554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12453): Terminated: ok {rc=0} 02:35:20.967769 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:35:22.276775 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:22.284314 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:35:22.319423 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:35:22.354882 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:35:22.408637 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:35:22.442863 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:35:22.478383 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:35:23.039807 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:35:23.045965 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:35:23.058250 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:35:23.127872 tst switch_tch_pdch.py: using LAC 18470 02:35:23.250000 tst switch_tch_pdch.py: using RAC 110 02:35:23.374387 tst switch_tch_pdch.py: using CellId 18470 02:35:23.496285 tst switch_tch_pdch.py: using BVCI 18471 02:35:23.611835 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:35:23.623428 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:35:23.635072 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:35:23.646846 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:35:23.658581 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:35:23.670251 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:35:23.682060 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:35:23.693806 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:35:23.810488 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:35:23.925365 tst switch_tch_pdch.py:51: start network... 02:35:24.121396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:24.575812 run create_hlr_db(pid=12459): Launched 02:35:24.696769 bus /gobi_6: Setting Powered False 02:35:25.755820 run create_hlr_db(pid=12459): Terminated: ok {rc=0} 02:35:26.167150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12461): Launched 02:35:26.458235 run osmo-hlr_10.42.42.2(pid=12462): Launched 02:35:26.569353 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:27.090492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12464): Launched 02:35:27.383383 run osmo-stp_10.42.42.5(pid=12465): Launched 02:35:27.494515 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:35:28.000234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12467): Launched 02:35:28.111214 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:35:28.357664 run patchelf(pid=12468): Launched 02:35:28.519637 run osmo-stp_10.42.42.5(pid=12465): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12465)] 02:35:28.643338 run osmo-stp_10.42.42.5(pid=12465): stdout: | (launched: 2022-12-09_02:35:27.329903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:28.769243 run osmo-stp_10.42.42.5(pid=12465): stderr: | 20221209023527499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023527499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023527500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023527500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023527501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023527501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023527501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:28.894935 run osmo-stp_10.42.42.5(pid=12465): stdout: | (launched: 2022-12-09_02:35:27.329903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:29.015160 run osmo-stp_10.42.42.5(pid=12465): stderr: | 20221209023527499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023527499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023527500 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023527500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023527501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023527501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023527501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:29.158213 run patchelf(pid=12468): Terminating (SIGINT) 02:35:29.322418 run patchelf(pid=12468): Terminated: ok {rc=0} 02:35:29.440168 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12465): Process ended prematurely: osmo-stp_10.42.42.5(pid=12465) [trial-2353↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12465)] [trial-2353↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:35:29.448999 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 02:35:29.475343 run osmo-hlr_10.42.42.2(pid=12462): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12462)] 02:35:29.522465 run osmo-hlr_10.42.42.2(pid=12462): stdout: | (launched: 2022-12-09_02:35:26.405193) 02:35:29.571109 run osmo-hlr_10.42.42.2(pid=12462): stderr: | 20221209023526579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023526579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023526579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023526579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023526579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023526579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023526592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023526600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023526600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023526600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:29.620038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12461): Terminating (SIGTERM) 02:35:29.659337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12464): Terminating (SIGTERM) 02:35:29.698607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12467): Terminating (SIGTERM) 02:35:29.738167 --- ParallelTerminationStrategy: PID 12461 died... 02:35:29.757219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12461): Terminated: ok {rc=0} 02:35:29.800458 --- ParallelTerminationStrategy: PID 12464 died... 02:35:29.818938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12464): Terminated: ok {rc=0} 02:35:29.862324 --- ParallelTerminationStrategy: PID 12467 died... 02:35:29.880602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12467): Terminated: ok {rc=0} 02:35:29.965577 bus /gobi_0: Setting Powered False 02:35:31.062326 bus /gobi_0: Setting Powered False 02:35:32.188510 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:35:33.443411 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:33.449594 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:35:33.484519 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:35:33.520283 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:35:33.574475 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:35:33.608776 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:35:33.644595 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:35:34.201143 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:35:34.206298 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:34.217680 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:35:34.291876 tst switch_tch_pdch.py: using LAC 18471 02:35:34.408675 tst switch_tch_pdch.py: using RAC 111 02:35:34.523409 tst switch_tch_pdch.py: using CellId 18471 02:35:34.637986 tst switch_tch_pdch.py: using BVCI 18472 02:35:34.746756 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:34.757737 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:34.768765 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:34.779553 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:34.790309 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:34.801057 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:34.811889 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:34.822665 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:35:34.939778 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:35:35.059648 tst switch_tch_pdch.py:51: start network... 02:35:35.272138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:35.732827 run create_hlr_db(pid=12473): Launched 02:35:35.853194 bus /gobi_6: Setting Powered False 02:35:36.914833 run create_hlr_db(pid=12473): Terminated: ok {rc=0} 02:35:37.326333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12475): Launched 02:35:37.640700 run osmo-hlr_10.42.42.2(pid=12476): Launched 02:35:37.761509 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:38.279953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12478): Launched 02:35:38.594359 run osmo-stp_10.42.42.5(pid=12479): Launched 02:35:38.714894 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:35:39.231585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12481): Launched 02:35:39.351621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:35:39.617701 run patchelf(pid=12482): Launched 02:35:39.791728 run osmo-stp_10.42.42.5(pid=12479): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12479)] 02:35:39.924321 run osmo-stp_10.42.42.5(pid=12479): stdout: | (launched: 2022-12-09_02:35:38.537087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:40.059088 run osmo-stp_10.42.42.5(pid=12479): stderr: | 20221209023538728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023538728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023538728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023538729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023538729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023538729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023538729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:40.193905 run osmo-stp_10.42.42.5(pid=12479): stdout: | (launched: 2022-12-09_02:35:38.537087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:40.323013 run osmo-stp_10.42.42.5(pid=12479): stderr: | 20221209023538728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023538728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023538728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023538729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023538729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023538729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023538729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:40.475869 run patchelf(pid=12482): Terminating (SIGINT) 02:35:40.651918 run patchelf(pid=12482): Terminated: ok {rc=0} 02:35:40.778448 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12479): Process ended prematurely: osmo-stp_10.42.42.5(pid=12479) [trial-2353↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12479)] [trial-2353↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:35:40.787763 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 02:35:40.815856 run osmo-hlr_10.42.42.2(pid=12476): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12476)] 02:35:40.865655 run osmo-hlr_10.42.42.2(pid=12476): stdout: | (launched: 2022-12-09_02:35:37.583475) 02:35:40.917343 run osmo-hlr_10.42.42.2(pid=12476): stderr: | 20221209023537781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023537782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023537782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023537782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023537782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023537782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023537792 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023537800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023537801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023537801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:40.969387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12475): Terminating (SIGTERM) 02:35:41.010976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12478): Terminating (SIGTERM) 02:35:41.052560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12481): Terminating (SIGTERM) 02:35:41.094537 --- ParallelTerminationStrategy: PID 12475 died... 02:35:41.114504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12475): Terminated: ok {rc=0} 02:35:41.160622 --- ParallelTerminationStrategy: PID 12478 died... 02:35:41.180008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12478): Terminated: ok {rc=0} 02:35:41.226062 --- ParallelTerminationStrategy: PID 12481 died... 02:35:41.245411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12481): Terminated: ok {rc=0} 02:35:41.332052 bus /gobi_0: Setting Powered False 02:35:42.429720 bus /gobi_0: Setting Powered False 02:35:43.544420 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 02:35:44.800656 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:44.804849 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:35:44.839810 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 02:35:44.846775 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:35:44.899581 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:35:44.934102 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 02:35:44.941068 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:35:45.480674 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 02:35:45.485718 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 02:35:45.496876 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:35:45.546372 tst mo_mt_sms.py: using LAC 18472 02:35:45.672247 tst mo_mt_sms.py: using RAC 112 02:35:45.795691 tst mo_mt_sms.py: using CellId 18472 02:35:45.951988 tst mo_mt_sms.py: using BVCI 18473 02:35:46.101751 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:35:46.237206 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:35:46.364246 tst mo_mt_sms.py:9: start nitb and bts... 02:35:46.598431 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:35:47.222690 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12487): Launched 02:35:47.547655 run osmo-nitb_10.42.42.2(pid=12488): Launched 02:35:47.722810 run osmo-nitb_10.42.42.2(pid=12488): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12488)] 02:35:47.864152 run osmo-nitb_10.42.42.2(pid=12488): stdout: | (launched: 2022-12-09_02:35:47.490561) 02:35:48.006733 run osmo-nitb_10.42.42.2(pid=12488): stderr: | (launched: 2022-12-09_02:35:47.537802) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:35:48.149432 run osmo-nitb_10.42.42.2(pid=12488): stdout: | (launched: 2022-12-09_02:35:47.490561) 02:35:48.286848 run osmo-nitb_10.42.42.2(pid=12488): stderr: | (launched: 2022-12-09_02:35:47.537802) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12488): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12488) [trial-2353↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12488)] 02:35:48.666973 tst osmo-nitb_10.42.42.2(pid=12488): stdout: | (launched: 2022-12-09_02:35:47.490561) 02:35:48.794738 tst osmo-nitb_10.42.42.2(pid=12488): stderr: | (launched: 2022-12-09_02:35:47.537802) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:35:48.944642 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12488): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12488) [trial-2353↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12488)] [trial-2353↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 02:35:48.953718 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 02:35:48.960556 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12487): Terminating (SIGTERM) 02:35:49.172304 --- ParallelTerminationStrategy: PID 12487 died... 02:35:49.193922 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12487): Terminated: ok {rc=0} 02:35:49.281370 bus /sierra_3: Setting Powered False 02:35:50.381142 bus /sierra_3: Setting Powered False 02:35:51.496349 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 sms:trx-sysmocell5000 --------------------------------------------------------------------- 02:35:52.693949 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:52.697818 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:35:52.730992 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:35:52.757848 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:35:52.808498 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:35:52.841861 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:35:52.868184 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:35:53.420040 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 02:35:53.425273 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:53.436274 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:35:53.489316 tst mo_mt_sms.py: using LAC 18473 02:35:53.614204 tst mo_mt_sms.py: using RAC 113 02:35:53.738082 tst mo_mt_sms.py: using CellId 18473 02:35:53.860220 tst mo_mt_sms.py: using BVCI 18474 02:35:53.975001 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:53.986186 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:53.997361 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:54.008473 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:54.019631 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:54.030826 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:35:54.144147 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:35:54.256764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:54.711562 run create_hlr_db(pid=12492): Launched 02:35:54.831552 bus /sierra_2: Setting Powered False 02:35:55.889828 run create_hlr_db(pid=12492): Terminated: ok {rc=0} 02:35:56.319732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12494): Launched 02:35:56.634047 run osmo-hlr_10.42.42.2(pid=12495): Launched 02:35:56.753761 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:57.296082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12497): Launched 02:35:57.610645 run osmo-stp_10.42.42.5(pid=12498): Launched 02:35:57.730676 run osmo-msc_10.42.42.6: Starting osmo-msc 02:35:58.300564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12500): Launched 02:35:58.615719 run osmo-msc_10.42.42.6(pid=12501): Launched 02:35:58.791674 run osmo-stp_10.42.42.5(pid=12498): ERR: Terminated: ERROR {rc=1} [trial-2353↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12498)] 02:35:58.925482 run osmo-stp_10.42.42.5(pid=12498): stdout: | (launched: 2022-12-09_02:35:57.553423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:59.059186 run osmo-stp_10.42.42.5(pid=12498): stderr: | 20221209023557742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023557742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023557742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023557743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023557743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023557743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023557743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:59.192432 run osmo-stp_10.42.42.5(pid=12498): stdout: | (launched: 2022-12-09_02:35:57.553423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:59.317489 run osmo-stp_10.42.42.5(pid=12498): stderr: | 20221209023557742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023557742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023557742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023557743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023557743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023557743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023557743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:59.468070 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12498): Process ended prematurely: osmo-stp_10.42.42.5(pid=12498) [trial-2353↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12498)] [trial-2353↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 02:35:59.476805 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 02:35:59.504437 run osmo-hlr_10.42.42.2(pid=12495): ERR: Terminated: ERROR {rc=237} [trial-2353↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12495)] 02:35:59.554954 run osmo-hlr_10.42.42.2(pid=12495): stdout: | (launched: 2022-12-09_02:35:56.576918) 02:35:59.606688 run osmo-hlr_10.42.42.2(pid=12495): stderr: | 20221209023556772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023556772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023556772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023556772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023556772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023556772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023556788 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023556796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023556796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023556796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:59.678468 run osmo-msc_10.42.42.6(pid=12501): ERR: Terminated: ERROR {rc=2} [trial-2353↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12501)] 02:35:59.728220 run osmo-msc_10.42.42.6(pid=12501): stdout: | (launched: 2022-12-09_02:35:58.558507) 02:35:59.779630 run osmo-msc_10.42.42.6(pid=12501): stderr: | 20221209023558878 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023558878 DLGLOBAL DEBUG validating counter group 0x7f7b06a97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023558878 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023558878 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023558879 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023558879 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023558882 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023558883 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023558883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023558883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:35:59.831678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12494): Terminating (SIGTERM) 02:35:59.873155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12497): Terminating (SIGTERM) 02:35:59.914641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12500): Terminating (SIGTERM) 02:35:59.956181 --- ParallelTerminationStrategy: PID 12494 died... 02:35:59.975939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12494): Terminated: ok {rc=0} 02:36:00.021966 --- ParallelTerminationStrategy: PID 12497 died... 02:36:00.041311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12497): Terminated: ok {rc=0} 02:36:00.086987 --- ParallelTerminationStrategy: PID 12500 died... 02:36:00.106217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12500): Terminated: ok {rc=0} 02:36:00.192252 bus /sierra_3: Setting Powered False 02:36:01.290795 bus /sierra_3: Setting Powered False 02:36:02.407339 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 02:36:03.638597 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:36:03.642581 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:36:03.676352 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 02:36:03.683069 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 02:36:03.717307 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:36:03.750881 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 02:36:03.757602 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 02:36:04.277459 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2353 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 02:36:04.282253 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 02:36:04.292852 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:36:04.340576 tst assert_extension.py: using LAC 18474 02:36:04.456077 tst assert_extension.py: using RAC 114 02:36:04.582178 tst assert_extension.py: using CellId 18474 02:36:04.707769 tst assert_extension.py: using BVCI 18475 02:36:04.823627 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 02:36:04.937207 tst assert_extension.py:10: start nitb and bts... 02:36:05.132617 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:36:05.733662 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12506): Launched 02:36:06.025558 run osmo-nitb_10.42.42.2(pid=12507): Launched 02:36:06.187989 run osmo-nitb_10.42.42.2(pid=12507): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12507)] 02:36:06.319171 run osmo-nitb_10.42.42.2(pid=12507): stdout: | (launched: 2022-12-09_02:36:05.972202) 02:36:06.452475 run osmo-nitb_10.42.42.2(pid=12507): stderr: | (launched: 2022-12-09_02:36:06.015763) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:36:06.585384 run osmo-nitb_10.42.42.2(pid=12507): stdout: | (launched: 2022-12-09_02:36:05.972202) 02:36:06.713216 run osmo-nitb_10.42.42.2(pid=12507): stderr: | (launched: 2022-12-09_02:36:06.015763) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12507): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12507) [trial-2353↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12507)] 02:36:07.135785 tst osmo-nitb_10.42.42.2(pid=12507): stdout: | (launched: 2022-12-09_02:36:05.972202) 02:36:07.254359 tst osmo-nitb_10.42.42.2(pid=12507): stderr: | (launched: 2022-12-09_02:36:06.015763) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:36:07.394035 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12507): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12507) [trial-2353↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12507)] [trial-2353↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 02:36:07.402702 tst assert_extension.py:12: Test FAILED (3.1 sec) 02:36:07.409186 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12506): Terminating (SIGTERM) 02:36:07.617952 --- ParallelTerminationStrategy: PID 12506 died... 02:36:07.638908 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12506): Terminated: ok {rc=0} 02:36:07.724902 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 02:36:08.908156 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:36:08.912332 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:36:08.947035 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:36:08.975239 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 02:36:09.010775 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:36:09.045403 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:36:09.073067 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 02:36:09.605894 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2353 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 02:36:09.611117 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:36:09.622314 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:36:09.676465 tst assert_extension.py: using LAC 18475 02:36:09.799503 tst assert_extension.py: using RAC 115 02:36:09.922111 tst assert_extension.py: using CellId 18475 02:36:10.044393 tst assert_extension.py: using BVCI 18476 02:36:10.158835 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:36:10.169992 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:36:10.180997 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:36:10.192219 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:36:10.203410 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:36:10.214672 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 02:36:10.331093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:10.820533 run create_hlr_db(pid=12511): Launched 02:36:10.940162 bus /sierra_2: Setting Powered False 02:36:12.002698 run create_hlr_db(pid=12511): Terminated: ok {rc=0} 02:36:12.423186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12513): Launched 02:36:12.715381 run osmo-hlr_10.42.42.2(pid=12514): Launched 02:36:12.826349 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:13.427315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12516): Launched 02:36:13.714401 run osmo-stp_10.42.42.5(pid=12517): Launched 02:36:13.824134 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:14.345456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12519): Launched 02:36:14.631948 run osmo-msc_10.42.42.6(pid=12520): Launched 02:36:14.793321 run osmo-stp_10.42.42.5(pid=12517): ERR: Terminated: ERROR {rc=1} [trial-2353↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12517)] 02:36:14.916255 run osmo-stp_10.42.42.5(pid=12517): stdout: | (launched: 2022-12-09_02:36:13.661669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:15.038652 run osmo-stp_10.42.42.5(pid=12517): stderr: | 20221209023613830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023613831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023613831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023613831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023613832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023613832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023613832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:15.158986 run osmo-stp_10.42.42.5(pid=12517): stdout: | (launched: 2022-12-09_02:36:13.661669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:15.273694 run osmo-stp_10.42.42.5(pid=12517): stderr: | 20221209023613830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023613831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023613831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023613831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023613832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023613832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023613832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:15.410806 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12517): Process ended prematurely: osmo-stp_10.42.42.5(pid=12517) [trial-2353↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12517)] [trial-2353↪ussd:trx-sysmocell5000↪assert_extension.py:17] 02:36:15.418944 tst assert_extension.py:17: Test FAILED (5.8 sec) 02:36:15.444574 run osmo-hlr_10.42.42.2(pid=12514): ERR: Terminated: ERROR {rc=237} [trial-2353↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12514)] 02:36:15.492725 run osmo-hlr_10.42.42.2(pid=12514): stdout: | (launched: 2022-12-09_02:36:12.662157) 02:36:15.541791 run osmo-hlr_10.42.42.2(pid=12514): stderr: | 20221209023612837 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023612837 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023612837 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023612837 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023612837 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023612837 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023612852 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023612861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023612861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023612861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:15.610039 run osmo-msc_10.42.42.6(pid=12520): ERR: Terminated: ERROR {rc=2} [trial-2353↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12520)] 02:36:15.657299 run osmo-msc_10.42.42.6(pid=12520): stdout: | (launched: 2022-12-09_02:36:14.579309) 02:36:15.706077 run osmo-msc_10.42.42.6(pid=12520): stderr: | 20221209023614849 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023614849 DLGLOBAL DEBUG validating counter group 0x7f1ec12c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023614849 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023614849 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023614850 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023614850 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023614851 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023614852 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023614852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023614852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:15.755473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12513): Terminating (SIGTERM) 02:36:15.794818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12516): Terminating (SIGTERM) 02:36:15.834739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12519): Terminating (SIGTERM) 02:36:15.903775 --- ParallelTerminationStrategy: PID 12513 died... 02:36:15.929412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12513): Terminated: ok {rc=0} 02:36:15.985037 --- ParallelTerminationStrategy: PID 12516 died... 02:36:16.005683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12516): Terminated: ok {rc=0} 02:36:16.055425 --- ParallelTerminationStrategy: PID 12519 died... 02:36:16.076066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12519): Terminated: ok {rc=0} 02:36:16.170058 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:36:17.382080 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:36:17.389385 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:36:17.425998 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:36:17.453261 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:36:17.511155 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:36:17.547981 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:36:17.576164 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:36:18.121262 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:36:18.173910 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:36:18.185590 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:36:18.256667 tst mo_mt_call.py: using LAC 18476 02:36:18.380587 tst mo_mt_call.py: using RAC 116 02:36:18.503415 tst mo_mt_call.py: using CellId 18476 02:36:18.627984 tst mo_mt_call.py: using BVCI 18477 02:36:18.745131 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:36:18.756662 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:36:18.768092 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:36:18.780248 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:36:18.792515 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:36:18.804736 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:36:18.921873 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:36:19.038477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:19.532073 run create_hlr_db(pid=12525): Launched 02:36:19.653969 bus /sierra_2: Setting Powered False 02:36:20.716403 run create_hlr_db(pid=12525): Terminated: ok {rc=0} 02:36:21.139354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12527): Launched 02:36:21.433493 run osmo-hlr_10.42.42.2(pid=12528): Launched 02:36:21.547863 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:22.075668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12530): Launched 02:36:22.367365 run osmo-stp_10.42.42.5(pid=12531): Launched 02:36:22.479436 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:23.027072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12533): Launched 02:36:23.344020 run osmo-msc_10.42.42.6(pid=12534): Launched 02:36:23.522128 run osmo-stp_10.42.42.5(pid=12531): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12531)] 02:36:23.657929 run osmo-stp_10.42.42.5(pid=12531): stdout: | (launched: 2022-12-09_02:36:22.314093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:23.793612 run osmo-stp_10.42.42.5(pid=12531): stderr: | 20221209023622482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023622482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023622482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023622483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023622483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023622483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023622483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:23.927621 run osmo-stp_10.42.42.5(pid=12531): stdout: | (launched: 2022-12-09_02:36:22.314093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:24.054305 run osmo-stp_10.42.42.5(pid=12531): stderr: | 20221209023622482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023622482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023622482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023622483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023622483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023622483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023622483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:24.206129 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12531): Process ended prematurely: osmo-stp_10.42.42.5(pid=12531) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12531)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:36:24.215594 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:36:24.243455 run osmo-hlr_10.42.42.2(pid=12528): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12528)] 02:36:24.293716 run osmo-hlr_10.42.42.2(pid=12528): stdout: | (launched: 2022-12-09_02:36:21.379531) 02:36:24.345678 run osmo-hlr_10.42.42.2(pid=12528): stderr: | 20221209023621553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023621553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023621553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023621553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023621553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023621553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023621566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023621574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023621575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023621575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:24.417969 run osmo-msc_10.42.42.6(pid=12534): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12534)] 02:36:24.468189 run osmo-msc_10.42.42.6(pid=12534): stdout: | (launched: 2022-12-09_02:36:23.286620) 02:36:24.519955 run osmo-msc_10.42.42.6(pid=12534): stderr: | 20221209023623607 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023623607 DLGLOBAL DEBUG validating counter group 0x7fa5c2c27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023623607 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023623607 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023623607 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023623608 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023623609 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023623610 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023623610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023623610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:24.572581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12527): Terminating (SIGTERM) 02:36:24.614994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12530): Terminating (SIGTERM) 02:36:24.656922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12533): Terminating (SIGTERM) 02:36:24.698980 --- ParallelTerminationStrategy: PID 12527 died... 02:36:24.718880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12527): Terminated: ok {rc=0} 02:36:24.765362 --- ParallelTerminationStrategy: PID 12530 died... 02:36:24.784734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12530): Terminated: ok {rc=0} 02:36:24.831024 --- ParallelTerminationStrategy: PID 12533 died... 02:36:24.850453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12533): Terminated: ok {rc=0} 02:36:24.938759 bus /sierra_3: Setting Powered False 02:36:26.034448 bus /sierra_3: Setting Powered False 02:36:27.150481 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:36:28.294490 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:36:28.306176 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:36:28.378667 tst mo_mt_call_osmux.py: using LAC 18477 02:36:28.503218 tst mo_mt_call_osmux.py: using RAC 117 02:36:28.627653 tst mo_mt_call_osmux.py: using CellId 18477 02:36:28.750840 tst mo_mt_call_osmux.py: using BVCI 18478 02:36:28.866719 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:36:28.878622 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:36:28.890258 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:36:28.901910 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:36:28.913725 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:36:28.925375 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:36:29.042500 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:36:29.157406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:29.617347 run create_hlr_db(pid=12536): Launched 02:36:29.737695 bus /sierra_2: Setting Powered False 02:36:30.797485 run create_hlr_db(pid=12536): Terminated: ok {rc=0} 02:36:31.246403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12538): Launched 02:36:31.565467 run osmo-hlr_10.42.42.2(pid=12539): Launched 02:36:31.691256 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:32.449768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12541): Launched 02:36:32.766740 run osmo-stp_10.42.42.5(pid=12542): Launched 02:36:32.888034 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:33.459969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12544): Launched 02:36:33.776212 run osmo-msc_10.42.42.6(pid=12545): Launched 02:36:33.953216 run osmo-stp_10.42.42.5(pid=12542): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12542)] 02:36:34.086945 run osmo-stp_10.42.42.5(pid=12542): stdout: | (launched: 2022-12-09_02:36:32.709791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:34.221566 run osmo-stp_10.42.42.5(pid=12542): stderr: | 20221209023632898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023632898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023632898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023632899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023632901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023632901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023632902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:34.355318 run osmo-stp_10.42.42.5(pid=12542): stdout: | (launched: 2022-12-09_02:36:32.709791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:34.481619 run osmo-stp_10.42.42.5(pid=12542): stderr: | 20221209023632898 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023632898 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023632898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023632899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023632901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023632901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023632902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:34.633406 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12542): Process ended prematurely: osmo-stp_10.42.42.5(pid=12542) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12542)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:36:34.642867 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:36:34.670501 run osmo-hlr_10.42.42.2(pid=12539): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12539)] 02:36:34.720229 run osmo-hlr_10.42.42.2(pid=12539): stdout: | (launched: 2022-12-09_02:36:31.503152) 02:36:34.771628 run osmo-hlr_10.42.42.2(pid=12539): stderr: | 20221209023631913 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023631913 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023631913 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023631913 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023631913 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023631913 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023631928 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023631946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023631947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023631948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:34.843093 run osmo-msc_10.42.42.6(pid=12545): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12545)] 02:36:34.892556 run osmo-msc_10.42.42.6(pid=12545): stdout: | (launched: 2022-12-09_02:36:33.719308) 02:36:34.943642 run osmo-msc_10.42.42.6(pid=12545): stderr: | 20221209023634038 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023634038 DLGLOBAL DEBUG validating counter group 0x7fb90fafbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023634038 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023634038 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023634038 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023634039 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023634040 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023634041 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023634041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023634041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:34.995148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12538): Terminating (SIGTERM) 02:36:35.036414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12541): Terminating (SIGTERM) 02:36:35.077893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12544): Terminating (SIGTERM) 02:36:35.119389 --- ParallelTerminationStrategy: PID 12538 died... 02:36:35.138968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12538): Terminated: ok {rc=0} 02:36:35.184773 --- ParallelTerminationStrategy: PID 12541 died... 02:36:35.203873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12541): Terminated: ok {rc=0} 02:36:35.249358 --- ParallelTerminationStrategy: PID 12544 died... 02:36:35.268395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12544): Terminated: ok {rc=0} 02:36:35.355605 bus /sierra_3: Setting Powered False 02:36:36.454331 bus /sierra_3: Setting Powered False 02:36:37.570708 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:36:38.819284 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:36:38.826073 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:36:38.863808 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:36:38.891305 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:36:38.943186 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:36:38.976706 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:36:39.003292 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:36:39.556154 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:36:39.603801 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:39.615111 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:36:39.682787 tst mo_mt_call.py: using LAC 18478 02:36:39.797462 tst mo_mt_call.py: using RAC 118 02:36:39.912362 tst mo_mt_call.py: using CellId 18478 02:36:40.027026 tst mo_mt_call.py: using BVCI 18479 02:36:40.133548 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:40.144743 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:40.155913 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:40.167032 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:40.178271 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:40.189382 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:36:40.305393 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:36:40.418818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:40.875515 run create_hlr_db(pid=12550): Launched 02:36:40.996109 bus /sierra_2: Setting Powered False 02:36:42.055549 run create_hlr_db(pid=12550): Terminated: ok {rc=0} 02:36:42.466734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12552): Launched 02:36:42.761078 run osmo-hlr_10.42.42.2(pid=12553): Launched 02:36:42.873573 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:43.384421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12555): Launched 02:36:43.678414 run osmo-stp_10.42.42.5(pid=12556): Launched 02:36:43.790963 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:44.328576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12558): Launched 02:36:44.622766 run osmo-msc_10.42.42.6(pid=12559): Launched 02:36:44.787401 run osmo-stp_10.42.42.5(pid=12556): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12556)] 02:36:44.912303 run osmo-stp_10.42.42.5(pid=12556): stdout: | (launched: 2022-12-09_02:36:43.624665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:45.037058 run osmo-stp_10.42.42.5(pid=12556): stderr: | 20221209023643794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023643794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023643794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023643795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023643795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023643795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023643795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:45.159782 run osmo-stp_10.42.42.5(pid=12556): stdout: | (launched: 2022-12-09_02:36:43.624665) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:45.277122 run osmo-stp_10.42.42.5(pid=12556): stderr: | 20221209023643794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023643794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023643794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023643795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023643795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023643795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023643795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:45.417611 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12556): Process ended prematurely: osmo-stp_10.42.42.5(pid=12556) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12556)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:36:45.426338 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 02:36:45.452212 run osmo-hlr_10.42.42.2(pid=12553): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12553)] 02:36:45.499320 run osmo-hlr_10.42.42.2(pid=12553): stdout: | (launched: 2022-12-09_02:36:42.707322) 02:36:45.548099 run osmo-hlr_10.42.42.2(pid=12553): stderr: | 20221209023642883 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023642883 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023642883 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023642883 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023642883 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023642883 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023642895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023642903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023642904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023642904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:45.616141 run osmo-msc_10.42.42.6(pid=12559): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12559)] 02:36:45.663074 run osmo-msc_10.42.42.6(pid=12559): stdout: | (launched: 2022-12-09_02:36:44.569055) 02:36:45.711799 run osmo-msc_10.42.42.6(pid=12559): stderr: | 20221209023644840 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023644841 DLGLOBAL DEBUG validating counter group 0x7feb7693cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023644841 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023644841 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023644841 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023644841 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023644843 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023644843 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023644844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023644844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:45.761166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12552): Terminating (SIGTERM) 02:36:45.799935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12555): Terminating (SIGTERM) 02:36:45.850496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12558): Terminating (SIGTERM) 02:36:45.893196 --- ParallelTerminationStrategy: PID 12552 died... 02:36:45.911941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12552): Terminated: ok {rc=0} 02:36:45.955735 --- ParallelTerminationStrategy: PID 12555 died... 02:36:45.980358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12555): Terminated: ok {rc=0} 02:36:46.024049 --- ParallelTerminationStrategy: PID 12558 died... 02:36:46.042964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12558): Terminated: ok {rc=0} 02:36:46.127043 bus /sierra_3: Setting Powered False 02:36:47.222890 bus /sierra_3: Setting Powered False 02:36:48.339313 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:36:49.482670 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:49.494494 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:36:49.563993 tst mo_mt_call_osmux.py: using LAC 18479 02:36:49.682984 tst mo_mt_call_osmux.py: using RAC 119 02:36:49.803727 tst mo_mt_call_osmux.py: using CellId 18479 02:36:49.922745 tst mo_mt_call_osmux.py: using BVCI 18480 02:36:50.030596 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:50.041866 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:50.052746 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:50.063651 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:50.074643 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:50.085602 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:36:50.199393 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:36:50.316391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:50.774668 run create_hlr_db(pid=12563): Launched 02:36:50.894618 bus /sierra_2: Setting Powered False 02:36:51.953775 run create_hlr_db(pid=12563): Terminated: ok {rc=0} 02:36:52.363809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12565): Launched 02:36:52.656843 run osmo-hlr_10.42.42.2(pid=12566): Launched 02:36:52.768565 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:53.287872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12568): Launched 02:36:53.582072 run osmo-stp_10.42.42.5(pid=12569): Launched 02:36:53.694804 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:54.230149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12571): Launched 02:36:54.524056 run osmo-msc_10.42.42.6(pid=12572): Launched 02:36:54.689588 run osmo-stp_10.42.42.5(pid=12569): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12569)] 02:36:54.814789 run osmo-stp_10.42.42.5(pid=12569): stdout: | (launched: 2022-12-09_02:36:53.527709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:54.940178 run osmo-stp_10.42.42.5(pid=12569): stderr: | 20221209023653696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023653696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023653697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023653697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023653698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023653698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023653698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:55.063947 run osmo-stp_10.42.42.5(pid=12569): stdout: | (launched: 2022-12-09_02:36:53.527709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:55.181886 run osmo-stp_10.42.42.5(pid=12569): stderr: | 20221209023653696 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023653696 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023653697 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023653697 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023653698 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023653698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023653698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:55.322681 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12569): Process ended prematurely: osmo-stp_10.42.42.5(pid=12569) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12569)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:36:55.331387 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 02:36:55.357049 run osmo-hlr_10.42.42.2(pid=12566): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12566)] 02:36:55.403816 run osmo-hlr_10.42.42.2(pid=12566): stdout: | (launched: 2022-12-09_02:36:52.603391) 02:36:55.452204 run osmo-hlr_10.42.42.2(pid=12566): stderr: | 20221209023652777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023652777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023652777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023652777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023652777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023652777 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023652789 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023652798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023652798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023652798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:55.519786 run osmo-msc_10.42.42.6(pid=12572): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12572)] 02:36:55.566455 run osmo-msc_10.42.42.6(pid=12572): stdout: | (launched: 2022-12-09_02:36:54.470458) 02:36:55.614575 run osmo-msc_10.42.42.6(pid=12572): stderr: | 20221209023654743 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023654743 DLGLOBAL DEBUG validating counter group 0x7f3fcab96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023654743 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023654743 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023654744 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023654744 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023654745 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023654746 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023654746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023654746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:55.663320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12565): Terminating (SIGTERM) 02:36:55.702055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12568): Terminating (SIGTERM) 02:36:55.741020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12571): Terminating (SIGTERM) 02:36:55.779954 --- ParallelTerminationStrategy: PID 12565 died... 02:36:55.798972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12565): Terminated: ok {rc=0} 02:36:55.842222 --- ParallelTerminationStrategy: PID 12568 died... 02:36:55.860265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12568): Terminated: ok {rc=0} 02:36:55.903065 --- ParallelTerminationStrategy: PID 12571 died... 02:36:55.921283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12571): Terminated: ok {rc=0} 02:36:56.003686 bus /sierra_3: Setting Powered False 02:36:57.099757 bus /sierra_3: Setting Powered False 02:36:58.217998 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:36:59.464598 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:36:59.470999 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:36:59.503966 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:36:59.530228 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:36:59.581899 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:36:59.616521 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:36:59.642941 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:37:00.193409 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:37:00.240352 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:37:00.251582 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:37:00.321233 tst mo_mt_call.py: using LAC 18480 02:37:00.438584 tst mo_mt_call.py: using RAC 120 02:37:00.556677 tst mo_mt_call.py: using CellId 18480 02:37:00.673457 tst mo_mt_call.py: using BVCI 18481 02:37:00.780221 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:37:00.791415 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:37:00.802353 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:37:00.813308 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:37:00.824212 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:37:00.846499 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:37:00.982229 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:37:01.110750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:01.601664 run create_hlr_db(pid=12578): Launched 02:37:01.762749 bus /sierra_2: Setting Powered False 02:37:02.827066 run create_hlr_db(pid=12578): Terminated: ok {rc=0} 02:37:03.251655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12580): Launched 02:37:03.547234 run osmo-hlr_10.42.42.2(pid=12581): Launched 02:37:03.659582 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:04.180288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12583): Launched 02:37:04.474790 run osmo-stp_10.42.42.5(pid=12584): Launched 02:37:04.586681 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:05.121389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12586): Launched 02:37:05.417443 run osmo-msc_10.42.42.6(pid=12587): Launched 02:37:05.583783 run osmo-stp_10.42.42.5(pid=12584): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12584)] 02:37:05.709246 run osmo-stp_10.42.42.5(pid=12584): stdout: | (launched: 2022-12-09_02:37:04.420284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:05.835215 run osmo-stp_10.42.42.5(pid=12584): stderr: | 20221209023704593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023704593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023704594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023704594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023704594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023704595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023704595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:05.959211 run osmo-stp_10.42.42.5(pid=12584): stdout: | (launched: 2022-12-09_02:37:04.420284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:06.077356 run osmo-stp_10.42.42.5(pid=12584): stderr: | 20221209023704593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023704593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023704594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023704594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023704594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023704595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023704595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:06.218495 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12584): Process ended prematurely: osmo-stp_10.42.42.5(pid=12584) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12584)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:37:06.227270 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:37:06.253270 run osmo-hlr_10.42.42.2(pid=12581): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12581)] 02:37:06.300376 run osmo-hlr_10.42.42.2(pid=12581): stdout: | (launched: 2022-12-09_02:37:03.493567) 02:37:06.349406 run osmo-hlr_10.42.42.2(pid=12581): stderr: | 20221209023703669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023703669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023703669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023703669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023703669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023703669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023703682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023703691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023703691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023703691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:06.417966 run osmo-msc_10.42.42.6(pid=12587): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12587)] 02:37:06.464938 run osmo-msc_10.42.42.6(pid=12587): stdout: | (launched: 2022-12-09_02:37:05.363598) 02:37:06.513530 run osmo-msc_10.42.42.6(pid=12587): stderr: | 20221209023705636 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023705636 DLGLOBAL DEBUG validating counter group 0x7f447f95fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023705636 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023705636 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023705636 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023705636 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023705638 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023705639 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023705639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023705639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:06.562452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12580): Terminating (SIGTERM) 02:37:06.601712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12583): Terminating (SIGTERM) 02:37:06.640829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12586): Terminating (SIGTERM) 02:37:06.680291 --- ParallelTerminationStrategy: PID 12580 died... 02:37:06.699101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12580): Terminated: ok {rc=0} 02:37:06.742634 --- ParallelTerminationStrategy: PID 12583 died... 02:37:06.760856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12583): Terminated: ok {rc=0} 02:37:06.804040 --- ParallelTerminationStrategy: PID 12586 died... 02:37:06.822376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12586): Terminated: ok {rc=0} 02:37:06.907076 bus /sierra_3: Setting Powered False 02:37:08.006919 bus /sierra_3: Setting Powered False 02:37:09.123537 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:37:10.269127 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:37:10.280841 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:37:10.350729 tst mo_mt_call_osmux.py: using LAC 18481 02:37:10.469988 tst mo_mt_call_osmux.py: using RAC 121 02:37:10.586609 tst mo_mt_call_osmux.py: using CellId 18481 02:37:10.704660 tst mo_mt_call_osmux.py: using BVCI 18482 02:37:10.811807 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:37:10.823041 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:37:10.834103 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:37:10.845094 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:37:10.856125 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:37:10.867048 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:37:10.980107 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:37:11.098925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:11.595235 run create_hlr_db(pid=12589): Launched 02:37:11.717893 bus /sierra_2: Setting Powered False 02:37:12.781262 run create_hlr_db(pid=12589): Terminated: ok {rc=0} 02:37:13.204665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12591): Launched 02:37:13.499036 run osmo-hlr_10.42.42.2(pid=12592): Launched 02:37:13.613353 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:14.123272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12594): Launched 02:37:14.418049 run osmo-stp_10.42.42.5(pid=12595): Launched 02:37:14.531232 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:15.067494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12597): Launched 02:37:15.362220 run osmo-msc_10.42.42.6(pid=12598): Launched 02:37:15.528059 run osmo-stp_10.42.42.5(pid=12595): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12595)] 02:37:15.653774 run osmo-stp_10.42.42.5(pid=12595): stdout: | (launched: 2022-12-09_02:37:14.363959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:15.779036 run osmo-stp_10.42.42.5(pid=12595): stderr: | 20221209023714534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023714534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023714534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023714535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023714535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023714535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023714535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:15.934341 run osmo-stp_10.42.42.5(pid=12595): stdout: | (launched: 2022-12-09_02:37:14.363959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:16.069423 run osmo-stp_10.42.42.5(pid=12595): stderr: | 20221209023714534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023714534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023714534 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023714535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023714535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023714535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023714535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:16.229681 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12595): Process ended prematurely: osmo-stp_10.42.42.5(pid=12595) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12595)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:37:16.240553 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:37:16.271952 run osmo-hlr_10.42.42.2(pid=12592): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12592)] 02:37:16.325437 run osmo-hlr_10.42.42.2(pid=12592): stdout: | (launched: 2022-12-09_02:37:13.445558) 02:37:16.382130 run osmo-hlr_10.42.42.2(pid=12592): stderr: | 20221209023713621 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023713621 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023713621 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023713621 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023713621 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023713621 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023713633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023713642 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023713642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023713642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:16.459191 run osmo-msc_10.42.42.6(pid=12598): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12598)] 02:37:16.512141 run osmo-msc_10.42.42.6(pid=12598): stdout: | (launched: 2022-12-09_02:37:15.308098) 02:37:16.567797 run osmo-msc_10.42.42.6(pid=12598): stderr: | 20221209023715581 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023715581 DLGLOBAL DEBUG validating counter group 0x7fc6d768dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023715581 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023715581 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023715581 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023715582 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023715585 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023715586 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023715586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023715586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:16.624078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12591): Terminating (SIGTERM) 02:37:16.669915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12594): Terminating (SIGTERM) 02:37:16.716340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12597): Terminating (SIGTERM) 02:37:16.763020 --- ParallelTerminationStrategy: PID 12591 died... 02:37:16.782237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12591): Terminated: ok {rc=0} 02:37:16.827061 --- ParallelTerminationStrategy: PID 12594 died... 02:37:16.846129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12594): Terminated: ok {rc=0} 02:37:16.890951 --- ParallelTerminationStrategy: PID 12597 died... 02:37:16.909953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12597): Terminated: ok {rc=0} 02:37:16.997025 bus /sierra_3: Setting Powered False 02:37:18.097302 bus /sierra_3: Setting Powered False 02:37:19.211739 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:37:20.470255 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:37:20.477350 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:37:20.512821 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:37:20.540359 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:37:20.593653 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:37:20.629170 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:37:20.656642 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:37:21.212442 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:37:21.262749 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:21.274078 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:37:21.347055 tst mo_mt_call.py: using LAC 18482 02:37:21.464808 tst mo_mt_call.py: using RAC 122 02:37:21.579662 tst mo_mt_call.py: using CellId 18482 02:37:21.696536 tst mo_mt_call.py: using BVCI 18483 02:37:21.803969 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:21.815162 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:21.826151 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:21.837139 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:21.848170 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:21.859152 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:37:21.971380 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:37:22.089884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:22.583347 run create_hlr_db(pid=12603): Launched 02:37:22.705406 bus /sierra_2: Setting Powered False 02:37:23.768157 run create_hlr_db(pid=12603): Terminated: ok {rc=0} 02:37:24.209978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12605): Launched 02:37:24.526612 run osmo-hlr_10.42.42.2(pid=12606): Launched 02:37:24.648812 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:25.196291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12608): Launched 02:37:25.512548 run osmo-stp_10.42.42.5(pid=12609): Launched 02:37:25.635254 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:26.210287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12611): Launched 02:37:26.527545 run osmo-msc_10.42.42.6(pid=12612): Launched 02:37:26.705674 run osmo-stp_10.42.42.5(pid=12609): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12609)] 02:37:26.839457 run osmo-stp_10.42.42.5(pid=12609): stdout: | (launched: 2022-12-09_02:37:25.455590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:26.973723 run osmo-stp_10.42.42.5(pid=12609): stderr: | 20221209023725648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023725649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023725649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023725649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023725650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023725650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023725650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:27.107511 run osmo-stp_10.42.42.5(pid=12609): stdout: | (launched: 2022-12-09_02:37:25.455590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:27.234108 run osmo-stp_10.42.42.5(pid=12609): stderr: | 20221209023725648 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023725649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023725649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023725649 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023725650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023725650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023725650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:27.385560 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12609): Process ended prematurely: osmo-stp_10.42.42.5(pid=12609) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12609)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:37:27.394957 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:37:27.422889 run osmo-hlr_10.42.42.2(pid=12606): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12606)] 02:37:27.472871 run osmo-hlr_10.42.42.2(pid=12606): stdout: | (launched: 2022-12-09_02:37:24.469231) 02:37:27.524536 run osmo-hlr_10.42.42.2(pid=12606): stderr: | 20221209023724666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023724666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023724666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023724667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023724667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023724667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023724679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023724687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023724688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023724688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:27.596384 run osmo-msc_10.42.42.6(pid=12612): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12612)] 02:37:27.646356 run osmo-msc_10.42.42.6(pid=12612): stdout: | (launched: 2022-12-09_02:37:26.469870) 02:37:27.697807 run osmo-msc_10.42.42.6(pid=12612): stderr: | 20221209023726793 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023726794 DLGLOBAL DEBUG validating counter group 0x7fac9acecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023726794 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023726794 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023726794 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023726794 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023726796 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023726796 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023726797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023726797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:27.749531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12605): Terminating (SIGTERM) 02:37:27.790812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12608): Terminating (SIGTERM) 02:37:27.832397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12611): Terminating (SIGTERM) 02:37:27.874271 --- ParallelTerminationStrategy: PID 12605 died... 02:37:27.893892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12605): Terminated: ok {rc=0} 02:37:27.939794 --- ParallelTerminationStrategy: PID 12608 died... 02:37:27.959091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12608): Terminated: ok {rc=0} 02:37:28.005632 --- ParallelTerminationStrategy: PID 12611 died... 02:37:28.024766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12611): Terminated: ok {rc=0} 02:37:28.111333 bus /sierra_3: Setting Powered False 02:37:29.210421 bus /sierra_3: Setting Powered False 02:37:30.326259 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:37:31.469775 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:31.482474 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:37:31.556704 tst mo_mt_call_osmux.py: using LAC 18483 02:37:31.718282 tst mo_mt_call_osmux.py: using RAC 123 02:37:31.874571 tst mo_mt_call_osmux.py: using CellId 18483 02:37:32.027329 tst mo_mt_call_osmux.py: using BVCI 18484 02:37:32.174790 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:32.192205 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:32.207227 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:32.220686 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:32.233184 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:32.246578 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:37:32.363813 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:37:32.480672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:32.938379 run create_hlr_db(pid=12614): Launched 02:37:33.059879 bus /sierra_2: Setting Powered False 02:37:34.119134 run create_hlr_db(pid=12614): Terminated: ok {rc=0} 02:37:34.530919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12616): Launched 02:37:34.825548 run osmo-hlr_10.42.42.2(pid=12617): Launched 02:37:34.937770 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:35.446468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12619): Launched 02:37:35.742387 run osmo-stp_10.42.42.5(pid=12620): Launched 02:37:35.858294 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:36.394444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12622): Launched 02:37:36.689447 run osmo-msc_10.42.42.6(pid=12623): Launched 02:37:36.854848 run osmo-stp_10.42.42.5(pid=12620): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12620)] 02:37:36.979969 run osmo-stp_10.42.42.5(pid=12620): stdout: | (launched: 2022-12-09_02:37:35.687915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:37.105864 run osmo-stp_10.42.42.5(pid=12620): stderr: | 20221209023735862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023735863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023735863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023735863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023735864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023735864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023735864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:37.228802 run osmo-stp_10.42.42.5(pid=12620): stdout: | (launched: 2022-12-09_02:37:35.687915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:37.346827 run osmo-stp_10.42.42.5(pid=12620): stderr: | 20221209023735862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023735863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023735863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023735863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023735864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023735864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023735864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:37.487957 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12620): Process ended prematurely: osmo-stp_10.42.42.5(pid=12620) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12620)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:37:37.496799 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:37:37.522900 run osmo-hlr_10.42.42.2(pid=12617): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12617)] 02:37:37.570148 run osmo-hlr_10.42.42.2(pid=12617): stdout: | (launched: 2022-12-09_02:37:34.771856) 02:37:37.619004 run osmo-hlr_10.42.42.2(pid=12617): stderr: | 20221209023734949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023734949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023734949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023734949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023734949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023734949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023734964 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023734975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023734975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023734975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:37.686844 run osmo-msc_10.42.42.6(pid=12623): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12623)] 02:37:37.734028 run osmo-msc_10.42.42.6(pid=12623): stdout: | (launched: 2022-12-09_02:37:36.635370) 02:37:37.782585 run osmo-msc_10.42.42.6(pid=12623): stderr: | 20221209023736908 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023736908 DLGLOBAL DEBUG validating counter group 0x7f6e6a722c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023736908 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023736908 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023736908 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023736908 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023736910 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023736910 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023736911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023736911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:37.831533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12616): Terminating (SIGTERM) 02:37:37.870556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12619): Terminating (SIGTERM) 02:37:37.909551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12622): Terminating (SIGTERM) 02:37:37.949086 --- ParallelTerminationStrategy: PID 12616 died... 02:37:37.968225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12616): Terminated: ok {rc=0} 02:37:38.011671 --- ParallelTerminationStrategy: PID 12619 died... 02:37:38.030082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12619): Terminated: ok {rc=0} 02:37:38.073798 --- ParallelTerminationStrategy: PID 12622 died... 02:37:38.092263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12622): Terminated: ok {rc=0} 02:37:38.176870 bus /sierra_3: Setting Powered False 02:37:39.276584 bus /sierra_3: Setting Powered False 02:37:40.393519 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:37:41.648117 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:37:41.655035 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:37:41.690291 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:37:41.717824 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:37:41.771282 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:37:41.806219 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:37:41.833714 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:37:42.384544 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:37:42.436075 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:42.447653 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:37:42.518821 tst mo_mt_call.py: using LAC 18484 02:37:42.645893 tst mo_mt_call.py: using RAC 124 02:37:42.772360 tst mo_mt_call.py: using CellId 18484 02:37:42.904864 tst mo_mt_call.py: using BVCI 18485 02:37:43.021848 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:43.033501 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:43.044820 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:43.056562 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:43.068343 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:43.080029 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:37:43.196452 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:37:43.312010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:43.773540 run create_hlr_db(pid=12628): Launched 02:37:43.894934 bus /sierra_2: Setting Powered False 02:37:44.954078 run create_hlr_db(pid=12628): Terminated: ok {rc=0} 02:37:45.391010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12630): Launched 02:37:45.709669 run osmo-hlr_10.42.42.2(pid=12631): Launched 02:37:45.831780 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:46.498235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12633): Launched 02:37:46.809767 run osmo-stp_10.42.42.5(pid=12634): Launched 02:37:46.984115 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:47.719996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12636): Launched 02:37:48.038122 run osmo-msc_10.42.42.6(pid=12637): Launched 02:37:48.215060 run osmo-stp_10.42.42.5(pid=12634): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12634)] 02:37:48.349596 run osmo-stp_10.42.42.5(pid=12634): stdout: | (launched: 2022-12-09_02:37:46.751847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:48.484680 run osmo-stp_10.42.42.5(pid=12634): stderr: | 20221209023747118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023747118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023747118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023747119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023747119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023747119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023747119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:48.619559 run osmo-stp_10.42.42.5(pid=12634): stdout: | (launched: 2022-12-09_02:37:46.751847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:48.746943 run osmo-stp_10.42.42.5(pid=12634): stderr: | 20221209023747118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023747118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023747118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023747119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023747119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023747119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023747119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:48.898870 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12634): Process ended prematurely: osmo-stp_10.42.42.5(pid=12634) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12634)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:37:48.908094 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 02:37:48.935920 run osmo-hlr_10.42.42.2(pid=12631): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12631)] 02:37:48.985808 run osmo-hlr_10.42.42.2(pid=12631): stdout: | (launched: 2022-12-09_02:37:45.652275) 02:37:49.037767 run osmo-hlr_10.42.42.2(pid=12631): stderr: | 20221209023745867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023745867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023745867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023745867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023745867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023745867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023745879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023745891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023745892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023745892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:49.109477 run osmo-msc_10.42.42.6(pid=12637): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12637)] 02:37:49.159014 run osmo-msc_10.42.42.6(pid=12637): stdout: | (launched: 2022-12-09_02:37:47.980268) 02:37:49.210279 run osmo-msc_10.42.42.6(pid=12637): stderr: | 20221209023748301 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023748301 DLGLOBAL DEBUG validating counter group 0x7fed1170ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023748301 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023748301 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023748301 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023748302 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023748303 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023748304 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023748304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023748304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:49.262017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12630): Terminating (SIGTERM) 02:37:49.303431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12633): Terminating (SIGTERM) 02:37:49.344905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12636): Terminating (SIGTERM) 02:37:49.386895 --- ParallelTerminationStrategy: PID 12630 died... 02:37:49.406557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12630): Terminated: ok {rc=0} 02:37:49.452846 --- ParallelTerminationStrategy: PID 12633 died... 02:37:49.472022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12633): Terminated: ok {rc=0} 02:37:49.518254 --- ParallelTerminationStrategy: PID 12636 died... 02:37:49.537479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12636): Terminated: ok {rc=0} 02:37:49.625454 bus /sierra_3: Setting Powered False 02:37:50.723339 bus /sierra_3: Setting Powered False 02:37:51.838287 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:37:52.986263 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:52.998609 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:37:53.070683 tst mo_mt_call_osmux.py: using LAC 18485 02:37:53.197141 tst mo_mt_call_osmux.py: using RAC 125 02:37:53.322130 tst mo_mt_call_osmux.py: using CellId 18485 02:37:53.448518 tst mo_mt_call_osmux.py: using BVCI 18486 02:37:53.566105 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:53.577902 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:53.589405 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:53.601222 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:53.613501 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:53.625248 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:37:53.744003 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:37:53.863883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:54.357275 run create_hlr_db(pid=12639): Launched 02:37:54.479021 bus /sierra_2: Setting Powered False 02:37:55.541816 run create_hlr_db(pid=12639): Terminated: ok {rc=0} 02:37:55.966334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12641): Launched 02:37:56.262252 run osmo-hlr_10.42.42.2(pid=12642): Launched 02:37:56.376497 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:56.885206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12644): Launched 02:37:57.181029 run osmo-stp_10.42.42.5(pid=12645): Launched 02:37:57.294395 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:57.831804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12647): Launched 02:37:58.127214 run osmo-msc_10.42.42.6(pid=12648): Launched 02:37:58.293729 run osmo-stp_10.42.42.5(pid=12645): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12645)] 02:37:58.420232 run osmo-stp_10.42.42.5(pid=12645): stdout: | (launched: 2022-12-09_02:37:57.127054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:58.545262 run osmo-stp_10.42.42.5(pid=12645): stderr: | 20221209023757294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023757294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023757295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023757295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023757297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023757298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023757298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:58.668556 run osmo-stp_10.42.42.5(pid=12645): stdout: | (launched: 2022-12-09_02:37:57.127054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:58.786384 run osmo-stp_10.42.42.5(pid=12645): stderr: | 20221209023757294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023757294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023757295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023757295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023757297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023757298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023757298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:58.927839 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12645): Process ended prematurely: osmo-stp_10.42.42.5(pid=12645) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12645)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:37:58.936879 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:37:58.963041 run osmo-hlr_10.42.42.2(pid=12642): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12642)] 02:37:59.010708 run osmo-hlr_10.42.42.2(pid=12642): stdout: | (launched: 2022-12-09_02:37:56.208075) 02:37:59.059687 run osmo-hlr_10.42.42.2(pid=12642): stderr: | 20221209023756385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023756385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023756385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023756385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023756385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023756385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023756398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023756408 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023756408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023756408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:59.127712 run osmo-msc_10.42.42.6(pid=12648): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12648)] 02:37:59.175033 run osmo-msc_10.42.42.6(pid=12648): stdout: | (launched: 2022-12-09_02:37:58.072765) 02:37:59.223399 run osmo-msc_10.42.42.6(pid=12648): stderr: | 20221209023758342 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023758343 DLGLOBAL DEBUG validating counter group 0x7f1452860c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023758343 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023758343 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023758343 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023758343 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023758346 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023758346 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023758346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023758347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:59.272475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12641): Terminating (SIGTERM) 02:37:59.311752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12644): Terminating (SIGTERM) 02:37:59.351227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12647): Terminating (SIGTERM) 02:37:59.391124 --- ParallelTerminationStrategy: PID 12641 died... 02:37:59.410171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12641): Terminated: ok {rc=0} 02:37:59.453829 --- ParallelTerminationStrategy: PID 12644 died... 02:37:59.472141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12644): Terminated: ok {rc=0} 02:37:59.515497 --- ParallelTerminationStrategy: PID 12647 died... 02:37:59.534041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12647): Terminated: ok {rc=0} 02:37:59.616282 bus /sierra_3: Setting Powered False 02:38:00.711878 bus /sierra_3: Setting Powered False 02:38:01.861436 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:38:03.198366 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:38:03.210545 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:38:03.254578 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:38:03.290542 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:38:03.346875 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:38:03.410137 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:38:03.441346 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:38:03.961407 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:38:04.011684 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:38:04.024113 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:38:04.093530 tst mo_mt_call.py: using LAC 18486 02:38:04.211079 tst mo_mt_call.py: using RAC 126 02:38:04.328622 tst mo_mt_call.py: using CellId 18486 02:38:04.447123 tst mo_mt_call.py: using BVCI 18487 02:38:04.557132 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:38:04.569296 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:38:04.581207 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:38:04.593103 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:38:04.604659 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:38:04.617402 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:38:04.735670 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:38:04.852763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:05.328068 run create_hlr_db(pid=12924): Launched 02:38:05.481815 bus /sierra_2: Setting Powered False 02:38:06.546109 run create_hlr_db(pid=12924): Terminated: ok {rc=0} 02:38:07.006824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12927): Launched 02:38:07.342627 run osmo-hlr_10.42.42.2(pid=12928): Launched 02:38:07.576782 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:08.262799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12930): Launched 02:38:08.585294 run osmo-stp_10.42.42.5(pid=12931): Launched 02:38:08.820784 run osmo-msc_10.42.42.6: Starting osmo-msc 02:38:09.530776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12933): Launched 02:38:09.865718 run osmo-msc_10.42.42.6(pid=12934): Launched 02:38:10.200797 run osmo-stp_10.42.42.5(pid=12931): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12931)] 02:38:10.473803 run osmo-stp_10.42.42.5(pid=12931): stdout: | (launched: 2022-12-09_02:38:08.525731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:10.736531 run osmo-stp_10.42.42.5(pid=12931): stderr: | 20221209023808851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023808851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023808851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023808852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023808852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023808852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023808852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:10.913125 run osmo-stp_10.42.42.5(pid=12931): stdout: | (launched: 2022-12-09_02:38:08.525731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:11.035741 run osmo-stp_10.42.42.5(pid=12931): stderr: | 20221209023808851 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023808851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023808851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023808852 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023808852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023808852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023808852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:11.182361 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12931): Process ended prematurely: osmo-stp_10.42.42.5(pid=12931) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12931)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:38:11.192501 tst mo_mt_call.py:8: Test FAILED (7.2 sec) 02:38:11.220445 run osmo-hlr_10.42.42.2(pid=12928): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12928)] 02:38:11.269804 run osmo-hlr_10.42.42.2(pid=12928): stdout: | (launched: 2022-12-09_02:38:07.284242) 02:38:11.320823 run osmo-hlr_10.42.42.2(pid=12928): stderr: | 20221209023807614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023807614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023807614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023807614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023807614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023807614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023807635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023807651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023807652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023807652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:11.391895 run osmo-msc_10.42.42.6(pid=12934): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12934)] 02:38:11.440863 run osmo-msc_10.42.42.6(pid=12934): stdout: | (launched: 2022-12-09_02:38:09.791007) 02:38:11.491437 run osmo-msc_10.42.42.6(pid=12934): stderr: | 20221209023810385 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023810385 DLGLOBAL DEBUG validating counter group 0x7f4bd6667c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023810385 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023810385 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023810386 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023810386 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023810388 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023810388 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023810388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023810388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:38:11.542602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12927): Terminating (SIGTERM) 02:38:11.583454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12930): Terminating (SIGTERM) 02:38:11.625396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12933): Terminating (SIGTERM) 02:38:11.669167 --- ParallelTerminationStrategy: PID 12927 died... 02:38:11.689341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12927): Terminated: ok {rc=0} 02:38:11.736126 --- ParallelTerminationStrategy: PID 12930 died... 02:38:11.755761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12930): Terminated: ok {rc=0} 02:38:11.801084 --- ParallelTerminationStrategy: PID 12933 died... 02:38:11.820768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12933): Terminated: ok {rc=0} 02:38:11.906899 bus /sierra_3: Setting Powered False 02:38:13.006944 bus /sierra_3: Setting Powered False 02:38:14.124130 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:38:15.281459 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:38:15.295261 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:38:15.372586 tst mo_mt_call_osmux.py: using LAC 18487 02:38:15.507376 tst mo_mt_call_osmux.py: using RAC 127 02:38:15.639301 tst mo_mt_call_osmux.py: using CellId 18487 02:38:15.768622 tst mo_mt_call_osmux.py: using BVCI 18488 02:38:15.907692 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:38:15.920676 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:38:15.933664 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:38:15.948522 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:38:15.962901 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:38:15.982791 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:38:16.138753 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:38:16.303278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:16.789200 run create_hlr_db(pid=12936): Launched 02:38:16.946306 bus /sierra_2: Setting Powered False 02:38:18.013661 run create_hlr_db(pid=12936): Terminated: ok {rc=0} 02:38:18.469746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12938): Launched 02:38:18.782416 run osmo-hlr_10.42.42.2(pid=12939): Launched 02:38:19.017858 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:19.733502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12941): Launched 02:38:20.052802 run osmo-stp_10.42.42.5(pid=12942): Launched 02:38:20.295337 run osmo-msc_10.42.42.6: Starting osmo-msc 02:38:20.997255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12944): Launched 02:38:21.317115 run osmo-msc_10.42.42.6(pid=12945): Launched 02:38:21.670384 run osmo-stp_10.42.42.5(pid=12942): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12942)] 02:38:21.937978 run osmo-stp_10.42.42.5(pid=12942): stdout: | (launched: 2022-12-09_02:38:19.996027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:22.213722 run osmo-stp_10.42.42.5(pid=12942): stderr: | 20221209023820319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023820319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023820320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023820320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023820325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023820325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023820325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:22.382278 run osmo-stp_10.42.42.5(pid=12942): stdout: | (launched: 2022-12-09_02:38:19.996027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:22.508260 run osmo-stp_10.42.42.5(pid=12942): stderr: | 20221209023820319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023820319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023820320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023820320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023820325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023820325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023820325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:22.656329 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12942): Process ended prematurely: osmo-stp_10.42.42.5(pid=12942) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12942)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:38:22.667297 tst mo_mt_call_osmux.py:8: Test FAILED (7.4 sec) 02:38:22.695149 run osmo-hlr_10.42.42.2(pid=12939): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12939)] 02:38:22.744779 run osmo-hlr_10.42.42.2(pid=12939): stdout: | (launched: 2022-12-09_02:38:18.726436) 02:38:22.795665 run osmo-hlr_10.42.42.2(pid=12939): stderr: | 20221209023819065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023819065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023819065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023819065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023819065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023819065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023819083 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023819091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023819091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023819091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:22.866667 run osmo-msc_10.42.42.6(pid=12945): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12945)] 02:38:22.916154 run osmo-msc_10.42.42.6(pid=12945): stdout: | (launched: 2022-12-09_02:38:21.261064) 02:38:22.966399 run osmo-msc_10.42.42.6(pid=12945): stderr: | 20221209023821843 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023821843 DLGLOBAL DEBUG validating counter group 0x7efe5b12dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023821844 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023821844 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023821844 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023821844 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023821854 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023821854 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023821855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023821855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:38:23.017622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12938): Terminating (SIGTERM) 02:38:23.058712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12941): Terminating (SIGTERM) 02:38:23.101897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12944): Terminating (SIGTERM) 02:38:23.145362 --- ParallelTerminationStrategy: PID 12938 died... 02:38:23.165040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12938): Terminated: ok {rc=0} 02:38:23.211608 --- ParallelTerminationStrategy: PID 12941 died... 02:38:23.230745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12941): Terminated: ok {rc=0} 02:38:23.275936 --- ParallelTerminationStrategy: PID 12944 died... 02:38:23.295074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12944): Terminated: ok {rc=0} 02:38:23.378892 bus /sierra_3: Setting Powered False 02:38:24.473540 bus /sierra_3: Setting Powered False 02:38:25.586758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:38:26.836122 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:38:26.841727 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:38:26.875076 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:38:26.901705 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:38:26.954271 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:38:26.988077 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:38:27.014651 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:38:27.564739 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:38:27.612584 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:27.624035 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:38:27.694624 tst mo_mt_call.py: using LAC 18488 02:38:27.814322 tst mo_mt_call.py: using RAC 128 02:38:27.934604 tst mo_mt_call.py: using CellId 18488 02:38:28.054468 tst mo_mt_call.py: using BVCI 18489 02:38:28.163795 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:28.174902 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:28.185942 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:28.196775 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:28.207682 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:28.218612 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:38:28.337118 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:38:28.457596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:28.959222 run create_hlr_db(pid=12950): Launched 02:38:29.082386 bus /sierra_2: Setting Powered False 02:38:30.146087 run create_hlr_db(pid=12950): Terminated: ok {rc=0} 02:38:30.575794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12952): Launched 02:38:30.885710 run osmo-hlr_10.42.42.2(pid=12953): Launched 02:38:31.068208 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:31.822465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12955): Launched 02:38:32.133698 run osmo-stp_10.42.42.5(pid=12956): Launched 02:38:32.280789 run osmo-msc_10.42.42.6: Starting osmo-msc 02:38:33.056749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12958): Launched 02:38:33.377991 run osmo-msc_10.42.42.6(pid=12959): Launched 02:38:33.557639 run osmo-stp_10.42.42.5(pid=12956): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12956)] 02:38:33.694748 run osmo-stp_10.42.42.5(pid=12956): stdout: | (launched: 2022-12-09_02:38:32.076839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:33.831066 run osmo-stp_10.42.42.5(pid=12956): stderr: | 20221209023832468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023832468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023832469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023832469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023832470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023832470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023832470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:33.966166 run osmo-stp_10.42.42.5(pid=12956): stdout: | (launched: 2022-12-09_02:38:32.076839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:34.094800 run osmo-stp_10.42.42.5(pid=12956): stderr: | 20221209023832468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023832468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023832469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023832469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023832470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023832470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023832470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:34.248701 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12956): Process ended prematurely: osmo-stp_10.42.42.5(pid=12956) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12956)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:38:34.258574 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 02:38:34.286619 run osmo-hlr_10.42.42.2(pid=12953): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12953)] 02:38:34.336774 run osmo-hlr_10.42.42.2(pid=12953): stdout: | (launched: 2022-12-09_02:38:30.822032) 02:38:34.388623 run osmo-hlr_10.42.42.2(pid=12953): stderr: | 20221209023831158 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023831158 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023831158 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023831158 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023831158 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023831158 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023831178 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023831197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023831197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023831197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:34.460674 run osmo-msc_10.42.42.6(pid=12959): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12959)] 02:38:34.510940 run osmo-msc_10.42.42.6(pid=12959): stdout: | (launched: 2022-12-09_02:38:33.319767) 02:38:34.563241 run osmo-msc_10.42.42.6(pid=12959): stderr: | 20221209023833643 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023833643 DLGLOBAL DEBUG validating counter group 0x7f22b92a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023833643 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023833643 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023833643 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023833643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023833645 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023833645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023833646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023833646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:38:34.615848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12952): Terminating (SIGTERM) 02:38:34.658087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12955): Terminating (SIGTERM) 02:38:34.700004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12958): Terminating (SIGTERM) 02:38:34.742088 --- ParallelTerminationStrategy: PID 12952 died... 02:38:34.761930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12952): Terminated: ok {rc=0} 02:38:34.808655 --- ParallelTerminationStrategy: PID 12955 died... 02:38:34.828233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12955): Terminated: ok {rc=0} 02:38:34.874831 --- ParallelTerminationStrategy: PID 12958 died... 02:38:34.894525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12958): Terminated: ok {rc=0} 02:38:34.982552 bus /sierra_3: Setting Powered False 02:38:36.081035 bus /sierra_3: Setting Powered False 02:38:37.197056 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:38:38.342927 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:38.354910 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:38:38.426703 tst mo_mt_call_osmux.py: using LAC 18489 02:38:38.547061 tst mo_mt_call_osmux.py: using RAC 129 02:38:38.667090 tst mo_mt_call_osmux.py: using CellId 18489 02:38:38.794821 tst mo_mt_call_osmux.py: using BVCI 18490 02:38:38.912666 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:38.924506 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:38.936099 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:38.947974 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:38.959734 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:38.971376 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:38:39.089035 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:38:39.212658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:39.714718 run create_hlr_db(pid=12961): Launched 02:38:39.839613 bus /sierra_2: Setting Powered False 02:38:40.903358 run create_hlr_db(pid=12961): Terminated: ok {rc=0} 02:38:41.333330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12963): Launched 02:38:41.634890 run osmo-hlr_10.42.42.2(pid=12964): Launched 02:38:41.752123 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:42.274460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12966): Launched 02:38:42.573650 run osmo-stp_10.42.42.5(pid=12967): Launched 02:38:42.690730 run osmo-msc_10.42.42.6: Starting osmo-msc 02:38:43.234955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12969): Launched 02:38:43.535292 run osmo-msc_10.42.42.6(pid=12970): Launched 02:38:43.703099 run osmo-stp_10.42.42.5(pid=12967): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12967)] 02:38:43.830454 run osmo-stp_10.42.42.5(pid=12967): stdout: | (launched: 2022-12-09_02:38:42.519167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:43.956428 run osmo-stp_10.42.42.5(pid=12967): stderr: | 20221209023842688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023842689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023842689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023842689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023842691 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023842692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023842692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:44.081215 run osmo-stp_10.42.42.5(pid=12967): stdout: | (launched: 2022-12-09_02:38:42.519167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:44.200262 run osmo-stp_10.42.42.5(pid=12967): stderr: | 20221209023842688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023842689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023842689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023842689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023842691 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023842692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023842692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:44.343354 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12967): Process ended prematurely: osmo-stp_10.42.42.5(pid=12967) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12967)] [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:38:44.352169 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:38:44.378317 run osmo-hlr_10.42.42.2(pid=12964): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12964)] 02:38:44.425833 run osmo-hlr_10.42.42.2(pid=12964): stdout: | (launched: 2022-12-09_02:38:41.579053) 02:38:44.474656 run osmo-hlr_10.42.42.2(pid=12964): stderr: | 20221209023841757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023841757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023841757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023841757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023841757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023841757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023841769 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023841777 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023841778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023841778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:44.542987 run osmo-msc_10.42.42.6(pid=12970): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12970)] 02:38:44.590138 run osmo-msc_10.42.42.6(pid=12970): stdout: | (launched: 2022-12-09_02:38:43.479957) 02:38:44.638736 run osmo-msc_10.42.42.6(pid=12970): stderr: | 20221209023843754 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023843754 DLGLOBAL DEBUG validating counter group 0x7f9f7b84fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023843754 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023843754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023843754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023843754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023843756 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023843757 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023843757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023843757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:38:44.688104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12963): Terminating (SIGTERM) 02:38:44.727140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12966): Terminating (SIGTERM) 02:38:44.766429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12969): Terminating (SIGTERM) 02:38:44.805708 --- ParallelTerminationStrategy: PID 12963 died... 02:38:44.824444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12963): Terminated: ok {rc=0} 02:38:44.868046 --- ParallelTerminationStrategy: PID 12966 died... 02:38:44.886505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12966): Terminated: ok {rc=0} 02:38:44.929576 --- ParallelTerminationStrategy: PID 12969 died... 02:38:44.947841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12969): Terminated: ok {rc=0} 02:38:45.030532 bus /sierra_3: Setting Powered False 02:38:46.125056 bus /sierra_3: Setting Powered False 02:38:47.244540 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 02:38:48.493532 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:38:48.497794 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:38:48.531248 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:38:48.558073 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 02:38:48.642461 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:38:48.675988 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:38:48.703027 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 02:38:49.286951 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2353 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 02:38:49.291835 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:49.302640 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:38:49.352291 tst emergency_mo_mt_call.py: using LAC 18490 02:38:49.468049 tst emergency_mo_mt_call.py: using RAC 130 02:38:49.584924 tst emergency_mo_mt_call.py: using CellId 18490 02:38:49.700689 tst emergency_mo_mt_call.py: using BVCI 18491 02:38:49.807044 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:49.818066 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:49.828928 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:49.839582 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:49.850220 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:49.860809 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:49.980424 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:50.096878 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:50.553652 run create_hlr_db(pid=12975): Launched 02:38:50.674645 bus /sierra_2: Setting Powered False 02:38:51.733656 run create_hlr_db(pid=12975): Terminated: ok {rc=0} 02:38:52.166724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12977): Launched 02:38:52.482666 run osmo-hlr_10.42.42.2(pid=12978): Launched 02:38:52.603946 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:53.153688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12980): Launched 02:38:53.470314 run osmo-stp_10.42.42.5(pid=12981): Launched 02:38:53.601455 tst emergency_mo_mt_call.py: using MSISDN 6983 02:38:53.760895 run osmo-msc_10.42.42.6: Starting osmo-msc 02:38:54.332753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12983): Launched 02:38:54.651582 run osmo-msc_10.42.42.6(pid=12984): Launched 02:38:54.829375 run osmo-stp_10.42.42.5(pid=12981): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12981)] 02:38:54.964406 run osmo-stp_10.42.42.5(pid=12981): stdout: | (launched: 2022-12-09_02:38:53.412822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:55.099829 run osmo-stp_10.42.42.5(pid=12981): stderr: | 20221209023853605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023853606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023853606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023853606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023853607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023853607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023853607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:55.234019 run osmo-stp_10.42.42.5(pid=12981): stdout: | (launched: 2022-12-09_02:38:53.412822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:55.360566 run osmo-stp_10.42.42.5(pid=12981): stderr: | 20221209023853605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023853606 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023853606 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023853606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023853607 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023853607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023853607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:55.511756 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12981): Process ended prematurely: osmo-stp_10.42.42.5(pid=12981) [trial-2353↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12981)] [trial-2353↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 02:38:55.521021 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 02:38:55.548886 run osmo-hlr_10.42.42.2(pid=12978): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12978)] 02:38:55.599424 run osmo-hlr_10.42.42.2(pid=12978): stdout: | (launched: 2022-12-09_02:38:52.425305) 02:38:55.651687 run osmo-hlr_10.42.42.2(pid=12978): stderr: | 20221209023852625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023852625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023852625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023852625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023852625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023852625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023852639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023852648 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023852649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023852649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:55.724061 run osmo-msc_10.42.42.6(pid=12984): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12984)] 02:38:55.774132 run osmo-msc_10.42.42.6(pid=12984): stdout: | (launched: 2022-12-09_02:38:54.593738) 02:38:55.825681 run osmo-msc_10.42.42.6(pid=12984): stderr: | 20221209023854913 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023854913 DLGLOBAL DEBUG validating counter group 0x7fa904c48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023854914 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023854914 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023854914 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023854914 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023854916 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023854916 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023854916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023854916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:38:55.877788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12977): Terminating (SIGTERM) 02:38:55.919709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12980): Terminating (SIGTERM) 02:38:55.961609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12983): Terminating (SIGTERM) 02:38:56.003796 --- ParallelTerminationStrategy: PID 12977 died... 02:38:56.023715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12977): Terminated: ok {rc=0} 02:38:56.070681 --- ParallelTerminationStrategy: PID 12980 died... 02:38:56.090274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12980): Terminated: ok {rc=0} 02:38:56.136697 --- ParallelTerminationStrategy: PID 12983 died... 02:38:56.156278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12983): Terminated: ok {rc=0} 02:38:56.243984 bus /sierra_3: Setting Powered False 02:38:57.342879 bus /sierra_3: Setting Powered False 02:38:58.455655 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 02:38:59.542440 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:59.554573 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:38:59.608202 tst emergency_preemptive_call.py: using LAC 18491 02:38:59.726241 tst emergency_preemptive_call.py: using RAC 131 02:38:59.841402 tst emergency_preemptive_call.py: using CellId 18491 02:38:59.959741 tst emergency_preemptive_call.py: using BVCI 18492 02:39:00.077219 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:39:00.088742 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:39:00.100089 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:39:00.112357 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:39:00.124462 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:39:00.136723 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:00.254647 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:00.373799 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:00.486182 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:00.602648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:01.109442 run create_hlr_db(pid=12986): Launched 02:39:01.262458 bus /sierra_2: Setting Powered False 02:39:02.319621 run create_hlr_db(pid=12986): Terminated: ok {rc=0} 02:39:02.769208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12988): Launched 02:39:03.086255 run osmo-hlr_10.42.42.2(pid=12989): Launched 02:39:03.208396 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:03.753610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12991): Launched 02:39:04.068537 run osmo-stp_10.42.42.5(pid=12992): Launched 02:39:04.197954 tst emergency_preemptive_call.py: using MSISDN 6984 02:39:04.361571 run osmo-msc_10.42.42.6: Starting osmo-msc 02:39:04.931487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12994): Launched 02:39:05.248356 run osmo-msc_10.42.42.6(pid=12995): Launched 02:39:05.425704 run osmo-stp_10.42.42.5(pid=12992): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12992)] 02:39:05.559833 run osmo-stp_10.42.42.5(pid=12992): stdout: | (launched: 2022-12-09_02:39:04.011397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:05.695362 run osmo-stp_10.42.42.5(pid=12992): stderr: | 20221209023904202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023904202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023904202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023904203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023904203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023904203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023904203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:05.828870 run osmo-stp_10.42.42.5(pid=12992): stdout: | (launched: 2022-12-09_02:39:04.011397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:05.955208 run osmo-stp_10.42.42.5(pid=12992): stderr: | 20221209023904202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023904202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023904202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023904203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023904203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023904203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023904203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:06.106591 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12992): Process ended prematurely: osmo-stp_10.42.42.5(pid=12992) [trial-2353↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12992)] [trial-2353↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 02:39:06.115569 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 02:39:06.143310 run osmo-hlr_10.42.42.2(pid=12989): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12989)] 02:39:06.193721 run osmo-hlr_10.42.42.2(pid=12989): stdout: | (launched: 2022-12-09_02:39:03.028846) 02:39:06.245626 run osmo-hlr_10.42.42.2(pid=12989): stderr: | 20221209023903226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023903226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023903226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023903226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023903226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023903226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023903238 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023903246 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023903246 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023903246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:06.318362 run osmo-msc_10.42.42.6(pid=12995): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12995)] 02:39:06.368683 run osmo-msc_10.42.42.6(pid=12995): stdout: | (launched: 2022-12-09_02:39:05.190704) 02:39:06.420780 run osmo-msc_10.42.42.6(pid=12995): stderr: | 20221209023905510 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209023905510 DLGLOBAL DEBUG validating counter group 0x7fb3b703dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209023905510 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209023905510 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209023905510 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209023905511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209023905512 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209023905513 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209023905513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209023905513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:39:06.473083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12988): Terminating (SIGTERM) 02:39:06.515005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12991): Terminating (SIGTERM) 02:39:06.556861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12994): Terminating (SIGTERM) 02:39:06.599261 --- ParallelTerminationStrategy: PID 12988 died... 02:39:06.619210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12988): Terminated: ok {rc=0} 02:39:06.666173 --- ParallelTerminationStrategy: PID 12991 died... 02:39:06.685752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12991): Terminated: ok {rc=0} 02:39:06.732139 --- ParallelTerminationStrategy: PID 12994 died... 02:39:06.751491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12994): Terminated: ok {rc=0} 02:39:06.839516 bus /sierra_9: Setting Powered False 02:39:07.939132 bus /sierra_9: Setting Powered False 02:39:09.056517 bus /sierra_8: Setting Powered False 02:39:10.155115 bus /sierra_8: Setting Powered False 02:39:11.271517 bus /sierra_3: Setting Powered False 02:39:12.369256 bus /sierra_3: Setting Powered False 02:39:13.485181 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 02:39:14.769749 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:39:14.774458 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:39:14.809908 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 02:39:14.849658 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 02:39:14.939383 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:39:14.974067 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 02:39:15.013829 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 02:39:15.602852 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 02:39:15.654715 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:15.665819 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:39:15.716910 tst cs_paging_gprs_active.py: using LAC 18492 02:39:15.840353 tst cs_paging_gprs_active.py: using RAC 132 02:39:15.980916 tst cs_paging_gprs_active.py: using CellId 18492 02:39:16.133726 tst cs_paging_gprs_active.py: using BVCI 18493 02:39:16.257284 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:16.269715 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:16.282512 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:16.294674 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:16.307028 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:16.320645 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:16.333809 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:16.345884 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:16.358857 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:16.485736 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:16.637777 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:39:16.866346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:17.177103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13000): Launched 02:39:17.452223 run iperf3-srv_10.42.42.10(pid=13001): Launched 02:39:17.565916 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:39:17.768308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:18.071402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13002): Launched 02:39:18.333162 run iperf3-srv_10.42.42.10(pid=13003): Launched 02:39:18.445619 tst cs_paging_gprs_active.py:38: start network... 02:39:18.646910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:19.113584 run create_hlr_db(pid=13004): Launched 02:39:19.235849 bus /sierra_2: Setting Powered False 02:39:20.295598 run create_hlr_db(pid=13004): Terminated: ok {rc=0} 02:39:20.716483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13006): Launched 02:39:21.018787 run osmo-hlr_10.42.42.2(pid=13007): Launched 02:39:21.132766 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:21.650436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13009): Launched 02:39:21.951232 run osmo-stp_10.42.42.5(pid=13010): Launched 02:39:22.066061 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:22.585562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13012): Launched 02:39:22.701699 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:22.956165 run patchelf(pid=13013): Launched 02:39:23.124116 run osmo-stp_10.42.42.5(pid=13010): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13010)] 02:39:23.251698 run osmo-stp_10.42.42.5(pid=13010): stdout: | (launched: 2022-12-09_02:39:21.896306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:23.380579 run osmo-stp_10.42.42.5(pid=13010): stderr: | 20221209023922066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023922066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023922066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023922067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023922067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023922067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023922067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:23.509456 run osmo-stp_10.42.42.5(pid=13010): stdout: | (launched: 2022-12-09_02:39:21.896306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:23.633239 run osmo-stp_10.42.42.5(pid=13010): stderr: | 20221209023922066 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023922066 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023922066 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023922067 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023922067 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023922067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023922067 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:23.779773 run patchelf(pid=13013): Terminating (SIGINT) 02:39:23.949349 run patchelf(pid=13013): Terminated: ok {rc=0} 02:39:24.071353 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13010): Process ended prematurely: osmo-stp_10.42.42.5(pid=13010) [trial-2353↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13010)] [trial-2353↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 02:39:24.081013 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:39:24.107820 run osmo-hlr_10.42.42.2(pid=13007): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13007)] 02:39:24.154799 run osmo-hlr_10.42.42.2(pid=13007): stdout: | (launched: 2022-12-09_02:39:20.963531) 02:39:24.203516 run osmo-hlr_10.42.42.2(pid=13007): stderr: | 20221209023921142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023921142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023921142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023921142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023921142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023921142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023921154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023921165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023921165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023921165 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:24.252781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13000): Terminating (SIGTERM) 02:39:24.292248 run iperf3-srv_10.42.42.10(pid=13001): Terminating (SIGTERM) 02:39:24.331720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13002): Terminating (SIGTERM) 02:39:24.371305 run iperf3-srv_10.42.42.10(pid=13003): Terminating (SIGTERM) 02:39:24.410677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13006): Terminating (SIGTERM) 02:39:24.450289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13009): Terminating (SIGTERM) 02:39:24.489596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13012): Terminating (SIGTERM) 02:39:24.529288 --- ParallelTerminationStrategy: PID 13000 died... 02:39:24.548293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13000): Terminated: ok {rc=0} 02:39:24.591930 --- ParallelTerminationStrategy: PID 13001 died... 02:39:24.610400 run iperf3-srv_10.42.42.10(pid=13001): Terminated {rc=256} 02:39:24.653717 --- ParallelTerminationStrategy: PID 13002 died... 02:39:24.672327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13002): Terminated: ok {rc=0} 02:39:24.715543 --- ParallelTerminationStrategy: PID 13003 died... 02:39:24.734012 run iperf3-srv_10.42.42.10(pid=13003): Terminated {rc=256} 02:39:24.777187 --- ParallelTerminationStrategy: PID 13006 died... 02:39:24.795542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13006): Terminated: ok {rc=0} 02:39:24.839046 --- ParallelTerminationStrategy: PID 13009 died... 02:39:24.857369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13009): Terminated: ok {rc=0} 02:39:24.901632 --- ParallelTerminationStrategy: PID 13012 died... 02:39:24.920442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13012): Terminated: ok {rc=0} 02:39:25.004736 bus /gobi_0: Setting Powered False 02:39:26.103433 bus /gobi_0: Setting Powered False 02:39:27.222596 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 02:39:28.368648 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:28.380169 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:39:28.432842 tst iperf3.py: using LAC 18493 02:39:28.551964 tst iperf3.py: using RAC 133 02:39:28.671417 tst iperf3.py: using CellId 18493 02:39:28.804472 tst iperf3.py: using BVCI 18494 02:39:28.923897 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:28.935448 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:28.946741 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:28.958457 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:28.970093 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:28.981967 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:28.993933 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:29.005641 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:29.017952 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:29.132018 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:39:29.334376 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:29.637699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13014): Launched 02:39:29.899062 run iperf3-srv_10.42.42.10(pid=13015): Launched 02:39:30.011858 tst iperf3.py:8: start network... 02:39:30.213713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:30.681964 run create_hlr_db(pid=13016): Launched 02:39:30.805711 bus /gobi_6: Setting Powered False 02:39:31.880115 run create_hlr_db(pid=13016): Terminated: ok {rc=0} 02:39:32.363482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13018): Launched 02:39:32.666576 run osmo-hlr_10.42.42.2(pid=13019): Launched 02:39:32.781384 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:33.318937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13021): Launched 02:39:33.620816 run osmo-stp_10.42.42.5(pid=13022): Launched 02:39:33.735423 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:34.255586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13024): Launched 02:39:34.370532 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:34.625993 run patchelf(pid=13025): Launched 02:39:34.792887 run osmo-stp_10.42.42.5(pid=13022): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13022)] 02:39:34.921154 run osmo-stp_10.42.42.5(pid=13022): stdout: | (launched: 2022-12-09_02:39:33.565021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:35.051255 run osmo-stp_10.42.42.5(pid=13022): stderr: | 20221209023933734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023933735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023933735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023933735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023933736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023933736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023933736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:35.181808 run osmo-stp_10.42.42.5(pid=13022): stdout: | (launched: 2022-12-09_02:39:33.565021) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:35.306117 run osmo-stp_10.42.42.5(pid=13022): stderr: | 20221209023933734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023933735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023933735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023933735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023933736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023933736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023933736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:35.453412 run patchelf(pid=13025): Terminating (SIGINT) 02:39:35.622963 run patchelf(pid=13025): Terminated: ok {rc=0} 02:39:35.745295 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13022): Process ended prematurely: osmo-stp_10.42.42.5(pid=13022) [trial-2353↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13022)] [trial-2353↪gprs:trx-sysmocell5000↪iperf3.py:8] 02:39:35.754717 tst iperf3.py:8: Test FAILED (7.4 sec) 02:39:35.781803 run osmo-hlr_10.42.42.2(pid=13019): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13019)] 02:39:35.829294 run osmo-hlr_10.42.42.2(pid=13019): stdout: | (launched: 2022-12-09_02:39:32.610252) 02:39:35.878684 run osmo-hlr_10.42.42.2(pid=13019): stderr: | 20221209023932786 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023932786 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023932786 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023932786 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023932787 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023932787 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023932799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023932808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023932808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023932808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:35.928556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13014): Terminating (SIGTERM) 02:39:35.968743 run iperf3-srv_10.42.42.10(pid=13015): Terminating (SIGTERM) 02:39:36.008559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13018): Terminating (SIGTERM) 02:39:36.048659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13021): Terminating (SIGTERM) 02:39:36.088586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13024): Terminating (SIGTERM) 02:39:36.128773 --- ParallelTerminationStrategy: PID 13014 died... 02:39:36.147917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13014): Terminated: ok {rc=0} 02:39:36.192239 --- ParallelTerminationStrategy: PID 13015 died... 02:39:36.210899 run iperf3-srv_10.42.42.10(pid=13015): Terminated {rc=256} 02:39:36.254823 --- ParallelTerminationStrategy: PID 13018 died... 02:39:36.273451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13018): Terminated: ok {rc=0} 02:39:36.317228 --- ParallelTerminationStrategy: PID 13021 died... 02:39:36.335934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13021): Terminated: ok {rc=0} 02:39:36.380062 --- ParallelTerminationStrategy: PID 13024 died... 02:39:36.398856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13024): Terminated: ok {rc=0} 02:39:36.484287 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 02:39:37.632446 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:37.644072 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:39:37.694658 tst iperf3m4.py: using LAC 18494 02:39:37.817771 tst iperf3m4.py: using RAC 134 02:39:37.937681 tst iperf3m4.py: using CellId 18494 02:39:38.054766 tst iperf3m4.py: using BVCI 18495 02:39:38.174215 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:38.185831 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:38.196819 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:38.208344 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:38.222322 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:38.233214 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:38.244206 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:38.255219 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:38.266342 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:38.387163 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:38.512648 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:38.629763 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:38.752096 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:39:38.969802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:39.293804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13026): Launched 02:39:39.574611 run iperf3-srv_10.42.42.10(pid=13027): Launched 02:39:39.696096 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:39:39.914254 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:40.222870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13028): Launched 02:39:40.484782 run iperf3-srv_10.42.42.10(pid=13029): Launched 02:39:40.597280 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:39:40.799129 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:41.101085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13030): Launched 02:39:41.362593 run iperf3-srv_10.42.42.10(pid=13031): Launched 02:39:41.475055 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:39:41.675755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:41.978286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13032): Launched 02:39:42.239006 run iperf3-srv_10.42.42.10(pid=13033): Launched 02:39:42.351168 tst iperf3m4.py:8: start network... 02:39:42.552295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:43.018507 run create_hlr_db(pid=13034): Launched 02:39:43.142673 bus /gobi_6: Setting Powered False 02:39:44.203265 run create_hlr_db(pid=13034): Terminated: ok {rc=0} 02:39:44.622272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13036): Launched 02:39:44.923426 run osmo-hlr_10.42.42.2(pid=13037): Launched 02:39:45.038552 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:45.573278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13039): Launched 02:39:45.877771 run osmo-stp_10.42.42.5(pid=13040): Launched 02:39:46.107522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:46.712027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13042): Launched 02:39:46.840042 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:47.101839 run patchelf(pid=13043): Launched 02:39:47.272687 run osmo-stp_10.42.42.5(pid=13040): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13040)] 02:39:47.401569 run osmo-stp_10.42.42.5(pid=13040): stdout: | (launched: 2022-12-09_02:39:45.819368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:47.531073 run osmo-stp_10.42.42.5(pid=13040): stderr: | 20221209023946060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023946060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023946061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023946061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023946062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023946062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023946062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:47.660715 run osmo-stp_10.42.42.5(pid=13040): stdout: | (launched: 2022-12-09_02:39:45.819368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:47.784864 run osmo-stp_10.42.42.5(pid=13040): stderr: | 20221209023946060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209023946060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209023946061 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209023946061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209023946062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209023946062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209023946062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:47.931775 run patchelf(pid=13043): Terminating (SIGINT) 02:39:48.100802 run patchelf(pid=13043): Terminated: ok {rc=0} 02:39:48.222741 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13040): Process ended prematurely: osmo-stp_10.42.42.5(pid=13040) [trial-2353↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13040)] [trial-2353↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 02:39:48.232446 tst iperf3m4.py:8: Test FAILED (10.6 sec) 02:39:48.260247 run osmo-hlr_10.42.42.2(pid=13037): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13037)] 02:39:48.308621 run osmo-hlr_10.42.42.2(pid=13037): stdout: | (launched: 2022-12-09_02:39:44.868037) 02:39:48.357769 run osmo-hlr_10.42.42.2(pid=13037): stderr: | 20221209023945045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209023945045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209023945045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209023945045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209023945045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209023945045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209023945057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209023945066 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209023945066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209023945066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:48.407678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13026): Terminating (SIGTERM) 02:39:48.447693 run iperf3-srv_10.42.42.10(pid=13027): Terminating (SIGTERM) 02:39:48.487549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13028): Terminating (SIGTERM) 02:39:48.527508 run iperf3-srv_10.42.42.10(pid=13029): Terminating (SIGTERM) 02:39:48.567305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13030): Terminating (SIGTERM) 02:39:48.607184 run iperf3-srv_10.42.42.10(pid=13031): Terminating (SIGTERM) 02:39:48.647010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13032): Terminating (SIGTERM) 02:39:48.686858 run iperf3-srv_10.42.42.10(pid=13033): Terminating (SIGTERM) 02:39:48.726560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13036): Terminating (SIGTERM) 02:39:48.766369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13039): Terminating (SIGTERM) 02:39:48.806101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13042): Terminating (SIGTERM) 02:39:48.846336 --- ParallelTerminationStrategy: PID 13026 died... 02:39:48.865540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13026): Terminated: ok {rc=0} 02:39:48.909944 --- ParallelTerminationStrategy: PID 13027 died... 02:39:48.928478 run iperf3-srv_10.42.42.10(pid=13027): Terminated {rc=256} 02:39:48.972417 --- ParallelTerminationStrategy: PID 13028 died... 02:39:48.991062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13028): Terminated: ok {rc=0} 02:39:49.035332 --- ParallelTerminationStrategy: PID 13029 died... 02:39:49.053849 run iperf3-srv_10.42.42.10(pid=13029): Terminated {rc=256} 02:39:49.097741 --- ParallelTerminationStrategy: PID 13030 died... 02:39:49.116420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13030): Terminated: ok {rc=0} 02:39:49.160492 --- ParallelTerminationStrategy: PID 13031 died... 02:39:49.179690 run iperf3-srv_10.42.42.10(pid=13031): Terminated {rc=256} 02:39:49.224045 --- ParallelTerminationStrategy: PID 13032 died... 02:39:49.242885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13032): Terminated: ok {rc=0} 02:39:49.286926 --- ParallelTerminationStrategy: PID 13033 died... 02:39:49.305631 run iperf3-srv_10.42.42.10(pid=13033): Terminated {rc=256} 02:39:49.349715 --- ParallelTerminationStrategy: PID 13036 died... 02:39:49.368345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13036): Terminated: ok {rc=0} 02:39:49.412500 --- ParallelTerminationStrategy: PID 13039 died... 02:39:49.431208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13039): Terminated: ok {rc=0} 02:39:49.475169 --- ParallelTerminationStrategy: PID 13042 died... 02:39:49.494012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13042): Terminated: ok {rc=0} 02:39:49.580678 bus /gobi_4: Setting Powered False 02:39:50.680622 bus /gobi_4: Setting Powered False 02:39:51.796350 bus /gobi_1: Setting Powered False 02:39:52.897498 bus /gobi_1: Setting Powered False 02:39:54.013955 bus /gobi_0: Setting Powered False 02:39:55.111870 bus /gobi_0: Setting Powered False 02:39:56.228141 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 02:39:57.330292 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:57.342458 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:39:57.395012 tst ping.py: using LAC 18495 02:39:57.526102 tst ping.py: using RAC 135 02:39:57.651997 tst ping.py: using CellId 18495 02:39:57.776681 tst ping.py: using BVCI 18496 02:39:57.892518 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:57.903917 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:57.915203 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:57.926818 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:57.938308 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:57.949600 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:57.960891 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:57.972426 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:58.088376 tst ping.py:19: start network... 02:39:58.287535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:58.745470 run create_hlr_db(pid=13044): Launched 02:39:58.858272 bus /gobi_6: Setting Powered False 02:39:59.917232 run create_hlr_db(pid=13044): Terminated: ok {rc=0} 02:40:00.348372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13046): Launched 02:40:00.665725 run osmo-hlr_10.42.42.2(pid=13047): Launched 02:40:00.789822 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:01.462348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13049): Launched 02:40:01.793966 run osmo-stp_10.42.42.5(pid=13050): Launched 02:40:02.017090 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:02.736404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13061): Launched 02:40:02.901490 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:03.169535 run patchelf(pid=13063): Launched 02:40:03.345733 run osmo-stp_10.42.42.5(pid=13050): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13050)] 02:40:03.479875 run osmo-stp_10.42.42.5(pid=13050): stdout: | (launched: 2022-12-09_02:40:01.737885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:03.616162 run osmo-stp_10.42.42.5(pid=13050): stderr: | 20221209024002058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024002058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024002058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024002058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024002059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024002059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024002059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:03.753302 run osmo-stp_10.42.42.5(pid=13050): stdout: | (launched: 2022-12-09_02:40:01.737885) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:03.883665 run osmo-stp_10.42.42.5(pid=13050): stderr: | 20221209024002058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024002058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024002058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024002058 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024002059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024002059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024002059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:04.038407 run patchelf(pid=13063): Terminating (SIGINT) 02:40:04.215344 run patchelf(pid=13063): Terminated: ok {rc=0} 02:40:04.343024 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13050): Process ended prematurely: osmo-stp_10.42.42.5(pid=13050) [trial-2353↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13050)] [trial-2353↪gprs:trx-sysmocell5000↪ping.py:22] 02:40:04.352531 tst ping.py:22: Test FAILED (7.0 sec) 02:40:04.380872 run osmo-hlr_10.42.42.2(pid=13047): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13047)] 02:40:04.430999 run osmo-hlr_10.42.42.2(pid=13047): stdout: | (launched: 2022-12-09_02:40:00.608485) 02:40:04.483139 run osmo-hlr_10.42.42.2(pid=13047): stderr: | 20221209024000803 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024000803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024000803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024000803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024000803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024000803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024000817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024000826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024000826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024000826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:04.535556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13046): Terminating (SIGTERM) 02:40:04.577659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13049): Terminating (SIGTERM) 02:40:04.619949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13061): Terminating (SIGTERM) 02:40:04.662583 --- ParallelTerminationStrategy: PID 13046 died... 02:40:04.683018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13046): Terminated: ok {rc=0} 02:40:04.730224 --- ParallelTerminationStrategy: PID 13049 died... 02:40:04.750157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13049): Terminated: ok {rc=0} 02:40:04.797161 --- ParallelTerminationStrategy: PID 13061 died... 02:40:04.816883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13061): Terminated: ok {rc=0} 02:40:04.905336 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 02:40:05.994611 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:40:06.007254 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:40:06.060528 tst ping_idle_ping.py: using LAC 18496 02:40:06.186775 tst ping_idle_ping.py: using RAC 136 02:40:06.313205 tst ping_idle_ping.py: using CellId 18496 02:40:06.439938 tst ping_idle_ping.py: using BVCI 18497 02:40:06.555923 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:40:06.567340 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:40:06.578690 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:40:06.590944 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:40:06.602320 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:40:06.613957 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:40:06.626131 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:40:06.637833 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:40:06.752451 tst ping_idle_ping.py:24: start network... 02:40:06.951178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:07.415547 run create_hlr_db(pid=13064): Launched 02:40:07.529916 bus /gobi_6: Setting Powered False 02:40:08.589572 run create_hlr_db(pid=13064): Terminated: ok {rc=0} 02:40:09.026054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13066): Launched 02:40:09.345683 run osmo-hlr_10.42.42.2(pid=13067): Launched 02:40:09.466990 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:10.019790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13069): Launched 02:40:10.337073 run osmo-stp_10.42.42.5(pid=13070): Launched 02:40:10.460467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:11.009434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13072): Launched 02:40:11.130381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:11.398613 run patchelf(pid=13073): Launched 02:40:11.574728 run osmo-stp_10.42.42.5(pid=13070): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13070)] 02:40:11.709591 run osmo-stp_10.42.42.5(pid=13070): stdout: | (launched: 2022-12-09_02:40:10.279257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:11.845933 run osmo-stp_10.42.42.5(pid=13070): stderr: | 20221209024010472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024010473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024010473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024010473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024010474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024010474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024010474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:11.982399 run osmo-stp_10.42.42.5(pid=13070): stdout: | (launched: 2022-12-09_02:40:10.279257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:12.113289 run osmo-stp_10.42.42.5(pid=13070): stderr: | 20221209024010472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024010473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024010473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024010473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024010474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024010474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024010474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:12.267592 run patchelf(pid=13073): Terminating (SIGINT) 02:40:12.445329 run patchelf(pid=13073): Terminated: ok {rc=0} 02:40:12.573035 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13070): Process ended prematurely: osmo-stp_10.42.42.5(pid=13070) [trial-2353↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13070)] [trial-2353↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 02:40:12.582499 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:40:12.610129 run osmo-hlr_10.42.42.2(pid=13067): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13067)] 02:40:12.659655 run osmo-hlr_10.42.42.2(pid=13067): stdout: | (launched: 2022-12-09_02:40:09.286574) 02:40:12.711541 run osmo-hlr_10.42.42.2(pid=13067): stderr: | 20221209024009485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024009485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024009485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024009485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024009485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024009485 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024009498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024009506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024009506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024009506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:12.763524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13066): Terminating (SIGTERM) 02:40:12.805102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13069): Terminating (SIGTERM) 02:40:12.846615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13072): Terminating (SIGTERM) 02:40:12.888521 --- ParallelTerminationStrategy: PID 13066 died... 02:40:12.908761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13066): Terminated: ok {rc=0} 02:40:12.956043 --- ParallelTerminationStrategy: PID 13069 died... 02:40:12.976253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13069): Terminated: ok {rc=0} 02:40:13.023971 --- ParallelTerminationStrategy: PID 13072 died... 02:40:13.044196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13072): Terminated: ok {rc=0} 02:40:13.133347 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 02:40:14.452088 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:40:14.458176 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:40:14.496746 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:40:14.537817 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:40:14.627487 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:40:14.667438 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:40:14.711087 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:40:15.299942 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:40:15.351651 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:15.363124 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:40:15.418712 tst cs_paging_gprs_active.py: using LAC 18497 02:40:15.544902 tst cs_paging_gprs_active.py: using RAC 137 02:40:15.669633 tst cs_paging_gprs_active.py: using CellId 18497 02:40:15.795572 tst cs_paging_gprs_active.py: using BVCI 18498 02:40:15.947757 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:15.959836 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:15.971914 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:15.983677 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:15.995362 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:16.007171 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:16.019035 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:16.034473 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:16.046533 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:16.170174 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:16.291332 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:40:16.516594 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:16.853697 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13429): Launched 02:40:17.148361 run iperf3-srv_10.42.42.10(pid=13430): Launched 02:40:17.270872 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:40:17.490883 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:17.818158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13431): Launched 02:40:18.099419 run iperf3-srv_10.42.42.10(pid=13432): Launched 02:40:18.220814 tst cs_paging_gprs_active.py:38: start network... 02:40:18.439837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:18.943256 run create_hlr_db(pid=13433): Launched 02:40:19.074940 bus /gobi_6: Setting Powered False 02:40:20.138877 run create_hlr_db(pid=13433): Terminated: ok {rc=0} 02:40:20.590132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13435): Launched 02:40:20.915512 run osmo-hlr_10.42.42.2(pid=13436): Launched 02:40:21.039473 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:21.601274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13438): Launched 02:40:21.925369 run osmo-stp_10.42.42.5(pid=13439): Launched 02:40:22.048546 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:22.607051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13441): Launched 02:40:22.731924 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:23.011850 run patchelf(pid=13442): Launched 02:40:23.191039 run osmo-stp_10.42.42.5(pid=13439): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13439)] 02:40:23.328806 run osmo-stp_10.42.42.5(pid=13439): stdout: | (launched: 2022-12-09_02:40:21.866902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:23.471266 run osmo-stp_10.42.42.5(pid=13439): stderr: | 20221209024022059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024022060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024022060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024022060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024022061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024022061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024022061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:23.612393 run osmo-stp_10.42.42.5(pid=13439): stdout: | (launched: 2022-12-09_02:40:21.866902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:23.748729 run osmo-stp_10.42.42.5(pid=13439): stderr: | 20221209024022059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024022060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024022060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024022060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024022061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024022061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024022061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:23.910583 run patchelf(pid=13442): Terminating (SIGINT) 02:40:24.095097 run patchelf(pid=13442): Terminated: ok {rc=0} 02:40:24.228569 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13439): Process ended prematurely: osmo-stp_10.42.42.5(pid=13439) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13439)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:40:24.239637 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 02:40:24.269459 run osmo-hlr_10.42.42.2(pid=13436): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13436)] 02:40:24.323151 run osmo-hlr_10.42.42.2(pid=13436): stdout: | (launched: 2022-12-09_02:40:20.856827) 02:40:24.377389 run osmo-hlr_10.42.42.2(pid=13436): stderr: | 20221209024021057 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024021057 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024021057 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024021057 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024021057 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024021057 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024021070 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024021078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024021078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024021078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:24.429337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13429): Terminating (SIGTERM) 02:40:24.471880 run iperf3-srv_10.42.42.10(pid=13430): Terminating (SIGTERM) 02:40:24.516357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13431): Terminating (SIGTERM) 02:40:24.558923 run iperf3-srv_10.42.42.10(pid=13432): Terminating (SIGTERM) 02:40:24.601148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13435): Terminating (SIGTERM) 02:40:24.643493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13438): Terminating (SIGTERM) 02:40:24.686129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13441): Terminating (SIGTERM) 02:40:24.729181 --- ParallelTerminationStrategy: PID 13429 died... 02:40:24.749664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13429): Terminated: ok {rc=0} 02:40:24.797490 --- ParallelTerminationStrategy: PID 13430 died... 02:40:24.817875 run iperf3-srv_10.42.42.10(pid=13430): Terminated {rc=256} 02:40:24.865110 --- ParallelTerminationStrategy: PID 13431 died... 02:40:24.885452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13431): Terminated: ok {rc=0} 02:40:24.933045 --- ParallelTerminationStrategy: PID 13432 died... 02:40:24.953329 run iperf3-srv_10.42.42.10(pid=13432): Terminated {rc=256} 02:40:25.000358 --- ParallelTerminationStrategy: PID 13435 died... 02:40:25.021156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13435): Terminated: ok {rc=0} 02:40:25.069148 --- ParallelTerminationStrategy: PID 13438 died... 02:40:25.089372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13438): Terminated: ok {rc=0} 02:40:25.137103 --- ParallelTerminationStrategy: PID 13441 died... 02:40:25.157429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13441): Terminated: ok {rc=0} 02:40:25.247680 bus /gobi_0: Setting Powered False 02:40:26.350990 bus /gobi_0: Setting Powered False 02:40:27.471498 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:40:28.627441 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:28.640332 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:40:28.698371 tst iperf3.py: using LAC 18498 02:40:28.822073 tst iperf3.py: using RAC 138 02:40:28.945373 tst iperf3.py: using CellId 18498 02:40:29.070860 tst iperf3.py: using BVCI 18499 02:40:29.186104 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:29.198556 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:29.210844 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:29.227126 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:29.240285 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:29.252453 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:29.265951 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:29.278689 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:29.292857 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:29.413167 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:40:29.614975 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:29.915829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13621): Launched 02:40:30.176414 run iperf3-srv_10.42.42.10(pid=13622): Launched 02:40:30.288379 tst iperf3.py:8: start network... 02:40:30.488726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:30.986415 run create_hlr_db(pid=13623): Launched 02:40:31.142875 bus /gobi_6: Setting Powered False 02:40:32.204380 run create_hlr_db(pid=13623): Terminated: ok {rc=0} 02:40:32.635558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13625): Launched 02:40:32.936297 run osmo-hlr_10.42.42.2(pid=13626): Launched 02:40:33.052613 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:33.574517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13628): Launched 02:40:33.876035 run osmo-stp_10.42.42.5(pid=13629): Launched 02:40:33.991222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:34.511600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13631): Launched 02:40:34.626495 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:34.880853 run patchelf(pid=13632): Launched 02:40:35.047955 run osmo-stp_10.42.42.5(pid=13629): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13629)] 02:40:35.175455 run osmo-stp_10.42.42.5(pid=13629): stdout: | (launched: 2022-12-09_02:40:33.821210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:35.304653 run osmo-stp_10.42.42.5(pid=13629): stderr: | 20221209024033992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024033992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024033992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024033992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024033993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024033993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024033993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:35.433889 run osmo-stp_10.42.42.5(pid=13629): stdout: | (launched: 2022-12-09_02:40:33.821210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:35.557924 run osmo-stp_10.42.42.5(pid=13629): stderr: | 20221209024033992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024033992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024033992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024033992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024033993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024033993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024033993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:35.704351 run patchelf(pid=13632): Terminating (SIGINT) 02:40:35.873302 run patchelf(pid=13632): Terminated: ok {rc=0} 02:40:35.995170 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13629): Process ended prematurely: osmo-stp_10.42.42.5(pid=13629) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13629)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 02:40:36.004940 tst iperf3.py:8: Test FAILED (7.4 sec) 02:40:36.032616 run osmo-hlr_10.42.42.2(pid=13626): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13626)] 02:40:36.080643 run osmo-hlr_10.42.42.2(pid=13626): stdout: | (launched: 2022-12-09_02:40:32.881488) 02:40:36.130348 run osmo-hlr_10.42.42.2(pid=13626): stderr: | 20221209024033059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024033059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024033059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024033059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024033059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024033059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024033071 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024033079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024033079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024033079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:36.180360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13621): Terminating (SIGTERM) 02:40:36.220500 run iperf3-srv_10.42.42.10(pid=13622): Terminating (SIGTERM) 02:40:36.260544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13625): Terminating (SIGTERM) 02:40:36.300320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13628): Terminating (SIGTERM) 02:40:36.340116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13631): Terminating (SIGTERM) 02:40:36.380121 --- ParallelTerminationStrategy: PID 13621 died... 02:40:36.399062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13621): Terminated: ok {rc=0} 02:40:36.443299 --- ParallelTerminationStrategy: PID 13622 died... 02:40:36.461747 run iperf3-srv_10.42.42.10(pid=13622): Terminated {rc=256} 02:40:36.505336 --- ParallelTerminationStrategy: PID 13625 died... 02:40:36.523749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13625): Terminated: ok {rc=0} 02:40:36.567438 --- ParallelTerminationStrategy: PID 13628 died... 02:40:36.586045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13628): Terminated: ok {rc=0} 02:40:36.629821 --- ParallelTerminationStrategy: PID 13631 died... 02:40:36.648309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13631): Terminated: ok {rc=0} 02:40:36.730509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:40:37.878966 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:37.891139 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:40:37.946825 tst iperf3m4.py: using LAC 18499 02:40:38.074963 tst iperf3m4.py: using RAC 139 02:40:38.203784 tst iperf3m4.py: using CellId 18499 02:40:38.331349 tst iperf3m4.py: using BVCI 18500 02:40:38.450620 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:38.462308 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:38.473664 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:38.485542 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:38.497314 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:38.509138 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:38.520943 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:38.532913 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:38.544840 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:38.663359 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:38.786914 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:38.908406 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:39.026209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:40:39.227049 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:39.529391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13633): Launched 02:40:39.791972 run iperf3-srv_10.42.42.10(pid=13634): Launched 02:40:39.904788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:40:40.107215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:40.410306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13635): Launched 02:40:40.672193 run iperf3-srv_10.42.42.10(pid=13636): Launched 02:40:40.784757 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:40:40.985855 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:41.288750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13637): Launched 02:40:41.550082 run iperf3-srv_10.42.42.10(pid=13638): Launched 02:40:41.664188 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:40:41.865567 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:42.168580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13639): Launched 02:40:42.430044 run iperf3-srv_10.42.42.10(pid=13640): Launched 02:40:42.541902 tst iperf3m4.py:8: start network... 02:40:42.742885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:43.207471 run create_hlr_db(pid=13641): Launched 02:40:43.323146 bus /gobi_6: Setting Powered False 02:40:44.383163 run create_hlr_db(pid=13641): Terminated: ok {rc=0} 02:40:44.802280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13643): Launched 02:40:45.102638 run osmo-hlr_10.42.42.2(pid=13644): Launched 02:40:45.218234 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:45.755534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13646): Launched 02:40:46.083079 run osmo-stp_10.42.42.5(pid=13647): Launched 02:40:46.337967 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:46.941889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13649): Launched 02:40:47.070725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:47.331535 run patchelf(pid=13650): Launched 02:40:47.498169 run osmo-stp_10.42.42.5(pid=13647): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13647)] 02:40:47.625346 run osmo-stp_10.42.42.5(pid=13647): stdout: | (launched: 2022-12-09_02:40:46.022866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:47.754729 run osmo-stp_10.42.42.5(pid=13647): stderr: | 20221209024046293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024046293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024046294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024046294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024046294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024046294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024046295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:47.883643 run osmo-stp_10.42.42.5(pid=13647): stdout: | (launched: 2022-12-09_02:40:46.022866) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:48.006980 run osmo-stp_10.42.42.5(pid=13647): stderr: | 20221209024046293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024046293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024046294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024046294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024046294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024046294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024046295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:48.153517 run patchelf(pid=13650): Terminating (SIGINT) 02:40:48.322111 run patchelf(pid=13650): Terminated: ok {rc=0} 02:40:48.444042 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13647): Process ended prematurely: osmo-stp_10.42.42.5(pid=13647) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13647)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 02:40:48.453602 tst iperf3m4.py:8: Test FAILED (10.6 sec) 02:40:48.481230 run osmo-hlr_10.42.42.2(pid=13644): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13644)] 02:40:48.528360 run osmo-hlr_10.42.42.2(pid=13644): stdout: | (launched: 2022-12-09_02:40:45.047887) 02:40:48.577638 run osmo-hlr_10.42.42.2(pid=13644): stderr: | 20221209024045221 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024045221 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024045221 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024045221 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024045221 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024045221 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024045234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024045243 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024045243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024045243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:48.627146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13633): Terminating (SIGTERM) 02:40:48.666830 run iperf3-srv_10.42.42.10(pid=13634): Terminating (SIGTERM) 02:40:48.706308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13635): Terminating (SIGTERM) 02:40:48.746123 run iperf3-srv_10.42.42.10(pid=13636): Terminating (SIGTERM) 02:40:48.785553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13637): Terminating (SIGTERM) 02:40:48.825164 run iperf3-srv_10.42.42.10(pid=13638): Terminating (SIGTERM) 02:40:48.864470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13639): Terminating (SIGTERM) 02:40:48.903968 run iperf3-srv_10.42.42.10(pid=13640): Terminating (SIGTERM) 02:40:48.943314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13643): Terminating (SIGTERM) 02:40:48.982811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13646): Terminating (SIGTERM) 02:40:49.022303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13649): Terminating (SIGTERM) 02:40:49.062103 --- ParallelTerminationStrategy: PID 13633 died... 02:40:49.081085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13633): Terminated: ok {rc=0} 02:40:49.125365 --- ParallelTerminationStrategy: PID 13634 died... 02:40:49.143651 run iperf3-srv_10.42.42.10(pid=13634): Terminated {rc=256} 02:40:49.187625 --- ParallelTerminationStrategy: PID 13635 died... 02:40:49.206139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13635): Terminated: ok {rc=0} 02:40:49.250511 --- ParallelTerminationStrategy: PID 13636 died... 02:40:49.268911 run iperf3-srv_10.42.42.10(pid=13636): Terminated {rc=256} 02:40:49.312760 --- ParallelTerminationStrategy: PID 13637 died... 02:40:49.331314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13637): Terminated: ok {rc=0} 02:40:49.375117 --- ParallelTerminationStrategy: PID 13638 died... 02:40:49.393689 run iperf3-srv_10.42.42.10(pid=13638): Terminated {rc=256} 02:40:49.437575 --- ParallelTerminationStrategy: PID 13639 died... 02:40:49.455997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13639): Terminated: ok {rc=0} 02:40:49.500290 --- ParallelTerminationStrategy: PID 13640 died... 02:40:49.518832 run iperf3-srv_10.42.42.10(pid=13640): Terminated {rc=256} 02:40:49.563281 --- ParallelTerminationStrategy: PID 13643 died... 02:40:49.581888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13643): Terminated: ok {rc=0} 02:40:49.625903 --- ParallelTerminationStrategy: PID 13646 died... 02:40:49.644747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13646): Terminated: ok {rc=0} 02:40:49.688898 --- ParallelTerminationStrategy: PID 13649 died... 02:40:49.707562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13649): Terminated: ok {rc=0} 02:40:49.791068 bus /gobi_4: Setting Powered False 02:40:50.886312 bus /gobi_4: Setting Powered False 02:40:51.999768 bus /gobi_1: Setting Powered False 02:40:53.097146 bus /gobi_1: Setting Powered False 02:40:54.213227 bus /gobi_0: Setting Powered False 02:40:55.308409 bus /gobi_0: Setting Powered False 02:40:56.423948 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 02:40:57.526846 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:57.539247 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:40:57.593124 tst ping.py: using LAC 18500 02:40:57.719598 tst ping.py: using RAC 140 02:40:57.846612 tst ping.py: using CellId 18500 02:40:57.972344 tst ping.py: using BVCI 18501 02:40:58.087801 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:58.099376 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:58.110720 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:58.122158 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:58.133434 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:58.144650 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:58.156140 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:58.167606 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:58.285475 tst ping.py:19: start network... 02:40:58.498212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:58.988489 run create_hlr_db(pid=13651): Launched 02:40:59.116410 bus /gobi_6: Setting Powered False 02:41:00.177807 run create_hlr_db(pid=13651): Terminated: ok {rc=0} 02:41:00.600476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13653): Launched 02:41:00.905758 run osmo-hlr_10.42.42.2(pid=13654): Launched 02:41:01.109718 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:01.831184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13656): Launched 02:41:02.149557 run osmo-stp_10.42.42.5(pid=13657): Launched 02:41:02.399952 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:03.019982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13659): Launched 02:41:03.140471 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:03.408192 run patchelf(pid=13660): Launched 02:41:03.583482 run osmo-stp_10.42.42.5(pid=13657): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13657)] 02:41:03.717403 run osmo-stp_10.42.42.5(pid=13657): stdout: | (launched: 2022-12-09_02:41:02.089893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:03.853982 run osmo-stp_10.42.42.5(pid=13657): stderr: | 20221209024102382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024102382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024102383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024102383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024102383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024102384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024102384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:03.989691 run osmo-stp_10.42.42.5(pid=13657): stdout: | (launched: 2022-12-09_02:41:02.089893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:04.119723 run osmo-stp_10.42.42.5(pid=13657): stderr: | 20221209024102382 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024102382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024102383 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024102383 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024102383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024102384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024102384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:04.273716 run patchelf(pid=13660): Terminating (SIGINT) 02:41:04.450859 run patchelf(pid=13660): Terminated: ok {rc=0} 02:41:04.578505 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13657): Process ended prematurely: osmo-stp_10.42.42.5(pid=13657) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13657)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 02:41:04.587984 tst ping.py:22: Test FAILED (7.1 sec) 02:41:04.615704 run osmo-hlr_10.42.42.2(pid=13654): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13654)] 02:41:04.665107 run osmo-hlr_10.42.42.2(pid=13654): stdout: | (launched: 2022-12-09_02:41:00.842306) 02:41:04.716481 run osmo-hlr_10.42.42.2(pid=13654): stderr: | 20221209024101172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024101175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024101175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024101175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024101175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024101175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024101204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024101216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024101216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024101216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:04.768199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13653): Terminating (SIGTERM) 02:41:04.809730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13656): Terminating (SIGTERM) 02:41:04.850970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13659): Terminating (SIGTERM) 02:41:04.892523 --- ParallelTerminationStrategy: PID 13653 died... 02:41:04.912805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13653): Terminated: ok {rc=0} 02:41:04.958633 --- ParallelTerminationStrategy: PID 13656 died... 02:41:04.978065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13656): Terminated: ok {rc=0} 02:41:05.023685 --- ParallelTerminationStrategy: PID 13659 died... 02:41:05.043125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13659): Terminated: ok {rc=0} 02:41:05.130536 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:41:06.219448 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:41:06.232105 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:41:06.287180 tst ping_idle_ping.py: using LAC 18501 02:41:06.412174 tst ping_idle_ping.py: using RAC 141 02:41:06.537369 tst ping_idle_ping.py: using CellId 18501 02:41:06.661185 tst ping_idle_ping.py: using BVCI 18502 02:41:06.777121 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:41:06.788694 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:41:06.800174 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:41:06.811434 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:41:06.822617 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:41:06.833864 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:41:06.845363 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:41:06.856557 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:41:06.975282 tst ping_idle_ping.py:24: start network... 02:41:07.189960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:07.685355 run create_hlr_db(pid=13661): Launched 02:41:07.815435 bus /gobi_6: Setting Powered False 02:41:08.878221 run create_hlr_db(pid=13661): Terminated: ok {rc=0} 02:41:09.303140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13663): Launched 02:41:09.600316 run osmo-hlr_10.42.42.2(pid=13664): Launched 02:41:09.728094 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:10.277758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13666): Launched 02:41:10.594441 run osmo-stp_10.42.42.5(pid=13667): Launched 02:41:10.716779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:11.265500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13669): Launched 02:41:11.387980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:11.656394 run patchelf(pid=13670): Launched 02:41:11.834117 run osmo-stp_10.42.42.5(pid=13667): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13667)] 02:41:11.968865 run osmo-stp_10.42.42.5(pid=13667): stdout: | (launched: 2022-12-09_02:41:10.536631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:12.105267 run osmo-stp_10.42.42.5(pid=13667): stderr: | 20221209024110730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024110730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024110731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024110731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024110731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024110732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024110732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:12.241355 run osmo-stp_10.42.42.5(pid=13667): stdout: | (launched: 2022-12-09_02:41:10.536631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:12.371802 run osmo-stp_10.42.42.5(pid=13667): stderr: | 20221209024110730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024110730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024110731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024110731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024110731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024110732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024110732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:12.526462 run patchelf(pid=13670): Terminating (SIGINT) 02:41:12.703946 run patchelf(pid=13670): Terminated: ok {rc=0} 02:41:12.832157 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13667): Process ended prematurely: osmo-stp_10.42.42.5(pid=13667) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13667)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 02:41:12.841706 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:41:12.869604 run osmo-hlr_10.42.42.2(pid=13664): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13664)] 02:41:12.919314 run osmo-hlr_10.42.42.2(pid=13664): stdout: | (launched: 2022-12-09_02:41:09.545731) 02:41:12.970423 run osmo-hlr_10.42.42.2(pid=13664): stderr: | 20221209024109734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024109734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024109734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024109734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024109734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024109734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024109746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024109755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024109755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024109755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:13.021747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13663): Terminating (SIGTERM) 02:41:13.063539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13666): Terminating (SIGTERM) 02:41:13.105015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13669): Terminating (SIGTERM) 02:41:13.146909 --- ParallelTerminationStrategy: PID 13663 died... 02:41:13.166823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13663): Terminated: ok {rc=0} 02:41:13.212808 --- ParallelTerminationStrategy: PID 13666 died... 02:41:13.232761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13666): Terminated: ok {rc=0} 02:41:13.278903 --- ParallelTerminationStrategy: PID 13669 died... 02:41:13.298587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13669): Terminated: ok {rc=0} 02:41:13.386729 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:41:14.705383 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:41:14.712142 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:41:14.747026 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:41:14.787064 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:41:14.879061 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:41:14.914506 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:41:14.954049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:41:15.552759 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:41:15.605003 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:15.616561 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:41:15.693567 tst cs_paging_gprs_active.py: using LAC 18502 02:41:15.827432 tst cs_paging_gprs_active.py: using RAC 142 02:41:15.973709 tst cs_paging_gprs_active.py: using CellId 18502 02:41:16.119914 tst cs_paging_gprs_active.py: using BVCI 18503 02:41:16.239566 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:16.251697 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:16.263705 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:16.275706 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:16.287716 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:16.299662 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:16.311679 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:16.323624 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:16.335816 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:16.457637 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:16.584155 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:41:16.796386 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:17.113430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13675): Launched 02:41:17.393871 run iperf3-srv_10.42.42.10(pid=13676): Launched 02:41:17.510720 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:41:17.713966 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:18.018435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13677): Launched 02:41:18.281614 run iperf3-srv_10.42.42.10(pid=13678): Launched 02:41:18.395207 tst cs_paging_gprs_active.py:38: start network... 02:41:18.597902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:19.065502 run create_hlr_db(pid=13679): Launched 02:41:19.180264 bus /gobi_6: Setting Powered False 02:41:20.240824 run create_hlr_db(pid=13679): Terminated: ok {rc=0} 02:41:20.661197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13681): Launched 02:41:20.962907 run osmo-hlr_10.42.42.2(pid=13682): Launched 02:41:21.078397 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:21.611988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13684): Launched 02:41:21.914772 run osmo-stp_10.42.42.5(pid=13685): Launched 02:41:22.031782 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:22.551459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13687): Launched 02:41:22.667010 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:22.922087 run patchelf(pid=13688): Launched 02:41:23.089295 run osmo-stp_10.42.42.5(pid=13685): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13685)] 02:41:23.216803 run osmo-stp_10.42.42.5(pid=13685): stdout: | (launched: 2022-12-09_02:41:21.859295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:23.345718 run osmo-stp_10.42.42.5(pid=13685): stderr: | 20221209024122030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024122030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024122030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024122030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024122031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024122031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024122031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:23.474757 run osmo-stp_10.42.42.5(pid=13685): stdout: | (launched: 2022-12-09_02:41:21.859295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:23.598632 run osmo-stp_10.42.42.5(pid=13685): stderr: | 20221209024122030 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024122030 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024122030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024122030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024122031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024122031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024122031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:23.745130 run patchelf(pid=13688): Terminating (SIGINT) 02:41:23.914351 run patchelf(pid=13688): Terminated: ok {rc=0} 02:41:24.036433 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13685): Process ended prematurely: osmo-stp_10.42.42.5(pid=13685) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13685)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:41:24.046065 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:41:24.073516 run osmo-hlr_10.42.42.2(pid=13682): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13682)] 02:41:24.121528 run osmo-hlr_10.42.42.2(pid=13682): stdout: | (launched: 2022-12-09_02:41:20.907963) 02:41:24.170831 run osmo-hlr_10.42.42.2(pid=13682): stderr: | 20221209024121083 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024121083 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024121083 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024121083 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024121083 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024121083 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024121095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024121104 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024121104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024121104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:24.220261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13675): Terminating (SIGTERM) 02:41:24.260176 run iperf3-srv_10.42.42.10(pid=13676): Terminating (SIGTERM) 02:41:24.300138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13677): Terminating (SIGTERM) 02:41:24.340112 run iperf3-srv_10.42.42.10(pid=13678): Terminating (SIGTERM) 02:41:24.379752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13681): Terminating (SIGTERM) 02:41:24.419682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13684): Terminating (SIGTERM) 02:41:24.459818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13687): Terminating (SIGTERM) 02:41:24.499906 --- ParallelTerminationStrategy: PID 13675 died... 02:41:24.518990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13675): Terminated: ok {rc=0} 02:41:24.563188 --- ParallelTerminationStrategy: PID 13676 died... 02:41:24.581664 run iperf3-srv_10.42.42.10(pid=13676): Terminated {rc=256} 02:41:24.625535 --- ParallelTerminationStrategy: PID 13677 died... 02:41:24.644001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13677): Terminated: ok {rc=0} 02:41:24.688076 --- ParallelTerminationStrategy: PID 13678 died... 02:41:24.706562 run iperf3-srv_10.42.42.10(pid=13678): Terminated {rc=256} 02:41:24.750581 --- ParallelTerminationStrategy: PID 13681 died... 02:41:24.769176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13681): Terminated: ok {rc=0} 02:41:24.813359 --- ParallelTerminationStrategy: PID 13684 died... 02:41:24.831984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13684): Terminated: ok {rc=0} 02:41:24.876082 --- ParallelTerminationStrategy: PID 13687 died... 02:41:24.894757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13687): Terminated: ok {rc=0} 02:41:24.980236 bus /gobi_0: Setting Powered False 02:41:26.078614 bus /gobi_0: Setting Powered False 02:41:27.193068 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:41:28.340307 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:28.352358 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:41:28.426511 tst iperf3.py: using LAC 18503 02:41:28.545992 tst iperf3.py: using RAC 143 02:41:28.666874 tst iperf3.py: using CellId 18503 02:41:28.787693 tst iperf3.py: using BVCI 18504 02:41:28.899067 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:28.910195 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:28.921073 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:28.932137 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:28.943181 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:28.954290 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:28.965504 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:28.976663 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:28.987992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:29.106279 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:41:29.324489 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:29.648150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13689): Launched 02:41:29.928096 run iperf3-srv_10.42.42.10(pid=13690): Launched 02:41:30.049279 tst iperf3.py:8: start network... 02:41:30.266465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:30.767162 run create_hlr_db(pid=13691): Launched 02:41:30.909493 bus /gobi_6: Setting Powered False 02:41:31.978001 run create_hlr_db(pid=13691): Terminated: ok {rc=0} 02:41:32.457721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13693): Launched 02:41:32.761306 run osmo-hlr_10.42.42.2(pid=13694): Launched 02:41:32.877278 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:33.412242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13696): Launched 02:41:33.713776 run osmo-stp_10.42.42.5(pid=13697): Launched 02:41:33.830473 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:34.351407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13699): Launched 02:41:34.466815 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:34.723199 run patchelf(pid=13700): Launched 02:41:34.890534 run osmo-stp_10.42.42.5(pid=13697): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13697)] 02:41:35.018790 run osmo-stp_10.42.42.5(pid=13697): stdout: | (launched: 2022-12-09_02:41:33.658936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:35.148316 run osmo-stp_10.42.42.5(pid=13697): stderr: | 20221209024133827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024133827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024133827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024133828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024133830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024133830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024133830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:35.278222 run osmo-stp_10.42.42.5(pid=13697): stdout: | (launched: 2022-12-09_02:41:33.658936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:35.402509 run osmo-stp_10.42.42.5(pid=13697): stderr: | 20221209024133827 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024133827 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024133827 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024133828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024133830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024133830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024133830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:35.549542 run patchelf(pid=13700): Terminating (SIGINT) 02:41:35.719502 run patchelf(pid=13700): Terminated: ok {rc=0} 02:41:35.842360 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13697): Process ended prematurely: osmo-stp_10.42.42.5(pid=13697) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13697)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 02:41:35.851765 tst iperf3.py:8: Test FAILED (7.5 sec) 02:41:35.879527 run osmo-hlr_10.42.42.2(pid=13694): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13694)] 02:41:35.927659 run osmo-hlr_10.42.42.2(pid=13694): stdout: | (launched: 2022-12-09_02:41:32.706400) 02:41:35.977465 run osmo-hlr_10.42.42.2(pid=13694): stderr: | 20221209024132880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024132880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024132880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024132880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024132881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024132881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024132893 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024132902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024132902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024132902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:36.028093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13689): Terminating (SIGTERM) 02:41:36.068612 run iperf3-srv_10.42.42.10(pid=13690): Terminating (SIGTERM) 02:41:36.108807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13693): Terminating (SIGTERM) 02:41:36.149446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13696): Terminating (SIGTERM) 02:41:36.189992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13699): Terminating (SIGTERM) 02:41:36.230549 --- ParallelTerminationStrategy: PID 13689 died... 02:41:36.249827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13689): Terminated: ok {rc=0} 02:41:36.294832 --- ParallelTerminationStrategy: PID 13690 died... 02:41:36.313616 run iperf3-srv_10.42.42.10(pid=13690): Terminated {rc=256} 02:41:36.358119 --- ParallelTerminationStrategy: PID 13693 died... 02:41:36.376898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13693): Terminated: ok {rc=0} 02:41:36.421782 --- ParallelTerminationStrategy: PID 13696 died... 02:41:36.440568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13696): Terminated: ok {rc=0} 02:41:36.485036 --- ParallelTerminationStrategy: PID 13699 died... 02:41:36.503728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13699): Terminated: ok {rc=0} 02:41:36.590363 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:41:37.737867 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:37.749902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:41:37.823429 tst iperf3m4.py: using LAC 18504 02:41:37.953456 tst iperf3m4.py: using RAC 144 02:41:38.081167 tst iperf3m4.py: using CellId 18504 02:41:38.211579 tst iperf3m4.py: using BVCI 18505 02:41:38.330732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:38.342662 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:38.354445 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:38.365919 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:38.377268 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:38.388586 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:38.400216 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:38.411556 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:38.423130 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:38.541232 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:38.666501 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:38.789540 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:38.909884 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:41:39.129650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:39.455125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13701): Launched 02:41:39.736870 run iperf3-srv_10.42.42.10(pid=13702): Launched 02:41:39.858077 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:41:40.077448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:40.402092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13703): Launched 02:41:40.683223 run iperf3-srv_10.42.42.10(pid=13704): Launched 02:41:40.804812 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:41:41.022981 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:41.339870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13705): Launched 02:41:41.603437 run iperf3-srv_10.42.42.10(pid=13706): Launched 02:41:41.716465 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:41:41.919120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:42.222869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13707): Launched 02:41:42.484799 run iperf3-srv_10.42.42.10(pid=13708): Launched 02:41:42.597836 tst iperf3m4.py:8: start network... 02:41:42.799411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:43.266807 run create_hlr_db(pid=13709): Launched 02:41:43.382596 bus /gobi_6: Setting Powered False 02:41:44.442383 run create_hlr_db(pid=13709): Terminated: ok {rc=0} 02:41:44.882326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13711): Launched 02:41:45.204749 run osmo-hlr_10.42.42.2(pid=13712): Launched 02:41:45.323976 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:45.865553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13714): Launched 02:41:46.190708 run osmo-stp_10.42.42.5(pid=13715): Launched 02:41:46.513249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:47.187142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13717): Launched 02:41:47.323245 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:47.598810 run patchelf(pid=13718): Launched 02:41:47.778598 run osmo-stp_10.42.42.5(pid=13715): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13715)] 02:41:47.915177 run osmo-stp_10.42.42.5(pid=13715): stdout: | (launched: 2022-12-09_02:41:46.134965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:48.053905 run osmo-stp_10.42.42.5(pid=13715): stderr: | 20221209024146421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024146421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024146421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024146421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024146422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024146422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024146422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:48.192618 run osmo-stp_10.42.42.5(pid=13715): stdout: | (launched: 2022-12-09_02:41:46.134965) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:48.325487 run osmo-stp_10.42.42.5(pid=13715): stderr: | 20221209024146421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024146421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024146421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024146421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024146422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024146422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024146422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:48.482620 run patchelf(pid=13718): Terminating (SIGINT) 02:41:48.663312 run patchelf(pid=13718): Terminated: ok {rc=0} 02:41:48.793816 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13715): Process ended prematurely: osmo-stp_10.42.42.5(pid=13715) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13715)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:41:48.804000 tst iperf3m4.py:8: Test FAILED (11.1 sec) 02:41:48.832913 run osmo-hlr_10.42.42.2(pid=13712): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13712)] 02:41:48.883008 run osmo-hlr_10.42.42.2(pid=13712): stdout: | (launched: 2022-12-09_02:41:45.146386) 02:41:48.934605 run osmo-hlr_10.42.42.2(pid=13712): stderr: | 20221209024145327 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024145327 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024145327 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024145327 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024145327 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024145327 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024145339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024145348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024145348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024145348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:48.986803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13701): Terminating (SIGTERM) 02:41:49.028797 run iperf3-srv_10.42.42.10(pid=13702): Terminating (SIGTERM) 02:41:49.070642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13703): Terminating (SIGTERM) 02:41:49.112440 run iperf3-srv_10.42.42.10(pid=13704): Terminating (SIGTERM) 02:41:49.154272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13705): Terminating (SIGTERM) 02:41:49.196125 run iperf3-srv_10.42.42.10(pid=13706): Terminating (SIGTERM) 02:41:49.238629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13707): Terminating (SIGTERM) 02:41:49.282206 run iperf3-srv_10.42.42.10(pid=13708): Terminating (SIGTERM) 02:41:49.323135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13711): Terminating (SIGTERM) 02:41:49.364215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13714): Terminating (SIGTERM) 02:41:49.404459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13717): Terminating (SIGTERM) 02:41:49.444859 --- ParallelTerminationStrategy: PID 13701 died... 02:41:49.463653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13701): Terminated: ok {rc=0} 02:41:49.508014 --- ParallelTerminationStrategy: PID 13702 died... 02:41:49.526425 run iperf3-srv_10.42.42.10(pid=13702): Terminated {rc=256} 02:41:49.570836 --- ParallelTerminationStrategy: PID 13703 died... 02:41:49.589435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13703): Terminated: ok {rc=0} 02:41:49.633871 --- ParallelTerminationStrategy: PID 13704 died... 02:41:49.652413 run iperf3-srv_10.42.42.10(pid=13704): Terminated {rc=256} 02:41:49.695960 --- ParallelTerminationStrategy: PID 13705 died... 02:41:49.714701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13705): Terminated: ok {rc=0} 02:41:49.759071 --- ParallelTerminationStrategy: PID 13706 died... 02:41:49.777691 run iperf3-srv_10.42.42.10(pid=13706): Terminated {rc=256} 02:41:49.821601 --- ParallelTerminationStrategy: PID 13707 died... 02:41:49.840492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13707): Terminated: ok {rc=0} 02:41:49.885462 --- ParallelTerminationStrategy: PID 13708 died... 02:41:49.904080 run iperf3-srv_10.42.42.10(pid=13708): Terminated {rc=256} 02:41:49.948147 --- ParallelTerminationStrategy: PID 13711 died... 02:41:49.966819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13711): Terminated: ok {rc=0} 02:41:50.010982 --- ParallelTerminationStrategy: PID 13714 died... 02:41:50.029634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13714): Terminated: ok {rc=0} 02:41:50.073725 --- ParallelTerminationStrategy: PID 13717 died... 02:41:50.092324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13717): Terminated: ok {rc=0} 02:41:50.178563 bus /gobi_4: Setting Powered False 02:41:51.279565 bus /gobi_4: Setting Powered False 02:41:52.394854 bus /gobi_1: Setting Powered False 02:41:53.490500 bus /gobi_1: Setting Powered False 02:41:54.606279 bus /gobi_0: Setting Powered False 02:41:55.703740 bus /gobi_0: Setting Powered False 02:41:56.820387 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:41:57.923138 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:57.935251 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:41:58.006420 tst ping.py: using LAC 18505 02:41:58.124903 tst ping.py: using RAC 145 02:41:58.241363 tst ping.py: using CellId 18505 02:41:58.357990 tst ping.py: using BVCI 18506 02:41:58.465757 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:58.476866 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:58.487943 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:58.499167 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:58.510373 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:58.521663 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:58.532792 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:58.544106 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:58.658721 tst ping.py:19: start network... 02:41:58.856171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:59.313991 run create_hlr_db(pid=13719): Launched 02:41:59.425557 bus /gobi_6: Setting Powered False 02:42:00.484784 run create_hlr_db(pid=13719): Terminated: ok {rc=0} 02:42:00.946773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13722): Launched 02:42:01.291075 run osmo-hlr_10.42.42.2(pid=13724): Launched 02:42:01.497159 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:02.276430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13726): Launched 02:42:02.594244 run osmo-stp_10.42.42.5(pid=13727): Launched 02:42:02.716082 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:03.263224 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13729): Launched 02:42:03.383569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:03.651575 run patchelf(pid=13730): Launched 02:42:03.827996 run osmo-stp_10.42.42.5(pid=13727): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13727)] 02:42:03.961816 run osmo-stp_10.42.42.5(pid=13727): stdout: | (launched: 2022-12-09_02:42:02.536498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:04.097791 run osmo-stp_10.42.42.5(pid=13727): stderr: | 20221209024202728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024202728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024202729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024202729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024202730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024202730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024202730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:04.233466 run osmo-stp_10.42.42.5(pid=13727): stdout: | (launched: 2022-12-09_02:42:02.536498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:04.364082 run osmo-stp_10.42.42.5(pid=13727): stderr: | 20221209024202728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024202728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024202729 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024202729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024202730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024202730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024202730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:04.518610 run patchelf(pid=13730): Terminating (SIGINT) 02:42:04.695381 run patchelf(pid=13730): Terminated: ok {rc=0} 02:42:04.823858 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13727): Process ended prematurely: osmo-stp_10.42.42.5(pid=13727) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13727)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 02:42:04.833284 tst ping.py:22: Test FAILED (6.9 sec) 02:42:04.860927 run osmo-hlr_10.42.42.2(pid=13724): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13724)] 02:42:04.911133 run osmo-hlr_10.42.42.2(pid=13724): stdout: | (launched: 2022-12-09_02:42:01.233780) 02:42:04.962495 run osmo-hlr_10.42.42.2(pid=13724): stderr: | 20221209024201570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024201570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024201570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024201570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024201570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024201571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024201586 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024201604 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024201604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024201604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:05.014404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13722): Terminating (SIGTERM) 02:42:05.056087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13726): Terminating (SIGTERM) 02:42:05.098000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13729): Terminating (SIGTERM) 02:42:05.139944 --- ParallelTerminationStrategy: PID 13722 died... 02:42:05.159894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13722): Terminated: ok {rc=0} 02:42:05.205938 --- ParallelTerminationStrategy: PID 13726 died... 02:42:05.225537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13726): Terminated: ok {rc=0} 02:42:05.271425 --- ParallelTerminationStrategy: PID 13729 died... 02:42:05.290940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13729): Terminated: ok {rc=0} 02:42:05.378567 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:42:06.467003 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:42:06.479902 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:42:06.553827 tst ping_idle_ping.py: using LAC 18506 02:42:06.680611 tst ping_idle_ping.py: using RAC 146 02:42:06.809436 tst ping_idle_ping.py: using CellId 18506 02:42:06.927489 tst ping_idle_ping.py: using BVCI 18507 02:42:07.036222 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:42:07.048429 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:42:07.059628 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:42:07.071605 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:42:07.083459 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:42:07.095386 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:42:07.107407 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:42:07.119165 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:42:07.240228 tst ping_idle_ping.py:24: start network... 02:42:07.454359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:07.956356 run create_hlr_db(pid=13731): Launched 02:42:08.086073 bus /gobi_6: Setting Powered False 02:42:09.149451 run create_hlr_db(pid=13731): Terminated: ok {rc=0} 02:42:09.575643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13733): Launched 02:42:09.873540 run osmo-hlr_10.42.42.2(pid=13734): Launched 02:42:09.987677 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:10.498956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13736): Launched 02:42:10.793784 run osmo-stp_10.42.42.5(pid=13737): Launched 02:42:10.906527 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:11.417606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13739): Launched 02:42:11.530990 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:11.781272 run patchelf(pid=13740): Launched 02:42:11.946882 run osmo-stp_10.42.42.5(pid=13737): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13737)] 02:42:12.072752 run osmo-stp_10.42.42.5(pid=13737): stdout: | (launched: 2022-12-09_02:42:10.739750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:12.199989 run osmo-stp_10.42.42.5(pid=13737): stderr: | 20221209024210909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024210909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024210909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024210910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024210910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024210910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024210910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:12.328023 run osmo-stp_10.42.42.5(pid=13737): stdout: | (launched: 2022-12-09_02:42:10.739750) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:12.450287 run osmo-stp_10.42.42.5(pid=13737): stderr: | 20221209024210909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024210909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024210909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024210910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024210910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024210910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024210910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:12.594961 run patchelf(pid=13740): Terminating (SIGINT) 02:42:12.761154 run patchelf(pid=13740): Terminated: ok {rc=0} 02:42:12.880700 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13737): Process ended prematurely: osmo-stp_10.42.42.5(pid=13737) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13737)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:42:12.889722 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:42:12.916167 run osmo-hlr_10.42.42.2(pid=13734): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13734)] 02:42:12.963829 run osmo-hlr_10.42.42.2(pid=13734): stdout: | (launched: 2022-12-09_02:42:09.818770) 02:42:13.013057 run osmo-hlr_10.42.42.2(pid=13734): stderr: | 20221209024209995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024209995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024209995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024209995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024209995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024209995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024210007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024210017 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024210017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024210017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:13.062609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13733): Terminating (SIGTERM) 02:42:13.102521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13736): Terminating (SIGTERM) 02:42:13.142463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13739): Terminating (SIGTERM) 02:42:13.182457 --- ParallelTerminationStrategy: PID 13733 died... 02:42:13.201450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13733): Terminated: ok {rc=0} 02:42:13.245389 --- ParallelTerminationStrategy: PID 13736 died... 02:42:13.263908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13736): Terminated: ok {rc=0} 02:42:13.307699 --- ParallelTerminationStrategy: PID 13739 died... 02:42:13.326284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13739): Terminated: ok {rc=0} 02:42:13.409040 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:42:14.716005 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:42:14.722181 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:42:14.756578 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:42:14.795405 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:42:14.882048 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:42:14.915970 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:42:14.954841 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:42:15.550841 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:42:15.599756 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:15.610888 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:42:15.681254 tst cs_paging_gprs_active.py: using LAC 18507 02:42:15.806380 tst cs_paging_gprs_active.py: using RAC 147 02:42:15.947031 tst cs_paging_gprs_active.py: using CellId 18507 02:42:16.071072 tst cs_paging_gprs_active.py: using BVCI 18508 02:42:16.191925 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:16.204573 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:16.216885 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:16.229499 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:16.242693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:16.255897 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:16.270074 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:16.282113 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:16.295240 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:16.413903 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:16.535937 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:42:16.743402 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:42:17.085842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13745): Launched 02:42:17.377847 run iperf3-srv_10.42.42.10(pid=13746): Launched 02:42:17.499258 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:42:17.717878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:42:18.044306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13747): Launched 02:42:18.325677 run iperf3-srv_10.42.42.10(pid=13748): Launched 02:42:18.448725 tst cs_paging_gprs_active.py:38: start network... 02:42:18.667645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:19.169976 run create_hlr_db(pid=13749): Launched 02:42:19.303400 bus /gobi_6: Setting Powered False 02:42:20.367835 run create_hlr_db(pid=13749): Terminated: ok {rc=0} 02:42:20.799856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13751): Launched 02:42:21.101668 run osmo-hlr_10.42.42.2(pid=13752): Launched 02:42:21.217474 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:21.737195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13754): Launched 02:42:22.038634 run osmo-stp_10.42.42.5(pid=13755): Launched 02:42:22.154213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:22.687665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13757): Launched 02:42:22.802633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:23.057575 run patchelf(pid=13758): Launched 02:42:23.224884 run osmo-stp_10.42.42.5(pid=13755): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13755)] 02:42:23.353566 run osmo-stp_10.42.42.5(pid=13755): stdout: | (launched: 2022-12-09_02:42:21.983578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:23.482890 run osmo-stp_10.42.42.5(pid=13755): stderr: | 20221209024222154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024222154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024222154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024222155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024222155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024222155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024222155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:23.612162 run osmo-stp_10.42.42.5(pid=13755): stdout: | (launched: 2022-12-09_02:42:21.983578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:23.736320 run osmo-stp_10.42.42.5(pid=13755): stderr: | 20221209024222154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024222154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024222154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024222155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024222155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024222155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024222155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:23.883077 run patchelf(pid=13758): Terminating (SIGINT) 02:42:24.051606 run patchelf(pid=13758): Terminated: ok {rc=0} 02:42:24.173643 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13755): Process ended prematurely: osmo-stp_10.42.42.5(pid=13755) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13755)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:42:24.183144 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 02:42:24.210438 run osmo-hlr_10.42.42.2(pid=13752): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13752)] 02:42:24.258298 run osmo-hlr_10.42.42.2(pid=13752): stdout: | (launched: 2022-12-09_02:42:21.046817) 02:42:24.307343 run osmo-hlr_10.42.42.2(pid=13752): stderr: | 20221209024221224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024221224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024221224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024221224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024221224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024221224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024221238 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024221248 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024221248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024221248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:24.357368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13745): Terminating (SIGTERM) 02:42:24.397397 run iperf3-srv_10.42.42.10(pid=13746): Terminating (SIGTERM) 02:42:24.437117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13747): Terminating (SIGTERM) 02:42:24.476406 run iperf3-srv_10.42.42.10(pid=13748): Terminating (SIGTERM) 02:42:24.515642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13751): Terminating (SIGTERM) 02:42:24.554986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13754): Terminating (SIGTERM) 02:42:24.594465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13757): Terminating (SIGTERM) 02:42:24.634232 --- ParallelTerminationStrategy: PID 13745 died... 02:42:24.653289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13745): Terminated: ok {rc=0} 02:42:24.697599 --- ParallelTerminationStrategy: PID 13746 died... 02:42:24.716100 run iperf3-srv_10.42.42.10(pid=13746): Terminated {rc=256} 02:42:24.759940 --- ParallelTerminationStrategy: PID 13747 died... 02:42:24.778435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13747): Terminated: ok {rc=0} 02:42:24.822467 --- ParallelTerminationStrategy: PID 13748 died... 02:42:24.840841 run iperf3-srv_10.42.42.10(pid=13748): Terminated {rc=256} 02:42:24.884573 --- ParallelTerminationStrategy: PID 13751 died... 02:42:24.903074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13751): Terminated: ok {rc=0} 02:42:24.946933 --- ParallelTerminationStrategy: PID 13754 died... 02:42:24.965443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13754): Terminated: ok {rc=0} 02:42:25.009198 --- ParallelTerminationStrategy: PID 13757 died... 02:42:25.027518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13757): Terminated: ok {rc=0} 02:42:25.111707 bus /gobi_0: Setting Powered False 02:42:26.209951 bus /gobi_0: Setting Powered False 02:42:27.328153 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:42:28.472650 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:28.484474 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:42:28.558322 tst iperf3.py: using LAC 18508 02:42:28.677856 tst iperf3.py: using RAC 148 02:42:28.795756 tst iperf3.py: using CellId 18508 02:42:28.915445 tst iperf3.py: using BVCI 18509 02:42:29.024820 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:29.035933 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:29.047350 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:29.058524 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:29.069698 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:29.080632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:29.091872 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:29.103013 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:29.114183 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:29.233872 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:42:29.453700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:42:29.778541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13759): Launched 02:42:30.061366 run iperf3-srv_10.42.42.10(pid=13760): Launched 02:42:30.183805 tst iperf3.py:8: start network... 02:42:30.401945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:30.906845 run create_hlr_db(pid=13761): Launched 02:42:31.071984 bus /gobi_6: Setting Powered False 02:42:32.132109 run create_hlr_db(pid=13761): Terminated: ok {rc=0} 02:42:32.566482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13763): Launched 02:42:32.866963 run osmo-hlr_10.42.42.2(pid=13764): Launched 02:42:32.982858 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:33.515736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13766): Launched 02:42:33.816769 run osmo-stp_10.42.42.5(pid=13767): Launched 02:42:33.932313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:34.452480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13769): Launched 02:42:34.568378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:34.823547 run patchelf(pid=13770): Launched 02:42:34.991111 run osmo-stp_10.42.42.5(pid=13767): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13767)] 02:42:35.118419 run osmo-stp_10.42.42.5(pid=13767): stdout: | (launched: 2022-12-09_02:42:33.761756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:35.247652 run osmo-stp_10.42.42.5(pid=13767): stderr: | 20221209024233933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024233933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024233934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024233934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024233934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024233934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024233935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:35.376429 run osmo-stp_10.42.42.5(pid=13767): stdout: | (launched: 2022-12-09_02:42:33.761756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:35.500273 run osmo-stp_10.42.42.5(pid=13767): stderr: | 20221209024233933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024233933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024233934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024233934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024233934 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024233934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024233935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:35.646603 run patchelf(pid=13770): Terminating (SIGINT) 02:42:35.819286 run patchelf(pid=13770): Terminated: ok {rc=0} 02:42:35.941257 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13767): Process ended prematurely: osmo-stp_10.42.42.5(pid=13767) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13767)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 02:42:35.950862 tst iperf3.py:8: Test FAILED (7.5 sec) 02:42:35.978352 run osmo-hlr_10.42.42.2(pid=13764): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13764)] 02:42:36.026136 run osmo-hlr_10.42.42.2(pid=13764): stdout: | (launched: 2022-12-09_02:42:32.812281) 02:42:36.075645 run osmo-hlr_10.42.42.2(pid=13764): stderr: | 20221209024232985 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024232985 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024232985 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024232985 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024232985 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024232985 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024232998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024233007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024233007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024233007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:36.125583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13759): Terminating (SIGTERM) 02:42:36.165566 run iperf3-srv_10.42.42.10(pid=13760): Terminating (SIGTERM) 02:42:36.205447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13763): Terminating (SIGTERM) 02:42:36.245345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13766): Terminating (SIGTERM) 02:42:36.285439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13769): Terminating (SIGTERM) 02:42:36.325738 --- ParallelTerminationStrategy: PID 13759 died... 02:42:36.344820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13759): Terminated: ok {rc=0} 02:42:36.389389 --- ParallelTerminationStrategy: PID 13760 died... 02:42:36.407991 run iperf3-srv_10.42.42.10(pid=13760): Terminated {rc=256} 02:42:36.452213 --- ParallelTerminationStrategy: PID 13763 died... 02:42:36.470869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13763): Terminated: ok {rc=0} 02:42:36.515516 --- ParallelTerminationStrategy: PID 13766 died... 02:42:36.533964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13766): Terminated: ok {rc=0} 02:42:36.577783 --- ParallelTerminationStrategy: PID 13769 died... 02:42:36.596297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13769): Terminated: ok {rc=0} 02:42:36.681464 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:42:37.831385 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:37.843843 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:42:37.918246 tst iperf3m4.py: using LAC 18509 02:42:38.047789 tst iperf3m4.py: using RAC 149 02:42:38.179845 tst iperf3m4.py: using CellId 18509 02:42:38.309461 tst iperf3m4.py: using BVCI 18510 02:42:38.421560 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:38.432744 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:38.443957 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:38.455674 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:38.467070 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:38.478469 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:38.489774 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:38.500765 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:38.512389 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:38.632197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:38.751626 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:38.872735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:38.993898 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:42:39.212566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:42:39.537313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13773): Launched 02:42:39.819789 run iperf3-srv_10.42.42.10(pid=13774): Launched 02:42:39.940845 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:42:40.158568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:42:40.482353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13775): Launched 02:42:40.764718 run iperf3-srv_10.42.42.10(pid=13776): Launched 02:42:40.886371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:42:41.103624 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:42:41.427069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13777): Launched 02:42:41.709048 run iperf3-srv_10.42.42.10(pid=13778): Launched 02:42:41.830575 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:42:42.047953 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:42:42.372055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13779): Launched 02:42:42.654416 run iperf3-srv_10.42.42.10(pid=13780): Launched 02:42:42.775324 tst iperf3m4.py:8: start network... 02:42:42.992509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:43.493136 run create_hlr_db(pid=13781): Launched 02:42:43.623513 bus /gobi_6: Setting Powered False 02:42:44.686841 run create_hlr_db(pid=13781): Terminated: ok {rc=0} 02:42:45.136213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13783): Launched 02:42:45.458842 run osmo-hlr_10.42.42.2(pid=13784): Launched 02:42:45.581656 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:46.204815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13786): Launched 02:42:46.546431 run osmo-stp_10.42.42.5(pid=13787): Launched 02:42:46.691053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:47.556312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13789): Launched 02:42:47.671251 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:47.925374 run patchelf(pid=13790): Launched 02:42:48.093927 run osmo-stp_10.42.42.5(pid=13787): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13787)] 02:42:48.220926 run osmo-stp_10.42.42.5(pid=13787): stdout: | (launched: 2022-12-09_02:42:46.483230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:48.349694 run osmo-stp_10.42.42.5(pid=13787): stderr: | 20221209024246926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024246927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024246928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024246930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024246931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024246933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024246933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:48.478249 run osmo-stp_10.42.42.5(pid=13787): stdout: | (launched: 2022-12-09_02:42:46.483230) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:48.601700 run osmo-stp_10.42.42.5(pid=13787): stderr: | 20221209024246926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024246927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024246928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024246930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024246931 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024246933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024246933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:48.747947 run patchelf(pid=13790): Terminating (SIGINT) 02:42:48.916406 run patchelf(pid=13790): Terminated: ok {rc=0} 02:42:49.037727 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13787): Process ended prematurely: osmo-stp_10.42.42.5(pid=13787) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13787)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:42:49.047201 tst iperf3m4.py:8: Test FAILED (11.3 sec) 02:42:49.074740 run osmo-hlr_10.42.42.2(pid=13784): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13784)] 02:42:49.121987 run osmo-hlr_10.42.42.2(pid=13784): stdout: | (launched: 2022-12-09_02:42:45.400179) 02:42:49.170916 run osmo-hlr_10.42.42.2(pid=13784): stderr: | 20221209024245597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024245597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024245597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024245597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024245597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024245597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024245610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024245618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024245618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024245618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:49.220108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13773): Terminating (SIGTERM) 02:42:49.260172 run iperf3-srv_10.42.42.10(pid=13774): Terminating (SIGTERM) 02:42:49.299564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13775): Terminating (SIGTERM) 02:42:49.339020 run iperf3-srv_10.42.42.10(pid=13776): Terminating (SIGTERM) 02:42:49.378374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13777): Terminating (SIGTERM) 02:42:49.417773 run iperf3-srv_10.42.42.10(pid=13778): Terminating (SIGTERM) 02:42:49.456841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13779): Terminating (SIGTERM) 02:42:49.496145 run iperf3-srv_10.42.42.10(pid=13780): Terminating (SIGTERM) 02:42:49.535284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13783): Terminating (SIGTERM) 02:42:49.574596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13786): Terminating (SIGTERM) 02:42:49.613894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13789): Terminating (SIGTERM) 02:42:49.653433 --- ParallelTerminationStrategy: PID 13773 died... 02:42:49.672179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13773): Terminated: ok {rc=0} 02:42:49.716472 --- ParallelTerminationStrategy: PID 13774 died... 02:42:49.734933 run iperf3-srv_10.42.42.10(pid=13774): Terminated {rc=256} 02:42:49.778788 --- ParallelTerminationStrategy: PID 13775 died... 02:42:49.797276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13775): Terminated: ok {rc=0} 02:42:49.841095 --- ParallelTerminationStrategy: PID 13776 died... 02:42:49.859319 run iperf3-srv_10.42.42.10(pid=13776): Terminated {rc=256} 02:42:49.903133 --- ParallelTerminationStrategy: PID 13777 died... 02:42:49.921450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13777): Terminated: ok {rc=0} 02:42:49.965291 --- ParallelTerminationStrategy: PID 13778 died... 02:42:49.983706 run iperf3-srv_10.42.42.10(pid=13778): Terminated {rc=256} 02:42:50.027520 --- ParallelTerminationStrategy: PID 13779 died... 02:42:50.045989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13779): Terminated: ok {rc=0} 02:42:50.090207 --- ParallelTerminationStrategy: PID 13780 died... 02:42:50.108590 run iperf3-srv_10.42.42.10(pid=13780): Terminated {rc=256} 02:42:50.152323 --- ParallelTerminationStrategy: PID 13783 died... 02:42:50.170910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13783): Terminated: ok {rc=0} 02:42:50.214783 --- ParallelTerminationStrategy: PID 13786 died... 02:42:50.233328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13786): Terminated: ok {rc=0} 02:42:50.277461 --- ParallelTerminationStrategy: PID 13789 died... 02:42:50.296034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13789): Terminated: ok {rc=0} 02:42:50.381908 bus /gobi_4: Setting Powered False 02:42:51.481239 bus /gobi_4: Setting Powered False 02:42:52.596183 bus /gobi_1: Setting Powered False 02:42:53.696042 bus /gobi_1: Setting Powered False 02:42:54.810261 bus /gobi_0: Setting Powered False 02:42:55.908224 bus /gobi_0: Setting Powered False 02:42:57.025296 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:42:58.127043 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:58.139670 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:42:58.215554 tst ping.py: using LAC 18510 02:42:58.334743 tst ping.py: using RAC 150 02:42:58.453175 tst ping.py: using CellId 18510 02:42:58.569603 tst ping.py: using BVCI 18511 02:42:58.688330 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:58.700409 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:58.712273 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:58.724489 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:58.736632 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:58.748779 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:58.761142 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:58.774480 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:58.890120 tst ping.py:19: start network... 02:42:59.088587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:59.546003 run create_hlr_db(pid=13791): Launched 02:42:59.660523 bus /gobi_6: Setting Powered False 02:43:00.720036 run create_hlr_db(pid=13791): Terminated: ok {rc=0} 02:43:01.168645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13793): Launched 02:43:01.481131 run osmo-hlr_10.42.42.2(pid=13794): Launched 02:43:01.670579 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:02.415349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13796): Launched 02:43:02.731891 run osmo-stp_10.42.42.5(pid=13797): Launched 02:43:02.853983 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:43:03.402616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13799): Launched 02:43:03.522951 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:43:03.790990 run patchelf(pid=13800): Launched 02:43:03.968011 run osmo-stp_10.42.42.5(pid=13797): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13797)] 02:43:04.101919 run osmo-stp_10.42.42.5(pid=13797): stdout: | (launched: 2022-12-09_02:43:02.674238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:04.237669 run osmo-stp_10.42.42.5(pid=13797): stderr: | 20221209024302867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024302867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024302867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024302868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024302868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024302868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024302868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:04.372932 run osmo-stp_10.42.42.5(pid=13797): stdout: | (launched: 2022-12-09_02:43:02.674238) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:04.503062 run osmo-stp_10.42.42.5(pid=13797): stderr: | 20221209024302867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024302867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024302867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024302868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024302868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024302868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024302868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:04.657026 run patchelf(pid=13800): Terminating (SIGINT) 02:43:04.835070 run patchelf(pid=13800): Terminated: ok {rc=0} 02:43:04.962810 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13797): Process ended prematurely: osmo-stp_10.42.42.5(pid=13797) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13797)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 02:43:04.972256 tst ping.py:22: Test FAILED (6.8 sec) 02:43:05.000013 run osmo-hlr_10.42.42.2(pid=13794): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13794)] 02:43:05.049538 run osmo-hlr_10.42.42.2(pid=13794): stdout: | (launched: 2022-12-09_02:43:01.426628) 02:43:05.100540 run osmo-hlr_10.42.42.2(pid=13794): stderr: | 20221209024301791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024301791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024301791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024301791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024301791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024301791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024301814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024301844 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024301844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024301844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:05.151733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13793): Terminating (SIGTERM) 02:43:05.192920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13796): Terminating (SIGTERM) 02:43:05.234347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13799): Terminating (SIGTERM) 02:43:05.275700 --- ParallelTerminationStrategy: PID 13793 died... 02:43:05.295675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13793): Terminated: ok {rc=0} 02:43:05.341569 --- ParallelTerminationStrategy: PID 13796 died... 02:43:05.360849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13796): Terminated: ok {rc=0} 02:43:05.406180 --- ParallelTerminationStrategy: PID 13799 died... 02:43:05.425463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13799): Terminated: ok {rc=0} 02:43:05.511943 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:43:06.600057 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:43:06.611956 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:43:06.685350 tst ping_idle_ping.py: using LAC 18511 02:43:06.803050 tst ping_idle_ping.py: using RAC 151 02:43:06.921400 tst ping_idle_ping.py: using CellId 18511 02:43:07.047983 tst ping_idle_ping.py: using BVCI 18512 02:43:07.165515 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:43:07.177244 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:43:07.188786 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:43:07.200522 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:43:07.212052 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:43:07.223640 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:43:07.235327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:43:07.246823 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:43:07.364005 tst ping_idle_ping.py:24: start network... 02:43:07.580015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:08.077397 run create_hlr_db(pid=13801): Launched 02:43:08.206460 bus /gobi_6: Setting Powered False 02:43:09.269511 run create_hlr_db(pid=13801): Terminated: ok {rc=0} 02:43:09.695492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13803): Launched 02:43:09.992364 run osmo-hlr_10.42.42.2(pid=13804): Launched 02:43:10.117469 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:10.667682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13806): Launched 02:43:10.985783 run osmo-stp_10.42.42.5(pid=13807): Launched 02:43:11.107668 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:43:11.655816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13809): Launched 02:43:11.778064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:43:12.047559 run patchelf(pid=13810): Launched 02:43:12.223905 run osmo-stp_10.42.42.5(pid=13807): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13807)] 02:43:12.358778 run osmo-stp_10.42.42.5(pid=13807): stdout: | (launched: 2022-12-09_02:43:10.928227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:12.495413 run osmo-stp_10.42.42.5(pid=13807): stderr: | 20221209024311120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024311120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024311120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024311121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024311121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024311121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024311121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:12.631908 run osmo-stp_10.42.42.5(pid=13807): stdout: | (launched: 2022-12-09_02:43:10.928227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:12.763198 run osmo-stp_10.42.42.5(pid=13807): stderr: | 20221209024311120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024311120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024311120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024311121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024311121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024311121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024311121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:12.919443 run patchelf(pid=13810): Terminating (SIGINT) 02:43:13.097544 run patchelf(pid=13810): Terminated: ok {rc=0} 02:43:13.225817 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13807): Process ended prematurely: osmo-stp_10.42.42.5(pid=13807) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13807)] [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:43:13.235411 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:43:13.262887 run osmo-hlr_10.42.42.2(pid=13804): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13804)] 02:43:13.312336 run osmo-hlr_10.42.42.2(pid=13804): stdout: | (launched: 2022-12-09_02:43:09.937962) 02:43:13.364468 run osmo-hlr_10.42.42.2(pid=13804): stderr: | 20221209024310131 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024310131 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024310131 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024310131 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024310131 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024310131 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024310144 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024310152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024310152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024310152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:13.416366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13803): Terminating (SIGTERM) 02:43:13.458025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13806): Terminating (SIGTERM) 02:43:13.499662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13809): Terminating (SIGTERM) 02:43:13.541543 --- ParallelTerminationStrategy: PID 13803 died... 02:43:13.561429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13803): Terminated: ok {rc=0} 02:43:13.607413 --- ParallelTerminationStrategy: PID 13806 died... 02:43:13.626700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13806): Terminated: ok {rc=0} 02:43:13.672517 --- ParallelTerminationStrategy: PID 13809 died... 02:43:13.692057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13809): Terminated: ok {rc=0} 02:43:13.779282 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:43:15.090609 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:15.097820 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:43:15.132565 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:43:15.168257 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:43:15.224288 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:43:15.260254 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:43:15.295402 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:43:15.858274 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:43:15.867034 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:43:15.881579 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:43:15.956310 tst switch_tch_pdch.py: using LAC 18512 02:43:16.084374 tst switch_tch_pdch.py: using RAC 152 02:43:16.210904 tst switch_tch_pdch.py: using CellId 18512 02:43:16.338253 tst switch_tch_pdch.py: using BVCI 18513 02:43:16.452874 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:43:16.465543 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:43:16.479148 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:43:16.491395 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:43:16.504714 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:43:16.519210 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:43:16.533018 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:43:16.546541 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:43:16.691423 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:43:16.840531 tst switch_tch_pdch.py:51: start network... 02:43:17.059978 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:17.541063 run create_hlr_db(pid=13814): Launched 02:43:17.655741 bus /gobi_6: Setting Powered False 02:43:18.715431 run create_hlr_db(pid=13814): Terminated: ok {rc=0} 02:43:19.150548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13816): Launched 02:43:19.470327 run osmo-hlr_10.42.42.2(pid=13817): Launched 02:43:19.593142 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:20.140772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13819): Launched 02:43:20.457634 run osmo-stp_10.42.42.5(pid=13820): Launched 02:43:20.579467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:43:21.125665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13822): Launched 02:43:21.247750 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:43:21.514489 run patchelf(pid=13823): Launched 02:43:21.691601 run osmo-stp_10.42.42.5(pid=13820): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13820)] 02:43:21.825604 run osmo-stp_10.42.42.5(pid=13820): stdout: | (launched: 2022-12-09_02:43:20.400334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:21.961371 run osmo-stp_10.42.42.5(pid=13820): stderr: | 20221209024320591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024320591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024320592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024320592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024320592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024320592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024320593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:22.096720 run osmo-stp_10.42.42.5(pid=13820): stdout: | (launched: 2022-12-09_02:43:20.400334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:22.226303 run osmo-stp_10.42.42.5(pid=13820): stderr: | 20221209024320591 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024320591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024320592 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024320592 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024320592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024320592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024320593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:22.379746 run patchelf(pid=13823): Terminating (SIGINT) 02:43:22.556146 run patchelf(pid=13823): Terminated: ok {rc=0} 02:43:22.683119 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13820): Process ended prematurely: osmo-stp_10.42.42.5(pid=13820) [trial-2353↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13820)] [trial-2353↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:43:22.692729 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 02:43:22.720376 run osmo-hlr_10.42.42.2(pid=13817): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13817)] 02:43:22.769804 run osmo-hlr_10.42.42.2(pid=13817): stdout: | (launched: 2022-12-09_02:43:19.412697) 02:43:22.821458 run osmo-hlr_10.42.42.2(pid=13817): stderr: | 20221209024319609 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024319609 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024319609 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024319609 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024319609 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024319609 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024319621 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024319629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024319629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024319629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:22.873657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13816): Terminating (SIGTERM) 02:43:22.915344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13819): Terminating (SIGTERM) 02:43:22.957110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13822): Terminating (SIGTERM) 02:43:22.999060 --- ParallelTerminationStrategy: PID 13816 died... 02:43:23.019007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13816): Terminated: ok {rc=0} 02:43:23.065102 --- ParallelTerminationStrategy: PID 13819 died... 02:43:23.085176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13819): Terminated: ok {rc=0} 02:43:23.130997 --- ParallelTerminationStrategy: PID 13822 died... 02:43:23.150517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13822): Terminated: ok {rc=0} 02:43:23.237524 bus /gobi_0: Setting Powered False 02:43:24.336024 bus /gobi_0: Setting Powered False 02:43:25.450949 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:43:26.710539 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:26.716846 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:43:26.751814 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:43:26.787879 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:43:26.843023 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:43:26.877752 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:43:26.913655 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:43:27.471190 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:43:27.476434 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:43:27.488172 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:43:27.560729 tst switch_tch_pdch.py: using LAC 18513 02:43:27.686632 tst switch_tch_pdch.py: using RAC 153 02:43:27.812924 tst switch_tch_pdch.py: using CellId 18513 02:43:27.937198 tst switch_tch_pdch.py: using BVCI 18514 02:43:28.054039 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:43:28.065692 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:43:28.077316 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:43:28.088812 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:43:28.100345 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:43:28.111881 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:43:28.123458 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:43:28.135033 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:43:28.254181 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:43:28.373295 tst switch_tch_pdch.py:51: start network... 02:43:28.587031 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:29.053672 run create_hlr_db(pid=13827): Launched 02:43:29.182788 bus /gobi_6: Setting Powered False 02:43:30.245220 run create_hlr_db(pid=13827): Terminated: ok {rc=0} 02:43:30.645703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13829): Launched 02:43:30.963231 run osmo-hlr_10.42.42.2(pid=13830): Launched 02:43:31.161630 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:31.860360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13832): Launched 02:43:32.180081 run osmo-stp_10.42.42.5(pid=13833): Launched 02:43:32.314100 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:43:32.883734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13835): Launched 02:43:32.997200 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:43:33.247209 run patchelf(pid=13836): Launched 02:43:33.411492 run osmo-stp_10.42.42.5(pid=13833): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13833)] 02:43:33.536777 run osmo-stp_10.42.42.5(pid=13833): stdout: | (launched: 2022-12-09_02:43:32.118626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:33.664191 run osmo-stp_10.42.42.5(pid=13833): stderr: | 20221209024332407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024332407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024332408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024332408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024332410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024332410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024332410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:33.791252 run osmo-stp_10.42.42.5(pid=13833): stdout: | (launched: 2022-12-09_02:43:32.118626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:33.912698 run osmo-stp_10.42.42.5(pid=13833): stderr: | 20221209024332407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024332407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024332408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024332408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024332410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024332410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024332410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:34.056592 run patchelf(pid=13836): Terminating (SIGINT) 02:43:34.222338 run patchelf(pid=13836): Terminated: ok {rc=0} 02:43:34.341358 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13833): Process ended prematurely: osmo-stp_10.42.42.5(pid=13833) [trial-2353↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13833)] [trial-2353↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:43:34.350261 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 02:43:34.376872 run osmo-hlr_10.42.42.2(pid=13830): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13830)] 02:43:34.424485 run osmo-hlr_10.42.42.2(pid=13830): stdout: | (launched: 2022-12-09_02:43:30.894476) 02:43:34.473537 run osmo-hlr_10.42.42.2(pid=13830): stderr: | 20221209024331209 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024331209 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024331209 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024331209 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024331209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024331209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024331240 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024331250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024331251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024331251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:34.523089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13829): Terminating (SIGTERM) 02:43:34.562450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13832): Terminating (SIGTERM) 02:43:34.602286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13835): Terminating (SIGTERM) 02:43:34.642365 --- ParallelTerminationStrategy: PID 13829 died... 02:43:34.661542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13829): Terminated: ok {rc=0} 02:43:34.705646 --- ParallelTerminationStrategy: PID 13832 died... 02:43:34.724234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13832): Terminated: ok {rc=0} 02:43:34.768497 --- ParallelTerminationStrategy: PID 13835 died... 02:43:34.787049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13835): Terminated: ok {rc=0} 02:43:34.871188 bus /gobi_0: Setting Powered False 02:43:35.968775 bus /gobi_0: Setting Powered False 02:43:37.083278 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_sms:trx-umtrx --------------------------------------------------------------------- 02:43:38.336754 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:38.340573 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:43:38.373139 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 02:43:38.379966 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 02:43:38.432206 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:43:38.464483 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 02:43:38.471188 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 02:43:39.009729 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 02:43:39.014586 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 02:43:39.025314 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 02:43:39.071572 tst mo_mt_sms.py: using LAC 18514 02:43:39.192454 tst mo_mt_sms.py: using RAC 154 02:43:39.308259 tst mo_mt_sms.py: using CellId 18514 02:43:39.422336 tst mo_mt_sms.py: using BVCI 18515 02:43:39.529700 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 02:43:39.648659 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 02:43:39.764046 tst mo_mt_sms.py:9: start nitb and bts... 02:43:39.964462 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:43:40.569056 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13841): Launched 02:43:40.865571 run osmo-nitb_10.42.42.2(pid=13842): Launched 02:43:41.029814 run osmo-nitb_10.42.42.2(pid=13842): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13842)] 02:43:41.162092 run osmo-nitb_10.42.42.2(pid=13842): stdout: | (launched: 2022-12-09_02:43:40.810792) 02:43:41.295985 run osmo-nitb_10.42.42.2(pid=13842): stderr: | (launched: 2022-12-09_02:43:40.854856) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:43:41.429935 run osmo-nitb_10.42.42.2(pid=13842): stdout: | (launched: 2022-12-09_02:43:40.810792) 02:43:41.558860 run osmo-nitb_10.42.42.2(pid=13842): stderr: | (launched: 2022-12-09_02:43:40.854856) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13842): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13842) [trial-2353↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13842)] 02:43:41.976817 tst osmo-nitb_10.42.42.2(pid=13842): stdout: | (launched: 2022-12-09_02:43:40.810792) 02:43:42.097110 tst osmo-nitb_10.42.42.2(pid=13842): stderr: | (launched: 2022-12-09_02:43:40.854856) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:43:42.238274 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=13842): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13842) [trial-2353↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13842)] [trial-2353↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 02:43:42.246833 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 02:43:42.253566 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13841): Terminating (SIGTERM) 02:43:42.463083 --- ParallelTerminationStrategy: PID 13841 died... 02:43:42.483725 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13841): Terminated: ok {rc=0} 02:43:42.570629 bus /sierra_3: Setting Powered False 02:43:43.670761 bus /sierra_3: Setting Powered False 02:43:44.787132 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 sms:trx-umtrx --------------------------------------------------------------------- 02:43:45.995354 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:46.000106 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:43:46.038484 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:43:46.068787 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 02:43:46.124246 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:43:46.177916 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:43:46.213708 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 02:43:46.741491 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 02:43:46.748405 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:46.763589 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 02:43:46.826529 tst mo_mt_sms.py: using LAC 18515 02:43:46.982292 tst mo_mt_sms.py: using RAC 155 02:43:47.123711 tst mo_mt_sms.py: using CellId 18515 02:43:47.271217 tst mo_mt_sms.py: using BVCI 18516 02:43:47.382917 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:47.393876 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:47.404591 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:47.415653 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:47.426792 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:47.437917 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 02:43:47.552525 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 02:43:47.666880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:48.125652 run create_hlr_db(pid=13846): Launched 02:43:48.238808 bus /sierra_2: Setting Powered False 02:43:49.297593 run create_hlr_db(pid=13846): Terminated: ok {rc=0} 02:43:49.710737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13848): Launched 02:43:50.004576 run osmo-hlr_10.42.42.2(pid=13849): Launched 02:43:50.117356 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:50.625616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13851): Launched 02:43:50.921980 run osmo-stp_10.42.42.5(pid=13852): Launched 02:43:51.035273 run osmo-msc_10.42.42.6: Starting osmo-msc 02:43:51.569515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13854): Launched 02:43:51.864763 run osmo-msc_10.42.42.6(pid=13855): Launched 02:43:52.030060 run osmo-stp_10.42.42.5(pid=13852): ERR: Terminated: ERROR {rc=1} [trial-2353↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13852)] 02:43:52.156118 run osmo-stp_10.42.42.5(pid=13852): stdout: | (launched: 2022-12-09_02:43:50.867810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:52.282121 run osmo-stp_10.42.42.5(pid=13852): stderr: | 20221209024351036 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024351036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024351037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024351037 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024351038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024351038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024351038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:52.405495 run osmo-stp_10.42.42.5(pid=13852): stdout: | (launched: 2022-12-09_02:43:50.867810) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:52.523362 run osmo-stp_10.42.42.5(pid=13852): stderr: | 20221209024351036 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024351036 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024351037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024351037 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024351038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024351038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024351038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:52.664465 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=13852): Process ended prematurely: osmo-stp_10.42.42.5(pid=13852) [trial-2353↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13852)] [trial-2353↪sms:trx-umtrx↪mo_mt_sms.py:16] 02:43:52.673029 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 02:43:52.699155 run osmo-hlr_10.42.42.2(pid=13849): ERR: Terminated: ERROR {rc=237} [trial-2353↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13849)] 02:43:52.747266 run osmo-hlr_10.42.42.2(pid=13849): stdout: | (launched: 2022-12-09_02:43:49.950850) 02:43:52.796402 run osmo-hlr_10.42.42.2(pid=13849): stderr: | 20221209024350128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024350128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024350128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024350128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024350128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024350128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024350139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024350147 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024350147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024350147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:52.864932 run osmo-msc_10.42.42.6(pid=13855): ERR: Terminated: ERROR {rc=2} [trial-2353↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13855)] 02:43:52.912103 run osmo-msc_10.42.42.6(pid=13855): stdout: | (launched: 2022-12-09_02:43:51.810757) 02:43:52.960870 run osmo-msc_10.42.42.6(pid=13855): stderr: | 20221209024352081 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024352081 DLGLOBAL DEBUG validating counter group 0x7fc7b22d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024352081 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024352081 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024352082 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024352082 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024352084 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024352084 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024352084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024352084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:43:53.010192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13848): Terminating (SIGTERM) 02:43:53.049601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13851): Terminating (SIGTERM) 02:43:53.089312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13854): Terminating (SIGTERM) 02:43:53.129919 --- ParallelTerminationStrategy: PID 13848 died... 02:43:53.148872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13848): Terminated: ok {rc=0} 02:43:53.193725 --- ParallelTerminationStrategy: PID 13851 died... 02:43:53.211942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13851): Terminated: ok {rc=0} 02:43:53.255398 --- ParallelTerminationStrategy: PID 13854 died... 02:43:53.273544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13854): Terminated: ok {rc=0} 02:43:53.356133 bus /sierra_3: Setting Powered False 02:43:54.452753 bus /sierra_3: Setting Powered False 02:43:55.567609 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 02:43:56.803591 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:56.808607 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:43:56.843483 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 02:43:56.850816 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 02:43:56.885971 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:43:56.918713 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 02:43:56.925585 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 02:43:57.447407 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2353 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 02:43:57.453554 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 02:43:57.465352 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 02:43:57.515794 tst assert_extension.py: using LAC 18516 02:43:57.639709 tst assert_extension.py: using RAC 156 02:43:57.763445 tst assert_extension.py: using CellId 18516 02:43:57.887725 tst assert_extension.py: using BVCI 18517 02:43:58.003626 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 02:43:58.120044 tst assert_extension.py:10: start nitb and bts... 02:43:58.320039 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:43:58.926584 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13861): Launched 02:43:59.221311 run osmo-nitb_10.42.42.2(pid=13862): Launched 02:43:59.386148 run osmo-nitb_10.42.42.2(pid=13862): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13862)] 02:43:59.518850 run osmo-nitb_10.42.42.2(pid=13862): stdout: | (launched: 2022-12-09_02:43:59.167380) 02:43:59.652571 run osmo-nitb_10.42.42.2(pid=13862): stderr: | (launched: 2022-12-09_02:43:59.211334) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:43:59.787123 run osmo-nitb_10.42.42.2(pid=13862): stdout: | (launched: 2022-12-09_02:43:59.167380) 02:43:59.915932 run osmo-nitb_10.42.42.2(pid=13862): stderr: | (launched: 2022-12-09_02:43:59.211334) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13862): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13862) [trial-2353↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13862)] 02:44:00.333842 tst osmo-nitb_10.42.42.2(pid=13862): stdout: | (launched: 2022-12-09_02:43:59.167380) 02:44:00.453512 tst osmo-nitb_10.42.42.2(pid=13862): stderr: | (launched: 2022-12-09_02:43:59.211334) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:44:00.594158 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=13862): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13862) [trial-2353↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13862)] [trial-2353↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 02:44:00.602679 tst assert_extension.py:12: Test FAILED (3.1 sec) 02:44:00.609355 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13861): Terminating (SIGTERM) 02:44:00.818730 --- ParallelTerminationStrategy: PID 13861 died... 02:44:00.840050 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13861): Terminated: ok {rc=0} 02:44:00.929869 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 ussd:trx-umtrx --------------------------------------------------------------------- 02:44:02.143831 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:44:02.155745 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:44:02.193772 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:44:02.223481 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 02:44:02.260926 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:44:02.299079 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:44:02.328860 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 02:44:02.851093 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2353 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 02:44:02.856142 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:44:02.867279 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 02:44:02.917204 tst assert_extension.py: using LAC 18517 02:44:03.042549 tst assert_extension.py: using RAC 157 02:44:03.167685 tst assert_extension.py: using CellId 18517 02:44:03.292630 tst assert_extension.py: using BVCI 18518 02:44:03.408782 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:44:03.419959 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:44:03.430964 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:44:03.442409 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:44:03.454299 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:44:03.465853 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 02:44:03.580494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:04.038700 run create_hlr_db(pid=13866): Launched 02:44:04.152410 bus /sierra_2: Setting Powered False 02:44:05.212842 run create_hlr_db(pid=13866): Terminated: ok {rc=0} 02:44:05.627190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13868): Launched 02:44:05.923292 run osmo-hlr_10.42.42.2(pid=13869): Launched 02:44:06.036918 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:06.554607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13871): Launched 02:44:06.850152 run osmo-stp_10.42.42.5(pid=13872): Launched 02:44:06.962917 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:07.500023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13874): Launched 02:44:07.795989 run osmo-msc_10.42.42.6(pid=13875): Launched 02:44:07.961422 run osmo-stp_10.42.42.5(pid=13872): ERR: Terminated: ERROR {rc=1} [trial-2353↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13872)] 02:44:08.086958 run osmo-stp_10.42.42.5(pid=13872): stdout: | (launched: 2022-12-09_02:44:06.795470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:08.213039 run osmo-stp_10.42.42.5(pid=13872): stderr: | 20221209024406963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024406963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024406963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024406964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024406966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024406966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024406966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:08.336390 run osmo-stp_10.42.42.5(pid=13872): stdout: | (launched: 2022-12-09_02:44:06.795470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:08.454362 run osmo-stp_10.42.42.5(pid=13872): stderr: | 20221209024406963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024406963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024406963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024406964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024406966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024406966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024406966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:08.595354 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13872): Process ended prematurely: osmo-stp_10.42.42.5(pid=13872) [trial-2353↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13872)] [trial-2353↪ussd:trx-umtrx↪assert_extension.py:17] 02:44:08.603906 tst assert_extension.py:17: Test FAILED (5.7 sec) 02:44:08.630407 run osmo-hlr_10.42.42.2(pid=13869): ERR: Terminated: ERROR {rc=237} [trial-2353↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13869)] 02:44:08.679078 run osmo-hlr_10.42.42.2(pid=13869): stdout: | (launched: 2022-12-09_02:44:05.869266) 02:44:08.728636 run osmo-hlr_10.42.42.2(pid=13869): stderr: | 20221209024406045 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024406045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024406045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024406045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024406045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024406046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024406057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024406065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024406065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024406066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:08.797523 run osmo-msc_10.42.42.6(pid=13875): ERR: Terminated: ERROR {rc=2} [trial-2353↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13875)] 02:44:08.845578 run osmo-msc_10.42.42.6(pid=13875): stdout: | (launched: 2022-12-09_02:44:07.741650) 02:44:08.894971 run osmo-msc_10.42.42.6(pid=13875): stderr: | 20221209024408012 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024408012 DLGLOBAL DEBUG validating counter group 0x7fb8ca930c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024408012 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024408012 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024408012 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024408012 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024408015 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024408015 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024408015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024408015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:08.945133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13868): Terminating (SIGTERM) 02:44:08.985171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13871): Terminating (SIGTERM) 02:44:09.025427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13874): Terminating (SIGTERM) 02:44:09.066134 --- ParallelTerminationStrategy: PID 13868 died... 02:44:09.085347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13868): Terminated: ok {rc=0} 02:44:09.130255 --- ParallelTerminationStrategy: PID 13871 died... 02:44:09.148780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13871): Terminated: ok {rc=0} 02:44:09.193467 --- ParallelTerminationStrategy: PID 13874 died... 02:44:09.211898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13874): Terminated: ok {rc=0} 02:44:09.295398 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:44:10.504211 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:44:10.511658 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:44:10.544850 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:44:10.571773 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:44:10.621821 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:44:10.654506 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:44:10.681470 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:44:11.234927 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:44:11.285171 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:44:11.296465 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:44:11.362649 tst mo_mt_call.py: using LAC 18518 02:44:11.479290 tst mo_mt_call.py: using RAC 158 02:44:11.595483 tst mo_mt_call.py: using CellId 18518 02:44:11.713340 tst mo_mt_call.py: using BVCI 18519 02:44:11.824071 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:44:11.835176 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:44:11.846225 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:44:11.857759 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:44:11.869367 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:44:11.880677 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:44:12.000274 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:44:12.121203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:12.625596 run create_hlr_db(pid=13880): Launched 02:44:12.756683 bus /sierra_2: Setting Powered False 02:44:13.821483 run create_hlr_db(pid=13880): Terminated: ok {rc=0} 02:44:14.253625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13882): Launched 02:44:14.554385 run osmo-hlr_10.42.42.2(pid=13883): Launched 02:44:14.670613 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:15.191512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13885): Launched 02:44:15.492406 run osmo-stp_10.42.42.5(pid=13886): Launched 02:44:15.608055 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:16.220436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13888): Launched 02:44:16.547821 run osmo-msc_10.42.42.6(pid=13889): Launched 02:44:17.046169 run osmo-stp_10.42.42.5(pid=13886): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13886)] 02:44:17.348097 run osmo-stp_10.42.42.5(pid=13886): stdout: | (launched: 2022-12-09_02:44:15.437726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:17.485108 run osmo-stp_10.42.42.5(pid=13886): stderr: | 20221209024415608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024415608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024415608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024415608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024415609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024415609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024415609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:17.619524 run osmo-stp_10.42.42.5(pid=13886): stdout: | (launched: 2022-12-09_02:44:15.437726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:17.748502 run osmo-stp_10.42.42.5(pid=13886): stderr: | 20221209024415608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024415608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024415608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024415608 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024415609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024415609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024415609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:17.903180 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13886): Process ended prematurely: osmo-stp_10.42.42.5(pid=13886) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13886)] [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:44:17.912933 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 02:44:17.940655 run osmo-hlr_10.42.42.2(pid=13883): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13883)] 02:44:17.990536 run osmo-hlr_10.42.42.2(pid=13883): stdout: | (launched: 2022-12-09_02:44:14.499627) 02:44:18.042052 run osmo-hlr_10.42.42.2(pid=13883): stderr: | 20221209024414675 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024414675 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024414675 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024414675 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024414675 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024414675 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024414688 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024414698 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024414698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024414698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:18.113607 run osmo-msc_10.42.42.6(pid=13889): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13889)] 02:44:18.163113 run osmo-msc_10.42.42.6(pid=13889): stdout: | (launched: 2022-12-09_02:44:16.484892) 02:44:18.214734 run osmo-msc_10.42.42.6(pid=13889): stderr: | 20221209024416942 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024416943 DLGLOBAL DEBUG validating counter group 0x7f46b7ff3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024416943 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024416943 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024416944 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024416945 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024416949 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024416950 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024416950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024416950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:18.266391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13882): Terminating (SIGTERM) 02:44:18.308045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13885): Terminating (SIGTERM) 02:44:18.349989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13888): Terminating (SIGTERM) 02:44:18.391966 --- ParallelTerminationStrategy: PID 13882 died... 02:44:18.411716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13882): Terminated: ok {rc=0} 02:44:18.458439 --- ParallelTerminationStrategy: PID 13885 died... 02:44:18.477972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13885): Terminated: ok {rc=0} 02:44:18.523790 --- ParallelTerminationStrategy: PID 13888 died... 02:44:18.543290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13888): Terminated: ok {rc=0} 02:44:18.630989 bus /sierra_3: Setting Powered False 02:44:19.730530 bus /sierra_3: Setting Powered False 02:44:20.845543 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:44:21.994890 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:44:22.007383 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:44:22.078448 tst mo_mt_call_osmux.py: using LAC 18519 02:44:22.204498 tst mo_mt_call_osmux.py: using RAC 159 02:44:22.342171 tst mo_mt_call_osmux.py: using CellId 18519 02:44:22.476417 tst mo_mt_call_osmux.py: using BVCI 18520 02:44:22.594309 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:44:22.605941 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:44:22.617382 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:44:22.628846 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:44:22.640392 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:44:22.651885 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:44:22.767283 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:44:22.889257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:23.391176 run create_hlr_db(pid=13891): Launched 02:44:23.529381 bus /sierra_2: Setting Powered False 02:44:24.593484 run create_hlr_db(pid=13891): Terminated: ok {rc=0} 02:44:25.023998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13893): Launched 02:44:25.325034 run osmo-hlr_10.42.42.2(pid=13894): Launched 02:44:25.440710 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:25.997816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13896): Launched 02:44:26.319674 run osmo-stp_10.42.42.5(pid=13897): Launched 02:44:26.442364 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:27.026573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13899): Launched 02:44:27.349709 run osmo-msc_10.42.42.6(pid=13900): Launched 02:44:27.529382 run osmo-stp_10.42.42.5(pid=13897): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13897)] 02:44:27.665061 run osmo-stp_10.42.42.5(pid=13897): stdout: | (launched: 2022-12-09_02:44:26.261645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:27.800672 run osmo-stp_10.42.42.5(pid=13897): stderr: | 20221209024426453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024426453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024426453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024426454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024426454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024426454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024426454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:27.936803 run osmo-stp_10.42.42.5(pid=13897): stdout: | (launched: 2022-12-09_02:44:26.261645) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:28.065365 run osmo-stp_10.42.42.5(pid=13897): stderr: | 20221209024426453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024426453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024426453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024426454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024426454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024426454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024426454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:28.219402 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13897): Process ended prematurely: osmo-stp_10.42.42.5(pid=13897) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13897)] [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:44:28.229194 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:44:28.256796 run osmo-hlr_10.42.42.2(pid=13894): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13894)] 02:44:28.306471 run osmo-hlr_10.42.42.2(pid=13894): stdout: | (launched: 2022-12-09_02:44:25.269531) 02:44:28.357702 run osmo-hlr_10.42.42.2(pid=13894): stderr: | 20221209024425447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024425447 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024425447 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024425447 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024425447 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024425447 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024425460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024425468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024425468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024425469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:28.429270 run osmo-msc_10.42.42.6(pid=13900): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13900)] 02:44:28.478716 run osmo-msc_10.42.42.6(pid=13900): stdout: | (launched: 2022-12-09_02:44:27.291343) 02:44:28.529646 run osmo-msc_10.42.42.6(pid=13900): stderr: | 20221209024427616 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024427616 DLGLOBAL DEBUG validating counter group 0x7f65a398ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024427616 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024427616 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024427616 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024427616 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024427618 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024427618 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024427619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024427619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:28.580921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13893): Terminating (SIGTERM) 02:44:28.622225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13896): Terminating (SIGTERM) 02:44:28.663519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13899): Terminating (SIGTERM) 02:44:28.705341 --- ParallelTerminationStrategy: PID 13893 died... 02:44:28.724766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13893): Terminated: ok {rc=0} 02:44:28.770667 --- ParallelTerminationStrategy: PID 13896 died... 02:44:28.790040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13896): Terminated: ok {rc=0} 02:44:28.836181 --- ParallelTerminationStrategy: PID 13899 died... 02:44:28.855788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13899): Terminated: ok {rc=0} 02:44:28.942981 bus /sierra_3: Setting Powered False 02:44:30.040396 bus /sierra_3: Setting Powered False 02:44:31.157671 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:44:32.413108 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:44:32.420173 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:44:32.453785 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:44:32.481444 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:44:32.535481 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:44:32.569518 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:44:32.597269 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:44:33.148306 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:44:33.199645 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:33.211380 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:44:33.282329 tst mo_mt_call.py: using LAC 18520 02:44:33.415430 tst mo_mt_call.py: using RAC 160 02:44:33.542470 tst mo_mt_call.py: using CellId 18520 02:44:33.668720 tst mo_mt_call.py: using BVCI 18521 02:44:33.786422 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:33.798230 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:33.809700 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:33.821577 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:33.833161 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:33.844690 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:44:33.966644 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:44:34.084564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:34.585960 run create_hlr_db(pid=13905): Launched 02:44:34.716445 bus /sierra_2: Setting Powered False 02:44:35.780410 run create_hlr_db(pid=13905): Terminated: ok {rc=0} 02:44:36.212013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13907): Launched 02:44:36.513028 run osmo-hlr_10.42.42.2(pid=13908): Launched 02:44:36.628634 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:37.160332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13910): Launched 02:44:37.461741 run osmo-stp_10.42.42.5(pid=13911): Launched 02:44:37.580107 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:38.141668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13913): Launched 02:44:38.442441 run osmo-msc_10.42.42.6(pid=13914): Launched 02:44:38.613850 run osmo-stp_10.42.42.5(pid=13911): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13911)] 02:44:38.742539 run osmo-stp_10.42.42.5(pid=13911): stdout: | (launched: 2022-12-09_02:44:37.406619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:38.870686 run osmo-stp_10.42.42.5(pid=13911): stderr: | 20221209024437574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024437574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024437575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024437575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024437576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024437576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024437576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:38.996408 run osmo-stp_10.42.42.5(pid=13911): stdout: | (launched: 2022-12-09_02:44:37.406619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:39.116695 run osmo-stp_10.42.42.5(pid=13911): stderr: | 20221209024437574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024437574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024437575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024437575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024437576 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024437576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024437576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:39.260713 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13911): Process ended prematurely: osmo-stp_10.42.42.5(pid=13911) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13911)] [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:44:39.270014 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:44:39.297077 run osmo-hlr_10.42.42.2(pid=13908): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13908)] 02:44:39.345256 run osmo-hlr_10.42.42.2(pid=13908): stdout: | (launched: 2022-12-09_02:44:36.458355) 02:44:39.394605 run osmo-hlr_10.42.42.2(pid=13908): stderr: | 20221209024436633 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024436633 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024436633 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024436633 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024436633 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024436634 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024436647 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024436658 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024436658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024436658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:39.463470 run osmo-msc_10.42.42.6(pid=13914): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13914)] 02:44:39.511473 run osmo-msc_10.42.42.6(pid=13914): stdout: | (launched: 2022-12-09_02:44:38.387300) 02:44:39.561058 run osmo-msc_10.42.42.6(pid=13914): stderr: | 20221209024438659 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024438659 DLGLOBAL DEBUG validating counter group 0x7f5e60947c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024438659 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024438659 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024438659 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024438659 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024438661 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024438662 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024438662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024438662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:39.610615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13907): Terminating (SIGTERM) 02:44:39.650472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13910): Terminating (SIGTERM) 02:44:39.690593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13913): Terminating (SIGTERM) 02:44:39.730797 --- ParallelTerminationStrategy: PID 13907 died... 02:44:39.749919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13907): Terminated: ok {rc=0} 02:44:39.794276 --- ParallelTerminationStrategy: PID 13910 died... 02:44:39.812819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13910): Terminated: ok {rc=0} 02:44:39.857580 --- ParallelTerminationStrategy: PID 13913 died... 02:44:39.876485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13913): Terminated: ok {rc=0} 02:44:39.960263 bus /sierra_3: Setting Powered False 02:44:41.059525 bus /sierra_3: Setting Powered False 02:44:42.177150 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:44:43.323806 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:43.335884 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:44:43.406184 tst mo_mt_call_osmux.py: using LAC 18521 02:44:43.535885 tst mo_mt_call_osmux.py: using RAC 161 02:44:43.663708 tst mo_mt_call_osmux.py: using CellId 18521 02:44:43.793819 tst mo_mt_call_osmux.py: using BVCI 18522 02:44:43.913317 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:43.925288 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:43.936653 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:43.948229 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:43.959833 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:43.971344 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:44:44.087517 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:44:44.210078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:44.713938 run create_hlr_db(pid=13916): Launched 02:44:44.844683 bus /sierra_2: Setting Powered False 02:44:45.926382 run create_hlr_db(pid=13916): Terminated: ok {rc=0} 02:44:46.396929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13918): Launched 02:44:46.731854 run osmo-hlr_10.42.42.2(pid=13919): Launched 02:44:46.987447 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:47.635460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13921): Launched 02:44:47.936411 run osmo-stp_10.42.42.5(pid=13922): Launched 02:44:48.051356 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:48.597772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13924): Launched 02:44:48.901702 run osmo-msc_10.42.42.6(pid=13925): Launched 02:44:49.070864 run osmo-stp_10.42.42.5(pid=13922): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13922)] 02:44:49.199155 run osmo-stp_10.42.42.5(pid=13922): stdout: | (launched: 2022-12-09_02:44:47.881405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:49.327262 run osmo-stp_10.42.42.5(pid=13922): stderr: | 20221209024448051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024448051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024448051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024448052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024448052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024448052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024448052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:49.453268 run osmo-stp_10.42.42.5(pid=13922): stdout: | (launched: 2022-12-09_02:44:47.881405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:49.573646 run osmo-stp_10.42.42.5(pid=13922): stderr: | 20221209024448051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024448051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024448051 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024448052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024448052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024448052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024448052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:49.717384 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13922): Process ended prematurely: osmo-stp_10.42.42.5(pid=13922) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13922)] [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:44:49.726398 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:44:49.753132 run osmo-hlr_10.42.42.2(pid=13919): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13919)] 02:44:49.801117 run osmo-hlr_10.42.42.2(pid=13919): stdout: | (launched: 2022-12-09_02:44:46.672229) 02:44:49.850692 run osmo-hlr_10.42.42.2(pid=13919): stderr: | 20221209024446955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024446955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024446955 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024446955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024446955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024446955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024446975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024446988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024446988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024446988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:49.919568 run osmo-msc_10.42.42.6(pid=13925): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13925)] 02:44:49.967785 run osmo-msc_10.42.42.6(pid=13925): stdout: | (launched: 2022-12-09_02:44:48.846029) 02:44:50.017084 run osmo-msc_10.42.42.6(pid=13925): stderr: | 20221209024449117 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024449117 DLGLOBAL DEBUG validating counter group 0x7fb96185bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024449117 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024449117 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024449117 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024449118 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024449120 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024449120 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024449120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024449121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:50.066423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13918): Terminating (SIGTERM) 02:44:50.106185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13921): Terminating (SIGTERM) 02:44:50.145918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13924): Terminating (SIGTERM) 02:44:50.186120 --- ParallelTerminationStrategy: PID 13918 died... 02:44:50.205203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13918): Terminated: ok {rc=0} 02:44:50.249373 --- ParallelTerminationStrategy: PID 13921 died... 02:44:50.268108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13921): Terminated: ok {rc=0} 02:44:50.312025 --- ParallelTerminationStrategy: PID 13924 died... 02:44:50.330604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13924): Terminated: ok {rc=0} 02:44:50.415782 bus /sierra_3: Setting Powered False 02:44:51.513457 bus /sierra_3: Setting Powered False 02:44:52.628246 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:44:53.884259 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:44:53.891567 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:44:53.925241 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:44:53.952264 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:44:54.004067 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:44:54.036935 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:44:54.064054 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:44:54.614491 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:44:54.663788 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:54.675060 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:44:54.744033 tst mo_mt_call.py: using LAC 18522 02:44:54.863640 tst mo_mt_call.py: using RAC 162 02:44:54.987126 tst mo_mt_call.py: using CellId 18522 02:44:55.104829 tst mo_mt_call.py: using BVCI 18523 02:44:55.214312 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:55.225585 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:55.236483 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:55.247871 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:55.259286 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:55.270730 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:44:55.384129 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:44:55.499980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:55.967858 run create_hlr_db(pid=13930): Launched 02:44:56.081923 bus /sierra_2: Setting Powered False 02:44:57.141441 run create_hlr_db(pid=13930): Terminated: ok {rc=0} 02:44:57.583789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13932): Launched 02:44:57.909053 run osmo-hlr_10.42.42.2(pid=13933): Launched 02:44:58.033243 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:58.593362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13935): Launched 02:44:58.916899 run osmo-stp_10.42.42.5(pid=13936): Launched 02:44:59.042381 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:59.628363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13938): Launched 02:44:59.952576 run osmo-msc_10.42.42.6(pid=13939): Launched 02:45:00.132903 run osmo-stp_10.42.42.5(pid=13936): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13936)] 02:45:00.269653 run osmo-stp_10.42.42.5(pid=13936): stdout: | (launched: 2022-12-09_02:44:58.858375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:00.407063 run osmo-stp_10.42.42.5(pid=13936): stderr: | 20221209024459052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024459052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024459053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024459053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024459053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024459054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024459054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:00.543190 run osmo-stp_10.42.42.5(pid=13936): stdout: | (launched: 2022-12-09_02:44:58.858375) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:00.671975 run osmo-stp_10.42.42.5(pid=13936): stderr: | 20221209024459052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024459052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024459053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024459053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024459053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024459054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024459054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:00.826228 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13936): Process ended prematurely: osmo-stp_10.42.42.5(pid=13936) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13936)] [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:45:00.840614 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:45:00.876213 run osmo-hlr_10.42.42.2(pid=13933): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13933)] 02:45:00.944942 run osmo-hlr_10.42.42.2(pid=13933): stdout: | (launched: 2022-12-09_02:44:57.850441) 02:45:00.998049 run osmo-hlr_10.42.42.2(pid=13933): stderr: | 20221209024458051 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024458051 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024458051 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024458051 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024458051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024458051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024458063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024458072 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024458072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024458072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:01.075999 run osmo-msc_10.42.42.6(pid=13939): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13939)] 02:45:01.127295 run osmo-msc_10.42.42.6(pid=13939): stdout: | (launched: 2022-12-09_02:44:59.893603) 02:45:01.179953 run osmo-msc_10.42.42.6(pid=13939): stderr: | 20221209024500214 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024500214 DLGLOBAL DEBUG validating counter group 0x7efda6920c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024500215 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024500215 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024500215 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024500215 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024500217 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024500217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024500217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024500217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:01.232706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13932): Terminating (SIGTERM) 02:45:01.275533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13935): Terminating (SIGTERM) 02:45:01.318873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13938): Terminating (SIGTERM) 02:45:01.363309 --- ParallelTerminationStrategy: PID 13932 died... 02:45:01.394195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13932): Terminated: ok {rc=0} 02:45:01.441173 --- ParallelTerminationStrategy: PID 13935 died... 02:45:01.461435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13935): Terminated: ok {rc=0} 02:45:01.508711 --- ParallelTerminationStrategy: PID 13938 died... 02:45:01.529751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13938): Terminated: ok {rc=0} 02:45:01.633570 bus /sierra_3: Setting Powered False 02:45:02.748243 bus /sierra_3: Setting Powered False 02:45:03.865644 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:45:05.015887 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:45:05.028335 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:45:05.100612 tst mo_mt_call_osmux.py: using LAC 18523 02:45:05.229255 tst mo_mt_call_osmux.py: using RAC 163 02:45:05.356828 tst mo_mt_call_osmux.py: using CellId 18523 02:45:05.484778 tst mo_mt_call_osmux.py: using BVCI 18524 02:45:05.603997 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:45:05.615688 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:45:05.627311 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:45:05.639008 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:45:05.650901 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:45:05.662607 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:45:05.778784 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:45:05.895593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:06.364906 run create_hlr_db(pid=13951): Launched 02:45:06.481722 bus /sierra_2: Setting Powered False 02:45:07.542713 run create_hlr_db(pid=13951): Terminated: ok {rc=0} 02:45:07.985620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13953): Launched 02:45:08.310133 run osmo-hlr_10.42.42.2(pid=13954): Launched 02:45:08.435930 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:08.991998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13956): Launched 02:45:09.313964 run osmo-stp_10.42.42.5(pid=13957): Launched 02:45:09.437841 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:10.023644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13959): Launched 02:45:10.345991 run osmo-msc_10.42.42.6(pid=13960): Launched 02:45:10.528214 run osmo-stp_10.42.42.5(pid=13957): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13957)] 02:45:10.664059 run osmo-stp_10.42.42.5(pid=13957): stdout: | (launched: 2022-12-09_02:45:09.255526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:10.800212 run osmo-stp_10.42.42.5(pid=13957): stderr: | 20221209024509450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024509450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024509450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024509451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024509451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024509451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024509451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:10.935527 run osmo-stp_10.42.42.5(pid=13957): stdout: | (launched: 2022-12-09_02:45:09.255526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:11.063718 run osmo-stp_10.42.42.5(pid=13957): stderr: | 20221209024509450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024509450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024509450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024509451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024509451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024509451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024509451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:11.219508 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13957): Process ended prematurely: osmo-stp_10.42.42.5(pid=13957) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13957)] [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:45:11.228887 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:45:11.256474 run osmo-hlr_10.42.42.2(pid=13954): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13954)] 02:45:11.306246 run osmo-hlr_10.42.42.2(pid=13954): stdout: | (launched: 2022-12-09_02:45:08.251716) 02:45:11.357805 run osmo-hlr_10.42.42.2(pid=13954): stderr: | 20221209024508449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024508449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024508449 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024508449 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024508449 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024508449 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024508462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024508470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024508470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024508470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:11.429708 run osmo-msc_10.42.42.6(pid=13960): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13960)] 02:45:11.479456 run osmo-msc_10.42.42.6(pid=13960): stdout: | (launched: 2022-12-09_02:45:10.287233) 02:45:11.530559 run osmo-msc_10.42.42.6(pid=13960): stderr: | 20221209024510608 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024510608 DLGLOBAL DEBUG validating counter group 0x7fd483629c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024510608 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024510608 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024510608 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024510609 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024510610 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024510611 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024510611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024510611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:11.582226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13953): Terminating (SIGTERM) 02:45:11.623518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13956): Terminating (SIGTERM) 02:45:11.664923 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13959): Terminating (SIGTERM) 02:45:11.706854 --- ParallelTerminationStrategy: PID 13953 died... 02:45:11.726985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13953): Terminated: ok {rc=0} 02:45:11.773331 --- ParallelTerminationStrategy: PID 13956 died... 02:45:11.792826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13956): Terminated: ok {rc=0} 02:45:11.838872 --- ParallelTerminationStrategy: PID 13959 died... 02:45:11.858448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13959): Terminated: ok {rc=0} 02:45:11.945958 bus /sierra_3: Setting Powered False 02:45:13.049898 bus /sierra_3: Setting Powered False 02:45:14.169802 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:45:15.426777 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:45:15.434064 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:45:15.467939 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:45:15.496045 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:45:15.547740 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:45:15.581302 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:45:15.608849 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:45:16.182901 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:45:16.236462 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:45:16.250174 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:45:16.319961 tst mo_mt_call.py: using LAC 18524 02:45:16.457862 tst mo_mt_call.py: using RAC 164 02:45:16.579097 tst mo_mt_call.py: using CellId 18524 02:45:16.712262 tst mo_mt_call.py: using BVCI 18525 02:45:16.826249 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:45:16.839346 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:45:16.853957 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:45:16.867098 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:45:16.879263 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:45:16.892479 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:45:17.015384 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:45:17.163308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:17.646276 run create_hlr_db(pid=14316): Launched 02:45:17.762922 bus /sierra_2: Setting Powered False 02:45:18.823050 run create_hlr_db(pid=14316): Terminated: ok {rc=0} 02:45:19.242839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14318): Launched 02:45:19.544187 run osmo-hlr_10.42.42.2(pid=14319): Launched 02:45:19.659514 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:20.192795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14321): Launched 02:45:20.496070 run osmo-stp_10.42.42.5(pid=14322): Launched 02:45:20.612274 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:21.160572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14324): Launched 02:45:21.463875 run osmo-msc_10.42.42.6(pid=14325): Launched 02:45:21.633824 run osmo-stp_10.42.42.5(pid=14322): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14322)] 02:45:21.762564 run osmo-stp_10.42.42.5(pid=14322): stdout: | (launched: 2022-12-09_02:45:20.440564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:21.891609 run osmo-stp_10.42.42.5(pid=14322): stderr: | 20221209024520611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024520611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024520611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024520612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024520612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024520612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024520612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:22.017488 run osmo-stp_10.42.42.5(pid=14322): stdout: | (launched: 2022-12-09_02:45:20.440564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:22.138137 run osmo-stp_10.42.42.5(pid=14322): stderr: | 20221209024520611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024520611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024520611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024520612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024520612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024520612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024520612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:22.282581 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14322): Process ended prematurely: osmo-stp_10.42.42.5(pid=14322) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14322)] [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:45:22.291503 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:45:22.318333 run osmo-hlr_10.42.42.2(pid=14319): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14319)] 02:45:22.366965 run osmo-hlr_10.42.42.2(pid=14319): stdout: | (launched: 2022-12-09_02:45:19.489342) 02:45:22.417402 run osmo-hlr_10.42.42.2(pid=14319): stderr: | 20221209024519667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024519668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024519668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024519668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024519668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024519668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024519679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024519688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024519688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024519688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:22.487346 run osmo-msc_10.42.42.6(pid=14325): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14325)] 02:45:22.536561 run osmo-msc_10.42.42.6(pid=14325): stdout: | (launched: 2022-12-09_02:45:21.408582) 02:45:22.589686 run osmo-msc_10.42.42.6(pid=14325): stderr: | 20221209024521680 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024521680 DLGLOBAL DEBUG validating counter group 0x7f5c42693c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024521680 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024521680 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024521681 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024521681 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024521683 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024521683 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024521683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024521683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:22.641872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14318): Terminating (SIGTERM) 02:45:22.683633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14321): Terminating (SIGTERM) 02:45:22.725963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14324): Terminating (SIGTERM) 02:45:22.768197 --- ParallelTerminationStrategy: PID 14318 died... 02:45:22.787901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14318): Terminated: ok {rc=0} 02:45:22.834438 --- ParallelTerminationStrategy: PID 14321 died... 02:45:22.854008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14321): Terminated: ok {rc=0} 02:45:22.900421 --- ParallelTerminationStrategy: PID 14324 died... 02:45:22.920174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14324): Terminated: ok {rc=0} 02:45:23.008242 bus /sierra_3: Setting Powered False 02:45:24.109322 bus /sierra_3: Setting Powered False 02:45:25.227071 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:45:26.382383 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:45:26.395612 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:45:26.467121 tst mo_mt_call_osmux.py: using LAC 18525 02:45:26.595960 tst mo_mt_call_osmux.py: using RAC 165 02:45:26.727773 tst mo_mt_call_osmux.py: using CellId 18525 02:45:26.858723 tst mo_mt_call_osmux.py: using BVCI 18526 02:45:26.978813 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:45:26.991577 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:45:27.004352 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:45:27.016803 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:45:27.029162 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:45:27.041840 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:45:27.167207 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:45:27.294129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:27.812822 run create_hlr_db(pid=14502): Launched 02:45:27.986117 bus /sierra_2: Setting Powered False 02:45:29.049934 run create_hlr_db(pid=14502): Terminated: ok {rc=0} 02:45:29.482602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14505): Launched 02:45:29.784013 run osmo-hlr_10.42.42.2(pid=14506): Launched 02:45:29.899396 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:30.434100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14508): Launched 02:45:30.734945 run osmo-stp_10.42.42.5(pid=14509): Launched 02:45:30.850602 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:31.500096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14511): Launched 02:45:31.841734 run osmo-msc_10.42.42.6(pid=14512): Launched 02:45:32.299729 run osmo-stp_10.42.42.5(pid=14509): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14509)] 02:45:32.484114 run osmo-stp_10.42.42.5(pid=14509): stdout: | (launched: 2022-12-09_02:45:30.679803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:32.610573 run osmo-stp_10.42.42.5(pid=14509): stderr: | 20221209024530901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024530901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024530902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024530909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024530911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024530911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024530911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:32.736431 run osmo-stp_10.42.42.5(pid=14509): stdout: | (launched: 2022-12-09_02:45:30.679803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:32.857266 run osmo-stp_10.42.42.5(pid=14509): stderr: | 20221209024530901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024530901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024530902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024530909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024530911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024530911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024530911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:33.001570 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14509): Process ended prematurely: osmo-stp_10.42.42.5(pid=14509) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14509)] [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:45:33.010648 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 02:45:33.037995 run osmo-hlr_10.42.42.2(pid=14506): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14506)] 02:45:33.086149 run osmo-hlr_10.42.42.2(pid=14506): stdout: | (launched: 2022-12-09_02:45:29.729118) 02:45:33.135693 run osmo-hlr_10.42.42.2(pid=14506): stderr: | 20221209024529907 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024529907 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024529907 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024529907 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024529907 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024529907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024529918 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024529927 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024529928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024529928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:33.204806 run osmo-msc_10.42.42.6(pid=14512): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14512)] 02:45:33.252568 run osmo-msc_10.42.42.6(pid=14512): stdout: | (launched: 2022-12-09_02:45:31.782863) 02:45:33.301927 run osmo-msc_10.42.42.6(pid=14512): stderr: | 20221209024532182 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024532183 DLGLOBAL DEBUG validating counter group 0x7ff2bf71dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024532183 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024532183 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024532183 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024532183 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024532189 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024532190 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024532190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024532190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:33.351745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14505): Terminating (SIGTERM) 02:45:33.391856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14508): Terminating (SIGTERM) 02:45:33.431948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14511): Terminating (SIGTERM) 02:45:33.472499 --- ParallelTerminationStrategy: PID 14505 died... 02:45:33.491491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14505): Terminated: ok {rc=0} 02:45:33.536296 --- ParallelTerminationStrategy: PID 14508 died... 02:45:33.555000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14508): Terminated: ok {rc=0} 02:45:33.599360 --- ParallelTerminationStrategy: PID 14511 died... 02:45:33.618110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14511): Terminated: ok {rc=0} 02:45:33.703977 bus /sierra_3: Setting Powered False 02:45:34.801582 bus /sierra_3: Setting Powered False 02:45:35.914787 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:45:37.164544 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:45:37.171212 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:45:37.204820 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:45:37.231711 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:45:37.283254 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:45:37.315866 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:45:37.342553 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:45:37.895106 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:45:37.944430 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:37.955676 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:45:38.022735 tst mo_mt_call.py: using LAC 18526 02:45:38.139874 tst mo_mt_call.py: using RAC 166 02:45:38.256287 tst mo_mt_call.py: using CellId 18526 02:45:38.372857 tst mo_mt_call.py: using BVCI 18527 02:45:38.482232 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:38.493396 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:38.504247 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:38.515383 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:38.526674 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:38.537930 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:45:38.657746 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:45:38.774479 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:39.242262 run create_hlr_db(pid=14517): Launched 02:45:39.357896 bus /sierra_2: Setting Powered False 02:45:40.418442 run create_hlr_db(pid=14517): Terminated: ok {rc=0} 02:45:40.859265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14519): Launched 02:45:41.165136 run osmo-hlr_10.42.42.2(pid=14520): Launched 02:45:41.280440 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:41.813671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14522): Launched 02:45:42.115536 run osmo-stp_10.42.42.5(pid=14523): Launched 02:45:42.230502 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:42.774917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14525): Launched 02:45:43.075884 run osmo-msc_10.42.42.6(pid=14526): Launched 02:45:43.244275 run osmo-stp_10.42.42.5(pid=14523): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14523)] 02:45:43.372189 run osmo-stp_10.42.42.5(pid=14523): stdout: | (launched: 2022-12-09_02:45:42.060457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:43.499825 run osmo-stp_10.42.42.5(pid=14523): stderr: | 20221209024542230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024542230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024542230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024542231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024542231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024542231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024542231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:43.625305 run osmo-stp_10.42.42.5(pid=14523): stdout: | (launched: 2022-12-09_02:45:42.060457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:43.745695 run osmo-stp_10.42.42.5(pid=14523): stderr: | 20221209024542230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024542230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024542230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024542231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024542231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024542231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024542231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:43.889394 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14523): Process ended prematurely: osmo-stp_10.42.42.5(pid=14523) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14523)] [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:45:43.898507 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:45:43.925346 run osmo-hlr_10.42.42.2(pid=14520): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14520)] 02:45:43.973630 run osmo-hlr_10.42.42.2(pid=14520): stdout: | (launched: 2022-12-09_02:45:41.110222) 02:45:44.023786 run osmo-hlr_10.42.42.2(pid=14520): stderr: | 20221209024541286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024541286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024541286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024541286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024541286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024541286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024541298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024541307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024541307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024541307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:44.092712 run osmo-msc_10.42.42.6(pid=14526): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14526)] 02:45:44.140850 run osmo-msc_10.42.42.6(pid=14526): stdout: | (launched: 2022-12-09_02:45:43.020589) 02:45:44.190377 run osmo-msc_10.42.42.6(pid=14526): stderr: | 20221209024543293 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024543293 DLGLOBAL DEBUG validating counter group 0x7f5326934c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024543293 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024543293 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024543293 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024543294 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024543296 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024543296 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024543296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024543297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:44.240109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14519): Terminating (SIGTERM) 02:45:44.280026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14522): Terminating (SIGTERM) 02:45:44.319910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14525): Terminating (SIGTERM) 02:45:44.360041 --- ParallelTerminationStrategy: PID 14519 died... 02:45:44.379235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14519): Terminated: ok {rc=0} 02:45:44.424038 --- ParallelTerminationStrategy: PID 14522 died... 02:45:44.442929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14522): Terminated: ok {rc=0} 02:45:44.487333 --- ParallelTerminationStrategy: PID 14525 died... 02:45:44.506071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14525): Terminated: ok {rc=0} 02:45:44.592477 bus /sierra_3: Setting Powered False 02:45:45.691738 bus /sierra_3: Setting Powered False 02:45:46.814406 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:45:47.982054 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:47.994499 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:45:48.071756 tst mo_mt_call_osmux.py: using LAC 18527 02:45:48.203436 tst mo_mt_call_osmux.py: using RAC 167 02:45:48.322279 tst mo_mt_call_osmux.py: using CellId 18527 02:45:48.439012 tst mo_mt_call_osmux.py: using BVCI 18528 02:45:48.548363 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:48.559763 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:48.570921 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:48.582175 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:48.593822 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:48.604937 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:45:48.722572 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:45:48.844923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:49.313858 run create_hlr_db(pid=14528): Launched 02:45:49.429161 bus /sierra_2: Setting Powered False 02:45:50.489331 run create_hlr_db(pid=14528): Terminated: ok {rc=0} 02:45:50.931392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14530): Launched 02:45:51.254793 run osmo-hlr_10.42.42.2(pid=14531): Launched 02:45:51.378595 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:51.937358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14533): Launched 02:45:52.261254 run osmo-stp_10.42.42.5(pid=14534): Launched 02:45:52.383808 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:52.968271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14536): Launched 02:45:53.290056 run osmo-msc_10.42.42.6(pid=14537): Launched 02:45:53.471695 run osmo-stp_10.42.42.5(pid=14534): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14534)] 02:45:53.607543 run osmo-stp_10.42.42.5(pid=14534): stdout: | (launched: 2022-12-09_02:45:52.202775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:53.744129 run osmo-stp_10.42.42.5(pid=14534): stderr: | 20221209024552397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024552397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024552397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024552397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024552398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024552398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024552398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:53.879647 run osmo-stp_10.42.42.5(pid=14534): stdout: | (launched: 2022-12-09_02:45:52.202775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:54.008452 run osmo-stp_10.42.42.5(pid=14534): stderr: | 20221209024552397 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024552397 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024552397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024552397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024552398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024552398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024552398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:54.162560 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14534): Process ended prematurely: osmo-stp_10.42.42.5(pid=14534) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14534)] [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:45:54.171953 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:45:54.199416 run osmo-hlr_10.42.42.2(pid=14531): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14531)] 02:45:54.248695 run osmo-hlr_10.42.42.2(pid=14531): stdout: | (launched: 2022-12-09_02:45:51.195513) 02:45:54.299477 run osmo-hlr_10.42.42.2(pid=14531): stderr: | 20221209024551392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024551393 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024551393 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024551393 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024551393 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024551393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024551405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024551413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024551414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024551414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:54.370871 run osmo-msc_10.42.42.6(pid=14537): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14537)] 02:45:54.420442 run osmo-msc_10.42.42.6(pid=14537): stdout: | (launched: 2022-12-09_02:45:53.231610) 02:45:54.471393 run osmo-msc_10.42.42.6(pid=14537): stderr: | 20221209024553551 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024553551 DLGLOBAL DEBUG validating counter group 0x7f112d007c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024553551 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024553551 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024553552 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024553552 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024553554 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024553554 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024553554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024553554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:54.522618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14530): Terminating (SIGTERM) 02:45:54.563625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14533): Terminating (SIGTERM) 02:45:54.604698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14536): Terminating (SIGTERM) 02:45:54.646376 --- ParallelTerminationStrategy: PID 14530 died... 02:45:54.665893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14530): Terminated: ok {rc=0} 02:45:54.711409 --- ParallelTerminationStrategy: PID 14533 died... 02:45:54.730749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14533): Terminated: ok {rc=0} 02:45:54.776116 --- ParallelTerminationStrategy: PID 14536 died... 02:45:54.795394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14536): Terminated: ok {rc=0} 02:45:54.883116 bus /sierra_3: Setting Powered False 02:45:55.981490 bus /sierra_3: Setting Powered False 02:45:57.096586 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:45:58.348426 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:45:58.355067 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:45:58.388685 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:45:58.415569 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:45:58.471477 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:45:58.505830 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:45:58.532729 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:45:59.079352 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:45:59.128659 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:59.140039 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:45:59.207103 tst mo_mt_call.py: using LAC 18528 02:45:59.323802 tst mo_mt_call.py: using RAC 168 02:45:59.441240 tst mo_mt_call.py: using CellId 18528 02:45:59.557806 tst mo_mt_call.py: using BVCI 18529 02:45:59.669427 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:59.680538 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:59.691687 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:59.703036 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:59.714737 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:59.726324 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:45:59.845304 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:45:59.960914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:00.429211 run create_hlr_db(pid=14542): Launched 02:46:00.544424 bus /sierra_2: Setting Powered False 02:46:01.604279 run create_hlr_db(pid=14542): Terminated: ok {rc=0} 02:46:02.036540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14544): Launched 02:46:02.362271 run osmo-hlr_10.42.42.2(pid=14545): Launched 02:46:02.500265 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:03.060801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14547): Launched 02:46:03.384387 run osmo-stp_10.42.42.5(pid=14548): Launched 02:46:03.507497 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:04.092419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14550): Launched 02:46:04.416236 run osmo-msc_10.42.42.6(pid=14551): Launched 02:46:04.597624 run osmo-stp_10.42.42.5(pid=14548): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14548)] 02:46:04.733391 run osmo-stp_10.42.42.5(pid=14548): stdout: | (launched: 2022-12-09_02:46:03.326089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:04.871063 run osmo-stp_10.42.42.5(pid=14548): stderr: | 20221209024603519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024603519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024603520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024603520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024603521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024603521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024603521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:05.007305 run osmo-stp_10.42.42.5(pid=14548): stdout: | (launched: 2022-12-09_02:46:03.326089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:05.136496 run osmo-stp_10.42.42.5(pid=14548): stderr: | 20221209024603519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024603519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024603520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024603520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024603521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024603521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024603521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:05.291217 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14548): Process ended prematurely: osmo-stp_10.42.42.5(pid=14548) [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14548)] [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:46:05.300869 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:46:05.328665 run osmo-hlr_10.42.42.2(pid=14545): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14545)] 02:46:05.378591 run osmo-hlr_10.42.42.2(pid=14545): stdout: | (launched: 2022-12-09_02:46:02.300443) 02:46:05.429933 run osmo-hlr_10.42.42.2(pid=14545): stderr: | 20221209024602517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024602518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024602518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024602518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024602518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024602518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024602530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024602538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024602538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024602538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:05.501797 run osmo-msc_10.42.42.6(pid=14551): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14551)] 02:46:05.551910 run osmo-msc_10.42.42.6(pid=14551): stdout: | (launched: 2022-12-09_02:46:04.357490) 02:46:05.603251 run osmo-msc_10.42.42.6(pid=14551): stderr: | 20221209024604684 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024604685 DLGLOBAL DEBUG validating counter group 0x7f31479b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024604685 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024604685 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024604685 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024604685 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024604687 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024604687 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024604687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024604687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:05.654882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14544): Terminating (SIGTERM) 02:46:05.696421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14547): Terminating (SIGTERM) 02:46:05.737969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14550): Terminating (SIGTERM) 02:46:05.779732 --- ParallelTerminationStrategy: PID 14544 died... 02:46:05.799710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14544): Terminated: ok {rc=0} 02:46:05.846451 --- ParallelTerminationStrategy: PID 14547 died... 02:46:05.866183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14547): Terminated: ok {rc=0} 02:46:05.912244 --- ParallelTerminationStrategy: PID 14550 died... 02:46:05.931864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14550): Terminated: ok {rc=0} 02:46:06.019301 bus /sierra_3: Setting Powered False 02:46:07.117809 bus /sierra_3: Setting Powered False 02:46:08.233968 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:46:09.384004 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:46:09.396514 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:46:09.473435 tst mo_mt_call_osmux.py: using LAC 18529 02:46:09.601005 tst mo_mt_call_osmux.py: using RAC 169 02:46:09.726986 tst mo_mt_call_osmux.py: using CellId 18529 02:46:09.852908 tst mo_mt_call_osmux.py: using BVCI 18530 02:46:09.971648 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:46:09.983528 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:46:09.995148 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:46:10.006752 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:46:10.018496 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:46:10.030202 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:46:10.147026 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:46:10.268800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:10.772855 run create_hlr_db(pid=14553): Launched 02:46:10.904005 bus /sierra_2: Setting Powered False 02:46:11.967631 run create_hlr_db(pid=14553): Terminated: ok {rc=0} 02:46:12.417078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14555): Launched 02:46:12.738720 run osmo-hlr_10.42.42.2(pid=14556): Launched 02:46:12.862494 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:13.395671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14558): Launched 02:46:13.697077 run osmo-stp_10.42.42.5(pid=14559): Launched 02:46:13.811891 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:14.357534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14561): Launched 02:46:14.657980 run osmo-msc_10.42.42.6(pid=14562): Launched 02:46:14.827060 run osmo-stp_10.42.42.5(pid=14559): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14559)] 02:46:14.955640 run osmo-stp_10.42.42.5(pid=14559): stdout: | (launched: 2022-12-09_02:46:13.642123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:15.084304 run osmo-stp_10.42.42.5(pid=14559): stderr: | 20221209024613812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024613813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024613813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024613813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024613814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024613814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024613814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:15.210306 run osmo-stp_10.42.42.5(pid=14559): stdout: | (launched: 2022-12-09_02:46:13.642123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:15.330922 run osmo-stp_10.42.42.5(pid=14559): stderr: | 20221209024613812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024613813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024613813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024613813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024613814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024613814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024613814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:15.475355 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14559): Process ended prematurely: osmo-stp_10.42.42.5(pid=14559) [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14559)] [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:46:15.484504 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:46:15.511256 run osmo-hlr_10.42.42.2(pid=14556): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14556)] 02:46:15.559176 run osmo-hlr_10.42.42.2(pid=14556): stdout: | (launched: 2022-12-09_02:46:12.680132) 02:46:15.608338 run osmo-hlr_10.42.42.2(pid=14556): stderr: | 20221209024612880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024612880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024612880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024612880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024612880 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024612880 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024612893 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024612901 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024612901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024612901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:15.677011 run osmo-msc_10.42.42.6(pid=14562): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14562)] 02:46:15.724444 run osmo-msc_10.42.42.6(pid=14562): stdout: | (launched: 2022-12-09_02:46:14.603152) 02:46:15.773409 run osmo-msc_10.42.42.6(pid=14562): stderr: | 20221209024614872 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024614873 DLGLOBAL DEBUG validating counter group 0x7fcd39803c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024614873 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024614873 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024614873 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024614873 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024614875 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024614875 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024614875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024614876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:15.822859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14555): Terminating (SIGTERM) 02:46:15.874707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14558): Terminating (SIGTERM) 02:46:15.918409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14561): Terminating (SIGTERM) 02:46:15.960889 --- ParallelTerminationStrategy: PID 14555 died... 02:46:15.981842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14555): Terminated: ok {rc=0} 02:46:16.029252 --- ParallelTerminationStrategy: PID 14558 died... 02:46:16.048610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14558): Terminated: ok {rc=0} 02:46:16.095960 --- ParallelTerminationStrategy: PID 14561 died... 02:46:16.115604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14561): Terminated: ok {rc=0} 02:46:16.203251 bus /sierra_3: Setting Powered False 02:46:17.302407 bus /sierra_3: Setting Powered False 02:46:18.417157 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:46:19.671437 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:46:19.677572 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:46:19.711356 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:46:19.739229 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:46:19.794520 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:46:19.827257 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:46:19.854130 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:46:20.405973 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:46:20.457247 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:46:20.468314 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:46:20.538078 tst mo_mt_call.py: using LAC 18530 02:46:20.660317 tst mo_mt_call.py: using RAC 170 02:46:20.779279 tst mo_mt_call.py: using CellId 18530 02:46:20.897163 tst mo_mt_call.py: using BVCI 18531 02:46:21.008517 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:46:21.019749 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:46:21.030823 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:46:21.042191 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:46:21.053662 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:46:21.064906 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:46:21.184000 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:46:21.303731 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:21.806296 run create_hlr_db(pid=14568): Launched 02:46:21.937966 bus /sierra_2: Setting Powered False 02:46:23.002123 run create_hlr_db(pid=14568): Terminated: ok {rc=0} 02:46:23.434423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14570): Launched 02:46:23.737666 run osmo-hlr_10.42.42.2(pid=14571): Launched 02:46:23.854029 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:24.389469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14573): Launched 02:46:24.690607 run osmo-stp_10.42.42.5(pid=14574): Launched 02:46:24.806177 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:25.351599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14576): Launched 02:46:25.653631 run osmo-msc_10.42.42.6(pid=14577): Launched 02:46:25.822782 run osmo-stp_10.42.42.5(pid=14574): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14574)] 02:46:25.951821 run osmo-stp_10.42.42.5(pid=14574): stdout: | (launched: 2022-12-09_02:46:24.635487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:26.080185 run osmo-stp_10.42.42.5(pid=14574): stderr: | 20221209024624807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024624807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024624807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024624808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024624808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024624808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024624808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:26.206390 run osmo-stp_10.42.42.5(pid=14574): stdout: | (launched: 2022-12-09_02:46:24.635487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:26.327214 run osmo-stp_10.42.42.5(pid=14574): stderr: | 20221209024624807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024624807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024624807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024624808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024624808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024624808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024624808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:26.471466 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14574): Process ended prematurely: osmo-stp_10.42.42.5(pid=14574) [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14574)] [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:46:26.480555 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:46:26.507444 run osmo-hlr_10.42.42.2(pid=14571): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14571)] 02:46:26.555636 run osmo-hlr_10.42.42.2(pid=14571): stdout: | (launched: 2022-12-09_02:46:23.682378) 02:46:26.605267 run osmo-hlr_10.42.42.2(pid=14571): stderr: | 20221209024623877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024623877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024623877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024623877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024623877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024623877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024623888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024623896 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024623896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024623896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:26.674537 run osmo-msc_10.42.42.6(pid=14577): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14577)] 02:46:26.722664 run osmo-msc_10.42.42.6(pid=14577): stdout: | (launched: 2022-12-09_02:46:25.598422) 02:46:26.772012 run osmo-msc_10.42.42.6(pid=14577): stderr: | 20221209024625870 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024625870 DLGLOBAL DEBUG validating counter group 0x7f98829bbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024625870 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024625870 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024625870 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024625871 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024625872 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024625873 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024625873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024625873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:26.822031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14570): Terminating (SIGTERM) 02:46:26.861888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14573): Terminating (SIGTERM) 02:46:26.902018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14576): Terminating (SIGTERM) 02:46:26.942392 --- ParallelTerminationStrategy: PID 14570 died... 02:46:26.961483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14570): Terminated: ok {rc=0} 02:46:27.005694 --- ParallelTerminationStrategy: PID 14573 died... 02:46:27.024271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14573): Terminated: ok {rc=0} 02:46:27.068613 --- ParallelTerminationStrategy: PID 14576 died... 02:46:27.087313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14576): Terminated: ok {rc=0} 02:46:27.173247 bus /sierra_3: Setting Powered False 02:46:28.272173 bus /sierra_3: Setting Powered False 02:46:29.386676 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:46:30.531585 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:46:30.543254 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:46:30.612723 tst mo_mt_call_osmux.py: using LAC 18531 02:46:30.731232 tst mo_mt_call_osmux.py: using RAC 171 02:46:30.864271 tst mo_mt_call_osmux.py: using CellId 18531 02:46:31.007532 tst mo_mt_call_osmux.py: using BVCI 18532 02:46:31.127672 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:46:31.139684 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:46:31.151944 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:46:31.164274 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:46:31.176659 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:46:31.188621 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:46:31.324555 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:46:31.466281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:32.019785 run create_hlr_db(pid=14579): Launched 02:46:32.179824 bus /sierra_2: Setting Powered False 02:46:33.243902 run create_hlr_db(pid=14579): Terminated: ok {rc=0} 02:46:33.689247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14581): Launched 02:46:34.008336 run osmo-hlr_10.42.42.2(pid=14582): Launched 02:46:34.130412 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:34.685571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14584): Launched 02:46:35.003981 run osmo-stp_10.42.42.5(pid=14585): Launched 02:46:35.125676 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:35.707419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14587): Launched 02:46:36.027135 run osmo-msc_10.42.42.6(pid=14588): Launched 02:46:36.204805 run osmo-stp_10.42.42.5(pid=14585): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14585)] 02:46:36.338924 run osmo-stp_10.42.42.5(pid=14585): stdout: | (launched: 2022-12-09_02:46:34.946241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:36.474298 run osmo-stp_10.42.42.5(pid=14585): stderr: | 20221209024635139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024635139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024635139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024635140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024635140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024635140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024635140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:36.608527 run osmo-stp_10.42.42.5(pid=14585): stdout: | (launched: 2022-12-09_02:46:34.946241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:36.735891 run osmo-stp_10.42.42.5(pid=14585): stderr: | 20221209024635139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024635139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024635139 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024635140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024635140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024635140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024635140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:36.888924 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14585): Process ended prematurely: osmo-stp_10.42.42.5(pid=14585) [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14585)] [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:46:36.898648 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:46:36.926563 run osmo-hlr_10.42.42.2(pid=14582): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14582)] 02:46:36.975990 run osmo-hlr_10.42.42.2(pid=14582): stdout: | (launched: 2022-12-09_02:46:33.950602) 02:46:37.027144 run osmo-hlr_10.42.42.2(pid=14582): stderr: | 20221209024634151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024634151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024634151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024634151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024634151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024634151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024634167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024634176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024634177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024634177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:37.098404 run osmo-msc_10.42.42.6(pid=14588): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14588)] 02:46:37.147734 run osmo-msc_10.42.42.6(pid=14588): stdout: | (launched: 2022-12-09_02:46:35.969353) 02:46:37.198416 run osmo-msc_10.42.42.6(pid=14588): stderr: | 20221209024636292 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024636292 DLGLOBAL DEBUG validating counter group 0x7fd1da497c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024636292 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024636292 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024636292 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024636293 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024636296 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024636297 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024636297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024636297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:37.249486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14581): Terminating (SIGTERM) 02:46:37.290555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14584): Terminating (SIGTERM) 02:46:37.331573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14587): Terminating (SIGTERM) 02:46:37.372805 --- ParallelTerminationStrategy: PID 14581 died... 02:46:37.392665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14581): Terminated: ok {rc=0} 02:46:37.438522 --- ParallelTerminationStrategy: PID 14584 died... 02:46:37.457779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14584): Terminated: ok {rc=0} 02:46:37.503504 --- ParallelTerminationStrategy: PID 14587 died... 02:46:37.522783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14587): Terminated: ok {rc=0} 02:46:37.609048 bus /sierra_3: Setting Powered False 02:46:38.707690 bus /sierra_3: Setting Powered False 02:46:39.822351 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 02:46:41.075203 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:46:41.081722 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 02:46:41.114832 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 02:46:41.142198 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 02:46:41.194520 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 02:46:41.227866 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 02:46:41.255196 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 02:46:41.809592 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 02:46:41.860761 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:41.872593 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:46:41.927004 tst mo_mt_call.py: using LAC 18532 02:46:42.053921 tst mo_mt_call.py: using RAC 172 02:46:42.179184 tst mo_mt_call.py: using CellId 18532 02:46:42.309018 tst mo_mt_call.py: using BVCI 18533 02:46:42.426801 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:42.438663 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:42.450525 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:42.462279 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:42.474099 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:42.485783 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:46:42.601297 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:46:42.721624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:43.183625 run create_hlr_db(pid=14594): Launched 02:46:43.297866 bus /sierra_2: Setting Powered False 02:46:44.357578 run create_hlr_db(pid=14594): Terminated: ok {rc=0} 02:46:44.794011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14596): Launched 02:46:45.114175 run osmo-hlr_10.42.42.2(pid=14597): Launched 02:46:45.236882 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:45.787306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14599): Launched 02:46:46.122762 run osmo-stp_10.42.42.5(pid=14600): Launched 02:46:46.383164 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:46.951056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14602): Launched 02:46:47.327621 run osmo-msc_10.42.42.6(pid=14603): Launched 02:46:47.500556 run osmo-stp_10.42.42.5(pid=14600): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14600)] 02:46:47.630173 run osmo-stp_10.42.42.5(pid=14600): stdout: | (launched: 2022-12-09_02:46:46.059621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:47.758784 run osmo-stp_10.42.42.5(pid=14600): stderr: | 20221209024646251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024646251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024646251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024646251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024646252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024646252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024646252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:47.883877 run osmo-stp_10.42.42.5(pid=14600): stdout: | (launched: 2022-12-09_02:46:46.059621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:48.003190 run osmo-stp_10.42.42.5(pid=14600): stderr: | 20221209024646251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024646251 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024646251 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024646251 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024646252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024646252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024646252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:48.146398 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14600): Process ended prematurely: osmo-stp_10.42.42.5(pid=14600) [trial-2353↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14600)] [trial-2353↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 02:46:48.155445 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:46:48.182735 run osmo-hlr_10.42.42.2(pid=14597): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14597)] 02:46:48.230545 run osmo-hlr_10.42.42.2(pid=14597): stdout: | (launched: 2022-12-09_02:46:45.056434) 02:46:48.279843 run osmo-hlr_10.42.42.2(pid=14597): stderr: | 20221209024645252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024645252 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024645252 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024645252 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024645252 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024645252 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024645278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024645290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024645290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024645290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:48.348634 run osmo-msc_10.42.42.6(pid=14603): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14603)] 02:46:48.396259 run osmo-msc_10.42.42.6(pid=14603): stdout: | (launched: 2022-12-09_02:46:47.269257) 02:46:48.445357 run osmo-msc_10.42.42.6(pid=14603): stderr: | 20221209024647539 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024647539 DLGLOBAL DEBUG validating counter group 0x7f083f069c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024647539 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024647539 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024647539 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024647539 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024647543 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024647543 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024647543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024647543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:48.495214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14596): Terminating (SIGTERM) 02:46:48.535179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14599): Terminating (SIGTERM) 02:46:48.574906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14602): Terminating (SIGTERM) 02:46:48.615083 --- ParallelTerminationStrategy: PID 14596 died... 02:46:48.634234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14596): Terminated: ok {rc=0} 02:46:48.678758 --- ParallelTerminationStrategy: PID 14599 died... 02:46:48.697401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14599): Terminated: ok {rc=0} 02:46:48.741714 --- ParallelTerminationStrategy: PID 14602 died... 02:46:48.760409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14602): Terminated: ok {rc=0} 02:46:48.846650 bus /sierra_3: Setting Powered False 02:46:49.945396 bus /sierra_3: Setting Powered False 02:46:51.060617 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 02:46:52.205516 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:52.217457 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:46:52.269316 tst mo_mt_call_osmux.py: using LAC 18533 02:46:52.388694 tst mo_mt_call_osmux.py: using RAC 173 02:46:52.506153 tst mo_mt_call_osmux.py: using CellId 18533 02:46:52.626942 tst mo_mt_call_osmux.py: using BVCI 18534 02:46:52.735828 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:52.747129 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:52.758340 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:52.769763 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:52.781243 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:52.792447 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:46:52.912236 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:46:53.031146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:53.495736 run create_hlr_db(pid=14605): Launched 02:46:53.609759 bus /sierra_2: Setting Powered False 02:46:54.669503 run create_hlr_db(pid=14605): Terminated: ok {rc=0} 02:46:55.108216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14607): Launched 02:46:55.428877 run osmo-hlr_10.42.42.2(pid=14608): Launched 02:46:55.551846 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:56.107737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14610): Launched 02:46:56.427841 run osmo-stp_10.42.42.5(pid=14611): Launched 02:46:56.550512 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:57.131487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14613): Launched 02:46:57.451772 run osmo-msc_10.42.42.6(pid=14614): Launched 02:46:57.631613 run osmo-stp_10.42.42.5(pid=14611): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14611)] 02:46:57.766786 run osmo-stp_10.42.42.5(pid=14611): stdout: | (launched: 2022-12-09_02:46:56.369824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:57.902755 run osmo-stp_10.42.42.5(pid=14611): stderr: | 20221209024656562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024656563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024656563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024656563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024656564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024656564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024656564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:58.037551 run osmo-stp_10.42.42.5(pid=14611): stdout: | (launched: 2022-12-09_02:46:56.369824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:58.165263 run osmo-stp_10.42.42.5(pid=14611): stderr: | 20221209024656562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024656563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024656563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024656563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024656564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024656564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024656564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:58.317991 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14611): Process ended prematurely: osmo-stp_10.42.42.5(pid=14611) [trial-2353↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14611)] [trial-2353↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 02:46:58.327544 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:46:58.355067 run osmo-hlr_10.42.42.2(pid=14608): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14608)] 02:46:58.404564 run osmo-hlr_10.42.42.2(pid=14608): stdout: | (launched: 2022-12-09_02:46:55.370721) 02:46:58.455748 run osmo-hlr_10.42.42.2(pid=14608): stderr: | 20221209024655570 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024655570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024655570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024655570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024655570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024655570 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024655583 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024655591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024655591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024655591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:58.526798 run osmo-msc_10.42.42.6(pid=14614): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14614)] 02:46:58.576155 run osmo-msc_10.42.42.6(pid=14614): stdout: | (launched: 2022-12-09_02:46:57.393396) 02:46:58.627248 run osmo-msc_10.42.42.6(pid=14614): stderr: | 20221209024657716 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024657716 DLGLOBAL DEBUG validating counter group 0x7ff166e11c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024657716 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024657716 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024657716 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024657717 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024657718 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024657719 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024657719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024657719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:58.678598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14607): Terminating (SIGTERM) 02:46:58.719538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14610): Terminating (SIGTERM) 02:46:58.760521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14613): Terminating (SIGTERM) 02:46:58.801998 --- ParallelTerminationStrategy: PID 14607 died... 02:46:58.821819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14607): Terminated: ok {rc=0} 02:46:58.868873 --- ParallelTerminationStrategy: PID 14610 died... 02:46:58.888723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14610): Terminated: ok {rc=0} 02:46:58.934169 --- ParallelTerminationStrategy: PID 14613 died... 02:46:58.953747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14613): Terminated: ok {rc=0} 02:46:59.040389 bus /sierra_3: Setting Powered False 02:47:00.137090 bus /sierra_3: Setting Powered False 02:47:01.264653 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 emergency:trx-umtrx --------------------------------------------------------------------- 02:47:02.529259 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:47:02.533497 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:47:02.565951 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:47:02.592201 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 02:47:02.674681 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:47:02.706875 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:47:02.733335 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 02:47:03.319215 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2353 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 02:47:03.324102 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:47:03.334715 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:03.382238 tst emergency_mo_mt_call.py: using LAC 18534 02:47:03.498208 tst emergency_mo_mt_call.py: using RAC 174 02:47:03.612608 tst emergency_mo_mt_call.py: using CellId 18534 02:47:03.736449 tst emergency_mo_mt_call.py: using BVCI 18535 02:47:03.851591 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:47:03.862932 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:47:03.874026 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:47:03.885435 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:47:03.896878 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:47:03.908422 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:04.022345 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:04.138912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:04.593959 run create_hlr_db(pid=14619): Launched 02:47:04.707108 bus /sierra_2: Setting Powered False 02:47:05.766350 run create_hlr_db(pid=14619): Terminated: ok {rc=0} 02:47:06.177611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14621): Launched 02:47:06.470743 run osmo-hlr_10.42.42.2(pid=14622): Launched 02:47:06.583861 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:07.109192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14624): Launched 02:47:07.403036 run osmo-stp_10.42.42.5(pid=14625): Launched 02:47:07.527087 tst emergency_mo_mt_call.py: using MSISDN 6985 02:47:07.677598 run osmo-msc_10.42.42.6: Starting osmo-msc 02:47:08.206289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14627): Launched 02:47:08.499216 run osmo-msc_10.42.42.6(pid=14628): Launched 02:47:08.665128 run osmo-stp_10.42.42.5(pid=14625): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14625)] 02:47:08.789835 run osmo-stp_10.42.42.5(pid=14625): stdout: | (launched: 2022-12-09_02:47:07.349648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:08.914713 run osmo-stp_10.42.42.5(pid=14625): stderr: | 20221209024707519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024707520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024707521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024707521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024707522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024707522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024707522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:09.036885 run osmo-stp_10.42.42.5(pid=14625): stdout: | (launched: 2022-12-09_02:47:07.349648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:09.154088 run osmo-stp_10.42.42.5(pid=14625): stderr: | 20221209024707519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024707520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024707521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024707521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024707522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024707522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024707522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:09.293994 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=14625): Process ended prematurely: osmo-stp_10.42.42.5(pid=14625) [trial-2353↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14625)] [trial-2353↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 02:47:09.302506 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 02:47:09.328717 run osmo-hlr_10.42.42.2(pid=14622): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14622)] 02:47:09.376785 run osmo-hlr_10.42.42.2(pid=14622): stdout: | (launched: 2022-12-09_02:47:06.417382) 02:47:09.425931 run osmo-hlr_10.42.42.2(pid=14622): stderr: | 20221209024706592 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024706592 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024706592 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024706592 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024706592 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024706592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024706604 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024706612 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024706612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024706612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:09.494435 run osmo-msc_10.42.42.6(pid=14628): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14628)] 02:47:09.541868 run osmo-msc_10.42.42.6(pid=14628): stdout: | (launched: 2022-12-09_02:47:08.445674) 02:47:09.590883 run osmo-msc_10.42.42.6(pid=14628): stderr: | 20221209024708714 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024708714 DLGLOBAL DEBUG validating counter group 0x7f20a39fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024708714 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024708714 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024708714 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024708715 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024708717 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024708718 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024708718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024708718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:47:09.640474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14621): Terminating (SIGTERM) 02:47:09.679794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14624): Terminating (SIGTERM) 02:47:09.719419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14627): Terminating (SIGTERM) 02:47:09.759213 --- ParallelTerminationStrategy: PID 14621 died... 02:47:09.778148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14621): Terminated: ok {rc=0} 02:47:09.822138 --- ParallelTerminationStrategy: PID 14624 died... 02:47:09.840583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14624): Terminated: ok {rc=0} 02:47:09.884640 --- ParallelTerminationStrategy: PID 14627 died... 02:47:09.903196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14627): Terminated: ok {rc=0} 02:47:09.987729 bus /sierra_3: Setting Powered False 02:47:11.087054 bus /sierra_3: Setting Powered False 02:47:12.201493 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 02:47:13.287240 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:47:13.298731 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:13.348762 tst emergency_preemptive_call.py: using LAC 18535 02:47:13.466413 tst emergency_preemptive_call.py: using RAC 175 02:47:13.592719 tst emergency_preemptive_call.py: using CellId 18535 02:47:13.718666 tst emergency_preemptive_call.py: using BVCI 18536 02:47:13.835246 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:47:13.846763 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:47:13.858096 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:47:13.869822 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:47:13.880892 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:47:13.892183 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:14.006896 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:14.124782 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:14.241208 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:14.359659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:14.818972 run create_hlr_db(pid=14630): Launched 02:47:14.931039 bus /sierra_2: Setting Powered False 02:47:15.993609 run create_hlr_db(pid=14630): Terminated: ok {rc=0} 02:47:16.470452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14632): Launched 02:47:16.825346 run osmo-hlr_10.42.42.2(pid=14633): Launched 02:47:16.954263 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:17.663963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14635): Launched 02:47:17.978982 run osmo-stp_10.42.42.5(pid=14636): Launched 02:47:18.108789 tst emergency_preemptive_call.py: using MSISDN 6986 02:47:18.270917 run osmo-msc_10.42.42.6: Starting osmo-msc 02:47:18.799000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14638): Launched 02:47:19.091934 run osmo-msc_10.42.42.6(pid=14639): Launched 02:47:19.257220 run osmo-stp_10.42.42.5(pid=14636): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14636)] 02:47:19.382725 run osmo-stp_10.42.42.5(pid=14636): stdout: | (launched: 2022-12-09_02:47:17.921522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:19.508072 run osmo-stp_10.42.42.5(pid=14636): stderr: | 20221209024718113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024718113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024718114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024718114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024718114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024718115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024718115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:19.630949 run osmo-stp_10.42.42.5(pid=14636): stdout: | (launched: 2022-12-09_02:47:17.921522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:19.748091 run osmo-stp_10.42.42.5(pid=14636): stderr: | 20221209024718113 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024718113 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024718114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024718114 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024718114 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024718115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024718115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:19.888063 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14636): Process ended prematurely: osmo-stp_10.42.42.5(pid=14636) [trial-2353↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14636)] [trial-2353↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 02:47:19.896577 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 02:47:19.922703 run osmo-hlr_10.42.42.2(pid=14633): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14633)] 02:47:19.970597 run osmo-hlr_10.42.42.2(pid=14633): stdout: | (launched: 2022-12-09_02:47:16.759488) 02:47:20.019549 run osmo-hlr_10.42.42.2(pid=14633): stderr: | 20221209024717068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024717069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024717069 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024717069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024717069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024717069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024717082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024717098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024717099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024717099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:20.088027 run osmo-msc_10.42.42.6(pid=14639): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14639)] 02:47:20.135501 run osmo-msc_10.42.42.6(pid=14639): stdout: | (launched: 2022-12-09_02:47:19.038155) 02:47:20.184554 run osmo-msc_10.42.42.6(pid=14639): stderr: | 20221209024719310 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209024719310 DLGLOBAL DEBUG validating counter group 0x7f31c3ab1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209024719311 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209024719311 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209024719311 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209024719311 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209024719313 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209024719313 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209024719313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209024719313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:47:20.233985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14632): Terminating (SIGTERM) 02:47:20.273594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14635): Terminating (SIGTERM) 02:47:20.313177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14638): Terminating (SIGTERM) 02:47:20.353051 --- ParallelTerminationStrategy: PID 14632 died... 02:47:20.371992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14632): Terminated: ok {rc=0} 02:47:20.416274 --- ParallelTerminationStrategy: PID 14635 died... 02:47:20.434948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14635): Terminated: ok {rc=0} 02:47:20.478993 --- ParallelTerminationStrategy: PID 14638 died... 02:47:20.497311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14638): Terminated: ok {rc=0} 02:47:20.580017 bus /sierra_9: Setting Powered False 02:47:21.677373 bus /sierra_9: Setting Powered False 02:47:22.793270 bus /sierra_8: Setting Powered False 02:47:23.891736 bus /sierra_8: Setting Powered False 02:47:25.006276 bus /sierra_3: Setting Powered False 02:47:26.103675 bus /sierra_3: Setting Powered False 02:47:27.218288 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-umtrx --------------------------------------------------------------------- 02:47:28.487858 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:47:28.492039 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:47:28.524636 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 02:47:28.563017 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 02:47:28.648790 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:47:28.680901 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 02:47:28.719088 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 02:47:29.307900 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 02:47:29.357666 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:29.368037 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:29.415596 tst cs_paging_gprs_active.py: using LAC 18536 02:47:29.534465 tst cs_paging_gprs_active.py: using RAC 176 02:47:29.657410 tst cs_paging_gprs_active.py: using CellId 18536 02:47:29.774429 tst cs_paging_gprs_active.py: using BVCI 18537 02:47:29.883396 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:29.894074 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:29.904440 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:29.915168 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:29.925751 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:29.936209 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:29.946972 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:29.957520 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:29.968127 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:30.086015 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:30.205524 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:47:30.424212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:30.747504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14645): Launched 02:47:31.047472 run iperf3-srv_10.42.42.10(pid=14646): Launched 02:47:31.181011 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:47:31.402743 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:31.741799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14647): Launched 02:47:32.032059 run iperf3-srv_10.42.42.10(pid=14648): Launched 02:47:32.166773 tst cs_paging_gprs_active.py:38: start network... 02:47:32.385587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:32.885670 run create_hlr_db(pid=14649): Launched 02:47:33.017917 bus /sierra_2: Setting Powered False 02:47:34.081938 run create_hlr_db(pid=14649): Terminated: ok {rc=0} 02:47:34.510546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14651): Launched 02:47:34.811049 run osmo-hlr_10.42.42.2(pid=14652): Launched 02:47:34.926646 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:35.458290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14654): Launched 02:47:35.761043 run osmo-stp_10.42.42.5(pid=14656): Launched 02:47:35.889112 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:47:36.451163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14658): Launched 02:47:36.574255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:47:36.845966 run patchelf(pid=14659): Launched 02:47:37.025420 run osmo-stp_10.42.42.5(pid=14656): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14656)] 02:47:37.161170 run osmo-stp_10.42.42.5(pid=14656): stdout: | (launched: 2022-12-09_02:47:35.703604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:37.298535 run osmo-stp_10.42.42.5(pid=14656): stderr: | 20221209024735893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024735893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024735893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024735893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024735894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024735894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024735894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:37.435777 run osmo-stp_10.42.42.5(pid=14656): stdout: | (launched: 2022-12-09_02:47:35.703604) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:37.567649 run osmo-stp_10.42.42.5(pid=14656): stderr: | 20221209024735893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024735893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024735893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024735893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024735894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024735894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024735894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:37.723460 run patchelf(pid=14659): Terminating (SIGINT) 02:47:37.903108 run patchelf(pid=14659): Terminated: ok {rc=0} 02:47:38.033173 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14656): Process ended prematurely: osmo-stp_10.42.42.5(pid=14656) [trial-2353↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14656)] [trial-2353↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 02:47:38.043122 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:47:38.071467 run osmo-hlr_10.42.42.2(pid=14652): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14652)] 02:47:38.121450 run osmo-hlr_10.42.42.2(pid=14652): stdout: | (launched: 2022-12-09_02:47:34.756275) 02:47:38.173282 run osmo-hlr_10.42.42.2(pid=14652): stderr: | 20221209024734934 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024734934 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024734934 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024734934 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024734934 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024734934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024734947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024734956 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024734956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024734956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:38.225049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14645): Terminating (SIGTERM) 02:47:38.266893 run iperf3-srv_10.42.42.10(pid=14646): Terminating (SIGTERM) 02:47:38.308463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14647): Terminating (SIGTERM) 02:47:38.350424 run iperf3-srv_10.42.42.10(pid=14648): Terminating (SIGTERM) 02:47:38.392202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14651): Terminating (SIGTERM) 02:47:38.435759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14654): Terminating (SIGTERM) 02:47:38.477853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14658): Terminating (SIGTERM) 02:47:38.519838 --- ParallelTerminationStrategy: PID 14645 died... 02:47:38.539935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14645): Terminated: ok {rc=0} 02:47:38.586296 --- ParallelTerminationStrategy: PID 14646 died... 02:47:38.605933 run iperf3-srv_10.42.42.10(pid=14646): Terminated {rc=256} 02:47:38.651749 --- ParallelTerminationStrategy: PID 14647 died... 02:47:38.671340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14647): Terminated: ok {rc=0} 02:47:38.717277 --- ParallelTerminationStrategy: PID 14648 died... 02:47:38.737011 run iperf3-srv_10.42.42.10(pid=14648): Terminated {rc=256} 02:47:38.782763 --- ParallelTerminationStrategy: PID 14651 died... 02:47:38.802351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14651): Terminated: ok {rc=0} 02:47:38.848091 --- ParallelTerminationStrategy: PID 14654 died... 02:47:38.867670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14654): Terminated: ok {rc=0} 02:47:38.914384 --- ParallelTerminationStrategy: PID 14658 died... 02:47:38.934092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14658): Terminated: ok {rc=0} 02:47:39.021861 bus /gobi_0: Setting Powered False 02:47:40.122033 bus /gobi_0: Setting Powered False 02:47:41.239661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx iperf3.py ---------------------------------------------- 02:47:42.389383 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:42.401285 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:42.456615 tst iperf3.py: using LAC 18537 02:47:42.582376 tst iperf3.py: using RAC 177 02:47:42.707211 tst iperf3.py: using CellId 18537 02:47:42.832334 tst iperf3.py: using BVCI 18538 02:47:42.950507 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:42.962320 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:42.973241 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:42.984138 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:42.995001 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:43.005989 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:43.017097 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:43.028209 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:43.039153 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:43.159261 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:47:43.378115 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:43.702572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14660): Launched 02:47:43.983534 run iperf3-srv_10.42.42.10(pid=14661): Launched 02:47:44.104524 tst iperf3.py:8: start network... 02:47:44.322609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:44.821691 run create_hlr_db(pid=14662): Launched 02:47:44.952029 bus /gobi_6: Setting Powered False 02:47:46.010770 run create_hlr_db(pid=14662): Terminated: ok {rc=0} 02:47:46.487305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14664): Launched 02:47:46.825441 run osmo-hlr_10.42.42.2(pid=14665): Launched 02:47:47.129392 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:47.699563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14667): Launched 02:47:48.020093 run osmo-stp_10.42.42.5(pid=14668): Launched 02:47:48.143228 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:47:48.696635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14670): Launched 02:47:48.818878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:47:49.090867 run patchelf(pid=14671): Launched 02:47:49.268608 run osmo-stp_10.42.42.5(pid=14668): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14668)] 02:47:49.404512 run osmo-stp_10.42.42.5(pid=14668): stdout: | (launched: 2022-12-09_02:47:47.962061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:49.542386 run osmo-stp_10.42.42.5(pid=14668): stderr: | 20221209024748154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024748155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024748155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024748155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024748156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024748156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024748156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:49.679958 run osmo-stp_10.42.42.5(pid=14668): stdout: | (launched: 2022-12-09_02:47:47.962061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:49.811809 run osmo-stp_10.42.42.5(pid=14668): stderr: | 20221209024748154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024748155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024748155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024748155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024748156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024748156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024748156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:49.968824 run patchelf(pid=14671): Terminating (SIGINT) 02:47:50.149355 run patchelf(pid=14671): Terminated: ok {rc=0} 02:47:50.278940 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14668): Process ended prematurely: osmo-stp_10.42.42.5(pid=14668) [trial-2353↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14668)] [trial-2353↪gprs:trx-umtrx↪iperf3.py:8] 02:47:50.288698 tst iperf3.py:8: Test FAILED (7.9 sec) 02:47:50.317136 run osmo-hlr_10.42.42.2(pid=14665): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14665)] 02:47:50.366968 run osmo-hlr_10.42.42.2(pid=14665): stdout: | (launched: 2022-12-09_02:47:46.760745) 02:47:50.418515 run osmo-hlr_10.42.42.2(pid=14665): stderr: | 20221209024746999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024746999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024746999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024746999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024746999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024746999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024747015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024747027 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024747027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024747027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:50.470267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14660): Terminating (SIGTERM) 02:47:50.511975 run iperf3-srv_10.42.42.10(pid=14661): Terminating (SIGTERM) 02:47:50.553599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14664): Terminating (SIGTERM) 02:47:50.595369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14667): Terminating (SIGTERM) 02:47:50.637075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14670): Terminating (SIGTERM) 02:47:50.679138 --- ParallelTerminationStrategy: PID 14660 died... 02:47:50.699201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14660): Terminated: ok {rc=0} 02:47:50.745580 --- ParallelTerminationStrategy: PID 14661 died... 02:47:50.764801 run iperf3-srv_10.42.42.10(pid=14661): Terminated {rc=256} 02:47:50.810744 --- ParallelTerminationStrategy: PID 14664 died... 02:47:50.830260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14664): Terminated: ok {rc=0} 02:47:50.875836 --- ParallelTerminationStrategy: PID 14667 died... 02:47:50.895236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14667): Terminated: ok {rc=0} 02:47:50.941432 --- ParallelTerminationStrategy: PID 14670 died... 02:47:50.961000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14670): Terminated: ok {rc=0} 02:47:51.048766 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 02:47:52.195146 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:52.206472 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:52.255107 tst iperf3m4.py: using LAC 18538 02:47:52.375502 tst iperf3m4.py: using RAC 178 02:47:52.498453 tst iperf3m4.py: using CellId 18538 02:47:52.617394 tst iperf3m4.py: using BVCI 18539 02:47:52.726799 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:52.737465 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:52.747875 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:52.758701 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:52.769495 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:52.780133 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:52.790964 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:52.801675 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:52.812809 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:52.927527 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:53.055116 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:53.175001 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:53.295232 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:47:53.512489 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:53.835644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14672): Launched 02:47:54.115213 run iperf3-srv_10.42.42.10(pid=14673): Launched 02:47:54.235661 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:47:54.452713 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:54.775020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14674): Launched 02:47:55.054673 run iperf3-srv_10.42.42.10(pid=14675): Launched 02:47:55.175197 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:47:55.391377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:55.713341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14676): Launched 02:47:55.993268 run iperf3-srv_10.42.42.10(pid=14677): Launched 02:47:56.113484 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:47:56.330466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:56.654191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14678): Launched 02:47:56.934453 run iperf3-srv_10.42.42.10(pid=14679): Launched 02:47:57.055178 tst iperf3m4.py:8: start network... 02:47:57.272295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:57.773657 run create_hlr_db(pid=14680): Launched 02:47:57.903333 bus /gobi_6: Setting Powered False 02:47:58.967360 run create_hlr_db(pid=14680): Terminated: ok {rc=0} 02:47:59.414501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14682): Launched 02:47:59.735755 run osmo-hlr_10.42.42.2(pid=14683): Launched 02:47:59.857982 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:00.412244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14685): Launched 02:48:00.732925 run osmo-stp_10.42.42.5(pid=14686): Launched 02:48:00.855722 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:01.522635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14688): Launched 02:48:01.687123 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:01.970831 run patchelf(pid=14689): Launched 02:48:02.163245 run osmo-stp_10.42.42.5(pid=14686): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14686)] 02:48:02.300310 run osmo-stp_10.42.42.5(pid=14686): stdout: | (launched: 2022-12-09_02:48:00.674638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:02.438539 run osmo-stp_10.42.42.5(pid=14686): stderr: | 20221209024800932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024800932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024800932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024800941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024800942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024800942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024800942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:02.576355 run osmo-stp_10.42.42.5(pid=14686): stdout: | (launched: 2022-12-09_02:48:00.674638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:02.707980 run osmo-stp_10.42.42.5(pid=14686): stderr: | 20221209024800932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024800932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024800932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024800941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024800942 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024800942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024800942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:02.864189 run patchelf(pid=14689): Terminating (SIGINT) 02:48:03.044406 run patchelf(pid=14689): Terminated: ok {rc=0} 02:48:03.174850 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14686): Process ended prematurely: osmo-stp_10.42.42.5(pid=14686) [trial-2353↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14686)] [trial-2353↪gprs:trx-umtrx↪iperf3m4.py:8] 02:48:03.184913 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:48:03.213428 run osmo-hlr_10.42.42.2(pid=14683): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14683)] 02:48:03.262831 run osmo-hlr_10.42.42.2(pid=14683): stdout: | (launched: 2022-12-09_02:47:59.677305) 02:48:03.313977 run osmo-hlr_10.42.42.2(pid=14683): stderr: | 20221209024759875 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024759875 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024759875 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024759875 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024759875 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024759875 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024759887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024759897 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024759898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024759898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:03.365335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14672): Terminating (SIGTERM) 02:48:03.406772 run iperf3-srv_10.42.42.10(pid=14673): Terminating (SIGTERM) 02:48:03.448114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14674): Terminating (SIGTERM) 02:48:03.489649 run iperf3-srv_10.42.42.10(pid=14675): Terminating (SIGTERM) 02:48:03.531032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14676): Terminating (SIGTERM) 02:48:03.572514 run iperf3-srv_10.42.42.10(pid=14677): Terminating (SIGTERM) 02:48:03.613877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14678): Terminating (SIGTERM) 02:48:03.655245 run iperf3-srv_10.42.42.10(pid=14679): Terminating (SIGTERM) 02:48:03.696363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14682): Terminating (SIGTERM) 02:48:03.737788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14685): Terminating (SIGTERM) 02:48:03.779035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14688): Terminating (SIGTERM) 02:48:03.820661 --- ParallelTerminationStrategy: PID 14672 died... 02:48:03.840493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14672): Terminated: ok {rc=0} 02:48:03.886473 --- ParallelTerminationStrategy: PID 14673 died... 02:48:03.905876 run iperf3-srv_10.42.42.10(pid=14673): Terminated {rc=256} 02:48:03.951841 --- ParallelTerminationStrategy: PID 14674 died... 02:48:03.971355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14674): Terminated: ok {rc=0} 02:48:04.017143 --- ParallelTerminationStrategy: PID 14675 died... 02:48:04.036302 run iperf3-srv_10.42.42.10(pid=14675): Terminated {rc=256} 02:48:04.082143 --- ParallelTerminationStrategy: PID 14676 died... 02:48:04.101579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14676): Terminated: ok {rc=0} 02:48:04.147110 --- ParallelTerminationStrategy: PID 14677 died... 02:48:04.166431 run iperf3-srv_10.42.42.10(pid=14677): Terminated {rc=256} 02:48:04.212103 --- ParallelTerminationStrategy: PID 14678 died... 02:48:04.231504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14678): Terminated: ok {rc=0} 02:48:04.277211 --- ParallelTerminationStrategy: PID 14679 died... 02:48:04.296451 run iperf3-srv_10.42.42.10(pid=14679): Terminated {rc=256} 02:48:04.342457 --- ParallelTerminationStrategy: PID 14682 died... 02:48:04.361940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14682): Terminated: ok {rc=0} 02:48:04.407659 --- ParallelTerminationStrategy: PID 14685 died... 02:48:04.427357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14685): Terminated: ok {rc=0} 02:48:04.473285 --- ParallelTerminationStrategy: PID 14688 died... 02:48:04.492597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14688): Terminated: ok {rc=0} 02:48:04.579677 bus /gobi_4: Setting Powered False 02:48:05.678643 bus /gobi_4: Setting Powered False 02:48:06.793451 bus /gobi_1: Setting Powered False 02:48:07.892194 bus /gobi_1: Setting Powered False 02:48:09.006645 bus /gobi_0: Setting Powered False 02:48:10.104757 bus /gobi_0: Setting Powered False 02:48:11.219317 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx ping.py ---------------------------------------------- 02:48:12.321123 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:12.332713 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:48:12.383920 tst ping.py: using LAC 18539 02:48:12.509357 tst ping.py: using RAC 179 02:48:12.636480 tst ping.py: using CellId 18539 02:48:12.761093 tst ping.py: using BVCI 18540 02:48:12.875902 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:12.886880 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:12.897796 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:12.908555 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:12.919350 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:12.930580 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:12.941562 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:12.952353 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:48:13.070434 tst ping.py:19: start network... 02:48:13.283560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:13.771418 run create_hlr_db(pid=14690): Launched 02:48:13.898911 bus /gobi_6: Setting Powered False 02:48:14.962220 run create_hlr_db(pid=14690): Terminated: ok {rc=0} 02:48:15.399541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14692): Launched 02:48:15.713109 run osmo-hlr_10.42.42.2(pid=14693): Launched 02:48:15.833267 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:16.475905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14695): Launched 02:48:16.815048 run osmo-stp_10.42.42.5(pid=14696): Launched 02:48:16.967605 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:17.650071 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14698): Launched 02:48:17.763355 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:18.012503 run patchelf(pid=14699): Launched 02:48:18.176622 run osmo-stp_10.42.42.5(pid=14696): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14696)] 02:48:18.301622 run osmo-stp_10.42.42.5(pid=14696): stdout: | (launched: 2022-12-09_02:48:16.747472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:18.428065 run osmo-stp_10.42.42.5(pid=14696): stderr: | 20221209024817075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024817075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024817075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024817076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024817076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024817076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024817076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:18.555457 run osmo-stp_10.42.42.5(pid=14696): stdout: | (launched: 2022-12-09_02:48:16.747472) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:18.676287 run osmo-stp_10.42.42.5(pid=14696): stderr: | 20221209024817075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024817075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024817075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024817076 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024817076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024817076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024817076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:18.819487 run patchelf(pid=14699): Terminating (SIGINT) 02:48:18.985231 run patchelf(pid=14699): Terminated: ok {rc=0} 02:48:19.103686 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14696): Process ended prematurely: osmo-stp_10.42.42.5(pid=14696) [trial-2353↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14696)] [trial-2353↪gprs:trx-umtrx↪ping.py:22] 02:48:19.112468 tst ping.py:22: Test FAILED (6.8 sec) 02:48:19.139693 run osmo-hlr_10.42.42.2(pid=14693): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14693)] 02:48:19.187292 run osmo-hlr_10.42.42.2(pid=14693): stdout: | (launched: 2022-12-09_02:48:15.655485) 02:48:19.236582 run osmo-hlr_10.42.42.2(pid=14693): stderr: | 20221209024815906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024815907 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024815907 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024815907 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024815907 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024815907 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024815927 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024815947 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024815948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024815948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:19.285779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14692): Terminating (SIGTERM) 02:48:19.325092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14695): Terminating (SIGTERM) 02:48:19.364337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14698): Terminating (SIGTERM) 02:48:19.404032 --- ParallelTerminationStrategy: PID 14692 died... 02:48:19.423148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14692): Terminated: ok {rc=0} 02:48:19.467668 --- ParallelTerminationStrategy: PID 14695 died... 02:48:19.486481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14695): Terminated: ok {rc=0} 02:48:19.530921 --- ParallelTerminationStrategy: PID 14698 died... 02:48:19.549626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14698): Terminated: ok {rc=0} 02:48:19.633186 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 02:48:20.718911 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:20.731138 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:48:20.788016 tst ping_idle_ping.py: using LAC 18540 02:48:20.905361 tst ping_idle_ping.py: using RAC 180 02:48:21.021491 tst ping_idle_ping.py: using CellId 18540 02:48:21.139725 tst ping_idle_ping.py: using BVCI 18541 02:48:21.247618 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:21.258640 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:21.269384 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:21.280159 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:21.291329 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:21.302331 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:21.313424 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:48:21.324320 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:48:21.438593 tst ping_idle_ping.py:24: start network... 02:48:21.653530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:22.146847 run create_hlr_db(pid=14700): Launched 02:48:22.275384 bus /gobi_6: Setting Powered False 02:48:23.338085 run create_hlr_db(pid=14700): Terminated: ok {rc=0} 02:48:23.761184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14702): Launched 02:48:24.080921 run osmo-hlr_10.42.42.2(pid=14703): Launched 02:48:24.201275 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:24.751968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14705): Launched 02:48:25.069359 run osmo-stp_10.42.42.5(pid=14706): Launched 02:48:25.190678 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:25.739983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14708): Launched 02:48:25.861069 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:26.129090 run patchelf(pid=14709): Launched 02:48:26.304877 run osmo-stp_10.42.42.5(pid=14706): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14706)] 02:48:26.438750 run osmo-stp_10.42.42.5(pid=14706): stdout: | (launched: 2022-12-09_02:48:25.011678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:26.574050 run osmo-stp_10.42.42.5(pid=14706): stderr: | 20221209024825202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024825202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024825203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024825203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024825203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024825203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024825204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:26.709933 run osmo-stp_10.42.42.5(pid=14706): stdout: | (launched: 2022-12-09_02:48:25.011678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:26.840193 run osmo-stp_10.42.42.5(pid=14706): stderr: | 20221209024825202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024825202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024825203 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024825203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024825203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024825203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024825204 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:26.995270 run patchelf(pid=14709): Terminating (SIGINT) 02:48:27.172087 run patchelf(pid=14709): Terminated: ok {rc=0} 02:48:27.300054 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14706): Process ended prematurely: osmo-stp_10.42.42.5(pid=14706) [trial-2353↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14706)] [trial-2353↪gprs:trx-umtrx↪ping_idle_ping.py:27] 02:48:27.309538 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:48:27.337466 run osmo-hlr_10.42.42.2(pid=14703): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14703)] 02:48:27.387411 run osmo-hlr_10.42.42.2(pid=14703): stdout: | (launched: 2022-12-09_02:48:24.023217) 02:48:27.439149 run osmo-hlr_10.42.42.2(pid=14703): stderr: | 20221209024824220 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024824221 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024824221 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024824221 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024824221 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024824221 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024824234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024824242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024824242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024824243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:27.492155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14702): Terminating (SIGTERM) 02:48:27.533974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14705): Terminating (SIGTERM) 02:48:27.575733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14708): Terminating (SIGTERM) 02:48:27.617849 --- ParallelTerminationStrategy: PID 14702 died... 02:48:27.637997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14702): Terminated: ok {rc=0} 02:48:27.684231 --- ParallelTerminationStrategy: PID 14705 died... 02:48:27.703924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14705): Terminated: ok {rc=0} 02:48:27.749899 --- ParallelTerminationStrategy: PID 14708 died... 02:48:27.769478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14708): Terminated: ok {rc=0} 02:48:27.856427 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 02:48:29.152750 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:48:29.158124 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:48:29.191532 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:48:29.230035 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:48:29.318786 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:48:29.352764 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:48:29.392661 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:48:29.977997 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:48:30.027783 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.038906 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:48:30.089236 tst cs_paging_gprs_active.py: using LAC 18541 02:48:30.208359 tst cs_paging_gprs_active.py: using RAC 181 02:48:30.326622 tst cs_paging_gprs_active.py: using CellId 18541 02:48:30.444767 tst cs_paging_gprs_active.py: using BVCI 18542 02:48:30.554496 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.565689 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.576499 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.587875 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.599178 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.610450 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.621935 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.633275 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:30.644560 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:30.758518 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:30.873701 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:48:31.122101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:31.434809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14713): Launched 02:48:31.718699 run iperf3-srv_10.42.42.10(pid=14714): Launched 02:48:31.833947 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:48:32.039481 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:32.345480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14715): Launched 02:48:32.606467 run iperf3-srv_10.42.42.10(pid=14716): Launched 02:48:32.719528 tst cs_paging_gprs_active.py:38: start network... 02:48:32.921135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:33.386585 run create_hlr_db(pid=14717): Launched 02:48:33.500648 bus /gobi_6: Setting Powered False 02:48:34.561282 run create_hlr_db(pid=14717): Terminated: ok {rc=0} 02:48:35.001679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14719): Launched 02:48:35.323867 run osmo-hlr_10.42.42.2(pid=14720): Launched 02:48:35.448042 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:36.005112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14722): Launched 02:48:36.326023 run osmo-stp_10.42.42.5(pid=14723): Launched 02:48:36.449066 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:37.008079 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14725): Launched 02:48:37.131039 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:37.403476 run patchelf(pid=14726): Launched 02:48:37.582111 run osmo-stp_10.42.42.5(pid=14723): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14723)] 02:48:37.718028 run osmo-stp_10.42.42.5(pid=14723): stdout: | (launched: 2022-12-09_02:48:36.267386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:37.855055 run osmo-stp_10.42.42.5(pid=14723): stderr: | 20221209024836458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024836458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024836458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024836458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024836459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024836459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024836459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:37.992509 run osmo-stp_10.42.42.5(pid=14723): stdout: | (launched: 2022-12-09_02:48:36.267386) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:38.124413 run osmo-stp_10.42.42.5(pid=14723): stderr: | 20221209024836458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024836458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024836458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024836458 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024836459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024836459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024836459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:38.280177 run patchelf(pid=14726): Terminating (SIGINT) 02:48:38.460491 run patchelf(pid=14726): Terminated: ok {rc=0} 02:48:38.590397 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14723): Process ended prematurely: osmo-stp_10.42.42.5(pid=14723) [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14723)] [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:48:38.600307 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 02:48:38.628666 run osmo-hlr_10.42.42.2(pid=14720): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14720)] 02:48:38.678177 run osmo-hlr_10.42.42.2(pid=14720): stdout: | (launched: 2022-12-09_02:48:35.265515) 02:48:38.729339 run osmo-hlr_10.42.42.2(pid=14720): stderr: | 20221209024835463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024835464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024835464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024835464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024835464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024835464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024835476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024835488 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024835488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024835488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:38.780837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14713): Terminating (SIGTERM) 02:48:38.822222 run iperf3-srv_10.42.42.10(pid=14714): Terminating (SIGTERM) 02:48:38.863377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14715): Terminating (SIGTERM) 02:48:38.904693 run iperf3-srv_10.42.42.10(pid=14716): Terminating (SIGTERM) 02:48:38.946307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14719): Terminating (SIGTERM) 02:48:38.988043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14722): Terminating (SIGTERM) 02:48:39.029404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14725): Terminating (SIGTERM) 02:48:39.071237 --- ParallelTerminationStrategy: PID 14713 died... 02:48:39.091297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14713): Terminated: ok {rc=0} 02:48:39.137098 --- ParallelTerminationStrategy: PID 14714 died... 02:48:39.156347 run iperf3-srv_10.42.42.10(pid=14714): Terminated {rc=256} 02:48:39.201874 --- ParallelTerminationStrategy: PID 14715 died... 02:48:39.221288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14715): Terminated: ok {rc=0} 02:48:39.267131 --- ParallelTerminationStrategy: PID 14716 died... 02:48:39.286399 run iperf3-srv_10.42.42.10(pid=14716): Terminated {rc=256} 02:48:39.331716 --- ParallelTerminationStrategy: PID 14719 died... 02:48:39.351156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14719): Terminated: ok {rc=0} 02:48:39.397441 --- ParallelTerminationStrategy: PID 14722 died... 02:48:39.416778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14722): Terminated: ok {rc=0} 02:48:39.462359 --- ParallelTerminationStrategy: PID 14725 died... 02:48:39.481788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14725): Terminated: ok {rc=0} 02:48:39.568718 bus /gobi_0: Setting Powered False 02:48:40.667026 bus /gobi_0: Setting Powered False 02:48:41.782075 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:48:42.931125 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:42.943710 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:48:42.997481 tst iperf3.py: using LAC 18542 02:48:43.126117 tst iperf3.py: using RAC 182 02:48:43.246105 tst iperf3.py: using CellId 18542 02:48:43.367834 tst iperf3.py: using BVCI 18543 02:48:43.477904 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:43.489039 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:43.499837 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:43.511244 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:43.522406 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:43.533674 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:43.545334 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:43.556487 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:43.568085 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:43.686160 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:48:43.904034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:44.228638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14727): Launched 02:48:44.507772 run iperf3-srv_10.42.42.10(pid=14728): Launched 02:48:44.628427 tst iperf3.py:8: start network... 02:48:44.845778 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:45.345132 run create_hlr_db(pid=14729): Launched 02:48:45.476143 bus /gobi_6: Setting Powered False 02:48:46.537735 run create_hlr_db(pid=14729): Terminated: ok {rc=0} 02:48:47.001710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14731): Launched 02:48:47.329274 run osmo-hlr_10.42.42.2(pid=14732): Launched 02:48:47.452284 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:48.014260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14734): Launched 02:48:48.334782 run osmo-stp_10.42.42.5(pid=14735): Launched 02:48:48.457199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:49.009392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14737): Launched 02:48:49.131199 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:49.401345 run patchelf(pid=14738): Launched 02:48:49.578762 run osmo-stp_10.42.42.5(pid=14735): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14735)] 02:48:49.713626 run osmo-stp_10.42.42.5(pid=14735): stdout: | (launched: 2022-12-09_02:48:48.276589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:49.850654 run osmo-stp_10.42.42.5(pid=14735): stderr: | 20221209024848469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024848469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024848469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024848470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024848470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024848470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024848470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:49.988131 run osmo-stp_10.42.42.5(pid=14735): stdout: | (launched: 2022-12-09_02:48:48.276589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:50.119602 run osmo-stp_10.42.42.5(pid=14735): stderr: | 20221209024848469 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024848469 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024848469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024848470 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024848470 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024848470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024848470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:50.275238 run patchelf(pid=14738): Terminating (SIGINT) 02:48:50.454482 run patchelf(pid=14738): Terminated: ok {rc=0} 02:48:50.583147 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14735): Process ended prematurely: osmo-stp_10.42.42.5(pid=14735) [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14735)] [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 02:48:50.593139 tst iperf3.py:8: Test FAILED (7.7 sec) 02:48:50.621355 run osmo-hlr_10.42.42.2(pid=14732): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14732)] 02:48:50.670680 run osmo-hlr_10.42.42.2(pid=14732): stdout: | (launched: 2022-12-09_02:48:47.271087) 02:48:50.721716 run osmo-hlr_10.42.42.2(pid=14732): stderr: | 20221209024847467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024847467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024847467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024847467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024847467 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024847467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024847480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024847490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024847490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024847490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:50.773243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14727): Terminating (SIGTERM) 02:48:50.814540 run iperf3-srv_10.42.42.10(pid=14728): Terminating (SIGTERM) 02:48:50.855774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14731): Terminating (SIGTERM) 02:48:50.897135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14734): Terminating (SIGTERM) 02:48:50.938837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14737): Terminating (SIGTERM) 02:48:50.980448 --- ParallelTerminationStrategy: PID 14727 died... 02:48:51.000385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14727): Terminated: ok {rc=0} 02:48:51.046261 --- ParallelTerminationStrategy: PID 14728 died... 02:48:51.065773 run iperf3-srv_10.42.42.10(pid=14728): Terminated {rc=256} 02:48:51.111352 --- ParallelTerminationStrategy: PID 14731 died... 02:48:51.130817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14731): Terminated: ok {rc=0} 02:48:51.176172 --- ParallelTerminationStrategy: PID 14734 died... 02:48:51.195613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14734): Terminated: ok {rc=0} 02:48:51.242027 --- ParallelTerminationStrategy: PID 14737 died... 02:48:51.261609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14737): Terminated: ok {rc=0} 02:48:51.348862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:48:52.496934 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:52.508744 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:48:52.559817 tst iperf3m4.py: using LAC 18543 02:48:52.688419 tst iperf3m4.py: using RAC 183 02:48:52.815667 tst iperf3m4.py: using CellId 18543 02:48:52.934622 tst iperf3m4.py: using BVCI 18544 02:48:53.042983 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:53.054061 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:53.064780 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:53.076037 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:53.087185 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:53.098441 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:53.109764 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:53.120572 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:53.131676 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:53.252244 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:53.371259 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:53.492396 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:53.611618 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:48:53.828626 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:54.151443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14739): Launched 02:48:54.430381 run iperf3-srv_10.42.42.10(pid=14740): Launched 02:48:54.550251 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:48:54.767062 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:55.090754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14741): Launched 02:48:55.370056 run iperf3-srv_10.42.42.10(pid=14742): Launched 02:48:55.490519 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:48:55.708281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:56.031915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14743): Launched 02:48:56.310509 run iperf3-srv_10.42.42.10(pid=14744): Launched 02:48:56.430622 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:48:56.648401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:56.971914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14745): Launched 02:48:57.251056 run iperf3-srv_10.42.42.10(pid=14746): Launched 02:48:57.371120 tst iperf3m4.py:8: start network... 02:48:57.588754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:58.090926 run create_hlr_db(pid=14747): Launched 02:48:58.222136 bus /gobi_6: Setting Powered False 02:48:59.285699 run create_hlr_db(pid=14747): Terminated: ok {rc=0} 02:48:59.714805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14749): Launched 02:49:00.015733 run osmo-hlr_10.42.42.2(pid=14750): Launched 02:49:00.130269 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:00.653088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14752): Launched 02:49:00.989858 run osmo-stp_10.42.42.5(pid=14753): Launched 02:49:01.253351 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:01.950134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14755): Launched 02:49:02.080404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:02.343835 run patchelf(pid=14756): Launched 02:49:02.511195 run osmo-stp_10.42.42.5(pid=14753): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14753)] 02:49:02.638495 run osmo-stp_10.42.42.5(pid=14753): stdout: | (launched: 2022-12-09_02:49:00.919683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:02.767679 run osmo-stp_10.42.42.5(pid=14753): stderr: | 20221209024901302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024901302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024901303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024901305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024901306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024901306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024901306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:02.896723 run osmo-stp_10.42.42.5(pid=14753): stdout: | (launched: 2022-12-09_02:49:00.919683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:03.019920 run osmo-stp_10.42.42.5(pid=14753): stderr: | 20221209024901302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024901302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024901303 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024901305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024901306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024901306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024901306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:03.166325 run patchelf(pid=14756): Terminating (SIGINT) 02:49:03.335043 run patchelf(pid=14756): Terminated: ok {rc=0} 02:49:03.456566 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14753): Process ended prematurely: osmo-stp_10.42.42.5(pid=14753) [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14753)] [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 02:49:03.466320 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:49:03.494492 run osmo-hlr_10.42.42.2(pid=14750): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14750)] 02:49:03.542547 run osmo-hlr_10.42.42.2(pid=14750): stdout: | (launched: 2022-12-09_02:48:59.960586) 02:49:03.592232 run osmo-hlr_10.42.42.2(pid=14750): stderr: | 20221209024900135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024900135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024900135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024900135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024900135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024900135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024900149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024900159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024900159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024900159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:03.642117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14739): Terminating (SIGTERM) 02:49:03.682261 run iperf3-srv_10.42.42.10(pid=14740): Terminating (SIGTERM) 02:49:03.722192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14741): Terminating (SIGTERM) 02:49:03.762324 run iperf3-srv_10.42.42.10(pid=14742): Terminating (SIGTERM) 02:49:03.802143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14743): Terminating (SIGTERM) 02:49:03.842172 run iperf3-srv_10.42.42.10(pid=14744): Terminating (SIGTERM) 02:49:03.881892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14745): Terminating (SIGTERM) 02:49:03.921805 run iperf3-srv_10.42.42.10(pid=14746): Terminating (SIGTERM) 02:49:03.961551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14749): Terminating (SIGTERM) 02:49:04.001466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14752): Terminating (SIGTERM) 02:49:04.041339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14755): Terminating (SIGTERM) 02:49:04.081918 --- ParallelTerminationStrategy: PID 14739 died... 02:49:04.101116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14739): Terminated: ok {rc=0} 02:49:04.145326 --- ParallelTerminationStrategy: PID 14740 died... 02:49:04.163772 run iperf3-srv_10.42.42.10(pid=14740): Terminated {rc=256} 02:49:04.207983 --- ParallelTerminationStrategy: PID 14741 died... 02:49:04.226452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14741): Terminated: ok {rc=0} 02:49:04.270726 --- ParallelTerminationStrategy: PID 14742 died... 02:49:04.289281 run iperf3-srv_10.42.42.10(pid=14742): Terminated {rc=256} 02:49:04.333334 --- ParallelTerminationStrategy: PID 14743 died... 02:49:04.352028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14743): Terminated: ok {rc=0} 02:49:04.396430 --- ParallelTerminationStrategy: PID 14744 died... 02:49:04.414809 run iperf3-srv_10.42.42.10(pid=14744): Terminated {rc=256} 02:49:04.458817 --- ParallelTerminationStrategy: PID 14745 died... 02:49:04.477483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14745): Terminated: ok {rc=0} 02:49:04.521498 --- ParallelTerminationStrategy: PID 14746 died... 02:49:04.540091 run iperf3-srv_10.42.42.10(pid=14746): Terminated {rc=256} 02:49:04.584021 --- ParallelTerminationStrategy: PID 14749 died... 02:49:04.602763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14749): Terminated: ok {rc=0} 02:49:04.647602 --- ParallelTerminationStrategy: PID 14752 died... 02:49:04.666327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14752): Terminated: ok {rc=0} 02:49:04.710736 --- ParallelTerminationStrategy: PID 14755 died... 02:49:04.729399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14755): Terminated: ok {rc=0} 02:49:04.815761 bus /gobi_4: Setting Powered False 02:49:05.916255 bus /gobi_4: Setting Powered False 02:49:07.030285 bus /gobi_1: Setting Powered False 02:49:08.127351 bus /gobi_1: Setting Powered False 02:49:09.242439 bus /gobi_0: Setting Powered False 02:49:10.339473 bus /gobi_0: Setting Powered False 02:49:11.454565 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 02:49:12.556821 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:12.569246 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:49:12.620701 tst ping.py: using LAC 18544 02:49:12.746861 tst ping.py: using RAC 184 02:49:12.870571 tst ping.py: using CellId 18544 02:49:12.995278 tst ping.py: using BVCI 18545 02:49:13.110350 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:13.121805 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:13.133018 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:13.144169 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:13.155229 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:13.166651 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:13.177935 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:13.189182 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:49:13.304168 tst ping.py:19: start network... 02:49:13.502327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:13.960099 run create_hlr_db(pid=14759): Launched 02:49:14.073964 bus /gobi_6: Setting Powered False 02:49:15.133310 run create_hlr_db(pid=14759): Terminated: ok {rc=0} 02:49:15.566144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14761): Launched 02:49:15.903489 run osmo-hlr_10.42.42.2(pid=14762): Launched 02:49:16.081060 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:16.709763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14764): Launched 02:49:17.045662 run osmo-stp_10.42.42.5(pid=14765): Launched 02:49:17.318933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:17.865313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14767): Launched 02:49:17.986098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:18.253664 run patchelf(pid=14768): Launched 02:49:18.428364 run osmo-stp_10.42.42.5(pid=14765): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14765)] 02:49:18.561565 run osmo-stp_10.42.42.5(pid=14765): stdout: | (launched: 2022-12-09_02:49:16.974363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:18.696724 run osmo-stp_10.42.42.5(pid=14765): stderr: | 20221209024917201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024917201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024917201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024917202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024917202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024917202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024917202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:18.831966 run osmo-stp_10.42.42.5(pid=14765): stdout: | (launched: 2022-12-09_02:49:16.974363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:18.962234 run osmo-stp_10.42.42.5(pid=14765): stderr: | 20221209024917201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024917201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024917201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024917202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024917202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024917202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024917202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:19.116009 run patchelf(pid=14768): Terminating (SIGINT) 02:49:19.292472 run patchelf(pid=14768): Terminated: ok {rc=0} 02:49:19.419574 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14765): Process ended prematurely: osmo-stp_10.42.42.5(pid=14765) [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14765)] [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 02:49:19.428784 tst ping.py:22: Test FAILED (6.9 sec) 02:49:19.456438 run osmo-hlr_10.42.42.2(pid=14762): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14762)] 02:49:19.505878 run osmo-hlr_10.42.42.2(pid=14762): stdout: | (launched: 2022-12-09_02:49:15.825083) 02:49:19.556734 run osmo-hlr_10.42.42.2(pid=14762): stderr: | 20221209024916140 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024916140 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024916140 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024916140 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024916140 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024916140 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024916164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024916188 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024916189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024916189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:19.608087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14761): Terminating (SIGTERM) 02:49:19.649820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14764): Terminating (SIGTERM) 02:49:19.691515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14767): Terminating (SIGTERM) 02:49:19.733738 --- ParallelTerminationStrategy: PID 14761 died... 02:49:19.753712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14761): Terminated: ok {rc=0} 02:49:19.799785 --- ParallelTerminationStrategy: PID 14764 died... 02:49:19.819372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14764): Terminated: ok {rc=0} 02:49:19.865494 --- ParallelTerminationStrategy: PID 14767 died... 02:49:19.884896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14767): Terminated: ok {rc=0} 02:49:19.971610 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:49:21.059402 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:21.071762 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:49:21.123958 tst ping_idle_ping.py: using LAC 18545 02:49:21.242185 tst ping_idle_ping.py: using RAC 185 02:49:21.358286 tst ping_idle_ping.py: using CellId 18545 02:49:21.477082 tst ping_idle_ping.py: using BVCI 18546 02:49:21.586500 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:21.597609 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:21.608393 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:21.619800 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:21.630991 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:21.642485 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:21.654025 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:49:21.665490 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:49:21.785431 tst ping_idle_ping.py:24: start network... 02:49:22.000399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:22.496833 run create_hlr_db(pid=14769): Launched 02:49:22.627074 bus /gobi_6: Setting Powered False 02:49:23.690178 run create_hlr_db(pid=14769): Terminated: ok {rc=0} 02:49:24.116812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14771): Launched 02:49:24.413881 run osmo-hlr_10.42.42.2(pid=14772): Launched 02:49:24.527569 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:25.054358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14774): Launched 02:49:25.350118 run osmo-stp_10.42.42.5(pid=14775): Launched 02:49:25.462944 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:25.973502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14777): Launched 02:49:26.086780 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:26.336130 run patchelf(pid=14778): Launched 02:49:26.500759 run osmo-stp_10.42.42.5(pid=14775): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14775)] 02:49:26.625856 run osmo-stp_10.42.42.5(pid=14775): stdout: | (launched: 2022-12-09_02:49:25.294993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:26.752927 run osmo-stp_10.42.42.5(pid=14775): stderr: | 20221209024925464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024925464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024925464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024925465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024925465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024925465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024925465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:26.879870 run osmo-stp_10.42.42.5(pid=14775): stdout: | (launched: 2022-12-09_02:49:25.294993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:27.001215 run osmo-stp_10.42.42.5(pid=14775): stderr: | 20221209024925464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024925464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024925464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024925465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024925465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024925465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024925465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:27.144721 run patchelf(pid=14778): Terminating (SIGINT) 02:49:27.310796 run patchelf(pid=14778): Terminated: ok {rc=0} 02:49:27.430317 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14775): Process ended prematurely: osmo-stp_10.42.42.5(pid=14775) [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14775)] [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 02:49:27.439150 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:49:27.466204 run osmo-hlr_10.42.42.2(pid=14772): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14772)] 02:49:27.514207 run osmo-hlr_10.42.42.2(pid=14772): stdout: | (launched: 2022-12-09_02:49:24.359471) 02:49:27.563644 run osmo-hlr_10.42.42.2(pid=14772): stderr: | 20221209024924534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024924534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024924534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024924534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024924534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024924534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024924546 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024924555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024924555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024924555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:27.613609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14771): Terminating (SIGTERM) 02:49:27.653715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14774): Terminating (SIGTERM) 02:49:27.693838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14777): Terminating (SIGTERM) 02:49:27.734415 --- ParallelTerminationStrategy: PID 14771 died... 02:49:27.753746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14771): Terminated: ok {rc=0} 02:49:27.798697 --- ParallelTerminationStrategy: PID 14774 died... 02:49:27.817396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14774): Terminated: ok {rc=0} 02:49:27.861668 --- ParallelTerminationStrategy: PID 14777 died... 02:49:27.880484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14777): Terminated: ok {rc=0} 02:49:27.967018 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:49:29.268787 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:49:29.275078 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:49:29.308217 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:49:29.346781 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:49:29.432397 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:49:29.464677 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:49:29.503101 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:49:30.097494 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:49:30.150912 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.162560 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:49:30.233083 tst cs_paging_gprs_active.py: using LAC 18546 02:49:30.359534 tst cs_paging_gprs_active.py: using RAC 186 02:49:30.486421 tst cs_paging_gprs_active.py: using CellId 18546 02:49:30.605662 tst cs_paging_gprs_active.py: using BVCI 18547 02:49:30.717202 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.728085 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.739064 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.749988 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.760669 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.771987 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.783001 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.793905 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:30.804878 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:30.933361 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:31.055880 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:49:31.331621 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:31.671866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14782): Launched 02:49:31.980257 run iperf3-srv_10.42.42.10(pid=14783): Launched 02:49:32.115385 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:49:32.340371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:32.666047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14784): Launched 02:49:32.946692 run iperf3-srv_10.42.42.10(pid=14785): Launched 02:49:33.068923 tst cs_paging_gprs_active.py:38: start network... 02:49:33.287261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:33.787152 run create_hlr_db(pid=14786): Launched 02:49:33.918382 bus /gobi_6: Setting Powered False 02:49:34.983128 run create_hlr_db(pid=14786): Terminated: ok {rc=0} 02:49:35.432213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14788): Launched 02:49:35.754043 run osmo-hlr_10.42.42.2(pid=14789): Launched 02:49:35.877761 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:36.430406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14791): Launched 02:49:36.751121 run osmo-stp_10.42.42.5(pid=14792): Launched 02:49:36.873515 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:37.428298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14794): Launched 02:49:37.551198 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:37.829544 run patchelf(pid=14795): Launched 02:49:38.008873 run osmo-stp_10.42.42.5(pid=14792): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14792)] 02:49:38.144415 run osmo-stp_10.42.42.5(pid=14792): stdout: | (launched: 2022-12-09_02:49:36.692606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:38.281482 run osmo-stp_10.42.42.5(pid=14792): stderr: | 20221209024936882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024936882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024936882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024936883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024936883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024936883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024936884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:38.418655 run osmo-stp_10.42.42.5(pid=14792): stdout: | (launched: 2022-12-09_02:49:36.692606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:38.550355 run osmo-stp_10.42.42.5(pid=14792): stderr: | 20221209024936882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024936882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024936882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024936883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024936883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024936883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024936884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:38.706698 run patchelf(pid=14795): Terminating (SIGINT) 02:49:38.886432 run patchelf(pid=14795): Terminated: ok {rc=0} 02:49:39.016811 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14792): Process ended prematurely: osmo-stp_10.42.42.5(pid=14792) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14792)] [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:49:39.026824 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 02:49:39.054860 run osmo-hlr_10.42.42.2(pid=14789): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14789)] 02:49:39.103932 run osmo-hlr_10.42.42.2(pid=14789): stdout: | (launched: 2022-12-09_02:49:35.695477) 02:49:39.154878 run osmo-hlr_10.42.42.2(pid=14789): stderr: | 20221209024935893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024935893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024935893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024935893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024935893 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024935893 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024935905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024935913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024935914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024935914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:39.206142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14782): Terminating (SIGTERM) 02:49:39.247346 run iperf3-srv_10.42.42.10(pid=14783): Terminating (SIGTERM) 02:49:39.288289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14784): Terminating (SIGTERM) 02:49:39.329564 run iperf3-srv_10.42.42.10(pid=14785): Terminating (SIGTERM) 02:49:39.370567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14788): Terminating (SIGTERM) 02:49:39.411761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14791): Terminating (SIGTERM) 02:49:39.453186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14794): Terminating (SIGTERM) 02:49:39.494668 --- ParallelTerminationStrategy: PID 14782 died... 02:49:39.514214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14782): Terminated: ok {rc=0} 02:49:39.559758 --- ParallelTerminationStrategy: PID 14783 died... 02:49:39.579188 run iperf3-srv_10.42.42.10(pid=14783): Terminated {rc=256} 02:49:39.624312 --- ParallelTerminationStrategy: PID 14784 died... 02:49:39.643761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14784): Terminated: ok {rc=0} 02:49:39.689119 --- ParallelTerminationStrategy: PID 14785 died... 02:49:39.708381 run iperf3-srv_10.42.42.10(pid=14785): Terminated {rc=256} 02:49:39.753650 --- ParallelTerminationStrategy: PID 14788 died... 02:49:39.773073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14788): Terminated: ok {rc=0} 02:49:39.818635 --- ParallelTerminationStrategy: PID 14791 died... 02:49:39.837959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14791): Terminated: ok {rc=0} 02:49:39.883818 --- ParallelTerminationStrategy: PID 14794 died... 02:49:39.903582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14794): Terminated: ok {rc=0} 02:49:39.992081 bus /gobi_0: Setting Powered False 02:49:41.090898 bus /gobi_0: Setting Powered False 02:49:42.205107 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:49:43.351897 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:43.363934 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:49:43.434476 tst iperf3.py: using LAC 18547 02:49:43.566830 tst iperf3.py: using RAC 187 02:49:43.692559 tst iperf3.py: using CellId 18547 02:49:43.817150 tst iperf3.py: using BVCI 18548 02:49:43.934917 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:43.946342 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:43.957688 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:43.969216 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:43.980274 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:43.991481 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:44.002774 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:44.014014 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:44.025297 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:44.140054 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:49:44.343341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:44.645696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14796): Launched 02:49:44.906344 run iperf3-srv_10.42.42.10(pid=14797): Launched 02:49:45.019089 tst iperf3.py:8: start network... 02:49:45.220190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:45.683585 run create_hlr_db(pid=14798): Launched 02:49:45.798186 bus /gobi_6: Setting Powered False 02:49:46.878945 run create_hlr_db(pid=14798): Terminated: ok {rc=0} 02:49:47.387995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14800): Launched 02:49:47.686477 run osmo-hlr_10.42.42.2(pid=14801): Launched 02:49:47.800232 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:48.419169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14803): Launched 02:49:48.711867 run osmo-stp_10.42.42.5(pid=14804): Launched 02:49:48.823882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:49.332645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14806): Launched 02:49:49.444870 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:49.692863 run patchelf(pid=14807): Launched 02:49:49.856105 run osmo-stp_10.42.42.5(pid=14804): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14804)] 02:49:49.980756 run osmo-stp_10.42.42.5(pid=14804): stdout: | (launched: 2022-12-09_02:49:48.658272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:50.108432 run osmo-stp_10.42.42.5(pid=14804): stderr: | 20221209024948825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024948825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024948825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024948826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024948826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024948826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024948826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:50.234802 run osmo-stp_10.42.42.5(pid=14804): stdout: | (launched: 2022-12-09_02:49:48.658272) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:50.356215 run osmo-stp_10.42.42.5(pid=14804): stderr: | 20221209024948825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209024948825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209024948825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209024948826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209024948826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209024948826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209024948826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:50.500771 run patchelf(pid=14807): Terminating (SIGINT) 02:49:50.665325 run patchelf(pid=14807): Terminated: ok {rc=0} 02:49:50.783955 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14804): Process ended prematurely: osmo-stp_10.42.42.5(pid=14804) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14804)] [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 02:49:50.793273 tst iperf3.py:8: Test FAILED (7.5 sec) 02:49:50.819908 run osmo-hlr_10.42.42.2(pid=14801): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14801)] 02:49:50.866698 run osmo-hlr_10.42.42.2(pid=14801): stdout: | (launched: 2022-12-09_02:49:47.631861) 02:49:50.915131 run osmo-hlr_10.42.42.2(pid=14801): stderr: | 20221209024947806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209024947806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209024947807 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209024947807 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209024947807 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209024947807 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209024947820 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209024947830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209024947831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209024947831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:50.963981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14796): Terminating (SIGTERM) 02:49:51.003121 run iperf3-srv_10.42.42.10(pid=14797): Terminating (SIGTERM) 02:49:51.042459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14800): Terminating (SIGTERM) 02:49:51.081830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14803): Terminating (SIGTERM) 02:49:51.121253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14806): Terminating (SIGTERM) 02:49:51.160806 --- ParallelTerminationStrategy: PID 14796 died... 02:49:51.179414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14796): Terminated: ok {rc=0} 02:49:51.222899 --- ParallelTerminationStrategy: PID 14797 died... 02:49:51.241353 run iperf3-srv_10.42.42.10(pid=14797): Terminated {rc=256} 02:49:51.284477 --- ParallelTerminationStrategy: PID 14800 died... 02:49:51.302969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14800): Terminated: ok {rc=0} 02:49:51.346108 --- ParallelTerminationStrategy: PID 14803 died... 02:49:51.364337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14803): Terminated: ok {rc=0} 02:49:51.407877 --- ParallelTerminationStrategy: PID 14806 died... 02:49:51.426140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14806): Terminated: ok {rc=0} 02:49:51.509988 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:49:52.657697 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:52.669545 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:49:52.740791 tst iperf3m4.py: using LAC 18548 02:49:52.857976 tst iperf3m4.py: using RAC 188 02:49:52.975365 tst iperf3m4.py: using CellId 18548 02:49:53.100242 tst iperf3m4.py: using BVCI 18549 02:49:53.217294 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:53.228586 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:53.239773 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:53.250805 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:53.261814 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:53.272786 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:53.283881 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:53.294816 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:53.306044 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:53.419445 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:53.539254 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:53.654125 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:53.773295 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:49:53.988716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:54.307482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14808): Launched 02:49:54.581569 run iperf3-srv_10.42.42.10(pid=14809): Launched 02:49:54.699348 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:49:54.911105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:55.227696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14810): Launched 02:49:55.501240 run iperf3-srv_10.42.42.10(pid=14811): Launched 02:49:55.619230 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:49:55.831581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:56.149948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14812): Launched 02:49:56.423752 run iperf3-srv_10.42.42.10(pid=14813): Launched 02:49:56.542049 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:49:56.755567 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:57.074772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14814): Launched 02:49:57.348836 run iperf3-srv_10.42.42.10(pid=14815): Launched 02:49:57.466859 tst iperf3m4.py:8: start network... 02:49:57.679080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:58.172836 run create_hlr_db(pid=14816): Launched 02:49:58.300737 bus /gobi_6: Setting Powered False 02:49:59.364021 run create_hlr_db(pid=14816): Terminated: ok {rc=0} 02:49:59.786570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14818): Launched 02:50:00.082658 run osmo-hlr_10.42.42.2(pid=14819): Launched 02:50:00.195451 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:00.716433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14821): Launched 02:50:01.029697 run osmo-stp_10.42.42.5(pid=14822): Launched 02:50:01.188123 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:01.756419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14827): Launched 02:50:01.875451 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:02.133963 run patchelf(pid=14828): Launched 02:50:02.315384 run osmo-stp_10.42.42.5(pid=14822): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14822)] 02:50:02.444329 run osmo-stp_10.42.42.5(pid=14822): stdout: | (launched: 2022-12-09_02:50:00.960567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:02.572274 run osmo-stp_10.42.42.5(pid=14822): stderr: | 20221209025001319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025001319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025001319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025001320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025001320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025001320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025001320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:02.700541 run osmo-stp_10.42.42.5(pid=14822): stdout: | (launched: 2022-12-09_02:50:00.960567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:02.822387 run osmo-stp_10.42.42.5(pid=14822): stderr: | 20221209025001319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025001319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025001319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025001320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025001320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025001320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025001320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:02.966728 run patchelf(pid=14828): Terminating (SIGINT) 02:50:03.133390 run patchelf(pid=14828): Terminated: ok {rc=0} 02:50:03.253163 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14822): Process ended prematurely: osmo-stp_10.42.42.5(pid=14822) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14822)] [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:50:03.262923 tst iperf3m4.py:8: Test FAILED (10.6 sec) 02:50:03.291128 run osmo-hlr_10.42.42.2(pid=14819): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14819)] 02:50:03.339596 run osmo-hlr_10.42.42.2(pid=14819): stdout: | (launched: 2022-12-09_02:50:00.028646) 02:50:03.389279 run osmo-hlr_10.42.42.2(pid=14819): stderr: | 20221209025000201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025000201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025000201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025000201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025000201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025000201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025000213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025000222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025000222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025000223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:03.439419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14808): Terminating (SIGTERM) 02:50:03.480092 run iperf3-srv_10.42.42.10(pid=14809): Terminating (SIGTERM) 02:50:03.520538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14810): Terminating (SIGTERM) 02:50:03.561103 run iperf3-srv_10.42.42.10(pid=14811): Terminating (SIGTERM) 02:50:03.601526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14812): Terminating (SIGTERM) 02:50:03.641740 run iperf3-srv_10.42.42.10(pid=14813): Terminating (SIGTERM) 02:50:03.681828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14814): Terminating (SIGTERM) 02:50:03.722059 run iperf3-srv_10.42.42.10(pid=14815): Terminating (SIGTERM) 02:50:03.762215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14818): Terminating (SIGTERM) 02:50:03.802482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14821): Terminating (SIGTERM) 02:50:03.842687 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14827): Terminating (SIGTERM) 02:50:03.883143 --- ParallelTerminationStrategy: PID 14808 died... 02:50:03.901909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14808): Terminated: ok {rc=0} 02:50:03.946656 --- ParallelTerminationStrategy: PID 14809 died... 02:50:03.965110 run iperf3-srv_10.42.42.10(pid=14809): Terminated {rc=256} 02:50:04.009518 --- ParallelTerminationStrategy: PID 14810 died... 02:50:04.028010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14810): Terminated: ok {rc=0} 02:50:04.072581 --- ParallelTerminationStrategy: PID 14811 died... 02:50:04.091114 run iperf3-srv_10.42.42.10(pid=14811): Terminated {rc=256} 02:50:04.135329 --- ParallelTerminationStrategy: PID 14812 died... 02:50:04.153979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14812): Terminated: ok {rc=0} 02:50:04.198251 --- ParallelTerminationStrategy: PID 14813 died... 02:50:04.216782 run iperf3-srv_10.42.42.10(pid=14813): Terminated {rc=256} 02:50:04.261141 --- ParallelTerminationStrategy: PID 14814 died... 02:50:04.279754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14814): Terminated: ok {rc=0} 02:50:04.324174 --- ParallelTerminationStrategy: PID 14815 died... 02:50:04.342843 run iperf3-srv_10.42.42.10(pid=14815): Terminated {rc=256} 02:50:04.387270 --- ParallelTerminationStrategy: PID 14818 died... 02:50:04.405885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14818): Terminated: ok {rc=0} 02:50:04.450578 --- ParallelTerminationStrategy: PID 14821 died... 02:50:04.469254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14821): Terminated: ok {rc=0} 02:50:04.513812 --- ParallelTerminationStrategy: PID 14827 died... 02:50:04.532578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14827): Terminated: ok {rc=0} 02:50:04.619729 bus /gobi_4: Setting Powered False 02:50:05.718037 bus /gobi_4: Setting Powered False 02:50:06.832583 bus /gobi_1: Setting Powered False 02:50:07.929821 bus /gobi_1: Setting Powered False 02:50:09.045521 bus /gobi_0: Setting Powered False 02:50:10.143364 bus /gobi_0: Setting Powered False 02:50:11.258938 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:50:12.360270 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:12.371770 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:50:12.443699 tst ping.py: using LAC 18549 02:50:12.558752 tst ping.py: using RAC 189 02:50:12.671817 tst ping.py: using CellId 18549 02:50:12.794256 tst ping.py: using BVCI 18550 02:50:12.909814 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:12.921404 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:12.932535 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:12.944027 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:12.955424 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:12.967029 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:12.978755 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:12.990161 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:50:13.107176 tst ping.py:19: start network... 02:50:13.302229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:13.757075 run create_hlr_db(pid=14829): Launched 02:50:13.868837 bus /gobi_6: Setting Powered False 02:50:14.927833 run create_hlr_db(pid=14829): Terminated: ok {rc=0} 02:50:15.355159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14831): Launched 02:50:15.666521 run osmo-hlr_10.42.42.2(pid=14832): Launched 02:50:15.785981 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:16.495854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14834): Launched 02:50:16.829775 run osmo-stp_10.42.42.5(pid=14835): Launched 02:50:16.970074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:17.610338 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14837): Launched 02:50:17.729734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:17.994248 run patchelf(pid=14838): Launched 02:50:18.168788 run osmo-stp_10.42.42.5(pid=14835): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14835)] 02:50:18.301190 run osmo-stp_10.42.42.5(pid=14835): stdout: | (launched: 2022-12-09_02:50:16.765320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:18.435320 run osmo-stp_10.42.42.5(pid=14835): stderr: | 20221209025017140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025017140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025017149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025017150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025017150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025017150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025017150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:18.570545 run osmo-stp_10.42.42.5(pid=14835): stdout: | (launched: 2022-12-09_02:50:16.765320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:18.699717 run osmo-stp_10.42.42.5(pid=14835): stderr: | 20221209025017140 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025017140 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025017149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025017150 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025017150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025017150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025017150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:18.852419 run patchelf(pid=14838): Terminating (SIGINT) 02:50:19.027686 run patchelf(pid=14838): Terminated: ok {rc=0} 02:50:19.154189 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14835): Process ended prematurely: osmo-stp_10.42.42.5(pid=14835) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14835)] [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 02:50:19.163630 tst ping.py:22: Test FAILED (6.8 sec) 02:50:19.191434 run osmo-hlr_10.42.42.2(pid=14832): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14832)] 02:50:19.240930 run osmo-hlr_10.42.42.2(pid=14832): stdout: | (launched: 2022-12-09_02:50:15.609702) 02:50:19.292367 run osmo-hlr_10.42.42.2(pid=14832): stderr: | 20221209025015806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025015806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025015806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025015806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025015806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025015806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025015819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025015830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025015830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025015830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:19.344274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14831): Terminating (SIGTERM) 02:50:19.386061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14834): Terminating (SIGTERM) 02:50:19.427900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14837): Terminating (SIGTERM) 02:50:19.469926 --- ParallelTerminationStrategy: PID 14831 died... 02:50:19.489856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14831): Terminated: ok {rc=0} 02:50:19.536241 --- ParallelTerminationStrategy: PID 14834 died... 02:50:19.555650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14834): Terminated: ok {rc=0} 02:50:19.601808 --- ParallelTerminationStrategy: PID 14837 died... 02:50:19.621298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14837): Terminated: ok {rc=0} 02:50:19.707507 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:50:20.795734 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:20.808199 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:50:20.883371 tst ping_idle_ping.py: using LAC 18550 02:50:20.998343 tst ping_idle_ping.py: using RAC 190 02:50:21.117467 tst ping_idle_ping.py: using CellId 18550 02:50:21.241817 tst ping_idle_ping.py: using BVCI 18551 02:50:21.356372 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:21.368064 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:21.379556 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:21.391208 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:21.402837 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:21.414496 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:21.426296 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:50:21.437733 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:50:21.554968 tst ping_idle_ping.py:24: start network... 02:50:21.764621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:22.249857 run create_hlr_db(pid=14839): Launched 02:50:22.376135 bus /gobi_6: Setting Powered False 02:50:23.437593 run create_hlr_db(pid=14839): Terminated: ok {rc=0} 02:50:23.854702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14841): Launched 02:50:24.144853 run osmo-hlr_10.42.42.2(pid=14842): Launched 02:50:24.256679 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:24.772800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14844): Launched 02:50:25.065422 run osmo-stp_10.42.42.5(pid=14845): Launched 02:50:25.177483 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:25.681496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14847): Launched 02:50:25.793411 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:26.040534 run patchelf(pid=14848): Launched 02:50:26.202597 run osmo-stp_10.42.42.5(pid=14845): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14845)] 02:50:26.326797 run osmo-stp_10.42.42.5(pid=14845): stdout: | (launched: 2022-12-09_02:50:25.012191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:26.452667 run osmo-stp_10.42.42.5(pid=14845): stderr: | 20221209025025180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025025180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025025180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025025181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025025181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025025181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025025181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:26.579324 run osmo-stp_10.42.42.5(pid=14845): stdout: | (launched: 2022-12-09_02:50:25.012191) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:26.699900 run osmo-stp_10.42.42.5(pid=14845): stderr: | 20221209025025180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025025180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025025180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025025181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025025181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025025181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025025181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:26.842896 run patchelf(pid=14848): Terminating (SIGINT) 02:50:27.008119 run patchelf(pid=14848): Terminated: ok {rc=0} 02:50:27.126921 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14845): Process ended prematurely: osmo-stp_10.42.42.5(pid=14845) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14845)] [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:50:27.135699 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 02:50:27.162219 run osmo-hlr_10.42.42.2(pid=14842): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14842)] 02:50:27.210529 run osmo-hlr_10.42.42.2(pid=14842): stdout: | (launched: 2022-12-09_02:50:24.091573) 02:50:27.260027 run osmo-hlr_10.42.42.2(pid=14842): stderr: | 20221209025024267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025024268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025024268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025024268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025024268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025024268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025024285 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025024295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025024295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025024295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:27.309456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14841): Terminating (SIGTERM) 02:50:27.349110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14844): Terminating (SIGTERM) 02:50:27.388699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14847): Terminating (SIGTERM) 02:50:27.428514 --- ParallelTerminationStrategy: PID 14841 died... 02:50:27.447464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14841): Terminated: ok {rc=0} 02:50:27.491939 --- ParallelTerminationStrategy: PID 14844 died... 02:50:27.510421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14844): Terminated: ok {rc=0} 02:50:27.554737 --- ParallelTerminationStrategy: PID 14847 died... 02:50:27.573384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14847): Terminated: ok {rc=0} 02:50:27.659465 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:50:28.963420 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:50:28.969700 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:50:29.002592 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:50:29.041952 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:50:29.126350 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:50:29.158627 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:50:29.197396 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:50:29.792721 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:50:29.841963 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:29.853051 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:50:29.920797 tst cs_paging_gprs_active.py: using LAC 18551 02:50:30.035916 tst cs_paging_gprs_active.py: using RAC 191 02:50:30.153347 tst cs_paging_gprs_active.py: using CellId 18551 02:50:30.268850 tst cs_paging_gprs_active.py: using BVCI 18552 02:50:30.376659 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:30.387590 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:30.398377 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:30.409760 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:30.420875 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:30.432207 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:30.443570 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:30.454887 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:30.466319 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:30.586473 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:30.705743 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:50:30.923015 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:31.295528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14853): Launched 02:50:31.586266 run iperf3-srv_10.42.42.10(pid=14854): Launched 02:50:31.759919 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:50:31.982810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:32.291975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14855): Launched 02:50:32.563820 run iperf3-srv_10.42.42.10(pid=14856): Launched 02:50:32.676040 tst cs_paging_gprs_active.py:38: start network... 02:50:32.875258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:33.335713 run create_hlr_db(pid=14857): Launched 02:50:33.448357 bus /gobi_6: Setting Powered False 02:50:34.506887 run create_hlr_db(pid=14857): Terminated: ok {rc=0} 02:50:34.941690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14859): Launched 02:50:35.239134 run osmo-hlr_10.42.42.2(pid=14860): Launched 02:50:35.352428 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:35.877986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14862): Launched 02:50:36.174814 run osmo-stp_10.42.42.5(pid=14863): Launched 02:50:36.287881 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:36.799213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14865): Launched 02:50:36.912940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:37.165419 run patchelf(pid=14866): Launched 02:50:37.330003 run osmo-stp_10.42.42.5(pid=14863): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14863)] 02:50:37.455639 run osmo-stp_10.42.42.5(pid=14863): stdout: | (launched: 2022-12-09_02:50:36.120683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:37.583044 run osmo-stp_10.42.42.5(pid=14863): stderr: | 20221209025036287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025036288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025036288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025036288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025036289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025036289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025036289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:37.710221 run osmo-stp_10.42.42.5(pid=14863): stdout: | (launched: 2022-12-09_02:50:36.120683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:37.832385 run osmo-stp_10.42.42.5(pid=14863): stderr: | 20221209025036287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025036288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025036288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025036288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025036289 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025036289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025036289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:37.977294 run patchelf(pid=14866): Terminating (SIGINT) 02:50:38.145079 run patchelf(pid=14866): Terminated: ok {rc=0} 02:50:38.265581 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14863): Process ended prematurely: osmo-stp_10.42.42.5(pid=14863) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14863)] [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:50:38.275140 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:50:38.302925 run osmo-hlr_10.42.42.2(pid=14860): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14860)] 02:50:38.350916 run osmo-hlr_10.42.42.2(pid=14860): stdout: | (launched: 2022-12-09_02:50:35.184740) 02:50:38.400053 run osmo-hlr_10.42.42.2(pid=14860): stderr: | 20221209025035360 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025035360 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025035360 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025035360 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025035360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025035360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025035373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025035381 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025035381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025035381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:38.449088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14853): Terminating (SIGTERM) 02:50:38.489380 run iperf3-srv_10.42.42.10(pid=14854): Terminating (SIGTERM) 02:50:38.529058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14855): Terminating (SIGTERM) 02:50:38.568874 run iperf3-srv_10.42.42.10(pid=14856): Terminating (SIGTERM) 02:50:38.608416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14859): Terminating (SIGTERM) 02:50:38.647991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14862): Terminating (SIGTERM) 02:50:38.687619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14865): Terminating (SIGTERM) 02:50:38.727684 --- ParallelTerminationStrategy: PID 14853 died... 02:50:38.746639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14853): Terminated: ok {rc=0} 02:50:38.791149 --- ParallelTerminationStrategy: PID 14854 died... 02:50:38.809615 run iperf3-srv_10.42.42.10(pid=14854): Terminated {rc=256} 02:50:38.854011 --- ParallelTerminationStrategy: PID 14855 died... 02:50:38.872356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14855): Terminated: ok {rc=0} 02:50:38.916303 --- ParallelTerminationStrategy: PID 14856 died... 02:50:38.934774 run iperf3-srv_10.42.42.10(pid=14856): Terminated {rc=256} 02:50:38.978430 --- ParallelTerminationStrategy: PID 14859 died... 02:50:38.997051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14859): Terminated: ok {rc=0} 02:50:39.041128 --- ParallelTerminationStrategy: PID 14862 died... 02:50:39.059639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14862): Terminated: ok {rc=0} 02:50:39.103702 --- ParallelTerminationStrategy: PID 14865 died... 02:50:39.122222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14865): Terminated: ok {rc=0} 02:50:39.207638 bus /gobi_0: Setting Powered False 02:50:40.305849 bus /gobi_0: Setting Powered False 02:50:41.420659 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:50:42.565938 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:42.577550 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:50:42.646840 tst iperf3.py: using LAC 18552 02:50:42.766654 tst iperf3.py: using RAC 192 02:50:42.884141 tst iperf3.py: using CellId 18552 02:50:42.999995 tst iperf3.py: using BVCI 18553 02:50:43.118771 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:43.130360 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:43.141780 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:43.153766 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:43.165490 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:43.177380 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:43.189363 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:43.201256 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:43.213157 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:43.330081 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:50:43.529762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:43.828103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14867): Launched 02:50:44.086878 run iperf3-srv_10.42.42.10(pid=14868): Launched 02:50:44.199013 tst iperf3.py:8: start network... 02:50:44.398438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:44.857946 run create_hlr_db(pid=14869): Launched 02:50:44.971914 bus /gobi_6: Setting Powered False 02:50:46.035163 run create_hlr_db(pid=14869): Terminated: ok {rc=0} 02:50:46.496321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14871): Launched 02:50:46.837567 run osmo-hlr_10.42.42.2(pid=14872): Launched 02:50:47.085312 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:47.604917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14874): Launched 02:50:47.901283 run osmo-stp_10.42.42.5(pid=14875): Launched 02:50:48.015056 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:48.528504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14877): Launched 02:50:48.642847 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:48.894099 run patchelf(pid=14878): Launched 02:50:49.058841 run osmo-stp_10.42.42.5(pid=14875): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14875)] 02:50:49.184821 run osmo-stp_10.42.42.5(pid=14875): stdout: | (launched: 2022-12-09_02:50:47.847312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:49.312487 run osmo-stp_10.42.42.5(pid=14875): stderr: | 20221209025048015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025048015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025048016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025048016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025048018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025048019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025048019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:49.440159 run osmo-stp_10.42.42.5(pid=14875): stdout: | (launched: 2022-12-09_02:50:47.847312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:49.562316 run osmo-stp_10.42.42.5(pid=14875): stderr: | 20221209025048015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025048015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025048016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025048016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025048018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025048019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025048019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:49.707589 run patchelf(pid=14878): Terminating (SIGINT) 02:50:49.874984 run patchelf(pid=14878): Terminated: ok {rc=0} 02:50:49.995785 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14875): Process ended prematurely: osmo-stp_10.42.42.5(pid=14875) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14875)] [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 02:50:50.005317 tst iperf3.py:8: Test FAILED (7.5 sec) 02:50:50.033099 run osmo-hlr_10.42.42.2(pid=14872): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14872)] 02:50:50.081374 run osmo-hlr_10.42.42.2(pid=14872): stdout: | (launched: 2022-12-09_02:50:46.775316) 02:50:50.131719 run osmo-hlr_10.42.42.2(pid=14872): stderr: | 20221209025047090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025047090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025047090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025047090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025047090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025047090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025047107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025047118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025047119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025047119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:50.181966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14867): Terminating (SIGTERM) 02:50:50.222345 run iperf3-srv_10.42.42.10(pid=14868): Terminating (SIGTERM) 02:50:50.262109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14871): Terminating (SIGTERM) 02:50:50.301795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14874): Terminating (SIGTERM) 02:50:50.341894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14877): Terminating (SIGTERM) 02:50:50.382401 --- ParallelTerminationStrategy: PID 14867 died... 02:50:50.401512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14867): Terminated: ok {rc=0} 02:50:50.446553 --- ParallelTerminationStrategy: PID 14868 died... 02:50:50.465151 run iperf3-srv_10.42.42.10(pid=14868): Terminated {rc=256} 02:50:50.509563 --- ParallelTerminationStrategy: PID 14871 died... 02:50:50.528120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14871): Terminated: ok {rc=0} 02:50:50.572718 --- ParallelTerminationStrategy: PID 14874 died... 02:50:50.591266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14874): Terminated: ok {rc=0} 02:50:50.635650 --- ParallelTerminationStrategy: PID 14877 died... 02:50:50.654252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14877): Terminated: ok {rc=0} 02:50:50.740072 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:50:51.885480 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:51.896993 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:50:51.967616 tst iperf3m4.py: using LAC 18553 02:50:52.085359 tst iperf3m4.py: using RAC 193 02:50:52.212734 tst iperf3m4.py: using CellId 18553 02:50:52.341044 tst iperf3m4.py: using BVCI 18554 02:50:52.459084 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:52.470693 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:52.482012 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:52.493383 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:52.504291 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:52.515451 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:52.526810 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:52.537903 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:52.549208 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:52.668662 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:52.786075 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:52.901686 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:53.016762 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:50:53.214639 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:53.511129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14879): Launched 02:50:53.768710 run iperf3-srv_10.42.42.10(pid=14880): Launched 02:50:53.879957 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:50:54.078571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:54.375868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14881): Launched 02:50:54.633359 run iperf3-srv_10.42.42.10(pid=14882): Launched 02:50:54.744447 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:50:54.942283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:55.239507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14883): Launched 02:50:55.496224 run iperf3-srv_10.42.42.10(pid=14884): Launched 02:50:55.607251 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:50:55.805243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:56.102645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14885): Launched 02:50:56.359679 run iperf3-srv_10.42.42.10(pid=14886): Launched 02:50:56.471064 tst iperf3m4.py:8: start network... 02:50:56.669499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:57.129765 run create_hlr_db(pid=14887): Launched 02:50:57.243394 bus /gobi_6: Setting Powered False 02:50:58.302943 run create_hlr_db(pid=14887): Terminated: ok {rc=0} 02:50:58.717449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14889): Launched 02:50:59.014803 run osmo-hlr_10.42.42.2(pid=14890): Launched 02:50:59.128001 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:59.650886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14892): Launched 02:50:59.946622 run osmo-stp_10.42.42.5(pid=14893): Launched 02:51:00.059610 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:00.571165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14895): Launched 02:51:00.684092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:00.970717 run patchelf(pid=14896): Launched 02:51:01.157664 run osmo-stp_10.42.42.5(pid=14893): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14893)] 02:51:01.294814 run osmo-stp_10.42.42.5(pid=14893): stdout: | (launched: 2022-12-09_02:50:59.892618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:01.434984 run osmo-stp_10.42.42.5(pid=14893): stderr: | 20221209025100056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025100056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025100056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025100057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025100057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025100057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025100057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:01.575898 run osmo-stp_10.42.42.5(pid=14893): stdout: | (launched: 2022-12-09_02:50:59.892618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:01.710780 run osmo-stp_10.42.42.5(pid=14893): stderr: | 20221209025100056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025100056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025100056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025100057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025100057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025100057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025100057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:01.870026 run patchelf(pid=14896): Terminating (SIGINT) 02:51:02.076608 run patchelf(pid=14896): Terminated: ok {rc=0} 02:51:02.216122 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14893): Process ended prematurely: osmo-stp_10.42.42.5(pid=14893) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14893)] [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:51:02.230235 tst iperf3m4.py:8: Test FAILED (10.4 sec) 02:51:02.268822 run osmo-hlr_10.42.42.2(pid=14890): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14890)] 02:51:02.320711 run osmo-hlr_10.42.42.2(pid=14890): stdout: | (launched: 2022-12-09_02:50:58.960324) 02:51:02.373080 run osmo-hlr_10.42.42.2(pid=14890): stderr: | 20221209025059132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025059132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025059132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025059132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025059132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025059132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025059144 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025059153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025059153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025059153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:02.425370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14879): Terminating (SIGTERM) 02:51:02.466247 run iperf3-srv_10.42.42.10(pid=14880): Terminating (SIGTERM) 02:51:02.507172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14881): Terminating (SIGTERM) 02:51:02.548077 run iperf3-srv_10.42.42.10(pid=14882): Terminating (SIGTERM) 02:51:02.588718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14883): Terminating (SIGTERM) 02:51:02.629413 run iperf3-srv_10.42.42.10(pid=14884): Terminating (SIGTERM) 02:51:02.669648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14885): Terminating (SIGTERM) 02:51:02.710150 run iperf3-srv_10.42.42.10(pid=14886): Terminating (SIGTERM) 02:51:02.750370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14889): Terminating (SIGTERM) 02:51:02.790238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14892): Terminating (SIGTERM) 02:51:02.830013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14895): Terminating (SIGTERM) 02:51:02.870170 --- ParallelTerminationStrategy: PID 14879 died... 02:51:02.888685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14879): Terminated: ok {rc=0} 02:51:02.933240 --- ParallelTerminationStrategy: PID 14880 died... 02:51:02.951656 run iperf3-srv_10.42.42.10(pid=14880): Terminated {rc=256} 02:51:02.996242 --- ParallelTerminationStrategy: PID 14881 died... 02:51:03.014983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14881): Terminated: ok {rc=0} 02:51:03.059356 --- ParallelTerminationStrategy: PID 14882 died... 02:51:03.077889 run iperf3-srv_10.42.42.10(pid=14882): Terminated {rc=256} 02:51:03.122292 --- ParallelTerminationStrategy: PID 14883 died... 02:51:03.141111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14883): Terminated: ok {rc=0} 02:51:03.185242 --- ParallelTerminationStrategy: PID 14884 died... 02:51:03.203812 run iperf3-srv_10.42.42.10(pid=14884): Terminated {rc=256} 02:51:03.248204 --- ParallelTerminationStrategy: PID 14885 died... 02:51:03.266973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14885): Terminated: ok {rc=0} 02:51:03.311303 --- ParallelTerminationStrategy: PID 14886 died... 02:51:03.329963 run iperf3-srv_10.42.42.10(pid=14886): Terminated {rc=256} 02:51:03.373874 --- ParallelTerminationStrategy: PID 14889 died... 02:51:03.392402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14889): Terminated: ok {rc=0} 02:51:03.436904 --- ParallelTerminationStrategy: PID 14892 died... 02:51:03.455569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14892): Terminated: ok {rc=0} 02:51:03.500013 --- ParallelTerminationStrategy: PID 14895 died... 02:51:03.518863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14895): Terminated: ok {rc=0} 02:51:03.604323 bus /gobi_4: Setting Powered False 02:51:04.702362 bus /gobi_4: Setting Powered False 02:51:05.814997 bus /gobi_1: Setting Powered False 02:51:06.910773 bus /gobi_1: Setting Powered False 02:51:08.026896 bus /gobi_0: Setting Powered False 02:51:09.127100 bus /gobi_0: Setting Powered False 02:51:10.243345 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:51:11.345455 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:11.356877 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:51:11.430132 tst ping.py: using LAC 18554 02:51:11.544203 tst ping.py: using RAC 194 02:51:11.657354 tst ping.py: using CellId 18554 02:51:11.770231 tst ping.py: using BVCI 18555 02:51:11.875593 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:11.886671 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:11.897596 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:11.908554 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:11.919811 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:11.930902 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:11.942021 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:11.953070 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:51:12.066568 tst ping.py:19: start network... 02:51:12.260133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:12.712546 run create_hlr_db(pid=14897): Launched 02:51:12.840356 bus /gobi_6: Setting Powered False 02:51:13.902637 run create_hlr_db(pid=14897): Terminated: ok {rc=0} 02:51:14.339453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14899): Launched 02:51:14.651506 run osmo-hlr_10.42.42.2(pid=14900): Launched 02:51:14.770411 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:15.313898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14902): Launched 02:51:15.624314 run osmo-stp_10.42.42.5(pid=14903): Launched 02:51:15.742593 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:16.344172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14905): Launched 02:51:16.463378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:16.726209 run patchelf(pid=14906): Launched 02:51:16.907464 run osmo-stp_10.42.42.5(pid=14903): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14903)] 02:51:17.036076 run osmo-stp_10.42.42.5(pid=14903): stdout: | (launched: 2022-12-09_02:51:15.567593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:17.168041 run osmo-stp_10.42.42.5(pid=14903): stderr: | 20221209025115759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025115759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025115760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025115760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025115761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025115761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025115761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:17.295453 run osmo-stp_10.42.42.5(pid=14903): stdout: | (launched: 2022-12-09_02:51:15.567593) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:17.416143 run osmo-stp_10.42.42.5(pid=14903): stderr: | 20221209025115759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025115759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025115760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025115760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025115761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025115761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025115761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:17.558756 run patchelf(pid=14906): Terminating (SIGINT) 02:51:17.723609 run patchelf(pid=14906): Terminated: ok {rc=0} 02:51:17.842826 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14903): Process ended prematurely: osmo-stp_10.42.42.5(pid=14903) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14903)] [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 02:51:17.851886 tst ping.py:22: Test FAILED (6.5 sec) 02:51:17.879384 run osmo-hlr_10.42.42.2(pid=14900): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14900)] 02:51:17.926633 run osmo-hlr_10.42.42.2(pid=14900): stdout: | (launched: 2022-12-09_02:51:14.594002) 02:51:17.976554 run osmo-hlr_10.42.42.2(pid=14900): stderr: | 20221209025114791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025114792 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025114792 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025114792 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025114792 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025114792 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025114804 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025114812 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025114813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025114813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:18.026270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14899): Terminating (SIGTERM) 02:51:18.066233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14902): Terminating (SIGTERM) 02:51:18.106324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14905): Terminating (SIGTERM) 02:51:18.147952 --- ParallelTerminationStrategy: PID 14899 died... 02:51:18.167651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14899): Terminated: ok {rc=0} 02:51:18.212941 --- ParallelTerminationStrategy: PID 14902 died... 02:51:18.231878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14902): Terminated: ok {rc=0} 02:51:18.275869 --- ParallelTerminationStrategy: PID 14905 died... 02:51:18.294736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14905): Terminated: ok {rc=0} 02:51:18.380767 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:51:19.467898 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:19.479520 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:51:19.551803 tst ping_idle_ping.py: using LAC 18555 02:51:19.667401 tst ping_idle_ping.py: using RAC 195 02:51:19.781472 tst ping_idle_ping.py: using CellId 18555 02:51:19.895781 tst ping_idle_ping.py: using BVCI 18556 02:51:20.011510 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:20.023610 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:20.035319 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:20.047003 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:20.058533 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:20.070410 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:20.082069 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:51:20.093651 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:51:20.206767 tst ping_idle_ping.py:24: start network... 02:51:20.401209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:20.853304 run create_hlr_db(pid=14907): Launched 02:51:20.964205 bus /gobi_6: Setting Powered False 02:51:22.022843 run create_hlr_db(pid=14907): Terminated: ok {rc=0} 02:51:22.451870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14909): Launched 02:51:22.765731 run osmo-hlr_10.42.42.2(pid=14910): Launched 02:51:22.885650 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:23.427674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14912): Launched 02:51:23.742149 run osmo-stp_10.42.42.5(pid=14913): Launched 02:51:23.862036 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:24.395918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14915): Launched 02:51:24.507550 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:24.755349 run patchelf(pid=14916): Launched 02:51:24.919237 run osmo-stp_10.42.42.5(pid=14913): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14913)] 02:51:25.043903 run osmo-stp_10.42.42.5(pid=14913): stdout: | (launched: 2022-12-09_02:51:23.685099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:25.170209 run osmo-stp_10.42.42.5(pid=14913): stderr: | 20221209025123873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025123873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025123873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025123874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025123876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025123876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025123876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:25.296726 run osmo-stp_10.42.42.5(pid=14913): stdout: | (launched: 2022-12-09_02:51:23.685099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:25.418099 run osmo-stp_10.42.42.5(pid=14913): stderr: | 20221209025123873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025123873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025123873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025123874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025123876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025123876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025123876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:25.561552 run patchelf(pid=14916): Terminating (SIGINT) 02:51:25.726370 run patchelf(pid=14916): Terminated: ok {rc=0} 02:51:25.845327 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14913): Process ended prematurely: osmo-stp_10.42.42.5(pid=14913) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14913)] [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:51:25.854557 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:51:25.882126 run osmo-hlr_10.42.42.2(pid=14910): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14910)] 02:51:25.930309 run osmo-hlr_10.42.42.2(pid=14910): stdout: | (launched: 2022-12-09_02:51:22.708629) 02:51:25.980100 run osmo-hlr_10.42.42.2(pid=14910): stderr: | 20221209025122903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025122903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025122903 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025122903 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025122903 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025122903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025122916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025122924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025122924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025122924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:26.030339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14909): Terminating (SIGTERM) 02:51:26.070434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14912): Terminating (SIGTERM) 02:51:26.110850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14915): Terminating (SIGTERM) 02:51:26.151151 --- ParallelTerminationStrategy: PID 14909 died... 02:51:26.170275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14909): Terminated: ok {rc=0} 02:51:26.214680 --- ParallelTerminationStrategy: PID 14912 died... 02:51:26.233372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14912): Terminated: ok {rc=0} 02:51:26.277892 --- ParallelTerminationStrategy: PID 14915 died... 02:51:26.296769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14915): Terminated: ok {rc=0} 02:51:26.384311 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 02:51:27.686175 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:51:27.692849 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 02:51:27.725998 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 02:51:27.764157 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 02:51:27.850795 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 02:51:27.884306 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 02:51:27.922636 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 02:51:28.526089 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 02:51:28.574552 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:28.586008 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:51:28.636906 tst cs_paging_gprs_active.py: using LAC 18556 02:51:28.755445 tst cs_paging_gprs_active.py: using RAC 196 02:51:28.883194 tst cs_paging_gprs_active.py: using CellId 18556 02:51:29.008114 tst cs_paging_gprs_active.py: using BVCI 18557 02:51:29.124903 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:29.136882 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:29.148665 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:29.160549 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:29.172287 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:29.184079 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:29.195885 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:29.207507 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:29.219326 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:29.334022 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:29.449687 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:51:29.648385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:29.946230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14921): Launched 02:51:30.205510 run iperf3-srv_10.42.42.10(pid=14922): Launched 02:51:30.317004 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:51:30.514948 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:30.813603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14923): Launched 02:51:31.101395 run iperf3-srv_10.42.42.10(pid=14924): Launched 02:51:31.229824 tst cs_paging_gprs_active.py:38: start network... 02:51:31.434290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:31.980809 run create_hlr_db(pid=14925): Launched 02:51:32.134426 bus /gobi_6: Setting Powered False 02:51:33.193502 run create_hlr_db(pid=14925): Terminated: ok {rc=0} 02:51:33.608295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14927): Launched 02:51:33.905357 run osmo-hlr_10.42.42.2(pid=14928): Launched 02:51:34.019083 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:34.541667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14930): Launched 02:51:34.838380 run osmo-stp_10.42.42.5(pid=14931): Launched 02:51:34.951447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:35.462646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14933): Launched 02:51:35.575760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:35.826422 run patchelf(pid=14934): Launched 02:51:35.991245 run osmo-stp_10.42.42.5(pid=14931): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14931)] 02:51:36.117232 run osmo-stp_10.42.42.5(pid=14931): stdout: | (launched: 2022-12-09_02:51:34.783720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:36.244359 run osmo-stp_10.42.42.5(pid=14931): stderr: | 20221209025134953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025134954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025134954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025134954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025134955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025134955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025134955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:36.371861 run osmo-stp_10.42.42.5(pid=14931): stdout: | (launched: 2022-12-09_02:51:34.783720) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:36.494427 run osmo-stp_10.42.42.5(pid=14931): stderr: | 20221209025134953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025134954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025134954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025134954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025134955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025134955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025134955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:36.639034 run patchelf(pid=14934): Terminating (SIGINT) 02:51:36.806394 run patchelf(pid=14934): Terminated: ok {rc=0} 02:51:36.927705 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14931): Process ended prematurely: osmo-stp_10.42.42.5(pid=14931) [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14931)] [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 02:51:36.937381 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 02:51:36.964622 run osmo-hlr_10.42.42.2(pid=14928): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14928)] 02:51:37.012066 run osmo-hlr_10.42.42.2(pid=14928): stdout: | (launched: 2022-12-09_02:51:33.851114) 02:51:37.061052 run osmo-hlr_10.42.42.2(pid=14928): stderr: | 20221209025134024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025134024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025134024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025134024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025134024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025134024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025134037 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025134045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025134045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025134045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:37.110614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14921): Terminating (SIGTERM) 02:51:37.150236 run iperf3-srv_10.42.42.10(pid=14922): Terminating (SIGTERM) 02:51:37.189649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14923): Terminating (SIGTERM) 02:51:37.229131 run iperf3-srv_10.42.42.10(pid=14924): Terminating (SIGTERM) 02:51:37.268522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14927): Terminating (SIGTERM) 02:51:37.307921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14930): Terminating (SIGTERM) 02:51:37.347347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14933): Terminating (SIGTERM) 02:51:37.386983 --- ParallelTerminationStrategy: PID 14921 died... 02:51:37.405742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14921): Terminated: ok {rc=0} 02:51:37.449887 --- ParallelTerminationStrategy: PID 14922 died... 02:51:37.468099 run iperf3-srv_10.42.42.10(pid=14922): Terminated {rc=256} 02:51:37.512019 --- ParallelTerminationStrategy: PID 14923 died... 02:51:37.530410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14923): Terminated: ok {rc=0} 02:51:37.573913 --- ParallelTerminationStrategy: PID 14924 died... 02:51:37.592096 run iperf3-srv_10.42.42.10(pid=14924): Terminated {rc=256} 02:51:37.635409 --- ParallelTerminationStrategy: PID 14927 died... 02:51:37.653721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14927): Terminated: ok {rc=0} 02:51:37.697372 --- ParallelTerminationStrategy: PID 14930 died... 02:51:37.715565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14930): Terminated: ok {rc=0} 02:51:37.759310 --- ParallelTerminationStrategy: PID 14933 died... 02:51:37.777621 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14933): Terminated: ok {rc=0} 02:51:37.863188 bus /gobi_0: Setting Powered False 02:51:38.962362 bus /gobi_0: Setting Powered False 02:51:40.077451 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 02:51:41.222038 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:41.233913 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:51:41.287698 tst iperf3.py: using LAC 18557 02:51:41.405807 tst iperf3.py: using RAC 197 02:51:41.521613 tst iperf3.py: using CellId 18557 02:51:41.637814 tst iperf3.py: using BVCI 18558 02:51:41.747774 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:41.759050 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:41.770150 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:41.781431 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:41.792678 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:41.803851 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:41.815395 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:41.826576 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:41.837978 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:41.957340 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:51:42.173244 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:42.492692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14935): Launched 02:51:42.769483 run iperf3-srv_10.42.42.10(pid=14936): Launched 02:51:42.889248 tst iperf3.py:8: start network... 02:51:43.104318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:43.597510 run create_hlr_db(pid=14937): Launched 02:51:43.727235 bus /gobi_6: Setting Powered False 02:51:44.789976 run create_hlr_db(pid=14937): Terminated: ok {rc=0} 02:51:45.234792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14939): Launched 02:51:45.552709 run osmo-hlr_10.42.42.2(pid=14940): Launched 02:51:45.677366 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:46.280902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14942): Launched 02:51:46.622958 run osmo-stp_10.42.42.5(pid=14943): Launched 02:51:46.914467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:47.525124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14945): Launched 02:51:47.639723 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:47.891498 run patchelf(pid=14946): Launched 02:51:48.056412 run osmo-stp_10.42.42.5(pid=14943): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14943)] 02:51:48.182477 run osmo-stp_10.42.42.5(pid=14943): stdout: | (launched: 2022-12-09_02:51:46.554567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:48.310175 run osmo-stp_10.42.42.5(pid=14943): stderr: | 20221209025146848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025146849 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025146849 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025146850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025146850 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025146850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025146850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:48.437913 run osmo-stp_10.42.42.5(pid=14943): stdout: | (launched: 2022-12-09_02:51:46.554567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:48.560380 run osmo-stp_10.42.42.5(pid=14943): stderr: | 20221209025146848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025146849 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025146849 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025146850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025146850 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025146850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025146850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:48.705255 run patchelf(pid=14946): Terminating (SIGINT) 02:51:48.871967 run patchelf(pid=14946): Terminated: ok {rc=0} 02:51:48.992248 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14943): Process ended prematurely: osmo-stp_10.42.42.5(pid=14943) [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14943)] [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 02:51:49.001694 tst iperf3.py:8: Test FAILED (7.8 sec) 02:51:49.028691 run osmo-hlr_10.42.42.2(pid=14940): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14940)] 02:51:49.076561 run osmo-hlr_10.42.42.2(pid=14940): stdout: | (launched: 2022-12-09_02:51:45.495089) 02:51:49.125926 run osmo-hlr_10.42.42.2(pid=14940): stderr: | 20221209025145694 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025145695 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025145695 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025145695 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025145695 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025145695 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025145707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025145716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025145716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025145716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:49.175632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14935): Terminating (SIGTERM) 02:51:49.215386 run iperf3-srv_10.42.42.10(pid=14936): Terminating (SIGTERM) 02:51:49.255072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14939): Terminating (SIGTERM) 02:51:49.294876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14942): Terminating (SIGTERM) 02:51:49.334613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14945): Terminating (SIGTERM) 02:51:49.374481 --- ParallelTerminationStrategy: PID 14935 died... 02:51:49.393454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14935): Terminated: ok {rc=0} 02:51:49.437331 --- ParallelTerminationStrategy: PID 14936 died... 02:51:49.455573 run iperf3-srv_10.42.42.10(pid=14936): Terminated {rc=256} 02:51:49.499182 --- ParallelTerminationStrategy: PID 14939 died... 02:51:49.517445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14939): Terminated: ok {rc=0} 02:51:49.560921 --- ParallelTerminationStrategy: PID 14942 died... 02:51:49.579561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14942): Terminated: ok {rc=0} 02:51:49.623291 --- ParallelTerminationStrategy: PID 14945 died... 02:51:49.641688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14945): Terminated: ok {rc=0} 02:51:49.726920 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 02:51:50.872775 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:50.884604 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:51:50.939797 tst iperf3m4.py: using LAC 18558 02:51:51.065392 tst iperf3m4.py: using RAC 198 02:51:51.189365 tst iperf3m4.py: using CellId 18558 02:51:51.315127 tst iperf3m4.py: using BVCI 18559 02:51:51.425488 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:51.436597 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:51.447685 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:51.458983 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:51.470254 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:51.481395 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:51.492527 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:51.503733 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:51.515180 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:51.635518 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:51.758844 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:51.875863 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:51.993676 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:51:52.192603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:52.489799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14947): Launched 02:51:52.746817 run iperf3-srv_10.42.42.10(pid=14948): Launched 02:51:52.857648 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:51:53.056774 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:53.354287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14949): Launched 02:51:53.611424 run iperf3-srv_10.42.42.10(pid=14950): Launched 02:51:53.722966 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:51:53.922095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:54.220204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14951): Launched 02:51:54.477647 run iperf3-srv_10.42.42.10(pid=14952): Launched 02:51:54.588336 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:51:54.786179 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:55.084424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14953): Launched 02:51:55.341959 run iperf3-srv_10.42.42.10(pid=14954): Launched 02:51:55.453156 tst iperf3m4.py:8: start network... 02:51:55.651228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:56.111023 run create_hlr_db(pid=14955): Launched 02:51:56.223743 bus /gobi_6: Setting Powered False 02:51:57.282935 run create_hlr_db(pid=14955): Terminated: ok {rc=0} 02:51:57.697882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14957): Launched 02:51:57.993897 run osmo-hlr_10.42.42.2(pid=14958): Launched 02:51:58.107621 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:58.621081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14960): Launched 02:51:58.916780 run osmo-stp_10.42.42.5(pid=14961): Launched 02:51:59.031304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:59.542096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14963): Launched 02:51:59.655458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:59.906443 run patchelf(pid=14964): Launched 02:52:00.070335 run osmo-stp_10.42.42.5(pid=14961): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14961)] 02:52:00.195611 run osmo-stp_10.42.42.5(pid=14961): stdout: | (launched: 2022-12-09_02:51:58.862393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:00.323326 run osmo-stp_10.42.42.5(pid=14961): stderr: | 20221209025159027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025159028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025159028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025159028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025159029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025159029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025159029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:00.450560 run osmo-stp_10.42.42.5(pid=14961): stdout: | (launched: 2022-12-09_02:51:58.862393) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:00.572460 run osmo-stp_10.42.42.5(pid=14961): stderr: | 20221209025159027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025159028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025159028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025159028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025159029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025159029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025159029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:00.716392 run patchelf(pid=14964): Terminating (SIGINT) 02:52:00.883550 run patchelf(pid=14964): Terminated: ok {rc=0} 02:52:01.005963 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14961): Process ended prematurely: osmo-stp_10.42.42.5(pid=14961) [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14961)] [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 02:52:01.015917 tst iperf3m4.py:8: Test FAILED (10.2 sec) 02:52:01.044772 run osmo-hlr_10.42.42.2(pid=14958): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14958)] 02:52:01.093799 run osmo-hlr_10.42.42.2(pid=14958): stdout: | (launched: 2022-12-09_02:51:57.939891) 02:52:01.144014 run osmo-hlr_10.42.42.2(pid=14958): stderr: | 20221209025158113 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025158113 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025158113 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025158113 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025158113 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025158113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025158128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025158138 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025158139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025158139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:01.194709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14947): Terminating (SIGTERM) 02:52:01.236211 run iperf3-srv_10.42.42.10(pid=14948): Terminating (SIGTERM) 02:52:01.278301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14949): Terminating (SIGTERM) 02:52:01.319701 run iperf3-srv_10.42.42.10(pid=14950): Terminating (SIGTERM) 02:52:01.363094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14951): Terminating (SIGTERM) 02:52:01.404259 run iperf3-srv_10.42.42.10(pid=14952): Terminating (SIGTERM) 02:52:01.444385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14953): Terminating (SIGTERM) 02:52:01.484641 run iperf3-srv_10.42.42.10(pid=14954): Terminating (SIGTERM) 02:52:01.526496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14957): Terminating (SIGTERM) 02:52:01.567158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14960): Terminating (SIGTERM) 02:52:01.607502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14963): Terminating (SIGTERM) 02:52:01.648009 --- ParallelTerminationStrategy: PID 14947 died... 02:52:01.667099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14947): Terminated: ok {rc=0} 02:52:01.712317 --- ParallelTerminationStrategy: PID 14948 died... 02:52:01.731119 run iperf3-srv_10.42.42.10(pid=14948): Terminated {rc=256} 02:52:01.775893 --- ParallelTerminationStrategy: PID 14949 died... 02:52:01.794864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14949): Terminated: ok {rc=0} 02:52:01.839689 --- ParallelTerminationStrategy: PID 14950 died... 02:52:01.858515 run iperf3-srv_10.42.42.10(pid=14950): Terminated {rc=256} 02:52:01.903220 --- ParallelTerminationStrategy: PID 14951 died... 02:52:01.922239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14951): Terminated: ok {rc=0} 02:52:01.966879 --- ParallelTerminationStrategy: PID 14952 died... 02:52:01.985811 run iperf3-srv_10.42.42.10(pid=14952): Terminated {rc=256} 02:52:02.030313 --- ParallelTerminationStrategy: PID 14953 died... 02:52:02.049422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14953): Terminated: ok {rc=0} 02:52:02.094378 --- ParallelTerminationStrategy: PID 14954 died... 02:52:02.113170 run iperf3-srv_10.42.42.10(pid=14954): Terminated {rc=256} 02:52:02.158089 --- ParallelTerminationStrategy: PID 14957 died... 02:52:02.177177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14957): Terminated: ok {rc=0} 02:52:02.221883 --- ParallelTerminationStrategy: PID 14960 died... 02:52:02.240671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14960): Terminated: ok {rc=0} 02:52:02.285419 --- ParallelTerminationStrategy: PID 14963 died... 02:52:02.304279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14963): Terminated: ok {rc=0} 02:52:02.390438 bus /gobi_4: Setting Powered False 02:52:03.488752 bus /gobi_4: Setting Powered False 02:52:04.603689 bus /gobi_1: Setting Powered False 02:52:05.703023 bus /gobi_1: Setting Powered False 02:52:06.817529 bus /gobi_0: Setting Powered False 02:52:07.916141 bus /gobi_0: Setting Powered False 02:52:09.031369 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 02:52:10.134987 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:10.147849 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:52:10.202418 tst ping.py: using LAC 18559 02:52:10.326742 tst ping.py: using RAC 199 02:52:10.451003 tst ping.py: using CellId 18559 02:52:10.574029 tst ping.py: using BVCI 18560 02:52:10.688082 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:10.699987 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:10.711674 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:10.723324 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:10.735005 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:10.746700 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:10.758510 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:10.770203 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:52:10.885702 tst ping.py:19: start network... 02:52:11.080546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:11.531901 run create_hlr_db(pid=14965): Launched 02:52:11.644365 bus /gobi_6: Setting Powered False 02:52:12.702774 run create_hlr_db(pid=14965): Terminated: ok {rc=0} 02:52:13.129640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14967): Launched 02:52:13.442117 run osmo-hlr_10.42.42.2(pid=14968): Launched 02:52:13.562042 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:14.108100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14970): Launched 02:52:14.419850 run osmo-stp_10.42.42.5(pid=14971): Launched 02:52:14.539222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:52:15.078724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14973): Launched 02:52:15.198760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:52:15.462516 run patchelf(pid=14974): Launched 02:52:15.636042 run osmo-stp_10.42.42.5(pid=14971): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14971)] 02:52:15.768132 run osmo-stp_10.42.42.5(pid=14971): stdout: | (launched: 2022-12-09_02:52:14.363040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:15.917970 run osmo-stp_10.42.42.5(pid=14971): stderr: | 20221209025214553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025214554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025214554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025214554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025214555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025214555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025214555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:16.056705 run osmo-stp_10.42.42.5(pid=14971): stdout: | (launched: 2022-12-09_02:52:14.363040) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:16.188095 run osmo-stp_10.42.42.5(pid=14971): stderr: | 20221209025214553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025214554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025214554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025214554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025214555 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025214555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025214555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:16.345673 run patchelf(pid=14974): Terminating (SIGINT) 02:52:16.523214 run patchelf(pid=14974): Terminated: ok {rc=0} 02:52:16.651503 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14971): Process ended prematurely: osmo-stp_10.42.42.5(pid=14971) [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14971)] [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 02:52:16.661593 tst ping.py:22: Test FAILED (6.5 sec) 02:52:16.690165 run osmo-hlr_10.42.42.2(pid=14968): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14968)] 02:52:16.740453 run osmo-hlr_10.42.42.2(pid=14968): stdout: | (launched: 2022-12-09_02:52:13.385330) 02:52:16.792770 run osmo-hlr_10.42.42.2(pid=14968): stderr: | 20221209025213581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025213581 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025213581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025213581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025213581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025213581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025213594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025213602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025213603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025213603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:16.845650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14967): Terminating (SIGTERM) 02:52:16.887955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14970): Terminating (SIGTERM) 02:52:16.930287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14973): Terminating (SIGTERM) 02:52:16.972607 --- ParallelTerminationStrategy: PID 14967 died... 02:52:16.992566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14967): Terminated: ok {rc=0} 02:52:17.039436 --- ParallelTerminationStrategy: PID 14970 died... 02:52:17.059536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14970): Terminated: ok {rc=0} 02:52:17.106666 --- ParallelTerminationStrategy: PID 14973 died... 02:52:17.126860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14973): Terminated: ok {rc=0} 02:52:17.214620 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 02:52:18.301489 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:18.314060 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:52:18.368110 tst ping_idle_ping.py: using LAC 18560 02:52:18.485459 tst ping_idle_ping.py: using RAC 200 02:52:18.601464 tst ping_idle_ping.py: using CellId 18560 02:52:18.719559 tst ping_idle_ping.py: using BVCI 18561 02:52:18.827793 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:18.839373 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:18.850490 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:18.862063 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:18.873567 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:18.884901 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:18.896417 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:52:18.907916 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:52:19.021877 tst ping_idle_ping.py:24: start network... 02:52:19.219954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:19.676613 run create_hlr_db(pid=14975): Launched 02:52:19.788467 bus /gobi_6: Setting Powered False 02:52:20.847773 run create_hlr_db(pid=14975): Terminated: ok {rc=0} 02:52:21.279792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14977): Launched 02:52:21.594295 run osmo-hlr_10.42.42.2(pid=14978): Launched 02:52:21.714369 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:22.259309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14980): Launched 02:52:22.572799 run osmo-stp_10.42.42.5(pid=14981): Launched 02:52:22.692233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:52:23.235031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14983): Launched 02:52:23.354540 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:52:23.619462 run patchelf(pid=14984): Launched 02:52:23.793497 run osmo-stp_10.42.42.5(pid=14981): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14981)] 02:52:23.926290 run osmo-stp_10.42.42.5(pid=14981): stdout: | (launched: 2022-12-09_02:52:22.515798) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:24.061473 run osmo-stp_10.42.42.5(pid=14981): stderr: | 20221209025222706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025222706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025222706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025222707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025222707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025222707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025222707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:24.196012 run osmo-stp_10.42.42.5(pid=14981): stdout: | (launched: 2022-12-09_02:52:22.515798) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:24.325229 run osmo-stp_10.42.42.5(pid=14981): stderr: | 20221209025222706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025222706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025222706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025222707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025222707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025222707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025222707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:24.478673 run patchelf(pid=14984): Terminating (SIGINT) 02:52:24.654582 run patchelf(pid=14984): Terminated: ok {rc=0} 02:52:24.781302 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14981): Process ended prematurely: osmo-stp_10.42.42.5(pid=14981) [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14981)] [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 02:52:24.790854 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 02:52:24.818492 run osmo-hlr_10.42.42.2(pid=14978): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14978)] 02:52:24.868055 run osmo-hlr_10.42.42.2(pid=14978): stdout: | (launched: 2022-12-09_02:52:21.537062) 02:52:24.919405 run osmo-hlr_10.42.42.2(pid=14978): stderr: | 20221209025221733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025221733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025221733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025221733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025221733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025221733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025221745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025221753 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025221753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025221753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:24.971052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14977): Terminating (SIGTERM) 02:52:25.012446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14980): Terminating (SIGTERM) 02:52:25.054489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14983): Terminating (SIGTERM) 02:52:25.096214 --- ParallelTerminationStrategy: PID 14977 died... 02:52:25.116321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14977): Terminated: ok {rc=0} 02:52:25.162979 --- ParallelTerminationStrategy: PID 14980 died... 02:52:25.182762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14980): Terminated: ok {rc=0} 02:52:25.228757 --- ParallelTerminationStrategy: PID 14983 died... 02:52:25.248323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14983): Terminated: ok {rc=0} 02:52:25.335581 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:52:26.639347 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:26.645932 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:52:26.679903 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:52:26.714830 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:52:26.772452 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:52:26.807095 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:52:26.842178 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:52:27.398983 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:52:27.404153 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:52:27.415428 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:52:27.484570 tst switch_tch_pdch.py: using LAC 18561 02:52:27.608859 tst switch_tch_pdch.py: using RAC 201 02:52:27.730607 tst switch_tch_pdch.py: using CellId 18561 02:52:27.851677 tst switch_tch_pdch.py: using BVCI 18562 02:52:27.965595 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:52:27.977430 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:52:27.989094 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:52:28.001002 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:52:28.012584 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:52:28.024175 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:52:28.035942 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:52:28.047652 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:52:28.163226 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:52:28.276583 tst switch_tch_pdch.py:51: start network... 02:52:28.470207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:28.920292 run create_hlr_db(pid=14988): Launched 02:52:29.031349 bus /gobi_6: Setting Powered False 02:52:30.089724 run create_hlr_db(pid=14988): Terminated: ok {rc=0} 02:52:30.517139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14990): Launched 02:52:30.831525 run osmo-hlr_10.42.42.2(pid=14991): Launched 02:52:31.008722 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:31.681120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14993): Launched 02:52:32.013699 run osmo-stp_10.42.42.5(pid=14994): Launched 02:52:32.248614 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:52:32.812032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14996): Launched 02:52:32.923348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:52:33.169705 run patchelf(pid=14997): Launched 02:52:33.332098 run osmo-stp_10.42.42.5(pid=14994): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14994)] 02:52:33.455657 run osmo-stp_10.42.42.5(pid=14994): stdout: | (launched: 2022-12-09_02:52:31.941362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:33.580705 run osmo-stp_10.42.42.5(pid=14994): stderr: | 20221209025232230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025232230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025232230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025232230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025232231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025232231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025232231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:33.706625 run osmo-stp_10.42.42.5(pid=14994): stdout: | (launched: 2022-12-09_02:52:31.941362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:33.826175 run osmo-stp_10.42.42.5(pid=14994): stderr: | 20221209025232230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025232230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025232230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025232230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025232231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025232231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025232231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:33.968741 run patchelf(pid=14997): Terminating (SIGINT) 02:52:34.132513 run patchelf(pid=14997): Terminated: ok {rc=0} 02:52:34.251063 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14994): Process ended prematurely: osmo-stp_10.42.42.5(pid=14994) [trial-2353↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14994)] [trial-2353↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:52:34.260011 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 02:52:34.286637 run osmo-hlr_10.42.42.2(pid=14991): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14991)] 02:52:34.334390 run osmo-hlr_10.42.42.2(pid=14991): stdout: | (launched: 2022-12-09_02:52:30.772462) 02:52:34.383672 run osmo-hlr_10.42.42.2(pid=14991): stderr: | 20221209025231076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025231076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025231076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025231076 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025231076 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025231076 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025231092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025231105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025231105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025231106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:34.433483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14990): Terminating (SIGTERM) 02:52:34.473597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14993): Terminating (SIGTERM) 02:52:34.513285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14996): Terminating (SIGTERM) 02:52:34.553195 --- ParallelTerminationStrategy: PID 14990 died... 02:52:34.572230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14990): Terminated: ok {rc=0} 02:52:34.616450 --- ParallelTerminationStrategy: PID 14993 died... 02:52:34.634981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14993): Terminated: ok {rc=0} 02:52:34.679125 --- ParallelTerminationStrategy: PID 14996 died... 02:52:34.697848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14996): Terminated: ok {rc=0} 02:52:34.784007 bus /gobi_0: Setting Powered False 02:52:35.882302 bus /gobi_0: Setting Powered False 02:52:36.997180 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:52:38.246173 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:38.251814 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:52:38.284312 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:52:38.318519 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:52:38.370663 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:52:38.402819 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:52:38.436783 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:52:38.991498 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:52:38.996486 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:39.007380 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:52:39.075811 tst switch_tch_pdch.py: using LAC 18562 02:52:39.190606 tst switch_tch_pdch.py: using RAC 202 02:52:39.307156 tst switch_tch_pdch.py: using CellId 18562 02:52:39.423464 tst switch_tch_pdch.py: using BVCI 18563 02:52:39.529202 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:39.540136 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:39.550826 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:39.561818 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:39.572570 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:39.583579 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:39.594669 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:39.605366 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:52:39.723079 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:52:39.838013 tst switch_tch_pdch.py:51: start network... 02:52:40.034282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:40.460536 run create_hlr_db(pid=15004): Launched 02:52:40.571470 bus /gobi_6: Setting Powered False 02:52:41.630415 run create_hlr_db(pid=15004): Terminated: ok {rc=0} 02:52:42.029734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15006): Launched 02:52:42.340746 run osmo-hlr_10.42.42.2(pid=15007): Launched 02:52:42.460458 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:42.970511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15009): Launched 02:52:43.281858 run osmo-stp_10.42.42.5(pid=15010): Launched 02:52:43.401634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:52:43.911840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15012): Launched 02:52:44.030641 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:52:44.293973 run patchelf(pid=15013): Launched 02:52:44.467072 run osmo-stp_10.42.42.5(pid=15010): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15010)] 02:52:44.599541 run osmo-stp_10.42.42.5(pid=15010): stdout: | (launched: 2022-12-09_02:52:43.225578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:44.733108 run osmo-stp_10.42.42.5(pid=15010): stderr: | 20221209025243414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025243414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025243414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025243414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025243415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025243415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025243415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:44.867011 run osmo-stp_10.42.42.5(pid=15010): stdout: | (launched: 2022-12-09_02:52:43.225578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:44.995144 run osmo-stp_10.42.42.5(pid=15010): stderr: | 20221209025243414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025243414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025243414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025243414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025243415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025243415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025243415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:45.147312 run patchelf(pid=15013): Terminating (SIGINT) 02:52:45.321457 run patchelf(pid=15013): Terminated: ok {rc=0} 02:52:45.447261 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15010): Process ended prematurely: osmo-stp_10.42.42.5(pid=15010) [trial-2353↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15010)] [trial-2353↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:52:45.456465 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 02:52:45.483708 run osmo-hlr_10.42.42.2(pid=15007): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15007)] 02:52:45.532721 run osmo-hlr_10.42.42.2(pid=15007): stdout: | (launched: 2022-12-09_02:52:42.284100) 02:52:45.583522 run osmo-hlr_10.42.42.2(pid=15007): stderr: | 20221209025242478 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025242478 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025242478 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025242478 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025242478 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025242478 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025242490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025242498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025242499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025242499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:45.635007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15006): Terminating (SIGTERM) 02:52:45.676811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15009): Terminating (SIGTERM) 02:52:45.718615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15012): Terminating (SIGTERM) 02:52:45.759956 --- ParallelTerminationStrategy: PID 15006 died... 02:52:45.779793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15006): Terminated: ok {rc=0} 02:52:45.825361 --- ParallelTerminationStrategy: PID 15009 died... 02:52:45.865904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15009): Terminated: ok {rc=0} 02:52:45.929151 --- ParallelTerminationStrategy: PID 15012 died... 02:52:45.950977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15012): Terminated: ok {rc=0} 02:52:46.037429 bus /gobi_0: Setting Powered False 02:52:47.147897 bus /gobi_0: Setting Powered False 02:52:48.270581 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_sms:trx-lms --------------------------------------------------------------------- 02:52:49.514653 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:49.518315 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 02:52:49.550702 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 02:52:49.557342 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 02:52:49.608392 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 02:52:49.640607 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 02:52:49.647154 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 02:52:50.185579 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 02:52:50.190468 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 02:52:50.200927 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 02:52:50.246998 tst mo_mt_sms.py: using LAC 18563 02:52:50.363512 tst mo_mt_sms.py: using RAC 203 02:52:50.487529 tst mo_mt_sms.py: using CellId 18563 02:52:50.610437 tst mo_mt_sms.py: using BVCI 18564 02:52:50.723626 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 02:52:50.838461 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 02:52:50.954965 tst mo_mt_sms.py:9: start nitb and bts... 02:52:51.166440 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:52:51.802273 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15017): Launched 02:52:52.113285 run osmo-nitb_10.42.42.2(pid=15018): Launched 02:52:52.286013 run osmo-nitb_10.42.42.2(pid=15018): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15018)] 02:52:52.425933 run osmo-nitb_10.42.42.2(pid=15018): stdout: | (launched: 2022-12-09_02:52:52.056379) 02:52:52.567476 run osmo-nitb_10.42.42.2(pid=15018): stderr: | (launched: 2022-12-09_02:52:52.103255) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:52:52.708448 run osmo-nitb_10.42.42.2(pid=15018): stdout: | (launched: 2022-12-09_02:52:52.056379) 02:52:52.844180 run osmo-nitb_10.42.42.2(pid=15018): stderr: | (launched: 2022-12-09_02:52:52.103255) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15018): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15018) [trial-2353↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15018)] 02:52:53.231053 tst osmo-nitb_10.42.42.2(pid=15018): stdout: | (launched: 2022-12-09_02:52:52.056379) 02:52:53.356841 tst osmo-nitb_10.42.42.2(pid=15018): stderr: | (launched: 2022-12-09_02:52:52.103255) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:52:53.505955 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=15018): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15018) [trial-2353↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15018)] [trial-2353↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 02:52:53.514816 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 02:52:53.521971 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15017): Terminating (SIGTERM) 02:52:53.731756 --- ParallelTerminationStrategy: PID 15017 died... 02:52:53.753051 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15017): Terminated: ok {rc=0} 02:52:53.839845 bus /sierra_3: Setting Powered False 02:52:54.937292 bus /sierra_3: Setting Powered False 02:52:56.052150 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 sms:trx-lms --------------------------------------------------------------------- 02:52:57.251944 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:57.256295 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 02:52:57.290346 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 02:52:57.317818 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 02:52:57.372018 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 02:52:57.406801 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 02:52:57.434594 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 02:52:57.978524 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 02:52:57.983953 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:57.995050 tst sms:trx-lms: Using 1 x bts (candidates: 1) 02:52:58.043107 tst mo_mt_sms.py: using LAC 18564 02:52:58.171210 tst mo_mt_sms.py: using RAC 204 02:52:58.293145 tst mo_mt_sms.py: using CellId 18564 02:52:58.414320 tst mo_mt_sms.py: using BVCI 18565 02:52:58.527473 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:58.538408 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:58.549240 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:58.559933 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:58.570736 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:58.581533 tst sms:trx-lms: Using 1 x modem (candidates: 2) 02:52:58.696019 tst sms:trx-lms: Using 1 x modem (candidates: 2) 02:52:58.816522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:59.299602 run create_hlr_db(pid=15022): Launched 02:52:59.426322 bus /sierra_2: Setting Powered False 02:53:00.487642 run create_hlr_db(pid=15022): Terminated: ok {rc=0} 02:53:00.959575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15024): Launched 02:53:01.350339 run osmo-hlr_10.42.42.2(pid=15028): Launched 02:53:01.627892 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:02.439957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15076): Launched 02:53:02.790683 run osmo-stp_10.42.42.5(pid=15084): Launched 02:53:03.053548 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:03.864013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15221): Launched 02:53:04.263449 run osmo-msc_10.42.42.6(pid=15272): Launched 02:53:04.621277 run osmo-stp_10.42.42.5(pid=15084): ERR: Terminated: ERROR {rc=1} [trial-2353↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15084)] 02:53:04.813252 run osmo-stp_10.42.42.5(pid=15084): stdout: | (launched: 2022-12-09_02:53:02.729328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:05.027567 run osmo-stp_10.42.42.5(pid=15084): stderr: | 20221209025303027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025303027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025303027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025303028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025303028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025303028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025303028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:05.184924 run osmo-stp_10.42.42.5(pid=15084): stdout: | (launched: 2022-12-09_02:53:02.729328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:05.311155 run osmo-stp_10.42.42.5(pid=15084): stderr: | 20221209025303027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025303027 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025303027 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025303028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025303028 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025303028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025303028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:05.463059 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15084): Process ended prematurely: osmo-stp_10.42.42.5(pid=15084) [trial-2353↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15084)] [trial-2353↪sms:trx-lms↪mo_mt_sms.py:16] 02:53:05.472642 tst mo_mt_sms.py:16: Test FAILED (7.5 sec) 02:53:05.501465 run osmo-hlr_10.42.42.2(pid=15028): ERR: Terminated: ERROR {rc=237} [trial-2353↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15028)] 02:53:05.552922 run osmo-hlr_10.42.42.2(pid=15028): stdout: | (launched: 2022-12-09_02:53:01.283273) 02:53:05.606012 run osmo-hlr_10.42.42.2(pid=15028): stderr: | 20221209025301622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025301622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025301622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025301622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025301622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025301622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025301650 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025301659 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025301659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025301659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:05.679407 run osmo-msc_10.42.42.6(pid=15272): ERR: Terminated: ERROR {rc=2} [trial-2353↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15272)] 02:53:05.730411 run osmo-msc_10.42.42.6(pid=15272): stdout: | (launched: 2022-12-09_02:53:04.190010) 02:53:05.782980 run osmo-msc_10.42.42.6(pid=15272): stderr: | 20221209025304760 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025304760 DLGLOBAL DEBUG validating counter group 0x7f5832e52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025304760 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025304760 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025304760 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025304761 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025304762 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025304763 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025304763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025304763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:05.836064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15024): Terminating (SIGTERM) 02:53:05.879115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15076): Terminating (SIGTERM) 02:53:05.923831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15221): Terminating (SIGTERM) 02:53:05.968605 --- ParallelTerminationStrategy: PID 15024 died... 02:53:05.989301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15024): Terminated: ok {rc=0} 02:53:06.037244 --- ParallelTerminationStrategy: PID 15076 died... 02:53:06.057455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15076): Terminated: ok {rc=0} 02:53:06.104257 --- ParallelTerminationStrategy: PID 15221 died... 02:53:06.124693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15221): Terminated: ok {rc=0} 02:53:06.213794 bus /sierra_3: Setting Powered False 02:53:07.313658 bus /sierra_3: Setting Powered False 02:53:08.432799 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_ussd:trx-lms --------------------------------------------------------------------- 02:53:09.671900 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:53:09.676549 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 02:53:09.711267 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 02:53:09.719114 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 02:53:09.755742 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 02:53:09.790575 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 02:53:09.798537 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 02:53:10.317344 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2353 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 02:53:10.323754 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 02:53:10.335688 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 02:53:10.386979 tst assert_extension.py: using LAC 18565 02:53:10.512322 tst assert_extension.py: using RAC 205 02:53:10.640117 tst assert_extension.py: using CellId 18565 02:53:10.768420 tst assert_extension.py: using BVCI 18566 02:53:10.886555 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 02:53:11.011583 tst assert_extension.py:10: start nitb and bts... 02:53:11.229893 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:53:11.893459 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15308): Launched 02:53:12.230495 run osmo-nitb_10.42.42.2(pid=15309): Launched 02:53:12.426574 run osmo-nitb_10.42.42.2(pid=15309): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15309)] 02:53:12.571704 run osmo-nitb_10.42.42.2(pid=15309): stdout: | (launched: 2022-12-09_02:53:12.167268) 02:53:12.721340 run osmo-nitb_10.42.42.2(pid=15309): stderr: | (launched: 2022-12-09_02:53:12.215163) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:53:12.867333 run osmo-nitb_10.42.42.2(pid=15309): stdout: | (launched: 2022-12-09_02:53:12.167268) 02:53:13.008183 run osmo-nitb_10.42.42.2(pid=15309): stderr: | (launched: 2022-12-09_02:53:12.215163) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15309): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15309) [trial-2353↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15309)] 02:53:13.370198 tst osmo-nitb_10.42.42.2(pid=15309): stdout: | (launched: 2022-12-09_02:53:12.167268) 02:53:13.499541 tst osmo-nitb_10.42.42.2(pid=15309): stderr: | (launched: 2022-12-09_02:53:12.215163) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:53:13.653363 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15309): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15309) [trial-2353↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15309)] [trial-2353↪nitb_ussd:trx-lms↪assert_extension.py:12] 02:53:13.663812 tst assert_extension.py:12: Test FAILED (3.3 sec) 02:53:13.671601 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15308): Terminating (SIGTERM) 02:53:13.883546 --- ParallelTerminationStrategy: PID 15308 died... 02:53:13.905756 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15308): Terminated: ok {rc=0} 02:53:13.996535 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 ussd:trx-lms --------------------------------------------------------------------- 02:53:15.173051 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:53:15.176643 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 02:53:15.210252 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 02:53:15.238195 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 02:53:15.271557 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 02:53:15.305668 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 02:53:15.333633 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 02:53:15.881209 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2353 ussd:trx-lms assert_extension.py ---------------------------------------------- 02:53:15.887319 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:53:15.905704 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 02:53:15.972288 tst assert_extension.py: using LAC 18566 02:53:16.099125 tst assert_extension.py: using RAC 206 02:53:16.271147 tst assert_extension.py: using CellId 18566 02:53:16.418973 tst assert_extension.py: using BVCI 18567 02:53:16.575691 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:53:16.587784 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:53:16.599577 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:53:16.611126 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:53:16.623016 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:53:16.634810 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 02:53:16.769302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:17.335982 run create_hlr_db(pid=15313): Launched 02:53:17.508018 bus /sierra_2: Setting Powered False 02:53:18.569584 run create_hlr_db(pid=15313): Terminated: ok {rc=0} 02:53:19.025734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15315): Launched 02:53:19.345958 run osmo-hlr_10.42.42.2(pid=15316): Launched 02:53:19.579858 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:20.284826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15318): Launched 02:53:20.621299 run osmo-stp_10.42.42.5(pid=15319): Launched 02:53:20.856208 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:21.561612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15321): Launched 02:53:21.883991 run osmo-msc_10.42.42.6(pid=15322): Launched 02:53:22.225750 run osmo-stp_10.42.42.5(pid=15319): ERR: Terminated: ERROR {rc=1} [trial-2353↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15319)] 02:53:22.488819 run osmo-stp_10.42.42.5(pid=15319): stdout: | (launched: 2022-12-09_02:53:20.545209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:22.769951 run osmo-stp_10.42.42.5(pid=15319): stderr: | 20221209025320874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025320874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025320874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025320875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025320875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025320875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025320875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:22.944243 run osmo-stp_10.42.42.5(pid=15319): stdout: | (launched: 2022-12-09_02:53:20.545209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:23.066537 run osmo-stp_10.42.42.5(pid=15319): stderr: | 20221209025320874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025320874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025320874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025320875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025320875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025320875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025320875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:23.211907 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15319): Process ended prematurely: osmo-stp_10.42.42.5(pid=15319) [trial-2353↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15319)] [trial-2353↪ussd:trx-lms↪assert_extension.py:17] 02:53:23.221112 tst assert_extension.py:17: Test FAILED (7.3 sec) 02:53:23.248424 run osmo-hlr_10.42.42.2(pid=15316): ERR: Terminated: ERROR {rc=237} [trial-2353↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15316)] 02:53:23.298191 run osmo-hlr_10.42.42.2(pid=15316): stdout: | (launched: 2022-12-09_02:53:19.283175) 02:53:23.350911 run osmo-hlr_10.42.42.2(pid=15316): stderr: | 20221209025319623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025319623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025319623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025319623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025319623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025319623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025319643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025319655 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025319655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025319655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:23.422249 run osmo-msc_10.42.42.6(pid=15322): ERR: Terminated: ERROR {rc=2} [trial-2353↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15322)] 02:53:23.472056 run osmo-msc_10.42.42.6(pid=15322): stdout: | (launched: 2022-12-09_02:53:21.821713) 02:53:23.523486 run osmo-msc_10.42.42.6(pid=15322): stderr: | 20221209025322420 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025322420 DLGLOBAL DEBUG validating counter group 0x7f00e042dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025322420 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025322420 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025322420 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025322421 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025322422 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025322423 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025322423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025322423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:23.577261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15315): Terminating (SIGTERM) 02:53:23.619053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15318): Terminating (SIGTERM) 02:53:23.663434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15321): Terminating (SIGTERM) 02:53:23.707732 --- ParallelTerminationStrategy: PID 15315 died... 02:53:23.727923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15315): Terminated: ok {rc=0} 02:53:23.776180 --- ParallelTerminationStrategy: PID 15318 died... 02:53:23.795818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15318): Terminated: ok {rc=0} 02:53:23.842062 --- ParallelTerminationStrategy: PID 15321 died... 02:53:23.862133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15321): Terminated: ok {rc=0} 02:53:23.950837 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:53:25.164277 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:53:25.170905 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:53:25.205741 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:53:25.233657 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:53:25.288060 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:53:25.322949 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:53:25.350399 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:53:25.899579 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:53:25.953135 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:53:25.965051 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:53:26.036178 tst mo_mt_call.py: using LAC 18567 02:53:26.164553 tst mo_mt_call.py: using RAC 207 02:53:26.283442 tst mo_mt_call.py: using CellId 18567 02:53:26.403344 tst mo_mt_call.py: using BVCI 18568 02:53:26.511628 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:53:26.522696 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:53:26.533557 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:53:26.545193 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:53:26.556822 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:53:26.568502 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:53:26.683537 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:53:26.798581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:27.261177 run create_hlr_db(pid=15327): Launched 02:53:27.374099 bus /sierra_2: Setting Powered False 02:53:28.434290 run create_hlr_db(pid=15327): Terminated: ok {rc=0} 02:53:28.870010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15329): Launched 02:53:29.190044 run osmo-hlr_10.42.42.2(pid=15330): Launched 02:53:29.312219 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:29.862435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15332): Launched 02:53:30.181368 run osmo-stp_10.42.42.5(pid=15333): Launched 02:53:30.303301 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:30.893775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15335): Launched 02:53:31.272208 run osmo-msc_10.42.42.6(pid=15336): Launched 02:53:31.604717 run osmo-stp_10.42.42.5(pid=15333): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15333)] 02:53:31.988781 run osmo-stp_10.42.42.5(pid=15333): stdout: | (launched: 2022-12-09_02:53:30.123181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:32.191639 run osmo-stp_10.42.42.5(pid=15333): stderr: | 20221209025330317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025330318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025330318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025330318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025330319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025330319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025330319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:32.326067 run osmo-stp_10.42.42.5(pid=15333): stdout: | (launched: 2022-12-09_02:53:30.123181) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:32.455885 run osmo-stp_10.42.42.5(pid=15333): stderr: | 20221209025330317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025330318 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025330318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025330318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025330319 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025330319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025330319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:32.608476 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15333): Process ended prematurely: osmo-stp_10.42.42.5(pid=15333) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15333)] [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:53:32.618284 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 02:53:32.645969 run osmo-hlr_10.42.42.2(pid=15330): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15330)] 02:53:32.696253 run osmo-hlr_10.42.42.2(pid=15330): stdout: | (launched: 2022-12-09_02:53:29.131926) 02:53:32.747846 run osmo-hlr_10.42.42.2(pid=15330): stderr: | 20221209025329328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025329328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025329328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025329328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025329329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025329329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025329341 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025329350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025329350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025329350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:32.819530 run osmo-msc_10.42.42.6(pid=15336): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15336)] 02:53:32.869341 run osmo-msc_10.42.42.6(pid=15336): stdout: | (launched: 2022-12-09_02:53:31.195278) 02:53:32.920642 run osmo-msc_10.42.42.6(pid=15336): stderr: | 20221209025331837 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025331837 DLGLOBAL DEBUG validating counter group 0x7f5a2018cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025331837 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025331837 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025331837 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025331838 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025331842 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025331844 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025331845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025331845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:32.972413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15329): Terminating (SIGTERM) 02:53:33.013943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15332): Terminating (SIGTERM) 02:53:33.055484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15335): Terminating (SIGTERM) 02:53:33.098314 --- ParallelTerminationStrategy: PID 15329 died... 02:53:33.118363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15329): Terminated: ok {rc=0} 02:53:33.164295 --- ParallelTerminationStrategy: PID 15332 died... 02:53:33.183876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15332): Terminated: ok {rc=0} 02:53:33.229986 --- ParallelTerminationStrategy: PID 15335 died... 02:53:33.249777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15335): Terminated: ok {rc=0} 02:53:33.337338 bus /sierra_3: Setting Powered False 02:53:34.435858 bus /sierra_3: Setting Powered False 02:53:35.552398 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:53:36.697591 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:53:36.709343 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:53:36.779414 tst mo_mt_call_osmux.py: using LAC 18568 02:53:36.896733 tst mo_mt_call_osmux.py: using RAC 208 02:53:37.023186 tst mo_mt_call_osmux.py: using CellId 18568 02:53:37.150883 tst mo_mt_call_osmux.py: using BVCI 18569 02:53:37.268679 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:53:37.280456 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:53:37.291836 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:53:37.303227 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:53:37.314673 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:53:37.326132 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:53:37.443625 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:53:37.562519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:38.025324 run create_hlr_db(pid=15338): Launched 02:53:38.139980 bus /sierra_2: Setting Powered False 02:53:39.200325 run create_hlr_db(pid=15338): Terminated: ok {rc=0} 02:53:39.638393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15340): Launched 02:53:39.959809 run osmo-hlr_10.42.42.2(pid=15341): Launched 02:53:40.083242 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:40.635456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15343): Launched 02:53:40.954912 run osmo-stp_10.42.42.5(pid=15344): Launched 02:53:41.077388 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:41.657578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15346): Launched 02:53:41.976806 run osmo-msc_10.42.42.6(pid=15347): Launched 02:53:42.155968 run osmo-stp_10.42.42.5(pid=15344): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15344)] 02:53:42.290533 run osmo-stp_10.42.42.5(pid=15344): stdout: | (launched: 2022-12-09_02:53:40.896804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:42.425761 run osmo-stp_10.42.42.5(pid=15344): stderr: | 20221209025341088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025341088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025341088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025341089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025341089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025341089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025341089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:42.560204 run osmo-stp_10.42.42.5(pid=15344): stdout: | (launched: 2022-12-09_02:53:40.896804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:42.688276 run osmo-stp_10.42.42.5(pid=15344): stderr: | 20221209025341088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025341088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025341088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025341089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025341089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025341089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025341089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:42.840729 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15344): Process ended prematurely: osmo-stp_10.42.42.5(pid=15344) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15344)] [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:53:42.850637 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:53:42.878854 run osmo-hlr_10.42.42.2(pid=15341): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15341)] 02:53:42.929448 run osmo-hlr_10.42.42.2(pid=15341): stdout: | (launched: 2022-12-09_02:53:39.901569) 02:53:42.981572 run osmo-hlr_10.42.42.2(pid=15341): stderr: | 20221209025340097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025340097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025340097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025340097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025340097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025340097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025340110 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025340118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025340118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025340118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:43.054019 run osmo-msc_10.42.42.6(pid=15347): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15347)] 02:53:43.104512 run osmo-msc_10.42.42.6(pid=15347): stdout: | (launched: 2022-12-09_02:53:41.918683) 02:53:43.156067 run osmo-msc_10.42.42.6(pid=15347): stderr: | 20221209025342241 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025342241 DLGLOBAL DEBUG validating counter group 0x7ff34f463c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025342241 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025342241 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025342242 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025342242 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025342244 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025342244 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025342245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025342245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:43.207708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15340): Terminating (SIGTERM) 02:53:43.249586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15343): Terminating (SIGTERM) 02:53:43.291610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15346): Terminating (SIGTERM) 02:53:43.334025 --- ParallelTerminationStrategy: PID 15340 died... 02:53:43.354356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15340): Terminated: ok {rc=0} 02:53:43.400800 --- ParallelTerminationStrategy: PID 15343 died... 02:53:43.420307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15343): Terminated: ok {rc=0} 02:53:43.466137 --- ParallelTerminationStrategy: PID 15346 died... 02:53:43.485670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15346): Terminated: ok {rc=0} 02:53:43.573857 bus /sierra_3: Setting Powered False 02:53:44.672282 bus /sierra_3: Setting Powered False 02:53:45.791491 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:53:47.060912 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:53:47.072868 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:53:47.115764 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:53:47.145717 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:53:47.198402 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:53:47.232747 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:53:47.260161 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:53:47.814749 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:53:47.866971 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:47.878760 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:53:47.953792 tst mo_mt_call.py: using LAC 18569 02:53:48.070731 tst mo_mt_call.py: using RAC 209 02:53:48.187195 tst mo_mt_call.py: using CellId 18569 02:53:48.303736 tst mo_mt_call.py: using BVCI 18570 02:53:48.423027 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:48.434873 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:48.446586 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:48.459883 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:48.472186 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:48.484081 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:53:48.602534 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:53:48.717683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:49.180093 run create_hlr_db(pid=15352): Launched 02:53:49.294873 bus /sierra_2: Setting Powered False 02:53:50.355231 run create_hlr_db(pid=15352): Terminated: ok {rc=0} 02:53:50.793139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15354): Launched 02:53:51.112682 run osmo-hlr_10.42.42.2(pid=15355): Launched 02:53:51.235498 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:51.789736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15357): Launched 02:53:52.109279 run osmo-stp_10.42.42.5(pid=15358): Launched 02:53:52.231776 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:52.811222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15360): Launched 02:53:53.130684 run osmo-msc_10.42.42.6(pid=15361): Launched 02:53:53.308493 run osmo-stp_10.42.42.5(pid=15358): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15358)] 02:53:53.443471 run osmo-stp_10.42.42.5(pid=15358): stdout: | (launched: 2022-12-09_02:53:52.050437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:53.578565 run osmo-stp_10.42.42.5(pid=15358): stderr: | 20221209025352241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025352241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025352242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025352242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025352244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025352244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025352245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:53.713377 run osmo-stp_10.42.42.5(pid=15358): stdout: | (launched: 2022-12-09_02:53:52.050437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:53.840597 run osmo-stp_10.42.42.5(pid=15358): stderr: | 20221209025352241 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025352241 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025352242 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025352242 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025352244 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025352244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025352245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:53.993653 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15358): Process ended prematurely: osmo-stp_10.42.42.5(pid=15358) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15358)] [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:53:54.003463 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:53:54.031250 run osmo-hlr_10.42.42.2(pid=15355): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15355)] 02:53:54.081301 run osmo-hlr_10.42.42.2(pid=15355): stdout: | (launched: 2022-12-09_02:53:51.054268) 02:53:54.133315 run osmo-hlr_10.42.42.2(pid=15355): stderr: | 20221209025351254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025351254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025351254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025351254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025351254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025351255 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025351266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025351275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025351275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025351275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:54.205228 run osmo-msc_10.42.42.6(pid=15361): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15361)] 02:53:54.254756 run osmo-msc_10.42.42.6(pid=15361): stdout: | (launched: 2022-12-09_02:53:53.071963) 02:53:54.305805 run osmo-msc_10.42.42.6(pid=15361): stderr: | 20221209025353396 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025353396 DLGLOBAL DEBUG validating counter group 0x7fda8a66bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025353396 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025353396 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025353397 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025353397 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025353398 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025353399 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025353399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025353399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:54.357876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15354): Terminating (SIGTERM) 02:53:54.399282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15357): Terminating (SIGTERM) 02:53:54.440836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15360): Terminating (SIGTERM) 02:53:54.482628 --- ParallelTerminationStrategy: PID 15354 died... 02:53:54.502413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15354): Terminated: ok {rc=0} 02:53:54.548488 --- ParallelTerminationStrategy: PID 15357 died... 02:53:54.568100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15357): Terminated: ok {rc=0} 02:53:54.614282 --- ParallelTerminationStrategy: PID 15360 died... 02:53:54.633934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15360): Terminated: ok {rc=0} 02:53:54.720605 bus /sierra_3: Setting Powered False 02:53:55.819664 bus /sierra_3: Setting Powered False 02:53:56.935879 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:53:58.078868 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:58.090768 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:53:58.160092 tst mo_mt_call_osmux.py: using LAC 18570 02:53:58.279112 tst mo_mt_call_osmux.py: using RAC 210 02:53:58.395297 tst mo_mt_call_osmux.py: using CellId 18570 02:53:58.511931 tst mo_mt_call_osmux.py: using BVCI 18571 02:53:58.619698 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:58.630817 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:58.641688 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:58.652793 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:58.664032 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:58.675186 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:53:58.794752 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:53:58.914615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:59.411900 run create_hlr_db(pid=15363): Launched 02:53:59.541866 bus /sierra_2: Setting Powered False 02:54:00.604643 run create_hlr_db(pid=15363): Terminated: ok {rc=0} 02:54:01.075359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15365): Launched 02:54:01.394934 run osmo-hlr_10.42.42.2(pid=15366): Launched 02:54:01.633714 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:02.324901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15368): Launched 02:54:02.624247 run osmo-stp_10.42.42.5(pid=15369): Launched 02:54:02.738765 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:03.284103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15371): Launched 02:54:03.603320 run osmo-msc_10.42.42.6(pid=15372): Launched 02:54:03.781189 run osmo-stp_10.42.42.5(pid=15369): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15369)] 02:54:03.917487 run osmo-stp_10.42.42.5(pid=15369): stdout: | (launched: 2022-12-09_02:54:02.569275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:04.053247 run osmo-stp_10.42.42.5(pid=15369): stderr: | 20221209025402738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025402738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025402738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025402739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025402741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025402741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025402741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:04.187921 run osmo-stp_10.42.42.5(pid=15369): stdout: | (launched: 2022-12-09_02:54:02.569275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:04.315166 run osmo-stp_10.42.42.5(pid=15369): stderr: | 20221209025402738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025402738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025402738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025402739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025402741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025402741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025402741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:04.467209 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15369): Process ended prematurely: osmo-stp_10.42.42.5(pid=15369) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15369)] [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:54:04.476872 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:54:04.504652 run osmo-hlr_10.42.42.2(pid=15366): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15366)] 02:54:04.554728 run osmo-hlr_10.42.42.2(pid=15366): stdout: | (launched: 2022-12-09_02:54:01.331768) 02:54:04.606458 run osmo-hlr_10.42.42.2(pid=15366): stderr: | 20221209025401666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025401666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025401666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025401666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025401666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025401666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025401679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025401687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025401688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025401688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:04.678762 run osmo-msc_10.42.42.6(pid=15372): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15372)] 02:54:04.728779 run osmo-msc_10.42.42.6(pid=15372): stdout: | (launched: 2022-12-09_02:54:03.545254) 02:54:04.780072 run osmo-msc_10.42.42.6(pid=15372): stderr: | 20221209025403865 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025403865 DLGLOBAL DEBUG validating counter group 0x7faeb4c1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025403865 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025403866 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025403866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025403866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025403868 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025403868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025403868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025403868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:04.831982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15365): Terminating (SIGTERM) 02:54:04.873667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15368): Terminating (SIGTERM) 02:54:04.915344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15371): Terminating (SIGTERM) 02:54:04.957388 --- ParallelTerminationStrategy: PID 15365 died... 02:54:04.977537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15365): Terminated: ok {rc=0} 02:54:05.023966 --- ParallelTerminationStrategy: PID 15368 died... 02:54:05.043391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15368): Terminated: ok {rc=0} 02:54:05.089259 --- ParallelTerminationStrategy: PID 15371 died... 02:54:05.109217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15371): Terminated: ok {rc=0} 02:54:05.196783 bus /sierra_3: Setting Powered False 02:54:06.295991 bus /sierra_3: Setting Powered False 02:54:07.412743 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:54:08.665343 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:54:08.672490 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:54:08.706186 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:54:08.734053 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:54:08.788167 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:54:08.823195 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:54:08.850680 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:54:09.400827 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:54:09.451822 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:54:09.463585 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:54:09.534277 tst mo_mt_call.py: using LAC 18571 02:54:09.665388 tst mo_mt_call.py: using RAC 211 02:54:09.789479 tst mo_mt_call.py: using CellId 18571 02:54:09.913158 tst mo_mt_call.py: using BVCI 18572 02:54:10.029841 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:54:10.041586 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:54:10.052807 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:54:10.064154 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:54:10.075638 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:54:10.087070 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:54:10.209037 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:54:10.334098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:10.798027 run create_hlr_db(pid=15377): Launched 02:54:10.911429 bus /sierra_2: Setting Powered False 02:54:11.969350 run create_hlr_db(pid=15377): Terminated: ok {rc=0} 02:54:12.407357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15379): Launched 02:54:12.727991 run osmo-hlr_10.42.42.2(pid=15380): Launched 02:54:12.850296 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:13.405583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15382): Launched 02:54:13.723381 run osmo-stp_10.42.42.5(pid=15383): Launched 02:54:13.845314 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:14.425194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15385): Launched 02:54:14.743934 run osmo-msc_10.42.42.6(pid=15386): Launched 02:54:14.913173 run osmo-stp_10.42.42.5(pid=15383): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15383)] 02:54:15.041735 run osmo-stp_10.42.42.5(pid=15383): stdout: | (launched: 2022-12-09_02:54:13.665414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:15.169541 run osmo-stp_10.42.42.5(pid=15383): stderr: | 20221209025413858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025413858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025413858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025413859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025413859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025413859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025413859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:15.294765 run osmo-stp_10.42.42.5(pid=15383): stdout: | (launched: 2022-12-09_02:54:13.665414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:15.413947 run osmo-stp_10.42.42.5(pid=15383): stderr: | 20221209025413858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025413858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025413858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025413859 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025413859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025413859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025413859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:15.556357 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15383): Process ended prematurely: osmo-stp_10.42.42.5(pid=15383) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15383)] [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:54:15.565902 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:54:15.592511 run osmo-hlr_10.42.42.2(pid=15380): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15380)] 02:54:15.640643 run osmo-hlr_10.42.42.2(pid=15380): stdout: | (launched: 2022-12-09_02:54:12.669646) 02:54:15.690329 run osmo-hlr_10.42.42.2(pid=15380): stderr: | 20221209025412870 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025412870 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025412870 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025412870 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025412870 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025412870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025412883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025412893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025412893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025412893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:15.759020 run osmo-msc_10.42.42.6(pid=15386): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15386)] 02:54:15.806870 run osmo-msc_10.42.42.6(pid=15386): stdout: | (launched: 2022-12-09_02:54:14.686060) 02:54:15.856565 run osmo-msc_10.42.42.6(pid=15386): stderr: | 20221209025414959 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025414959 DLGLOBAL DEBUG validating counter group 0x7ff152f86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025414959 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025414959 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025414959 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025414959 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025414961 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025414962 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025414962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025414962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:15.907282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15379): Terminating (SIGTERM) 02:54:15.948695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15382): Terminating (SIGTERM) 02:54:15.991726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15385): Terminating (SIGTERM) 02:54:16.034801 --- ParallelTerminationStrategy: PID 15379 died... 02:54:16.054554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15379): Terminated: ok {rc=0} 02:54:16.101556 --- ParallelTerminationStrategy: PID 15382 died... 02:54:16.120615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15382): Terminated: ok {rc=0} 02:54:16.165606 --- ParallelTerminationStrategy: PID 15385 died... 02:54:16.184713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15385): Terminated: ok {rc=0} 02:54:16.271216 bus /sierra_3: Setting Powered False 02:54:17.367399 bus /sierra_3: Setting Powered False 02:54:18.479540 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:54:19.628005 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:54:19.640291 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:54:19.716932 tst mo_mt_call_osmux.py: using LAC 18572 02:54:19.842814 tst mo_mt_call_osmux.py: using RAC 212 02:54:19.969239 tst mo_mt_call_osmux.py: using CellId 18572 02:54:20.093482 tst mo_mt_call_osmux.py: using BVCI 18573 02:54:20.205518 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:54:20.217128 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:54:20.228622 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:54:20.240434 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:54:20.251584 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:54:20.262866 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:54:20.378697 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:54:20.493611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:20.957417 run create_hlr_db(pid=15388): Launched 02:54:21.070565 bus /sierra_2: Setting Powered False 02:54:22.130837 run create_hlr_db(pid=15388): Terminated: ok {rc=0} 02:54:22.566943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15390): Launched 02:54:22.887646 run osmo-hlr_10.42.42.2(pid=15391): Launched 02:54:23.010572 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:23.565745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15393): Launched 02:54:23.884048 run osmo-stp_10.42.42.5(pid=15394): Launched 02:54:24.006461 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:24.600053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15396): Launched 02:54:24.919968 run osmo-msc_10.42.42.6(pid=15397): Launched 02:54:25.099339 run osmo-stp_10.42.42.5(pid=15394): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15394)] 02:54:25.234772 run osmo-stp_10.42.42.5(pid=15394): stdout: | (launched: 2022-12-09_02:54:23.826151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:25.370880 run osmo-stp_10.42.42.5(pid=15394): stderr: | 20221209025424020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025424020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025424020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025424021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025424021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025424021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025424021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:25.505115 run osmo-stp_10.42.42.5(pid=15394): stdout: | (launched: 2022-12-09_02:54:23.826151) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:25.632883 run osmo-stp_10.42.42.5(pid=15394): stderr: | 20221209025424020 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025424020 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025424020 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025424021 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025424021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025424021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025424021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:25.785591 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15394): Process ended prematurely: osmo-stp_10.42.42.5(pid=15394) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15394)] [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:54:25.795158 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:54:25.823178 run osmo-hlr_10.42.42.2(pid=15391): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15391)] 02:54:25.873401 run osmo-hlr_10.42.42.2(pid=15391): stdout: | (launched: 2022-12-09_02:54:22.829561) 02:54:25.924811 run osmo-hlr_10.42.42.2(pid=15391): stderr: | 20221209025423029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025423029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025423029 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025423029 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025423029 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025423030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025423042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025423051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025423051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025423051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:25.996833 run osmo-msc_10.42.42.6(pid=15397): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15397)] 02:54:26.046825 run osmo-msc_10.42.42.6(pid=15397): stdout: | (launched: 2022-12-09_02:54:24.861863) 02:54:26.098667 run osmo-msc_10.42.42.6(pid=15397): stderr: | 20221209025425185 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025425185 DLGLOBAL DEBUG validating counter group 0x7f94641bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025425185 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025425185 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025425185 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025425186 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025425187 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025425188 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025425188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025425188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:26.151426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15390): Terminating (SIGTERM) 02:54:26.193058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15393): Terminating (SIGTERM) 02:54:26.234622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15396): Terminating (SIGTERM) 02:54:26.276445 --- ParallelTerminationStrategy: PID 15390 died... 02:54:26.295989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15390): Terminated: ok {rc=0} 02:54:26.342075 --- ParallelTerminationStrategy: PID 15393 died... 02:54:26.361952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15393): Terminated: ok {rc=0} 02:54:26.407782 --- ParallelTerminationStrategy: PID 15396 died... 02:54:26.427232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15396): Terminated: ok {rc=0} 02:54:26.515162 bus /sierra_3: Setting Powered False 02:54:27.614605 bus /sierra_3: Setting Powered False 02:54:28.733386 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:54:29.988500 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:54:29.995741 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:54:30.029735 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:54:30.057721 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:54:30.112601 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:54:30.146742 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:54:30.174761 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:54:30.724284 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:54:30.775772 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:30.787564 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:54:30.857197 tst mo_mt_call.py: using LAC 18573 02:54:31.015930 tst mo_mt_call.py: using RAC 213 02:54:31.137504 tst mo_mt_call.py: using CellId 18573 02:54:31.261866 tst mo_mt_call.py: using BVCI 18574 02:54:31.407784 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:31.420644 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:31.432827 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:31.447164 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:31.460390 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:31.475059 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:54:31.616512 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:54:31.743647 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:32.230222 run create_hlr_db(pid=15402): Launched 02:54:32.385726 bus /sierra_2: Setting Powered False 02:54:33.445773 run create_hlr_db(pid=15402): Terminated: ok {rc=0} 02:54:33.883637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15404): Launched 02:54:34.188666 run osmo-hlr_10.42.42.2(pid=15405): Launched 02:54:34.302563 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:34.815787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15407): Launched 02:54:35.114206 run osmo-stp_10.42.42.5(pid=15408): Launched 02:54:35.228186 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:35.768022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15410): Launched 02:54:36.066288 run osmo-msc_10.42.42.6(pid=15411): Launched 02:54:36.233797 run osmo-stp_10.42.42.5(pid=15408): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15408)] 02:54:36.360433 run osmo-stp_10.42.42.5(pid=15408): stdout: | (launched: 2022-12-09_02:54:35.058946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:36.487242 run osmo-stp_10.42.42.5(pid=15408): stderr: | 20221209025435230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025435230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025435230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025435231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025435231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025435231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025435231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:36.613107 run osmo-stp_10.42.42.5(pid=15408): stdout: | (launched: 2022-12-09_02:54:35.058946) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:36.731711 run osmo-stp_10.42.42.5(pid=15408): stderr: | 20221209025435230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025435230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025435230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025435231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025435231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025435231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025435231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:36.874435 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15408): Process ended prematurely: osmo-stp_10.42.42.5(pid=15408) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15408)] [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:54:36.883579 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:54:36.910687 run osmo-hlr_10.42.42.2(pid=15405): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15405)] 02:54:36.958417 run osmo-hlr_10.42.42.2(pid=15405): stdout: | (launched: 2022-12-09_02:54:34.133312) 02:54:37.007898 run osmo-hlr_10.42.42.2(pid=15405): stderr: | 20221209025434311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025434311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025434311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025434311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025434311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025434311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025434324 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025434333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025434333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025434333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:37.076644 run osmo-msc_10.42.42.6(pid=15411): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15411)] 02:54:37.125074 run osmo-msc_10.42.42.6(pid=15411): stdout: | (launched: 2022-12-09_02:54:36.011356) 02:54:37.175315 run osmo-msc_10.42.42.6(pid=15411): stderr: | 20221209025436284 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025436284 DLGLOBAL DEBUG validating counter group 0x7f8bbc879c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025436284 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025436284 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025436285 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025436285 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025436288 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025436289 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025436289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025436289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:37.225309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15404): Terminating (SIGTERM) 02:54:37.265372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15407): Terminating (SIGTERM) 02:54:37.305134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15410): Terminating (SIGTERM) 02:54:37.345274 --- ParallelTerminationStrategy: PID 15404 died... 02:54:37.364216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15404): Terminated: ok {rc=0} 02:54:37.408413 --- ParallelTerminationStrategy: PID 15407 died... 02:54:37.426918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15407): Terminated: ok {rc=0} 02:54:37.470788 --- ParallelTerminationStrategy: PID 15410 died... 02:54:37.490100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15410): Terminated: ok {rc=0} 02:54:37.575835 bus /sierra_3: Setting Powered False 02:54:38.676053 bus /sierra_3: Setting Powered False 02:54:39.792242 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:54:40.936930 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:40.948925 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:54:41.018088 tst mo_mt_call_osmux.py: using LAC 18574 02:54:41.136940 tst mo_mt_call_osmux.py: using RAC 214 02:54:41.255233 tst mo_mt_call_osmux.py: using CellId 18574 02:54:41.379978 tst mo_mt_call_osmux.py: using BVCI 18575 02:54:41.490388 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:41.501883 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:41.513085 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:41.524190 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:41.535356 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:41.546519 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:54:41.662004 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:54:41.781219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:42.280026 run create_hlr_db(pid=15413): Launched 02:54:42.410634 bus /sierra_2: Setting Powered False 02:54:43.474157 run create_hlr_db(pid=15413): Terminated: ok {rc=0} 02:54:43.901954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15415): Launched 02:54:44.201647 run osmo-hlr_10.42.42.2(pid=15416): Launched 02:54:44.316245 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:44.848935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15418): Launched 02:54:45.149162 run osmo-stp_10.42.42.5(pid=15419): Launched 02:54:45.263404 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:45.806080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15421): Launched 02:54:46.144188 run osmo-msc_10.42.42.6(pid=15422): Launched 02:54:46.547295 run osmo-stp_10.42.42.5(pid=15419): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15419)] 02:54:46.784879 run osmo-stp_10.42.42.5(pid=15419): stdout: | (launched: 2022-12-09_02:54:45.093244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:46.923513 run osmo-stp_10.42.42.5(pid=15419): stderr: | 20221209025445264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025445264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025445264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025445264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025445265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025445265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025445265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:47.062359 run osmo-stp_10.42.42.5(pid=15419): stdout: | (launched: 2022-12-09_02:54:45.093244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:47.195470 run osmo-stp_10.42.42.5(pid=15419): stderr: | 20221209025445264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025445264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025445264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025445264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025445265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025445265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025445265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:47.349870 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15419): Process ended prematurely: osmo-stp_10.42.42.5(pid=15419) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15419)] [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:54:47.359845 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 02:54:47.388458 run osmo-hlr_10.42.42.2(pid=15416): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15416)] 02:54:47.439251 run osmo-hlr_10.42.42.2(pid=15416): stdout: | (launched: 2022-12-09_02:54:44.146561) 02:54:47.491652 run osmo-hlr_10.42.42.2(pid=15416): stderr: | 20221209025444325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025444325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025444325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025444325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025444325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025444325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025444340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025444351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025444351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025444351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:47.564641 run osmo-msc_10.42.42.6(pid=15422): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15422)] 02:54:47.615146 run osmo-msc_10.42.42.6(pid=15422): stdout: | (launched: 2022-12-09_02:54:46.080102) 02:54:47.667042 run osmo-msc_10.42.42.6(pid=15422): stderr: | 20221209025446472 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025446472 DLGLOBAL DEBUG validating counter group 0x7f5114015c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025446486 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025446487 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025446487 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025446487 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025446489 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025446489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025446489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025446490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:47.719473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15415): Terminating (SIGTERM) 02:54:47.761779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15418): Terminating (SIGTERM) 02:54:47.803852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15421): Terminating (SIGTERM) 02:54:47.846537 --- ParallelTerminationStrategy: PID 15415 died... 02:54:47.866867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15415): Terminated: ok {rc=0} 02:54:47.913999 --- ParallelTerminationStrategy: PID 15418 died... 02:54:47.933955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15418): Terminated: ok {rc=0} 02:54:47.981109 --- ParallelTerminationStrategy: PID 15421 died... 02:54:48.001083 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15421): Terminated: ok {rc=0} 02:54:48.089798 bus /sierra_3: Setting Powered False 02:54:49.188755 bus /sierra_3: Setting Powered False 02:54:50.305299 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:54:51.560566 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:54:51.567140 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:54:51.600898 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:54:51.627780 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:54:51.678682 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:54:51.711374 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:54:51.737947 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:54:52.292179 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:54:52.342229 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:52.353554 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:54:52.422204 tst mo_mt_call.py: using LAC 18575 02:54:52.542331 tst mo_mt_call.py: using RAC 215 02:54:52.661186 tst mo_mt_call.py: using CellId 18575 02:54:52.780025 tst mo_mt_call.py: using BVCI 18576 02:54:52.890356 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:52.901627 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:52.912362 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:52.923613 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:52.935048 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:52.946333 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:54:53.064808 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:54:53.181188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:53.642797 run create_hlr_db(pid=15427): Launched 02:54:53.755763 bus /sierra_2: Setting Powered False 02:54:54.819889 run create_hlr_db(pid=15427): Terminated: ok {rc=0} 02:54:55.266995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15429): Launched 02:54:55.587219 run osmo-hlr_10.42.42.2(pid=15430): Launched 02:54:55.709468 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:56.263612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15432): Launched 02:54:56.583808 run osmo-stp_10.42.42.5(pid=15433): Launched 02:54:56.706411 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:57.285795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15435): Launched 02:54:57.604840 run osmo-msc_10.42.42.6(pid=15436): Launched 02:54:57.783664 run osmo-stp_10.42.42.5(pid=15433): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15433)] 02:54:57.918611 run osmo-stp_10.42.42.5(pid=15433): stdout: | (launched: 2022-12-09_02:54:56.525777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:58.053420 run osmo-stp_10.42.42.5(pid=15433): stderr: | 20221209025456716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025456716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025456717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025456717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025456718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025456718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025456718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:58.188135 run osmo-stp_10.42.42.5(pid=15433): stdout: | (launched: 2022-12-09_02:54:56.525777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:58.315752 run osmo-stp_10.42.42.5(pid=15433): stderr: | 20221209025456716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025456716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025456717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025456717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025456718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025456718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025456718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:58.468448 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15433): Process ended prematurely: osmo-stp_10.42.42.5(pid=15433) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15433)] [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:54:58.477982 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:54:58.505335 run osmo-hlr_10.42.42.2(pid=15430): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15430)] 02:54:58.555147 run osmo-hlr_10.42.42.2(pid=15430): stdout: | (launched: 2022-12-09_02:54:55.529198) 02:54:58.606383 run osmo-hlr_10.42.42.2(pid=15430): stderr: | 20221209025455727 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025455727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025455727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025455727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025455727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025455727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025455740 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025455749 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025455749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025455750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:58.677680 run osmo-msc_10.42.42.6(pid=15436): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15436)] 02:54:58.727012 run osmo-msc_10.42.42.6(pid=15436): stdout: | (launched: 2022-12-09_02:54:57.546715) 02:54:58.778603 run osmo-msc_10.42.42.6(pid=15436): stderr: | 20221209025457868 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025457868 DLGLOBAL DEBUG validating counter group 0x7f588b469c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025457868 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025457868 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025457869 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025457869 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025457872 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025457873 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025457873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025457873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:58.830406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15429): Terminating (SIGTERM) 02:54:58.871507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15432): Terminating (SIGTERM) 02:54:58.912566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15435): Terminating (SIGTERM) 02:54:58.954115 --- ParallelTerminationStrategy: PID 15429 died... 02:54:58.973956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15429): Terminated: ok {rc=0} 02:54:59.019582 --- ParallelTerminationStrategy: PID 15432 died... 02:54:59.038994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15432): Terminated: ok {rc=0} 02:54:59.085132 --- ParallelTerminationStrategy: PID 15435 died... 02:54:59.104493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15435): Terminated: ok {rc=0} 02:54:59.192478 bus /sierra_3: Setting Powered False 02:55:00.292081 bus /sierra_3: Setting Powered False 02:55:01.404654 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:55:02.549307 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:55:02.561215 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:55:02.629294 tst mo_mt_call_osmux.py: using LAC 18576 02:55:02.748911 tst mo_mt_call_osmux.py: using RAC 216 02:55:02.865659 tst mo_mt_call_osmux.py: using CellId 18576 02:55:02.982741 tst mo_mt_call_osmux.py: using BVCI 18577 02:55:03.092417 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:55:03.103772 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:55:03.115004 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:55:03.126524 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:55:03.138189 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:55:03.149779 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:55:03.270308 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:55:03.389870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:03.885101 run create_hlr_db(pid=15441): Launched 02:55:04.015418 bus /sierra_2: Setting Powered False 02:55:05.074975 run create_hlr_db(pid=15441): Terminated: ok {rc=0} 02:55:05.521506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15443): Launched 02:55:05.840090 run osmo-hlr_10.42.42.2(pid=15444): Launched 02:55:05.961890 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:06.511956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15446): Launched 02:55:06.830538 run osmo-stp_10.42.42.5(pid=15447): Launched 02:55:06.951833 run osmo-msc_10.42.42.6: Starting osmo-msc 02:55:07.529752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15449): Launched 02:55:07.848178 run osmo-msc_10.42.42.6(pid=15450): Launched 02:55:08.025677 run osmo-stp_10.42.42.5(pid=15447): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15447)] 02:55:08.159997 run osmo-stp_10.42.42.5(pid=15447): stdout: | (launched: 2022-12-09_02:55:06.772493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:08.294897 run osmo-stp_10.42.42.5(pid=15447): stderr: | 20221209025506966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025506966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025506966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025506967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025506967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025506967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025506967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:08.429030 run osmo-stp_10.42.42.5(pid=15447): stdout: | (launched: 2022-12-09_02:55:06.772493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:08.556610 run osmo-stp_10.42.42.5(pid=15447): stderr: | 20221209025506966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025506966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025506966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025506967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025506967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025506967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025506967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:08.708789 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15447): Process ended prematurely: osmo-stp_10.42.42.5(pid=15447) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15447)] [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:55:08.718508 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:55:08.746091 run osmo-hlr_10.42.42.2(pid=15444): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15444)] 02:55:08.795768 run osmo-hlr_10.42.42.2(pid=15444): stdout: | (launched: 2022-12-09_02:55:05.782157) 02:55:08.846956 run osmo-hlr_10.42.42.2(pid=15444): stderr: | 20221209025505981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025505982 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025505982 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025505982 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025505982 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025505982 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025505998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025506008 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025506008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025506008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:08.918495 run osmo-msc_10.42.42.6(pid=15450): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15450)] 02:55:08.967946 run osmo-msc_10.42.42.6(pid=15450): stdout: | (launched: 2022-12-09_02:55:07.790128) 02:55:09.018856 run osmo-msc_10.42.42.6(pid=15450): stderr: | 20221209025508113 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025508113 DLGLOBAL DEBUG validating counter group 0x7f6e00714c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025508113 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025508113 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025508113 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025508114 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025508115 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025508116 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025508116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025508116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:09.070657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15443): Terminating (SIGTERM) 02:55:09.111683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15446): Terminating (SIGTERM) 02:55:09.153021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15449): Terminating (SIGTERM) 02:55:09.194411 --- ParallelTerminationStrategy: PID 15443 died... 02:55:09.213753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15443): Terminated: ok {rc=0} 02:55:09.259367 --- ParallelTerminationStrategy: PID 15446 died... 02:55:09.278703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15446): Terminated: ok {rc=0} 02:55:09.324059 --- ParallelTerminationStrategy: PID 15449 died... 02:55:09.343330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15449): Terminated: ok {rc=0} 02:55:09.430309 bus /sierra_3: Setting Powered False 02:55:10.526993 bus /sierra_3: Setting Powered False 02:55:11.642136 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:55:12.893165 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:55:12.900109 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:55:12.935341 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:55:12.963518 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:55:13.018215 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:55:13.052642 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:55:13.079635 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:55:13.631038 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:55:13.683028 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:55:13.694654 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:55:13.766652 tst mo_mt_call.py: using LAC 18577 02:55:13.892732 tst mo_mt_call.py: using RAC 217 02:55:14.019897 tst mo_mt_call.py: using CellId 18577 02:55:14.140488 tst mo_mt_call.py: using BVCI 18578 02:55:14.249383 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:55:14.260581 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:55:14.271787 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:55:14.283413 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:55:14.294980 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:55:14.306533 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:55:14.421317 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:55:14.540171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:15.038550 run create_hlr_db(pid=15455): Launched 02:55:15.168433 bus /sierra_2: Setting Powered False 02:55:16.245727 run create_hlr_db(pid=15455): Terminated: ok {rc=0} 02:55:16.730091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15457): Launched 02:55:17.072032 run osmo-hlr_10.42.42.2(pid=15458): Launched 02:55:17.195421 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:17.768158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15460): Launched 02:55:18.066528 run osmo-stp_10.42.42.5(pid=15461): Launched 02:55:18.180748 run osmo-msc_10.42.42.6: Starting osmo-msc 02:55:18.721359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15463): Launched 02:55:19.041681 run osmo-msc_10.42.42.6(pid=15464): Launched 02:55:19.220119 run osmo-stp_10.42.42.5(pid=15461): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15461)] 02:55:19.356630 run osmo-stp_10.42.42.5(pid=15461): stdout: | (launched: 2022-12-09_02:55:18.011747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:19.492189 run osmo-stp_10.42.42.5(pid=15461): stderr: | 20221209025518182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025518182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025518183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025518183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025518183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025518184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025518184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:19.627196 run osmo-stp_10.42.42.5(pid=15461): stdout: | (launched: 2022-12-09_02:55:18.011747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:19.754463 run osmo-stp_10.42.42.5(pid=15461): stderr: | 20221209025518182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025518182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025518183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025518183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025518183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025518184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025518184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:19.906494 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15461): Process ended prematurely: osmo-stp_10.42.42.5(pid=15461) [trial-2353↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15461)] [trial-2353↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:55:19.916028 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:55:19.944416 run osmo-hlr_10.42.42.2(pid=15458): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15458)] 02:55:19.994831 run osmo-hlr_10.42.42.2(pid=15458): stdout: | (launched: 2022-12-09_02:55:17.004397) 02:55:20.046664 run osmo-hlr_10.42.42.2(pid=15458): stderr: | 20221209025517334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025517334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025517334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025517334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025517334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025517334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025517347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025517357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025517357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025517357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:20.118818 run osmo-msc_10.42.42.6(pid=15464): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15464)] 02:55:20.168567 run osmo-msc_10.42.42.6(pid=15464): stdout: | (launched: 2022-12-09_02:55:18.983414) 02:55:20.219895 run osmo-msc_10.42.42.6(pid=15464): stderr: | 20221209025519304 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025519305 DLGLOBAL DEBUG validating counter group 0x7f77632a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025519305 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025519305 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025519305 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025519305 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025519307 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025519307 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025519307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025519307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:20.271358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15457): Terminating (SIGTERM) 02:55:20.312441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15460): Terminating (SIGTERM) 02:55:20.353656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15463): Terminating (SIGTERM) 02:55:20.394983 --- ParallelTerminationStrategy: PID 15457 died... 02:55:20.414730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15457): Terminated: ok {rc=0} 02:55:20.460092 --- ParallelTerminationStrategy: PID 15460 died... 02:55:20.479320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15460): Terminated: ok {rc=0} 02:55:20.525173 --- ParallelTerminationStrategy: PID 15463 died... 02:55:20.544411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15463): Terminated: ok {rc=0} 02:55:20.631565 bus /sierra_3: Setting Powered False 02:55:21.730348 bus /sierra_3: Setting Powered False 02:55:22.845518 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:55:23.992586 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:55:24.004505 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:55:24.074428 tst mo_mt_call_osmux.py: using LAC 18578 02:55:24.194660 tst mo_mt_call_osmux.py: using RAC 218 02:55:24.314317 tst mo_mt_call_osmux.py: using CellId 18578 02:55:24.433373 tst mo_mt_call_osmux.py: using BVCI 18579 02:55:24.542103 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:55:24.553327 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:55:24.564376 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:55:24.575751 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:55:24.587743 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:55:24.599162 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:55:24.717451 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:55:24.838240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:25.337250 run create_hlr_db(pid=15466): Launched 02:55:25.467293 bus /sierra_2: Setting Powered False 02:55:26.530978 run create_hlr_db(pid=15466): Terminated: ok {rc=0} 02:55:26.960104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15468): Launched 02:55:27.260627 run osmo-hlr_10.42.42.2(pid=15469): Launched 02:55:27.375083 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:27.892731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15471): Launched 02:55:28.191045 run osmo-stp_10.42.42.5(pid=15472): Launched 02:55:28.304939 run osmo-msc_10.42.42.6: Starting osmo-msc 02:55:28.850350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15474): Launched 02:55:29.151303 run osmo-msc_10.42.42.6(pid=15475): Launched 02:55:29.318850 run osmo-stp_10.42.42.5(pid=15472): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15472)] 02:55:29.446239 run osmo-stp_10.42.42.5(pid=15472): stdout: | (launched: 2022-12-09_02:55:28.136220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:29.573263 run osmo-stp_10.42.42.5(pid=15472): stderr: | 20221209025528304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025528304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025528304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025528305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025528305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025528305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025528305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:29.697905 run osmo-stp_10.42.42.5(pid=15472): stdout: | (launched: 2022-12-09_02:55:28.136220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:29.817236 run osmo-stp_10.42.42.5(pid=15472): stderr: | 20221209025528304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025528304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025528304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025528305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025528305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025528305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025528305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:29.960073 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15472): Process ended prematurely: osmo-stp_10.42.42.5(pid=15472) [trial-2353↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15472)] [trial-2353↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:55:29.969095 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:55:29.996337 run osmo-hlr_10.42.42.2(pid=15469): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15469)] 02:55:30.044269 run osmo-hlr_10.42.42.2(pid=15469): stdout: | (launched: 2022-12-09_02:55:27.205828) 02:55:30.093632 run osmo-hlr_10.42.42.2(pid=15469): stderr: | 20221209025527382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025527382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025527382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025527382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025527382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025527383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025527394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025527403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025527403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025527403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:30.162582 run osmo-msc_10.42.42.6(pid=15475): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15475)] 02:55:30.210219 run osmo-msc_10.42.42.6(pid=15475): stdout: | (launched: 2022-12-09_02:55:29.095454) 02:55:30.259322 run osmo-msc_10.42.42.6(pid=15475): stderr: | 20221209025529367 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025529367 DLGLOBAL DEBUG validating counter group 0x7f98da047c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025529367 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025529367 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025529368 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025529368 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025529370 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025529370 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025529370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025529370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:30.309116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15468): Terminating (SIGTERM) 02:55:30.349343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15471): Terminating (SIGTERM) 02:55:30.389639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15474): Terminating (SIGTERM) 02:55:30.429939 --- ParallelTerminationStrategy: PID 15468 died... 02:55:30.449062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15468): Terminated: ok {rc=0} 02:55:30.493574 --- ParallelTerminationStrategy: PID 15471 died... 02:55:30.512172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15471): Terminated: ok {rc=0} 02:55:30.556366 --- ParallelTerminationStrategy: PID 15474 died... 02:55:30.575107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15474): Terminated: ok {rc=0} 02:55:30.658503 bus /sierra_3: Setting Powered False 02:55:31.755610 bus /sierra_3: Setting Powered False 02:55:32.872213 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:55:34.124474 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:55:34.130842 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:55:34.165104 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:55:34.192438 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:55:34.245211 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:55:34.278804 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:55:34.306069 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:55:34.857555 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:55:34.909258 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:34.920641 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:55:34.991666 tst mo_mt_call.py: using LAC 18579 02:55:35.111617 tst mo_mt_call.py: using RAC 219 02:55:35.243735 tst mo_mt_call.py: using CellId 18579 02:55:35.369395 tst mo_mt_call.py: using BVCI 18580 02:55:35.488007 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:35.499672 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:35.511001 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:35.522434 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:35.533717 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:35.544858 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:55:35.660616 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:55:35.780693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:36.278966 run create_hlr_db(pid=15480): Launched 02:55:36.407904 bus /sierra_2: Setting Powered False 02:55:37.471467 run create_hlr_db(pid=15480): Terminated: ok {rc=0} 02:55:37.897422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15482): Launched 02:55:38.196418 run osmo-hlr_10.42.42.2(pid=15483): Launched 02:55:38.311898 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:38.825870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15485): Launched 02:55:39.123175 run osmo-stp_10.42.42.5(pid=15486): Launched 02:55:39.236685 run osmo-msc_10.42.42.6: Starting osmo-msc 02:55:39.776634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15488): Launched 02:55:40.076151 run osmo-msc_10.42.42.6(pid=15489): Launched 02:55:40.243637 run osmo-stp_10.42.42.5(pid=15486): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15486)] 02:55:40.371098 run osmo-stp_10.42.42.5(pid=15486): stdout: | (launched: 2022-12-09_02:55:39.068427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:40.497987 run osmo-stp_10.42.42.5(pid=15486): stderr: | 20221209025539240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025539240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025539240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025539241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025539241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025539241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025539241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:40.623150 run osmo-stp_10.42.42.5(pid=15486): stdout: | (launched: 2022-12-09_02:55:39.068427) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:40.742477 run osmo-stp_10.42.42.5(pid=15486): stderr: | 20221209025539240 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025539240 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025539240 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025539241 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025539241 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025539241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025539241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:40.885331 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15486): Process ended prematurely: osmo-stp_10.42.42.5(pid=15486) [trial-2353↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15486)] [trial-2353↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:55:40.894382 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:55:40.921191 run osmo-hlr_10.42.42.2(pid=15483): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15483)] 02:55:40.968707 run osmo-hlr_10.42.42.2(pid=15483): stdout: | (launched: 2022-12-09_02:55:38.141414) 02:55:41.018067 run osmo-hlr_10.42.42.2(pid=15483): stderr: | 20221209025538315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025538315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025538315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025538315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025538315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025538315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025538328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025538337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025538337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025538337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:41.087002 run osmo-msc_10.42.42.6(pid=15489): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15489)] 02:55:41.140344 run osmo-msc_10.42.42.6(pid=15489): stdout: | (launched: 2022-12-09_02:55:40.021086) 02:55:41.192555 run osmo-msc_10.42.42.6(pid=15489): stderr: | 20221209025540293 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025540293 DLGLOBAL DEBUG validating counter group 0x7fd1a5fedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025540293 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025540293 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025540294 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025540294 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025540296 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025540296 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025540297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025540297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:41.244413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15482): Terminating (SIGTERM) 02:55:41.286341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15485): Terminating (SIGTERM) 02:55:41.328701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15488): Terminating (SIGTERM) 02:55:41.370922 --- ParallelTerminationStrategy: PID 15482 died... 02:55:41.390840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15482): Terminated: ok {rc=0} 02:55:41.437821 --- ParallelTerminationStrategy: PID 15485 died... 02:55:41.457155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15485): Terminated: ok {rc=0} 02:55:41.504036 --- ParallelTerminationStrategy: PID 15488 died... 02:55:41.523373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15488): Terminated: ok {rc=0} 02:55:41.612543 bus /sierra_3: Setting Powered False 02:55:42.711052 bus /sierra_3: Setting Powered False 02:55:43.828329 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:55:44.974728 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:44.986923 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:55:45.059650 tst mo_mt_call_osmux.py: using LAC 18580 02:55:45.186137 tst mo_mt_call_osmux.py: using RAC 220 02:55:45.313692 tst mo_mt_call_osmux.py: using CellId 18580 02:55:45.438891 tst mo_mt_call_osmux.py: using BVCI 18581 02:55:45.556860 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:45.568192 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:45.579298 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:45.590414 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:45.601854 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:45.612999 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:55:45.733662 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:55:45.866782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:46.378117 run create_hlr_db(pid=15491): Launched 02:55:46.525304 bus /sierra_2: Setting Powered False 02:55:47.584769 run create_hlr_db(pid=15491): Terminated: ok {rc=0} 02:55:48.022184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15493): Launched 02:55:48.342462 run osmo-hlr_10.42.42.2(pid=15494): Launched 02:55:48.464663 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:49.014112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15496): Launched 02:55:49.332781 run osmo-stp_10.42.42.5(pid=15497): Launched 02:55:49.455097 run osmo-msc_10.42.42.6: Starting osmo-msc 02:55:50.033685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15499): Launched 02:55:50.352747 run osmo-msc_10.42.42.6(pid=15500): Launched 02:55:50.530689 run osmo-stp_10.42.42.5(pid=15497): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15497)] 02:55:50.665582 run osmo-stp_10.42.42.5(pid=15497): stdout: | (launched: 2022-12-09_02:55:49.274542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:50.800661 run osmo-stp_10.42.42.5(pid=15497): stderr: | 20221209025549466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025549466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025549467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025549467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025549469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025549470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025549470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:50.935281 run osmo-stp_10.42.42.5(pid=15497): stdout: | (launched: 2022-12-09_02:55:49.274542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:51.062634 run osmo-stp_10.42.42.5(pid=15497): stderr: | 20221209025549466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025549466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025549467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025549467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025549469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025549470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025549470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:51.215904 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15497): Process ended prematurely: osmo-stp_10.42.42.5(pid=15497) [trial-2353↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15497)] [trial-2353↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:55:51.225396 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:55:51.253041 run osmo-hlr_10.42.42.2(pid=15494): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15494)] 02:55:51.303217 run osmo-hlr_10.42.42.2(pid=15494): stdout: | (launched: 2022-12-09_02:55:48.284451) 02:55:51.355350 run osmo-hlr_10.42.42.2(pid=15494): stderr: | 20221209025548482 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025548482 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025548482 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025548482 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025548482 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025548482 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025548513 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025548523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025548523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025548523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:51.427064 run osmo-msc_10.42.42.6(pid=15500): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15500)] 02:55:51.477130 run osmo-msc_10.42.42.6(pid=15500): stdout: | (launched: 2022-12-09_02:55:50.294471) 02:55:51.528502 run osmo-msc_10.42.42.6(pid=15500): stderr: | 20221209025550616 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025550616 DLGLOBAL DEBUG validating counter group 0x7f8ed07b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025550616 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025550616 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025550616 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025550616 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025550618 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025550618 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025550618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025550619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:51.580480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15493): Terminating (SIGTERM) 02:55:51.622027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15496): Terminating (SIGTERM) 02:55:51.663542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15499): Terminating (SIGTERM) 02:55:51.705210 --- ParallelTerminationStrategy: PID 15493 died... 02:55:51.725131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15493): Terminated: ok {rc=0} 02:55:51.771205 --- ParallelTerminationStrategy: PID 15496 died... 02:55:51.790796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15496): Terminated: ok {rc=0} 02:55:51.836772 --- ParallelTerminationStrategy: PID 15499 died... 02:55:51.856351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15499): Terminated: ok {rc=0} 02:55:51.945346 bus /sierra_3: Setting Powered False 02:55:53.044627 bus /sierra_3: Setting Powered False 02:55:54.160171 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 emergency:trx-lms --------------------------------------------------------------------- 02:55:55.409281 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:55:55.413868 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 02:55:55.447200 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 02:55:55.473943 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 02:55:55.557958 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 02:55:55.590946 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 02:55:55.617371 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 02:55:56.199530 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2353 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 02:55:56.204634 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:56.215243 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 02:55:56.264609 tst emergency_mo_mt_call.py: using LAC 18581 02:55:56.380916 tst emergency_mo_mt_call.py: using RAC 221 02:55:56.496517 tst emergency_mo_mt_call.py: using CellId 18581 02:55:56.611454 tst emergency_mo_mt_call.py: using BVCI 18582 02:55:56.717282 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:56.727883 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:56.738623 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:56.749397 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:56.759944 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:56.770525 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:56.888872 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:57.011288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:57.500042 run create_hlr_db(pid=15505): Launched 02:55:57.627912 bus /sierra_2: Setting Powered False 02:55:58.690616 run create_hlr_db(pid=15505): Terminated: ok {rc=0} 02:55:59.128550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15507): Launched 02:55:59.442425 run osmo-hlr_10.42.42.2(pid=15508): Launched 02:55:59.561817 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:00.104870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15510): Launched 02:56:00.418816 run osmo-stp_10.42.42.5(pid=15511): Launched 02:56:00.547614 tst emergency_mo_mt_call.py: using MSISDN 6987 02:56:00.708253 run osmo-msc_10.42.42.6: Starting osmo-msc 02:56:01.307793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15513): Launched 02:56:01.653734 run osmo-msc_10.42.42.6(pid=15514): Launched 02:56:02.006483 run osmo-stp_10.42.42.5(pid=15511): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15511)] 02:56:02.232682 run osmo-stp_10.42.42.5(pid=15511): stdout: | (launched: 2022-12-09_02:56:00.361366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:02.364938 run osmo-stp_10.42.42.5(pid=15511): stderr: | 20221209025600552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025600552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025600553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025600553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025600554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025600554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025600554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:02.495693 run osmo-stp_10.42.42.5(pid=15511): stdout: | (launched: 2022-12-09_02:56:00.361366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:02.620784 run osmo-stp_10.42.42.5(pid=15511): stderr: | 20221209025600552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025600552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025600553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025600553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025600554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025600554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025600554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:02.770303 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=15511): Process ended prematurely: osmo-stp_10.42.42.5(pid=15511) [trial-2353↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15511)] [trial-2353↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 02:56:02.779350 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 02:56:02.806685 run osmo-hlr_10.42.42.2(pid=15508): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15508)] 02:56:02.856451 run osmo-hlr_10.42.42.2(pid=15508): stdout: | (launched: 2022-12-09_02:55:59.385122) 02:56:02.908118 run osmo-hlr_10.42.42.2(pid=15508): stderr: | 20221209025559583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025559583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025559583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025559583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025559583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025559583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025559596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025559605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025559605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025559605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:02.979599 run osmo-msc_10.42.42.6(pid=15514): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15514)] 02:56:03.029345 run osmo-msc_10.42.42.6(pid=15514): stdout: | (launched: 2022-12-09_02:56:01.583846) 02:56:03.080490 run osmo-msc_10.42.42.6(pid=15514): stderr: | 20221209025602024 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025602024 DLGLOBAL DEBUG validating counter group 0x7f6ad8a6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025602024 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025602024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025602025 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025602025 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025602027 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025602027 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025602027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025602027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:56:03.132100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15507): Terminating (SIGTERM) 02:56:03.174168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15510): Terminating (SIGTERM) 02:56:03.215815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15513): Terminating (SIGTERM) 02:56:03.257727 --- ParallelTerminationStrategy: PID 15507 died... 02:56:03.277657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15507): Terminated: ok {rc=0} 02:56:03.323742 --- ParallelTerminationStrategy: PID 15510 died... 02:56:03.343245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15510): Terminated: ok {rc=0} 02:56:03.389067 --- ParallelTerminationStrategy: PID 15513 died... 02:56:03.408566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15513): Terminated: ok {rc=0} 02:56:03.496584 bus /sierra_3: Setting Powered False 02:56:04.592684 bus /sierra_3: Setting Powered False 02:56:05.707108 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 02:56:06.793297 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:56:06.804541 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 02:56:06.855198 tst emergency_preemptive_call.py: using LAC 18582 02:56:06.971717 tst emergency_preemptive_call.py: using RAC 222 02:56:07.089418 tst emergency_preemptive_call.py: using CellId 18582 02:56:07.214787 tst emergency_preemptive_call.py: using BVCI 18583 02:56:07.330808 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:56:07.342146 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:56:07.353251 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:56:07.364237 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:56:07.375597 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:56:07.386668 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:56:07.500299 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:56:07.616691 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:56:07.736590 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:56:07.852828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:08.307537 run create_hlr_db(pid=15516): Launched 02:56:08.420488 bus /sierra_2: Setting Powered False 02:56:09.479086 run create_hlr_db(pid=15516): Terminated: ok {rc=0} 02:56:09.908754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15518): Launched 02:56:10.223366 run osmo-hlr_10.42.42.2(pid=15519): Launched 02:56:10.343010 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:10.886834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15521): Launched 02:56:11.201523 run osmo-stp_10.42.42.5(pid=15522): Launched 02:56:11.331751 tst emergency_preemptive_call.py: using MSISDN 6988 02:56:11.493923 run osmo-msc_10.42.42.6: Starting osmo-msc 02:56:12.057971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15524): Launched 02:56:12.371461 run osmo-msc_10.42.42.6(pid=15525): Launched 02:56:12.546223 run osmo-stp_10.42.42.5(pid=15522): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15522)] 02:56:12.682202 run osmo-stp_10.42.42.5(pid=15522): stdout: | (launched: 2022-12-09_02:56:11.143660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:12.814706 run osmo-stp_10.42.42.5(pid=15522): stderr: | 20221209025611334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025611334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025611334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025611335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025611335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025611335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025611335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:12.945250 run osmo-stp_10.42.42.5(pid=15522): stdout: | (launched: 2022-12-09_02:56:11.143660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:13.070628 run osmo-stp_10.42.42.5(pid=15522): stderr: | 20221209025611334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025611334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025611334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025611335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025611335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025611335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025611335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:13.220368 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=15522): Process ended prematurely: osmo-stp_10.42.42.5(pid=15522) [trial-2353↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15522)] [trial-2353↪emergency:trx-lms↪emergency_preemptive_call.py:32] 02:56:13.229564 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 02:56:13.257381 run osmo-hlr_10.42.42.2(pid=15519): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15519)] 02:56:13.307919 run osmo-hlr_10.42.42.2(pid=15519): stdout: | (launched: 2022-12-09_02:56:10.165697) 02:56:13.360213 run osmo-hlr_10.42.42.2(pid=15519): stderr: | 20221209025610365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025610365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025610365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025610365 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025610365 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025610365 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025610378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025610386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025610386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025610386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:13.433049 run osmo-msc_10.42.42.6(pid=15525): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15525)] 02:56:13.483481 run osmo-msc_10.42.42.6(pid=15525): stdout: | (launched: 2022-12-09_02:56:12.314080) 02:56:13.535620 run osmo-msc_10.42.42.6(pid=15525): stderr: | 20221209025612636 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209025612636 DLGLOBAL DEBUG validating counter group 0x7f585f766c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209025612636 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209025612636 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209025612636 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209025612637 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209025612639 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209025612639 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209025612639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209025612639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:56:13.588167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15518): Terminating (SIGTERM) 02:56:13.629807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15521): Terminating (SIGTERM) 02:56:13.671752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15524): Terminating (SIGTERM) 02:56:13.714108 --- ParallelTerminationStrategy: PID 15518 died... 02:56:13.734073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15518): Terminated: ok {rc=0} 02:56:13.780474 --- ParallelTerminationStrategy: PID 15521 died... 02:56:13.800175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15521): Terminated: ok {rc=0} 02:56:13.846109 --- ParallelTerminationStrategy: PID 15524 died... 02:56:13.865770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15524): Terminated: ok {rc=0} 02:56:13.954504 bus /sierra_9: Setting Powered False 02:56:15.050751 bus /sierra_9: Setting Powered False 02:56:16.168380 bus /sierra_8: Setting Powered False 02:56:17.277780 bus /sierra_8: Setting Powered False 02:56:18.392669 bus /sierra_3: Setting Powered False 02:56:19.490466 bus /sierra_3: Setting Powered False 02:56:20.609112 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-lms --------------------------------------------------------------------- 02:56:21.889878 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:56:21.906448 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 02:56:21.947711 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 02:56:21.986160 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 02:56:22.073132 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 02:56:22.107331 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 02:56:22.147093 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 02:56:22.737188 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 02:56:22.789341 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:22.800305 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:56:22.850363 tst cs_paging_gprs_active.py: using LAC 18583 02:56:22.977092 tst cs_paging_gprs_active.py: using RAC 223 02:56:23.103163 tst cs_paging_gprs_active.py: using CellId 18583 02:56:23.230438 tst cs_paging_gprs_active.py: using BVCI 18584 02:56:23.346905 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:23.358088 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:23.368917 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:23.380279 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:23.391357 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:23.402420 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:23.413657 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:23.424582 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:23.435571 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:23.555814 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:23.672538 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:56:23.873329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:24.174750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15531): Launched 02:56:24.434627 run iperf3-srv_10.42.42.10(pid=15532): Launched 02:56:24.546732 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:56:24.746598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:25.054590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15533): Launched 02:56:25.313848 run iperf3-srv_10.42.42.10(pid=15534): Launched 02:56:25.425823 tst cs_paging_gprs_active.py:38: start network... 02:56:25.624583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:26.086614 run create_hlr_db(pid=15535): Launched 02:56:26.201369 bus /sierra_2: Setting Powered False 02:56:27.261310 run create_hlr_db(pid=15535): Terminated: ok {rc=0} 02:56:27.677739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15537): Launched 02:56:27.975680 run osmo-hlr_10.42.42.2(pid=15538): Launched 02:56:28.089684 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:28.600921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15540): Launched 02:56:28.898568 run osmo-stp_10.42.42.5(pid=15541): Launched 02:56:29.012203 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:29.525755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15543): Launched 02:56:29.639586 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:29.890151 run patchelf(pid=15544): Launched 02:56:30.055467 run osmo-stp_10.42.42.5(pid=15541): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15541)] 02:56:30.180849 run osmo-stp_10.42.42.5(pid=15541): stdout: | (launched: 2022-12-09_02:56:28.843619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:30.309340 run osmo-stp_10.42.42.5(pid=15541): stderr: | 20221209025629013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025629013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025629014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025629014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025629016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025629016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025629017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:30.437146 run osmo-stp_10.42.42.5(pid=15541): stdout: | (launched: 2022-12-09_02:56:28.843619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:30.559574 run osmo-stp_10.42.42.5(pid=15541): stderr: | 20221209025629013 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025629013 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025629014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025629014 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025629016 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025629016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025629017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:30.703801 run patchelf(pid=15544): Terminating (SIGINT) 02:56:30.885401 run patchelf(pid=15544): Terminated: ok {rc=0} 02:56:31.026236 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15541): Process ended prematurely: osmo-stp_10.42.42.5(pid=15541) [trial-2353↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15541)] [trial-2353↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 02:56:31.037499 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 02:56:31.069525 run osmo-hlr_10.42.42.2(pid=15538): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15538)] 02:56:31.122108 run osmo-hlr_10.42.42.2(pid=15538): stdout: | (launched: 2022-12-09_02:56:27.920829) 02:56:31.179278 run osmo-hlr_10.42.42.2(pid=15538): stderr: | 20221209025628098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025628098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025628098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025628098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025628098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025628098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025628112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025628122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025628122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025628122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:31.235033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15531): Terminating (SIGTERM) 02:56:31.279918 run iperf3-srv_10.42.42.10(pid=15532): Terminating (SIGTERM) 02:56:31.326822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15533): Terminating (SIGTERM) 02:56:31.374280 run iperf3-srv_10.42.42.10(pid=15534): Terminating (SIGTERM) 02:56:31.420738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15537): Terminating (SIGTERM) 02:56:31.466096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15540): Terminating (SIGTERM) 02:56:31.512218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15543): Terminating (SIGTERM) 02:56:31.558918 --- ParallelTerminationStrategy: PID 15531 died... 02:56:31.580362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15531): Terminated: ok {rc=0} 02:56:31.631615 --- ParallelTerminationStrategy: PID 15532 died... 02:56:31.652392 run iperf3-srv_10.42.42.10(pid=15532): Terminated {rc=256} 02:56:31.702974 --- ParallelTerminationStrategy: PID 15533 died... 02:56:31.723841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15533): Terminated: ok {rc=0} 02:56:31.774280 --- ParallelTerminationStrategy: PID 15534 died... 02:56:31.794751 run iperf3-srv_10.42.42.10(pid=15534): Terminated {rc=256} 02:56:31.842754 --- ParallelTerminationStrategy: PID 15537 died... 02:56:31.863315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15537): Terminated: ok {rc=0} 02:56:31.910507 --- ParallelTerminationStrategy: PID 15540 died... 02:56:31.933208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15540): Terminated: ok {rc=0} 02:56:31.981983 --- ParallelTerminationStrategy: PID 15543 died... 02:56:32.002394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15543): Terminated: ok {rc=0} 02:56:32.094945 bus /gobi_0: Setting Powered False 02:56:33.193666 bus /gobi_0: Setting Powered False 02:56:34.308062 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms iperf3.py ---------------------------------------------- 02:56:35.452718 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:35.463917 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:56:35.518794 tst iperf3.py: using LAC 18584 02:56:35.636207 tst iperf3.py: using RAC 224 02:56:35.752639 tst iperf3.py: using CellId 18584 02:56:35.877986 tst iperf3.py: using BVCI 18585 02:56:35.995060 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:36.006403 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:36.017456 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:36.028186 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:36.039159 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:36.050060 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:36.060924 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:36.071783 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:36.082775 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:36.196578 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:56:36.397071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:36.697902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15545): Launched 02:56:36.958124 run iperf3-srv_10.42.42.10(pid=15546): Launched 02:56:37.070095 tst iperf3.py:8: start network... 02:56:37.282340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:37.782785 run create_hlr_db(pid=15547): Launched 02:56:37.912517 bus /gobi_6: Setting Powered False 02:56:38.976517 run create_hlr_db(pid=15547): Terminated: ok {rc=0} 02:56:39.424283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15549): Launched 02:56:39.745999 run osmo-hlr_10.42.42.2(pid=15550): Launched 02:56:39.868855 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:40.426409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15552): Launched 02:56:40.747918 run osmo-stp_10.42.42.5(pid=15553): Launched 02:56:40.870407 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:41.425148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15555): Launched 02:56:41.547130 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:41.817917 run patchelf(pid=15556): Launched 02:56:41.995386 run osmo-stp_10.42.42.5(pid=15553): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15553)] 02:56:42.130790 run osmo-stp_10.42.42.5(pid=15553): stdout: | (launched: 2022-12-09_02:56:40.689011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:42.268704 run osmo-stp_10.42.42.5(pid=15553): stderr: | 20221209025640882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025640882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025640883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025640883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025640883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025640883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025640884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:42.406151 run osmo-stp_10.42.42.5(pid=15553): stdout: | (launched: 2022-12-09_02:56:40.689011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:42.537556 run osmo-stp_10.42.42.5(pid=15553): stderr: | 20221209025640882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025640882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025640883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025640883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025640883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025640883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025640884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:42.693659 run patchelf(pid=15556): Terminating (SIGINT) 02:56:42.872636 run patchelf(pid=15556): Terminated: ok {rc=0} 02:56:43.001698 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15553): Process ended prematurely: osmo-stp_10.42.42.5(pid=15553) [trial-2353↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15553)] [trial-2353↪gprs:trx-lms↪iperf3.py:8] 02:56:43.011731 tst iperf3.py:8: Test FAILED (7.6 sec) 02:56:43.040220 run osmo-hlr_10.42.42.2(pid=15550): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15550)] 02:56:43.090192 run osmo-hlr_10.42.42.2(pid=15550): stdout: | (launched: 2022-12-09_02:56:39.687653) 02:56:43.141924 run osmo-hlr_10.42.42.2(pid=15550): stderr: | 20221209025639885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025639885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025639885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025639885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025639886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025639886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025639898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025639908 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025639908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025639909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:43.194185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15545): Terminating (SIGTERM) 02:56:43.236544 run iperf3-srv_10.42.42.10(pid=15546): Terminating (SIGTERM) 02:56:43.278184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15549): Terminating (SIGTERM) 02:56:43.319827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15552): Terminating (SIGTERM) 02:56:43.361522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15555): Terminating (SIGTERM) 02:56:43.403288 --- ParallelTerminationStrategy: PID 15545 died... 02:56:43.423247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15545): Terminated: ok {rc=0} 02:56:43.469548 --- ParallelTerminationStrategy: PID 15546 died... 02:56:43.488888 run iperf3-srv_10.42.42.10(pid=15546): Terminated {rc=256} 02:56:43.534635 --- ParallelTerminationStrategy: PID 15549 died... 02:56:43.554203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15549): Terminated: ok {rc=0} 02:56:43.599889 --- ParallelTerminationStrategy: PID 15552 died... 02:56:43.619319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15552): Terminated: ok {rc=0} 02:56:43.664935 --- ParallelTerminationStrategy: PID 15555 died... 02:56:43.684482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15555): Terminated: ok {rc=0} 02:56:43.770507 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms iperf3m4.py ---------------------------------------------- 02:56:44.915522 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:44.927097 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:56:44.977414 tst iperf3m4.py: using LAC 18585 02:56:45.096282 tst iperf3m4.py: using RAC 225 02:56:45.214271 tst iperf3m4.py: using CellId 18585 02:56:45.332807 tst iperf3m4.py: using BVCI 18586 02:56:45.444271 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:45.455048 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:45.465562 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:45.476549 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:45.487699 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:45.498838 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:45.510172 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:45.521364 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:45.532712 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:45.650497 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:45.772150 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:45.891871 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:46.024797 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:56:46.284027 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:46.692148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15557): Launched 02:56:46.972404 run iperf3-srv_10.42.42.10(pid=15558): Launched 02:56:47.100436 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:56:47.305865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:47.606715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15559): Launched 02:56:47.866320 run iperf3-srv_10.42.42.10(pid=15560): Launched 02:56:47.978242 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:56:48.177853 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:48.477683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15561): Launched 02:56:48.736817 run iperf3-srv_10.42.42.10(pid=15562): Launched 02:56:48.848616 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:56:49.047868 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:49.349285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15563): Launched 02:56:49.629518 run iperf3-srv_10.42.42.10(pid=15564): Launched 02:56:49.749828 tst iperf3m4.py:8: start network... 02:56:49.965801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:50.464254 run create_hlr_db(pid=15565): Launched 02:56:50.594261 bus /gobi_6: Setting Powered False 02:56:51.657542 run create_hlr_db(pid=15565): Terminated: ok {rc=0} 02:56:52.085974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15567): Launched 02:56:52.385514 run osmo-hlr_10.42.42.2(pid=15568): Launched 02:56:52.499373 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:53.031215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15570): Launched 02:56:53.331047 run osmo-stp_10.42.42.5(pid=15571): Launched 02:56:53.444911 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:53.961131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15573): Launched 02:56:54.075476 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:54.328215 run patchelf(pid=15574): Launched 02:56:54.494956 run osmo-stp_10.42.42.5(pid=15571): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15571)] 02:56:54.621792 run osmo-stp_10.42.42.5(pid=15571): stdout: | (launched: 2022-12-09_02:56:53.275560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:54.749918 run osmo-stp_10.42.42.5(pid=15571): stderr: | 20221209025653444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025653444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025653444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025653445 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025653445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025653445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025653445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:54.878215 run osmo-stp_10.42.42.5(pid=15571): stdout: | (launched: 2022-12-09_02:56:53.275560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:55.000840 run osmo-stp_10.42.42.5(pid=15571): stderr: | 20221209025653444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025653444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025653444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025653445 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025653445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025653445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025653445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:55.146889 run patchelf(pid=15574): Terminating (SIGINT) 02:56:55.315193 run patchelf(pid=15574): Terminated: ok {rc=0} 02:56:55.436257 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15571): Process ended prematurely: osmo-stp_10.42.42.5(pid=15571) [trial-2353↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15571)] [trial-2353↪gprs:trx-lms↪iperf3m4.py:8] 02:56:55.445880 tst iperf3m4.py:8: Test FAILED (10.6 sec) 02:56:55.473891 run osmo-hlr_10.42.42.2(pid=15568): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15568)] 02:56:55.522075 run osmo-hlr_10.42.42.2(pid=15568): stdout: | (launched: 2022-12-09_02:56:52.330271) 02:56:55.571610 run osmo-hlr_10.42.42.2(pid=15568): stderr: | 20221209025652505 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025652505 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025652505 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025652505 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025652505 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025652505 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025652517 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025652526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025652526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025652526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:55.621430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15557): Terminating (SIGTERM) 02:56:55.661522 run iperf3-srv_10.42.42.10(pid=15558): Terminating (SIGTERM) 02:56:55.701245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15559): Terminating (SIGTERM) 02:56:55.741121 run iperf3-srv_10.42.42.10(pid=15560): Terminating (SIGTERM) 02:56:55.780761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15561): Terminating (SIGTERM) 02:56:55.820542 run iperf3-srv_10.42.42.10(pid=15562): Terminating (SIGTERM) 02:56:55.860152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15563): Terminating (SIGTERM) 02:56:55.899748 run iperf3-srv_10.42.42.10(pid=15564): Terminating (SIGTERM) 02:56:55.939382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15567): Terminating (SIGTERM) 02:56:55.979062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15570): Terminating (SIGTERM) 02:56:56.018767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15573): Terminating (SIGTERM) 02:56:56.058680 --- ParallelTerminationStrategy: PID 15557 died... 02:56:56.077691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15557): Terminated: ok {rc=0} 02:56:56.121875 --- ParallelTerminationStrategy: PID 15558 died... 02:56:56.140330 run iperf3-srv_10.42.42.10(pid=15558): Terminated {rc=256} 02:56:56.184301 --- ParallelTerminationStrategy: PID 15559 died... 02:56:56.202807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15559): Terminated: ok {rc=0} 02:56:56.246910 --- ParallelTerminationStrategy: PID 15560 died... 02:56:56.265371 run iperf3-srv_10.42.42.10(pid=15560): Terminated {rc=256} 02:56:56.309357 --- ParallelTerminationStrategy: PID 15561 died... 02:56:56.327745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15561): Terminated: ok {rc=0} 02:56:56.372424 --- ParallelTerminationStrategy: PID 15562 died... 02:56:56.390943 run iperf3-srv_10.42.42.10(pid=15562): Terminated {rc=256} 02:56:56.435046 --- ParallelTerminationStrategy: PID 15563 died... 02:56:56.453603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15563): Terminated: ok {rc=0} 02:56:56.497612 --- ParallelTerminationStrategy: PID 15564 died... 02:56:56.516100 run iperf3-srv_10.42.42.10(pid=15564): Terminated {rc=256} 02:56:56.560283 --- ParallelTerminationStrategy: PID 15567 died... 02:56:56.579042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15567): Terminated: ok {rc=0} 02:56:56.623076 --- ParallelTerminationStrategy: PID 15570 died... 02:56:56.641679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15570): Terminated: ok {rc=0} 02:56:56.685836 --- ParallelTerminationStrategy: PID 15573 died... 02:56:56.704276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15573): Terminated: ok {rc=0} 02:56:56.790590 bus /gobi_4: Setting Powered False 02:56:57.890821 bus /gobi_4: Setting Powered False 02:56:59.005822 bus /gobi_1: Setting Powered False 02:57:00.104291 bus /gobi_1: Setting Powered False 02:57:01.225282 bus /gobi_0: Setting Powered False 02:57:02.338719 bus /gobi_0: Setting Powered False 02:57:03.454709 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms ping.py ---------------------------------------------- 02:57:04.558002 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:04.569579 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:57:04.620795 tst ping.py: using LAC 18586 02:57:04.745572 tst ping.py: using RAC 226 02:57:04.869758 tst ping.py: using CellId 18586 02:57:04.992322 tst ping.py: using BVCI 18587 02:57:05.099989 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:05.110746 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:05.121348 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:05.132060 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:05.142960 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:05.153979 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:05.164755 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:05.175809 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:57:05.293044 tst ping.py:19: start network... 02:57:05.504515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:05.990506 run create_hlr_db(pid=15575): Launched 02:57:06.118223 bus /gobi_6: Setting Powered False 02:57:07.181604 run create_hlr_db(pid=15575): Terminated: ok {rc=0} 02:57:07.619408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15577): Launched 02:57:07.931483 run osmo-hlr_10.42.42.2(pid=15578): Launched 02:57:08.049943 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:08.597268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15580): Launched 02:57:08.911990 run osmo-stp_10.42.42.5(pid=15581): Launched 02:57:09.031901 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:09.575539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15583): Launched 02:57:09.694558 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:09.958707 run patchelf(pid=15584): Launched 02:57:10.132566 run osmo-stp_10.42.42.5(pid=15581): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15581)] 02:57:10.265853 run osmo-stp_10.42.42.5(pid=15581): stdout: | (launched: 2022-12-09_02:57:08.854280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:10.400512 run osmo-stp_10.42.42.5(pid=15581): stderr: | 20221209025709048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025709048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025709048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025709048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025709049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025709049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025709049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:10.535255 run osmo-stp_10.42.42.5(pid=15581): stdout: | (launched: 2022-12-09_02:57:08.854280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:10.664085 run osmo-stp_10.42.42.5(pid=15581): stderr: | 20221209025709048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025709048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025709048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025709048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025709049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025709049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025709049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:10.816861 run patchelf(pid=15584): Terminating (SIGINT) 02:57:10.992355 run patchelf(pid=15584): Terminated: ok {rc=0} 02:57:11.118541 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15581): Process ended prematurely: osmo-stp_10.42.42.5(pid=15581) [trial-2353↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15581)] [trial-2353↪gprs:trx-lms↪ping.py:22] 02:57:11.127961 tst ping.py:22: Test FAILED (6.6 sec) 02:57:11.155681 run osmo-hlr_10.42.42.2(pid=15578): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15578)] 02:57:11.205498 run osmo-hlr_10.42.42.2(pid=15578): stdout: | (launched: 2022-12-09_02:57:07.874334) 02:57:11.256612 run osmo-hlr_10.42.42.2(pid=15578): stderr: | 20221209025708074 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025708074 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025708074 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025708074 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025708074 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025708075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025708087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025708098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025708099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025708099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:11.308081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15577): Terminating (SIGTERM) 02:57:11.349244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15580): Terminating (SIGTERM) 02:57:11.390343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15583): Terminating (SIGTERM) 02:57:11.431872 --- ParallelTerminationStrategy: PID 15577 died... 02:57:11.452094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15577): Terminated: ok {rc=0} 02:57:11.497874 --- ParallelTerminationStrategy: PID 15580 died... 02:57:11.517275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15580): Terminated: ok {rc=0} 02:57:11.562837 --- ParallelTerminationStrategy: PID 15583 died... 02:57:11.582145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15583): Terminated: ok {rc=0} 02:57:11.668170 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 02:57:12.755928 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:12.767348 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:57:12.818109 tst ping_idle_ping.py: using LAC 18587 02:57:12.938242 tst ping_idle_ping.py: using RAC 227 02:57:13.054671 tst ping_idle_ping.py: using CellId 18587 02:57:13.170836 tst ping_idle_ping.py: using BVCI 18588 02:57:13.278350 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:13.289167 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:13.299926 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:13.311036 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:13.322186 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:13.333104 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:13.344174 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:57:13.354769 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:57:13.469173 tst ping_idle_ping.py:24: start network... 02:57:13.666713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:14.125251 run create_hlr_db(pid=15585): Launched 02:57:14.237955 bus /gobi_6: Setting Powered False 02:57:15.297194 run create_hlr_db(pid=15585): Terminated: ok {rc=0} 02:57:15.709580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15587): Launched 02:57:16.034416 run osmo-hlr_10.42.42.2(pid=15588): Launched 02:57:16.273110 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:16.880841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15590): Launched 02:57:17.189211 run osmo-stp_10.42.42.5(pid=15591): Launched 02:57:17.392584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:17.907380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15593): Launched 02:57:18.019916 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:18.268457 run patchelf(pid=15594): Launched 02:57:18.431833 run osmo-stp_10.42.42.5(pid=15591): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15591)] 02:57:18.556630 run osmo-stp_10.42.42.5(pid=15591): stdout: | (launched: 2022-12-09_02:57:17.128625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:18.683203 run osmo-stp_10.42.42.5(pid=15591): stderr: | 20221209025717411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025717411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025717411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025717412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025717412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025717412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025717413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:18.809822 run osmo-stp_10.42.42.5(pid=15591): stdout: | (launched: 2022-12-09_02:57:17.128625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:18.930990 run osmo-stp_10.42.42.5(pid=15591): stderr: | 20221209025717411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025717411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025717411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025717412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025717412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025717412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025717413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:19.074090 run patchelf(pid=15594): Terminating (SIGINT) 02:57:19.239325 run patchelf(pid=15594): Terminated: ok {rc=0} 02:57:19.358608 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15591): Process ended prematurely: osmo-stp_10.42.42.5(pid=15591) [trial-2353↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15591)] [trial-2353↪gprs:trx-lms↪ping_idle_ping.py:27] 02:57:19.367783 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:57:19.394738 run osmo-hlr_10.42.42.2(pid=15588): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15588)] 02:57:19.442749 run osmo-hlr_10.42.42.2(pid=15588): stdout: | (launched: 2022-12-09_02:57:15.968851) 02:57:19.492090 run osmo-hlr_10.42.42.2(pid=15588): stderr: | 20221209025716198 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025716199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025716199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025716199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025716199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025716199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025716217 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025716242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025716243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025716243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:19.541862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15587): Terminating (SIGTERM) 02:57:19.581626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15590): Terminating (SIGTERM) 02:57:19.621198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15593): Terminating (SIGTERM) 02:57:19.661048 --- ParallelTerminationStrategy: PID 15587 died... 02:57:19.679946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15587): Terminated: ok {rc=0} 02:57:19.724611 --- ParallelTerminationStrategy: PID 15590 died... 02:57:19.743183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15590): Terminated: ok {rc=0} 02:57:19.786903 --- ParallelTerminationStrategy: PID 15593 died... 02:57:19.805386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15593): Terminated: ok {rc=0} 02:57:19.890747 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 02:57:21.192601 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:57:21.198136 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:57:21.231521 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:57:21.270225 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:57:21.357015 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:57:21.392001 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:57:21.431910 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:57:22.025509 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:57:22.077740 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:22.089233 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:57:22.142488 tst cs_paging_gprs_active.py: using LAC 18588 02:57:22.268489 tst cs_paging_gprs_active.py: using RAC 228 02:57:22.393165 tst cs_paging_gprs_active.py: using CellId 18588 02:57:22.518020 tst cs_paging_gprs_active.py: using BVCI 18589 02:57:22.635117 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:22.646613 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:22.657807 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:22.669067 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:22.680066 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:22.691131 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:22.702502 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:22.713591 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:22.724821 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:22.843881 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:22.964572 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:57:23.181996 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:23.506178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15598): Launched 02:57:23.786424 run iperf3-srv_10.42.42.10(pid=15599): Launched 02:57:23.906993 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:57:24.124832 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:24.449188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15600): Launched 02:57:24.727971 run iperf3-srv_10.42.42.10(pid=15601): Launched 02:57:24.848438 tst cs_paging_gprs_active.py:38: start network... 02:57:25.064904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:25.563070 run create_hlr_db(pid=15602): Launched 02:57:25.693436 bus /gobi_6: Setting Powered False 02:57:26.757462 run create_hlr_db(pid=15602): Terminated: ok {rc=0} 02:57:27.186044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15604): Launched 02:57:27.485970 run osmo-hlr_10.42.42.2(pid=15605): Launched 02:57:27.601817 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:28.122043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15607): Launched 02:57:28.421541 run osmo-stp_10.42.42.5(pid=15608): Launched 02:57:28.536585 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:29.054834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15610): Launched 02:57:29.169282 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:29.422060 run patchelf(pid=15611): Launched 02:57:29.589965 run osmo-stp_10.42.42.5(pid=15608): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15608)] 02:57:29.717977 run osmo-stp_10.42.42.5(pid=15608): stdout: | (launched: 2022-12-09_02:57:28.366124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:29.846922 run osmo-stp_10.42.42.5(pid=15608): stderr: | 20221209025728535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025728535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025728536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025728536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025728537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025728537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025728537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:29.976092 run osmo-stp_10.42.42.5(pid=15608): stdout: | (launched: 2022-12-09_02:57:28.366124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:30.099760 run osmo-stp_10.42.42.5(pid=15608): stderr: | 20221209025728535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025728535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025728536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025728536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025728537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025728537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025728537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:30.246655 run patchelf(pid=15611): Terminating (SIGINT) 02:57:30.415299 run patchelf(pid=15611): Terminated: ok {rc=0} 02:57:30.536633 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15608): Process ended prematurely: osmo-stp_10.42.42.5(pid=15608) [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15608)] [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:57:30.546208 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:57:30.573603 run osmo-hlr_10.42.42.2(pid=15605): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15605)] 02:57:30.622035 run osmo-hlr_10.42.42.2(pid=15605): stdout: | (launched: 2022-12-09_02:57:27.430972) 02:57:30.671664 run osmo-hlr_10.42.42.2(pid=15605): stderr: | 20221209025727608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025727608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025727608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025727608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025727608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025727608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025727621 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025727629 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025727629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025727629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:30.721800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15598): Terminating (SIGTERM) 02:57:30.762091 run iperf3-srv_10.42.42.10(pid=15599): Terminating (SIGTERM) 02:57:30.802098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15600): Terminating (SIGTERM) 02:57:30.844032 run iperf3-srv_10.42.42.10(pid=15601): Terminating (SIGTERM) 02:57:30.903053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15604): Terminating (SIGTERM) 02:57:30.945204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15607): Terminating (SIGTERM) 02:57:30.986758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15610): Terminating (SIGTERM) 02:57:31.029552 --- ParallelTerminationStrategy: PID 15598 died... 02:57:31.049450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15598): Terminated: ok {rc=0} 02:57:31.096125 --- ParallelTerminationStrategy: PID 15599 died... 02:57:31.115807 run iperf3-srv_10.42.42.10(pid=15599): Terminated {rc=256} 02:57:31.162752 --- ParallelTerminationStrategy: PID 15600 died... 02:57:31.182485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15600): Terminated: ok {rc=0} 02:57:31.229782 --- ParallelTerminationStrategy: PID 15601 died... 02:57:31.249318 run iperf3-srv_10.42.42.10(pid=15601): Terminated {rc=256} 02:57:31.296809 --- ParallelTerminationStrategy: PID 15604 died... 02:57:31.316591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15604): Terminated: ok {rc=0} 02:57:31.364399 --- ParallelTerminationStrategy: PID 15607 died... 02:57:31.383919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15607): Terminated: ok {rc=0} 02:57:31.431705 --- ParallelTerminationStrategy: PID 15610 died... 02:57:31.451467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15610): Terminated: ok {rc=0} 02:57:31.538806 bus /gobi_0: Setting Powered False 02:57:32.635127 bus /gobi_0: Setting Powered False 02:57:33.751168 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:57:34.896511 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:34.907935 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:57:34.958663 tst iperf3.py: using LAC 18589 02:57:35.077221 tst iperf3.py: using RAC 229 02:57:35.194381 tst iperf3.py: using CellId 18589 02:57:35.314084 tst iperf3.py: using BVCI 18590 02:57:35.425243 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:35.436045 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:35.446675 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:35.457683 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:35.468537 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:35.479575 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:35.490647 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:35.501488 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:35.512660 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:35.629984 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:57:35.855570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:36.178059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15615): Launched 02:57:36.457286 run iperf3-srv_10.42.42.10(pid=15616): Launched 02:57:36.577527 tst iperf3.py:8: start network... 02:57:36.793927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:37.292137 run create_hlr_db(pid=15617): Launched 02:57:37.421471 bus /gobi_6: Setting Powered False 02:57:38.485188 run create_hlr_db(pid=15617): Terminated: ok {rc=0} 02:57:38.932204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15619): Launched 02:57:39.251154 run osmo-hlr_10.42.42.2(pid=15620): Launched 02:57:39.373861 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:39.925948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15622): Launched 02:57:40.245360 run osmo-stp_10.42.42.5(pid=15623): Launched 02:57:40.368040 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:40.921222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15625): Launched 02:57:41.042792 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:41.314001 run patchelf(pid=15626): Launched 02:57:41.491172 run osmo-stp_10.42.42.5(pid=15623): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15623)] 02:57:41.626009 run osmo-stp_10.42.42.5(pid=15623): stdout: | (launched: 2022-12-09_02:57:40.186438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:41.763319 run osmo-stp_10.42.42.5(pid=15623): stderr: | 20221209025740378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025740378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025740379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025740379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025740381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025740381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025740381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:41.900446 run osmo-stp_10.42.42.5(pid=15623): stdout: | (launched: 2022-12-09_02:57:40.186438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:42.031187 run osmo-stp_10.42.42.5(pid=15623): stderr: | 20221209025740378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025740378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025740379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025740379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025740381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025740381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025740381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:42.186705 run patchelf(pid=15626): Terminating (SIGINT) 02:57:42.365933 run patchelf(pid=15626): Terminated: ok {rc=0} 02:57:42.494752 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15623): Process ended prematurely: osmo-stp_10.42.42.5(pid=15623) [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15623)] [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 02:57:42.504806 tst iperf3.py:8: Test FAILED (7.6 sec) 02:57:42.533221 run osmo-hlr_10.42.42.2(pid=15620): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15620)] 02:57:42.582627 run osmo-hlr_10.42.42.2(pid=15620): stdout: | (launched: 2022-12-09_02:57:39.192679) 02:57:42.633657 run osmo-hlr_10.42.42.2(pid=15620): stderr: | 20221209025739392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025739392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025739392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025739392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025739392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025739392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025739404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025739413 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025739413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025739414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:42.684909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15615): Terminating (SIGTERM) 02:57:42.726106 run iperf3-srv_10.42.42.10(pid=15616): Terminating (SIGTERM) 02:57:42.767197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15619): Terminating (SIGTERM) 02:57:42.808459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15622): Terminating (SIGTERM) 02:57:42.849855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15625): Terminating (SIGTERM) 02:57:42.891323 --- ParallelTerminationStrategy: PID 15615 died... 02:57:42.911172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15615): Terminated: ok {rc=0} 02:57:42.957226 --- ParallelTerminationStrategy: PID 15616 died... 02:57:42.976613 run iperf3-srv_10.42.42.10(pid=15616): Terminated {rc=256} 02:57:43.022374 --- ParallelTerminationStrategy: PID 15619 died... 02:57:43.041910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15619): Terminated: ok {rc=0} 02:57:43.087584 --- ParallelTerminationStrategy: PID 15622 died... 02:57:43.107023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15622): Terminated: ok {rc=0} 02:57:43.152796 --- ParallelTerminationStrategy: PID 15625 died... 02:57:43.172639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15625): Terminated: ok {rc=0} 02:57:43.259794 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:57:44.412396 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:44.424457 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:57:44.478914 tst iperf3m4.py: using LAC 18590 02:57:44.604506 tst iperf3m4.py: using RAC 230 02:57:44.732193 tst iperf3m4.py: using CellId 18590 02:57:44.858423 tst iperf3m4.py: using BVCI 18591 02:57:44.977464 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:44.988787 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:44.999914 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:45.011025 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:45.021995 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:45.033034 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:45.044191 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:45.055181 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:45.066381 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:45.182630 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:45.301994 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:45.422576 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:45.538502 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:57:45.755681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:46.083856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15628): Launched 02:57:46.476495 run iperf3-srv_10.42.42.10(pid=15629): Launched 02:57:46.651164 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:57:46.886008 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:47.201918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15630): Launched 02:57:47.495678 run iperf3-srv_10.42.42.10(pid=15631): Launched 02:57:47.615320 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:57:47.831746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:48.154806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15632): Launched 02:57:48.432734 run iperf3-srv_10.42.42.10(pid=15633): Launched 02:57:48.552393 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:57:48.768036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:49.089639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15634): Launched 02:57:49.368094 run iperf3-srv_10.42.42.10(pid=15635): Launched 02:57:49.487753 tst iperf3m4.py:8: start network... 02:57:49.703148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:50.201321 run create_hlr_db(pid=15636): Launched 02:57:50.332162 bus /gobi_6: Setting Powered False 02:57:51.396442 run create_hlr_db(pid=15636): Terminated: ok {rc=0} 02:57:51.842526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15638): Launched 02:57:52.162109 run osmo-hlr_10.42.42.2(pid=15639): Launched 02:57:52.285285 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:52.841288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15641): Launched 02:57:53.161145 run osmo-stp_10.42.42.5(pid=15642): Launched 02:57:53.284103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:53.838176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15644): Launched 02:57:53.960008 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:54.231310 run patchelf(pid=15645): Launched 02:57:54.408779 run osmo-stp_10.42.42.5(pid=15642): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15642)] 02:57:54.543862 run osmo-stp_10.42.42.5(pid=15642): stdout: | (launched: 2022-12-09_02:57:53.102681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:54.680899 run osmo-stp_10.42.42.5(pid=15642): stderr: | 20221209025753292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025753293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025753293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025753293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025753294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025753294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025753294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:54.818214 run osmo-stp_10.42.42.5(pid=15642): stdout: | (launched: 2022-12-09_02:57:53.102681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:54.949401 run osmo-stp_10.42.42.5(pid=15642): stderr: | 20221209025753292 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025753293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025753293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025753293 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025753294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025753294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025753294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:55.105817 run patchelf(pid=15645): Terminating (SIGINT) 02:57:55.285644 run patchelf(pid=15645): Terminated: ok {rc=0} 02:57:55.414642 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15642): Process ended prematurely: osmo-stp_10.42.42.5(pid=15642) [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15642)] [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 02:57:55.424661 tst iperf3m4.py:8: Test FAILED (11.1 sec) 02:57:55.453270 run osmo-hlr_10.42.42.2(pid=15639): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15639)] 02:57:55.502671 run osmo-hlr_10.42.42.2(pid=15639): stdout: | (launched: 2022-12-09_02:57:52.103471) 02:57:55.553717 run osmo-hlr_10.42.42.2(pid=15639): stderr: | 20221209025752301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025752301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025752301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025752301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025752301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025752301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025752313 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025752322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025752322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025752322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:55.605192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15628): Terminating (SIGTERM) 02:57:55.646348 run iperf3-srv_10.42.42.10(pid=15629): Terminating (SIGTERM) 02:57:55.687509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15630): Terminating (SIGTERM) 02:57:55.729042 run iperf3-srv_10.42.42.10(pid=15631): Terminating (SIGTERM) 02:57:55.770209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15632): Terminating (SIGTERM) 02:57:55.811985 run iperf3-srv_10.42.42.10(pid=15633): Terminating (SIGTERM) 02:57:55.853234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15634): Terminating (SIGTERM) 02:57:55.894577 run iperf3-srv_10.42.42.10(pid=15635): Terminating (SIGTERM) 02:57:55.935611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15638): Terminating (SIGTERM) 02:57:55.977147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15641): Terminating (SIGTERM) 02:57:56.018385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15644): Terminating (SIGTERM) 02:57:56.060364 --- ParallelTerminationStrategy: PID 15628 died... 02:57:56.080504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15628): Terminated: ok {rc=0} 02:57:56.126680 --- ParallelTerminationStrategy: PID 15629 died... 02:57:56.146147 run iperf3-srv_10.42.42.10(pid=15629): Terminated {rc=256} 02:57:56.192552 --- ParallelTerminationStrategy: PID 15630 died... 02:57:56.212529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15630): Terminated: ok {rc=0} 02:57:56.258648 --- ParallelTerminationStrategy: PID 15631 died... 02:57:56.278117 run iperf3-srv_10.42.42.10(pid=15631): Terminated {rc=256} 02:57:56.323858 --- ParallelTerminationStrategy: PID 15632 died... 02:57:56.343458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15632): Terminated: ok {rc=0} 02:57:56.389510 --- ParallelTerminationStrategy: PID 15633 died... 02:57:56.409019 run iperf3-srv_10.42.42.10(pid=15633): Terminated {rc=256} 02:57:56.454892 --- ParallelTerminationStrategy: PID 15634 died... 02:57:56.474461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15634): Terminated: ok {rc=0} 02:57:56.520239 --- ParallelTerminationStrategy: PID 15635 died... 02:57:56.539863 run iperf3-srv_10.42.42.10(pid=15635): Terminated {rc=256} 02:57:56.585799 --- ParallelTerminationStrategy: PID 15638 died... 02:57:56.605482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15638): Terminated: ok {rc=0} 02:57:56.651072 --- ParallelTerminationStrategy: PID 15641 died... 02:57:56.670419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15641): Terminated: ok {rc=0} 02:57:56.716272 --- ParallelTerminationStrategy: PID 15644 died... 02:57:56.735930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15644): Terminated: ok {rc=0} 02:57:56.822568 bus /gobi_4: Setting Powered False 02:57:57.923084 bus /gobi_4: Setting Powered False 02:57:59.040848 bus /gobi_1: Setting Powered False 02:58:00.139860 bus /gobi_1: Setting Powered False 02:58:01.267280 bus /gobi_0: Setting Powered False 02:58:02.365064 bus /gobi_0: Setting Powered False 02:58:03.480444 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 02:58:04.584587 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:04.596538 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:58:04.646837 tst ping.py: using LAC 18591 02:58:04.771396 tst ping.py: using RAC 231 02:58:04.894002 tst ping.py: using CellId 18591 02:58:05.016166 tst ping.py: using BVCI 18592 02:58:05.131196 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:05.142551 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:05.153748 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:05.164816 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:05.175920 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:05.187043 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:05.198337 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:05.209530 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:58:05.328074 tst ping.py:19: start network... 02:58:05.540276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:06.027754 run create_hlr_db(pid=15646): Launched 02:58:06.155258 bus /gobi_6: Setting Powered False 02:58:07.217661 run create_hlr_db(pid=15646): Terminated: ok {rc=0} 02:58:07.655408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15648): Launched 02:58:07.968855 run osmo-hlr_10.42.42.2(pid=15649): Launched 02:58:08.087852 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:08.632095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15651): Launched 02:58:08.946140 run osmo-stp_10.42.42.5(pid=15652): Launched 02:58:09.066057 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:09.610073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15654): Launched 02:58:09.729912 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:09.995802 run patchelf(pid=15655): Launched 02:58:10.170564 run osmo-stp_10.42.42.5(pid=15652): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15652)] 02:58:10.303862 run osmo-stp_10.42.42.5(pid=15652): stdout: | (launched: 2022-12-09_02:58:08.888765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:10.438857 run osmo-stp_10.42.42.5(pid=15652): stderr: | 20221209025809079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025809079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025809079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025809079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025809080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025809080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025809080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:10.573322 run osmo-stp_10.42.42.5(pid=15652): stdout: | (launched: 2022-12-09_02:58:08.888765) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:10.702578 run osmo-stp_10.42.42.5(pid=15652): stderr: | 20221209025809079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025809079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025809079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025809079 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025809080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025809080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025809080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:10.855153 run patchelf(pid=15655): Terminating (SIGINT) 02:58:11.030874 run patchelf(pid=15655): Terminated: ok {rc=0} 02:58:11.156872 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15652): Process ended prematurely: osmo-stp_10.42.42.5(pid=15652) [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15652)] [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 02:58:11.166486 tst ping.py:22: Test FAILED (6.6 sec) 02:58:11.194428 run osmo-hlr_10.42.42.2(pid=15649): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15649)] 02:58:11.244414 run osmo-hlr_10.42.42.2(pid=15649): stdout: | (launched: 2022-12-09_02:58:07.911309) 02:58:11.295679 run osmo-hlr_10.42.42.2(pid=15649): stderr: | 20221209025808109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025808109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025808109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025808109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025808109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025808109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025808121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025808132 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025808132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025808132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:11.347259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15648): Terminating (SIGTERM) 02:58:11.388537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15651): Terminating (SIGTERM) 02:58:11.429930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15654): Terminating (SIGTERM) 02:58:11.471700 --- ParallelTerminationStrategy: PID 15648 died... 02:58:11.491608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15648): Terminated: ok {rc=0} 02:58:11.537472 --- ParallelTerminationStrategy: PID 15651 died... 02:58:11.556784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15651): Terminated: ok {rc=0} 02:58:11.602528 --- ParallelTerminationStrategy: PID 15654 died... 02:58:11.622021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15654): Terminated: ok {rc=0} 02:58:11.708849 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:58:12.796261 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:12.807895 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:58:12.861349 tst ping_idle_ping.py: using LAC 18592 02:58:12.982583 tst ping_idle_ping.py: using RAC 232 02:58:13.097454 tst ping_idle_ping.py: using CellId 18592 02:58:13.212028 tst ping_idle_ping.py: using BVCI 18593 02:58:13.319245 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:13.330455 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:13.341015 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:13.352211 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:13.363170 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:13.374123 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:13.385556 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:58:13.396600 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:58:13.516427 tst ping_idle_ping.py:24: start network... 02:58:13.728687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:14.220113 run create_hlr_db(pid=15656): Launched 02:58:14.348407 bus /gobi_6: Setting Powered False 02:58:15.406666 run create_hlr_db(pid=15656): Terminated: ok {rc=0} 02:58:15.862611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15658): Launched 02:58:16.189326 run osmo-hlr_10.42.42.2(pid=15659): Launched 02:58:16.424800 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:17.135394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15661): Launched 02:58:17.443452 run osmo-stp_10.42.42.5(pid=15662): Launched 02:58:17.558891 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:18.070623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15664): Launched 02:58:18.182996 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:18.432410 run patchelf(pid=15665): Launched 02:58:18.596200 run osmo-stp_10.42.42.5(pid=15662): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15662)] 02:58:18.720463 run osmo-stp_10.42.42.5(pid=15662): stdout: | (launched: 2022-12-09_02:58:17.387741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:18.846776 run osmo-stp_10.42.42.5(pid=15662): stderr: | 20221209025817557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025817557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025817557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025817558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025817558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025817558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025817558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:18.973491 run osmo-stp_10.42.42.5(pid=15662): stdout: | (launched: 2022-12-09_02:58:17.387741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:19.094543 run osmo-stp_10.42.42.5(pid=15662): stderr: | 20221209025817557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025817557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025817557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025817558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025817558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025817558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025817558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:19.238212 run patchelf(pid=15665): Terminating (SIGINT) 02:58:19.403743 run patchelf(pid=15665): Terminated: ok {rc=0} 02:58:19.523130 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15662): Process ended prematurely: osmo-stp_10.42.42.5(pid=15662) [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15662)] [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 02:58:19.531953 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:58:19.558760 run osmo-hlr_10.42.42.2(pid=15659): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15659)] 02:58:19.606241 run osmo-hlr_10.42.42.2(pid=15659): stdout: | (launched: 2022-12-09_02:58:16.123627) 02:58:19.655210 run osmo-hlr_10.42.42.2(pid=15659): stderr: | 20221209025816467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025816467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025816468 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025816468 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025816468 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025816468 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025816487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025816500 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025816500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025816500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:19.704599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15658): Terminating (SIGTERM) 02:58:19.744216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15661): Terminating (SIGTERM) 02:58:19.784039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15664): Terminating (SIGTERM) 02:58:19.824320 --- ParallelTerminationStrategy: PID 15658 died... 02:58:19.843397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15658): Terminated: ok {rc=0} 02:58:19.887703 --- ParallelTerminationStrategy: PID 15661 died... 02:58:19.906528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15661): Terminated: ok {rc=0} 02:58:19.950834 --- ParallelTerminationStrategy: PID 15664 died... 02:58:19.969533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15664): Terminated: ok {rc=0} 02:58:20.054819 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:58:21.364537 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:58:21.371173 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:58:21.405370 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:58:21.445235 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:58:21.534844 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:58:21.568827 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:58:21.607238 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:58:22.202320 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:58:22.254839 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:22.266365 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:58:22.336656 tst cs_paging_gprs_active.py: using LAC 18593 02:58:22.456336 tst cs_paging_gprs_active.py: using RAC 233 02:58:22.574245 tst cs_paging_gprs_active.py: using CellId 18593 02:58:22.693745 tst cs_paging_gprs_active.py: using BVCI 18594 02:58:22.802628 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:22.813705 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:22.824449 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:22.835381 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:22.846190 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:22.857134 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:22.868026 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:22.878809 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:22.889789 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:23.004558 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:23.123798 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:58:23.343502 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:23.667097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15670): Launched 02:58:23.947057 run iperf3-srv_10.42.42.10(pid=15671): Launched 02:58:24.068228 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:58:24.286005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:24.609206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15672): Launched 02:58:24.887530 run iperf3-srv_10.42.42.10(pid=15673): Launched 02:58:25.008008 tst cs_paging_gprs_active.py:38: start network... 02:58:25.224923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:25.722863 run create_hlr_db(pid=15674): Launched 02:58:25.854508 bus /gobi_6: Setting Powered False 02:58:26.918208 run create_hlr_db(pid=15674): Terminated: ok {rc=0} 02:58:27.366373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15676): Launched 02:58:27.685502 run osmo-hlr_10.42.42.2(pid=15677): Launched 02:58:27.807021 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:28.356521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15679): Launched 02:58:28.676133 run osmo-stp_10.42.42.5(pid=15680): Launched 02:58:28.797888 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:29.352113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15682): Launched 02:58:29.474433 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:29.753080 run patchelf(pid=15683): Launched 02:58:29.930572 run osmo-stp_10.42.42.5(pid=15680): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15680)] 02:58:30.066107 run osmo-stp_10.42.42.5(pid=15680): stdout: | (launched: 2022-12-09_02:58:28.617602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:30.203570 run osmo-stp_10.42.42.5(pid=15680): stderr: | 20221209025828810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025828810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025828810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025828811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025828811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025828811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025828811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:30.341101 run osmo-stp_10.42.42.5(pid=15680): stdout: | (launched: 2022-12-09_02:58:28.617602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:30.472739 run osmo-stp_10.42.42.5(pid=15680): stderr: | 20221209025828810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025828810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025828810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025828811 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025828811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025828811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025828811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:30.628541 run patchelf(pid=15683): Terminating (SIGINT) 02:58:30.807740 run patchelf(pid=15683): Terminated: ok {rc=0} 02:58:30.943581 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15680): Process ended prematurely: osmo-stp_10.42.42.5(pid=15680) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15680)] [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:58:30.954757 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:58:30.984521 run osmo-hlr_10.42.42.2(pid=15677): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15677)] 02:58:31.044013 run osmo-hlr_10.42.42.2(pid=15677): stdout: | (launched: 2022-12-09_02:58:27.627071) 02:58:31.096518 run osmo-hlr_10.42.42.2(pid=15677): stderr: | 20221209025827827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025827827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025827827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025827827 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025827827 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025827827 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025827840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025827848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025827848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025827848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:31.149858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15670): Terminating (SIGTERM) 02:58:31.192504 run iperf3-srv_10.42.42.10(pid=15671): Terminating (SIGTERM) 02:58:31.235531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15672): Terminating (SIGTERM) 02:58:31.279289 run iperf3-srv_10.42.42.10(pid=15673): Terminating (SIGTERM) 02:58:31.321344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15676): Terminating (SIGTERM) 02:58:31.363464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15679): Terminating (SIGTERM) 02:58:31.406256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15682): Terminating (SIGTERM) 02:58:31.448918 --- ParallelTerminationStrategy: PID 15670 died... 02:58:31.470116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15670): Terminated: ok {rc=0} 02:58:31.517116 --- ParallelTerminationStrategy: PID 15671 died... 02:58:31.537010 run iperf3-srv_10.42.42.10(pid=15671): Terminated {rc=256} 02:58:31.583558 --- ParallelTerminationStrategy: PID 15672 died... 02:58:31.603620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15672): Terminated: ok {rc=0} 02:58:31.650432 --- ParallelTerminationStrategy: PID 15673 died... 02:58:31.670570 run iperf3-srv_10.42.42.10(pid=15673): Terminated {rc=256} 02:58:31.717121 --- ParallelTerminationStrategy: PID 15676 died... 02:58:31.737106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15676): Terminated: ok {rc=0} 02:58:31.783579 --- ParallelTerminationStrategy: PID 15679 died... 02:58:31.803617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15679): Terminated: ok {rc=0} 02:58:31.850074 --- ParallelTerminationStrategy: PID 15682 died... 02:58:31.869757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15682): Terminated: ok {rc=0} 02:58:31.976657 bus /gobi_0: Setting Powered False 02:58:33.079149 bus /gobi_0: Setting Powered False 02:58:34.195584 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:58:35.344479 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:35.356476 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:58:35.428512 tst iperf3.py: using LAC 18594 02:58:35.555890 tst iperf3.py: using RAC 234 02:58:35.685427 tst iperf3.py: using CellId 18594 02:58:35.811311 tst iperf3.py: using BVCI 18595 02:58:35.922803 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:35.933898 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:35.944672 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:35.958060 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:35.970368 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:35.982154 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:35.993963 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:36.005595 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:36.017603 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:36.134118 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:58:36.334503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:36.634368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15684): Launched 02:58:36.894410 run iperf3-srv_10.42.42.10(pid=15685): Launched 02:58:37.006198 tst iperf3.py:8: start network... 02:58:37.206643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:37.670747 run create_hlr_db(pid=15686): Launched 02:58:37.783819 bus /gobi_6: Setting Powered False 02:58:38.844208 run create_hlr_db(pid=15686): Terminated: ok {rc=0} 02:58:39.281210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15688): Launched 02:58:39.601121 run osmo-hlr_10.42.42.2(pid=15689): Launched 02:58:39.723707 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:40.277225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15691): Launched 02:58:40.597469 run osmo-stp_10.42.42.5(pid=15692): Launched 02:58:40.719559 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:41.273166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15694): Launched 02:58:41.395309 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:41.666473 run patchelf(pid=15695): Launched 02:58:41.843890 run osmo-stp_10.42.42.5(pid=15692): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15692)] 02:58:41.979053 run osmo-stp_10.42.42.5(pid=15692): stdout: | (launched: 2022-12-09_02:58:40.538914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:42.116004 run osmo-stp_10.42.42.5(pid=15692): stderr: | 20221209025840730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025840730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025840730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025840731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025840731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025840731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025840731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:42.254131 run osmo-stp_10.42.42.5(pid=15692): stdout: | (launched: 2022-12-09_02:58:40.538914) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:42.385399 run osmo-stp_10.42.42.5(pid=15692): stderr: | 20221209025840730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025840730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025840730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025840731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025840731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025840731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025840731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:42.540933 run patchelf(pid=15695): Terminating (SIGINT) 02:58:42.719682 run patchelf(pid=15695): Terminated: ok {rc=0} 02:58:42.848237 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15692): Process ended prematurely: osmo-stp_10.42.42.5(pid=15692) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15692)] [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 02:58:42.858353 tst iperf3.py:8: Test FAILED (7.6 sec) 02:58:42.886549 run osmo-hlr_10.42.42.2(pid=15689): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15689)] 02:58:42.935669 run osmo-hlr_10.42.42.2(pid=15689): stdout: | (launched: 2022-12-09_02:58:39.542665) 02:58:42.986566 run osmo-hlr_10.42.42.2(pid=15689): stderr: | 20221209025839739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025839739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025839739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025839739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025839739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025839739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025839753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025839761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025839762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025839762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:43.037942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15684): Terminating (SIGTERM) 02:58:43.079289 run iperf3-srv_10.42.42.10(pid=15685): Terminating (SIGTERM) 02:58:43.120608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15688): Terminating (SIGTERM) 02:58:43.162062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15691): Terminating (SIGTERM) 02:58:43.203389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15694): Terminating (SIGTERM) 02:58:43.245406 --- ParallelTerminationStrategy: PID 15684 died... 02:58:43.265377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15684): Terminated: ok {rc=0} 02:58:43.311376 --- ParallelTerminationStrategy: PID 15685 died... 02:58:43.330808 run iperf3-srv_10.42.42.10(pid=15685): Terminated {rc=256} 02:58:43.376156 --- ParallelTerminationStrategy: PID 15688 died... 02:58:43.395520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15688): Terminated: ok {rc=0} 02:58:43.441073 --- ParallelTerminationStrategy: PID 15691 died... 02:58:43.460376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15691): Terminated: ok {rc=0} 02:58:43.505890 --- ParallelTerminationStrategy: PID 15694 died... 02:58:43.525451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15694): Terminated: ok {rc=0} 02:58:43.611401 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:58:44.758937 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:44.770506 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:58:44.839313 tst iperf3m4.py: using LAC 18595 02:58:44.956873 tst iperf3m4.py: using RAC 235 02:58:45.074725 tst iperf3m4.py: using CellId 18595 02:58:45.192731 tst iperf3m4.py: using BVCI 18596 02:58:45.303435 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:45.314630 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:45.325449 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:45.336741 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:45.347972 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:45.359501 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:45.370814 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:45.381951 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:45.393217 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:45.512536 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:45.632054 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:45.747036 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:45.880941 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:58:46.105026 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:46.445286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15696): Launched 02:58:46.750508 run iperf3-srv_10.42.42.10(pid=15697): Launched 02:58:46.883799 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:58:47.106067 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:47.430346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15698): Launched 02:58:47.709341 run iperf3-srv_10.42.42.10(pid=15699): Launched 02:58:47.829444 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:58:48.044683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:48.367236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15700): Launched 02:58:48.645859 run iperf3-srv_10.42.42.10(pid=15701): Launched 02:58:48.765707 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:58:48.981329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:49.303982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15702): Launched 02:58:49.582637 run iperf3-srv_10.42.42.10(pid=15703): Launched 02:58:49.702635 tst iperf3m4.py:8: start network... 02:58:49.918582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:50.421283 run create_hlr_db(pid=15704): Launched 02:58:50.552781 bus /gobi_6: Setting Powered False 02:58:51.616489 run create_hlr_db(pid=15704): Terminated: ok {rc=0} 02:58:52.043837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15706): Launched 02:58:52.343151 run osmo-hlr_10.42.42.2(pid=15707): Launched 02:58:52.457266 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:52.986307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15709): Launched 02:58:53.284088 run osmo-stp_10.42.42.5(pid=15710): Launched 02:58:53.397840 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:53.911597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15712): Launched 02:58:54.025123 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:54.277421 run patchelf(pid=15713): Launched 02:58:54.442777 run osmo-stp_10.42.42.5(pid=15710): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15710)] 02:58:54.568839 run osmo-stp_10.42.42.5(pid=15710): stdout: | (launched: 2022-12-09_02:58:53.228710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:54.696464 run osmo-stp_10.42.42.5(pid=15710): stderr: | 20221209025853395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025853395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025853396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025853396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025853396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025853397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025853397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:54.823950 run osmo-stp_10.42.42.5(pid=15710): stdout: | (launched: 2022-12-09_02:58:53.228710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:54.945949 run osmo-stp_10.42.42.5(pid=15710): stderr: | 20221209025853395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025853395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025853396 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025853396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025853396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025853397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025853397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:55.090426 run patchelf(pid=15713): Terminating (SIGINT) 02:58:55.257341 run patchelf(pid=15713): Terminated: ok {rc=0} 02:58:55.377732 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15710): Process ended prematurely: osmo-stp_10.42.42.5(pid=15710) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15710)] [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:58:55.387065 tst iperf3m4.py:8: Test FAILED (10.7 sec) 02:58:55.414377 run osmo-hlr_10.42.42.2(pid=15707): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15707)] 02:58:55.461959 run osmo-hlr_10.42.42.2(pid=15707): stdout: | (launched: 2022-12-09_02:58:52.288062) 02:58:55.510810 run osmo-hlr_10.42.42.2(pid=15707): stderr: | 20221209025852462 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025852462 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025852462 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025852462 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025852462 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025852462 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025852475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025852485 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025852485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025852485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:55.560199 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15696): Terminating (SIGTERM) 02:58:55.599959 run iperf3-srv_10.42.42.10(pid=15697): Terminating (SIGTERM) 02:58:55.639664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15698): Terminating (SIGTERM) 02:58:55.679230 run iperf3-srv_10.42.42.10(pid=15699): Terminating (SIGTERM) 02:58:55.718779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15700): Terminating (SIGTERM) 02:58:55.758310 run iperf3-srv_10.42.42.10(pid=15701): Terminating (SIGTERM) 02:58:55.797710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15702): Terminating (SIGTERM) 02:58:55.837337 run iperf3-srv_10.42.42.10(pid=15703): Terminating (SIGTERM) 02:58:55.876722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15706): Terminating (SIGTERM) 02:58:55.916365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15709): Terminating (SIGTERM) 02:58:55.955969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15712): Terminating (SIGTERM) 02:58:55.995782 --- ParallelTerminationStrategy: PID 15696 died... 02:58:56.014755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15696): Terminated: ok {rc=0} 02:58:56.058695 --- ParallelTerminationStrategy: PID 15697 died... 02:58:56.077350 run iperf3-srv_10.42.42.10(pid=15697): Terminated {rc=256} 02:58:56.121577 --- ParallelTerminationStrategy: PID 15698 died... 02:58:56.140202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15698): Terminated: ok {rc=0} 02:58:56.184867 --- ParallelTerminationStrategy: PID 15699 died... 02:58:56.203738 run iperf3-srv_10.42.42.10(pid=15699): Terminated {rc=256} 02:58:56.247964 --- ParallelTerminationStrategy: PID 15700 died... 02:58:56.266716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15700): Terminated: ok {rc=0} 02:58:56.311248 --- ParallelTerminationStrategy: PID 15701 died... 02:58:56.329771 run iperf3-srv_10.42.42.10(pid=15701): Terminated {rc=256} 02:58:56.373808 --- ParallelTerminationStrategy: PID 15702 died... 02:58:56.392217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15702): Terminated: ok {rc=0} 02:58:56.436536 --- ParallelTerminationStrategy: PID 15703 died... 02:58:56.455251 run iperf3-srv_10.42.42.10(pid=15703): Terminated {rc=256} 02:58:56.499415 --- ParallelTerminationStrategy: PID 15706 died... 02:58:56.518077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15706): Terminated: ok {rc=0} 02:58:56.562465 --- ParallelTerminationStrategy: PID 15709 died... 02:58:56.581095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15709): Terminated: ok {rc=0} 02:58:56.630202 --- ParallelTerminationStrategy: PID 15712 died... 02:58:56.650014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15712): Terminated: ok {rc=0} 02:58:56.739051 bus /gobi_4: Setting Powered False 02:58:57.838272 bus /gobi_4: Setting Powered False 02:58:58.954640 bus /gobi_1: Setting Powered False 02:59:00.053517 bus /gobi_1: Setting Powered False 02:59:01.168012 bus /gobi_0: Setting Powered False 02:59:02.266653 bus /gobi_0: Setting Powered False 02:59:03.380672 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:59:04.483583 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:04.495536 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:59:04.569442 tst ping.py: using LAC 18596 02:59:04.699656 tst ping.py: using RAC 236 02:59:04.824277 tst ping.py: using CellId 18596 02:59:04.947020 tst ping.py: using BVCI 18597 02:59:05.062104 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:05.073573 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:05.084751 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:05.096513 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:05.108143 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:05.119807 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:05.131561 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:05.143145 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:59:05.259317 tst ping.py:19: start network... 02:59:05.455785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:05.911359 run create_hlr_db(pid=15715): Launched 02:59:06.024254 bus /gobi_6: Setting Powered False 02:59:07.083673 run create_hlr_db(pid=15715): Terminated: ok {rc=0} 02:59:07.515246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15717): Launched 02:59:07.830949 run osmo-hlr_10.42.42.2(pid=15718): Launched 02:59:07.950964 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:08.498085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15720): Launched 02:59:08.812541 run osmo-stp_10.42.42.5(pid=15721): Launched 02:59:08.932739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:09.477159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15723): Launched 02:59:09.597717 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:09.863849 run patchelf(pid=15724): Launched 02:59:10.038707 run osmo-stp_10.42.42.5(pid=15721): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15721)] 02:59:10.171559 run osmo-stp_10.42.42.5(pid=15721): stdout: | (launched: 2022-12-09_02:59:08.754708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:10.307135 run osmo-stp_10.42.42.5(pid=15721): stderr: | 20221209025908948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025908948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025908948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025908950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025908950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025908950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025908950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:10.442869 run osmo-stp_10.42.42.5(pid=15721): stdout: | (launched: 2022-12-09_02:59:08.754708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:10.572269 run osmo-stp_10.42.42.5(pid=15721): stderr: | 20221209025908948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025908948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025908948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025908950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025908950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025908950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025908950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:10.725565 run patchelf(pid=15724): Terminating (SIGINT) 02:59:10.901507 run patchelf(pid=15724): Terminated: ok {rc=0} 02:59:11.029177 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15721): Process ended prematurely: osmo-stp_10.42.42.5(pid=15721) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15721)] [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 02:59:11.038908 tst ping.py:22: Test FAILED (6.5 sec) 02:59:11.066935 run osmo-hlr_10.42.42.2(pid=15718): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15718)] 02:59:11.116484 run osmo-hlr_10.42.42.2(pid=15718): stdout: | (launched: 2022-12-09_02:59:07.773308) 02:59:11.167758 run osmo-hlr_10.42.42.2(pid=15718): stderr: | 20221209025907971 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025907971 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025907972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025907972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025907972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025907972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025907985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025907993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025907993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025907993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:11.219462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15717): Terminating (SIGTERM) 02:59:11.261462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15720): Terminating (SIGTERM) 02:59:11.303049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15723): Terminating (SIGTERM) 02:59:11.344726 --- ParallelTerminationStrategy: PID 15717 died... 02:59:11.364231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15717): Terminated: ok {rc=0} 02:59:11.409957 --- ParallelTerminationStrategy: PID 15720 died... 02:59:11.429426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15720): Terminated: ok {rc=0} 02:59:11.475229 --- ParallelTerminationStrategy: PID 15723 died... 02:59:11.494776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15723): Terminated: ok {rc=0} 02:59:11.581137 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:59:12.667989 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:12.679954 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:59:12.752547 tst ping_idle_ping.py: using LAC 18597 02:59:12.878307 tst ping_idle_ping.py: using RAC 237 02:59:13.003292 tst ping_idle_ping.py: using CellId 18597 02:59:13.129231 tst ping_idle_ping.py: using BVCI 18598 02:59:13.244708 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:13.256596 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:13.267937 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:13.279189 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:13.290466 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:13.301926 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:13.313237 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:59:13.324391 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:59:13.442408 tst ping_idle_ping.py:24: start network... 02:59:13.656450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:14.149624 run create_hlr_db(pid=15725): Launched 02:59:14.277751 bus /gobi_6: Setting Powered False 02:59:15.340818 run create_hlr_db(pid=15725): Terminated: ok {rc=0} 02:59:15.782150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15727): Launched 02:59:16.111506 run osmo-hlr_10.42.42.2(pid=15728): Launched 02:59:16.252659 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:16.916325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15730): Launched 02:59:17.302648 run osmo-stp_10.42.42.5(pid=15731): Launched 02:59:17.577995 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:18.087967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15733): Launched 02:59:18.200678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:18.451936 run patchelf(pid=15734): Launched 02:59:18.617625 run osmo-stp_10.42.42.5(pid=15731): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15731)] 02:59:18.742928 run osmo-stp_10.42.42.5(pid=15731): stdout: | (launched: 2022-12-09_02:59:17.227408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:18.869824 run osmo-stp_10.42.42.5(pid=15731): stderr: | 20221209025917451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025917451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025917451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025917452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025917455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025917455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025917455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:18.996315 run osmo-stp_10.42.42.5(pid=15731): stdout: | (launched: 2022-12-09_02:59:17.227408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:19.118001 run osmo-stp_10.42.42.5(pid=15731): stderr: | 20221209025917451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025917451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025917451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025917452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025917455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025917455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025917455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:19.261560 run patchelf(pid=15734): Terminating (SIGINT) 02:59:19.426758 run patchelf(pid=15734): Terminated: ok {rc=0} 02:59:19.546165 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15731): Process ended prematurely: osmo-stp_10.42.42.5(pid=15731) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15731)] [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:59:19.554896 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 02:59:19.582306 run osmo-hlr_10.42.42.2(pid=15728): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15728)] 02:59:19.630008 run osmo-hlr_10.42.42.2(pid=15728): stdout: | (launched: 2022-12-09_02:59:16.051275) 02:59:19.679513 run osmo-hlr_10.42.42.2(pid=15728): stderr: | 20221209025916464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025916464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025916464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025916464 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025916464 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025916464 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025916487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025916515 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025916515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025916515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:19.729470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15727): Terminating (SIGTERM) 02:59:19.769745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15730): Terminating (SIGTERM) 02:59:19.809991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15733): Terminating (SIGTERM) 02:59:19.850407 --- ParallelTerminationStrategy: PID 15727 died... 02:59:19.869357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15727): Terminated: ok {rc=0} 02:59:19.913949 --- ParallelTerminationStrategy: PID 15730 died... 02:59:19.932547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15730): Terminated: ok {rc=0} 02:59:19.977437 --- ParallelTerminationStrategy: PID 15733 died... 02:59:19.996174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15733): Terminated: ok {rc=0} 02:59:20.082611 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:59:21.387111 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:59:21.393460 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:59:21.427170 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:59:21.465628 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:59:21.552812 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:59:21.586658 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:59:21.625189 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:59:22.216547 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:59:22.265930 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:22.276877 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:59:22.346299 tst cs_paging_gprs_active.py: using LAC 18598 02:59:22.465790 tst cs_paging_gprs_active.py: using RAC 238 02:59:22.584762 tst cs_paging_gprs_active.py: using CellId 18598 02:59:22.702439 tst cs_paging_gprs_active.py: using BVCI 18599 02:59:22.811363 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:22.822274 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:22.832935 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:22.843795 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:22.854926 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:22.865920 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:22.876932 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:22.887930 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:22.899175 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:23.018962 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:23.143179 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:59:23.346551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:23.648691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15738): Launched 02:59:23.910046 run iperf3-srv_10.42.42.10(pid=15739): Launched 02:59:24.022507 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:59:24.223288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:24.525291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15740): Launched 02:59:24.786153 run iperf3-srv_10.42.42.10(pid=15741): Launched 02:59:24.898811 tst cs_paging_gprs_active.py:38: start network... 02:59:25.100392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:25.565381 run create_hlr_db(pid=15742): Launched 02:59:25.679092 bus /gobi_6: Setting Powered False 02:59:26.739163 run create_hlr_db(pid=15742): Terminated: ok {rc=0} 02:59:27.178707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15744): Launched 02:59:27.501076 run osmo-hlr_10.42.42.2(pid=15745): Launched 02:59:27.625088 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:28.178653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15747): Launched 02:59:28.501187 run osmo-stp_10.42.42.5(pid=15748): Launched 02:59:28.625136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:29.179080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15750): Launched 02:59:29.303044 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:29.575540 run patchelf(pid=15751): Launched 02:59:29.755077 run osmo-stp_10.42.42.5(pid=15748): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15748)] 02:59:29.890871 run osmo-stp_10.42.42.5(pid=15748): stdout: | (launched: 2022-12-09_02:59:28.441344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:30.028224 run osmo-stp_10.42.42.5(pid=15748): stderr: | 20221209025928634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025928634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025928634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025928635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025928635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025928635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025928635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:30.165447 run osmo-stp_10.42.42.5(pid=15748): stdout: | (launched: 2022-12-09_02:59:28.441344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:30.297997 run osmo-stp_10.42.42.5(pid=15748): stderr: | 20221209025928634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025928634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025928634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025928635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025928635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025928635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025928635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:30.454842 run patchelf(pid=15751): Terminating (SIGINT) 02:59:30.634373 run patchelf(pid=15751): Terminated: ok {rc=0} 02:59:30.763319 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=15748): Process ended prematurely: osmo-stp_10.42.42.5(pid=15748) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15748)] [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:59:30.773460 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:59:30.801694 run osmo-hlr_10.42.42.2(pid=15745): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15745)] 02:59:30.861236 run osmo-hlr_10.42.42.2(pid=15745): stdout: | (launched: 2022-12-09_02:59:27.441339) 02:59:30.928014 run osmo-hlr_10.42.42.2(pid=15745): stderr: | 20221209025927640 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025927640 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025927640 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025927640 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025927640 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025927641 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025927653 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025927661 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025927662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025927662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:30.981275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15738): Terminating (SIGTERM) 02:59:31.024205 run iperf3-srv_10.42.42.10(pid=15739): Terminating (SIGTERM) 02:59:31.078579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15740): Terminating (SIGTERM) 02:59:31.121470 run iperf3-srv_10.42.42.10(pid=15741): Terminating (SIGTERM) 02:59:31.166279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15744): Terminating (SIGTERM) 02:59:31.208722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15747): Terminating (SIGTERM) 02:59:31.250637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15750): Terminating (SIGTERM) 02:59:31.293281 --- ParallelTerminationStrategy: PID 15738 died... 02:59:31.313259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15738): Terminated: ok {rc=0} 02:59:31.359983 --- ParallelTerminationStrategy: PID 15739 died... 02:59:31.379503 run iperf3-srv_10.42.42.10(pid=15739): Terminated {rc=256} 02:59:31.426673 --- ParallelTerminationStrategy: PID 15740 died... 02:59:31.446826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15740): Terminated: ok {rc=0} 02:59:31.493606 --- ParallelTerminationStrategy: PID 15741 died... 02:59:31.513458 run iperf3-srv_10.42.42.10(pid=15741): Terminated {rc=256} 02:59:31.560086 --- ParallelTerminationStrategy: PID 15744 died... 02:59:31.580293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15744): Terminated: ok {rc=0} 02:59:31.626538 --- ParallelTerminationStrategy: PID 15747 died... 02:59:31.646504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15747): Terminated: ok {rc=0} 02:59:31.692781 --- ParallelTerminationStrategy: PID 15750 died... 02:59:31.712680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15750): Terminated: ok {rc=0} 02:59:31.800858 bus /gobi_0: Setting Powered False 02:59:32.898465 bus /gobi_0: Setting Powered False 02:59:34.010801 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:59:35.158724 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:35.170616 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:59:35.243389 tst iperf3.py: using LAC 18599 02:59:35.373116 tst iperf3.py: using RAC 239 02:59:35.501328 tst iperf3.py: using CellId 18599 02:59:35.629662 tst iperf3.py: using BVCI 18600 02:59:35.742220 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:35.753107 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:35.764054 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:35.775220 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:35.786293 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:35.797090 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:35.808150 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:35.819054 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:35.830026 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:35.948759 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:59:36.166839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:36.490437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15752): Launched 02:59:36.770166 run iperf3-srv_10.42.42.10(pid=15753): Launched 02:59:36.890215 tst iperf3.py:8: start network... 02:59:37.106833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:37.606032 run create_hlr_db(pid=15754): Launched 02:59:37.736488 bus /gobi_6: Setting Powered False 02:59:38.800583 run create_hlr_db(pid=15754): Terminated: ok {rc=0} 02:59:39.229584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15756): Launched 02:59:39.529775 run osmo-hlr_10.42.42.2(pid=15757): Launched 02:59:39.645379 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:40.179981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15759): Launched 02:59:40.480385 run osmo-stp_10.42.42.5(pid=15760): Launched 02:59:40.596139 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:41.114184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15762): Launched 02:59:41.228209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:41.482396 run patchelf(pid=15763): Launched 02:59:41.648922 run osmo-stp_10.42.42.5(pid=15760): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15760)] 02:59:41.775255 run osmo-stp_10.42.42.5(pid=15760): stdout: | (launched: 2022-12-09_02:59:40.425095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:41.903376 run osmo-stp_10.42.42.5(pid=15760): stderr: | 20221209025940596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025940596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025940596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025940597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025940597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025940597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025940597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:42.031316 run osmo-stp_10.42.42.5(pid=15760): stdout: | (launched: 2022-12-09_02:59:40.425095) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:42.154185 run osmo-stp_10.42.42.5(pid=15760): stderr: | 20221209025940596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025940596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025940596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025940597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025940597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025940597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025940597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:42.299450 run patchelf(pid=15763): Terminating (SIGINT) 02:59:42.466913 run patchelf(pid=15763): Terminated: ok {rc=0} 02:59:42.587541 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15760): Process ended prematurely: osmo-stp_10.42.42.5(pid=15760) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15760)] [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 02:59:42.596856 tst iperf3.py:8: Test FAILED (7.5 sec) 02:59:42.624688 run osmo-hlr_10.42.42.2(pid=15757): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15757)] 02:59:42.672828 run osmo-hlr_10.42.42.2(pid=15757): stdout: | (launched: 2022-12-09_02:59:39.474273) 02:59:42.722321 run osmo-hlr_10.42.42.2(pid=15757): stderr: | 20221209025939653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025939653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025939653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025939653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025939653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025939653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025939668 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025939677 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025939677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025939677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:42.772214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15752): Terminating (SIGTERM) 02:59:42.812281 run iperf3-srv_10.42.42.10(pid=15753): Terminating (SIGTERM) 02:59:42.852338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15756): Terminating (SIGTERM) 02:59:42.892429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15759): Terminating (SIGTERM) 02:59:42.932171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15762): Terminating (SIGTERM) 02:59:42.972891 --- ParallelTerminationStrategy: PID 15752 died... 02:59:42.992190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15752): Terminated: ok {rc=0} 02:59:43.036738 --- ParallelTerminationStrategy: PID 15753 died... 02:59:43.055424 run iperf3-srv_10.42.42.10(pid=15753): Terminated {rc=256} 02:59:43.099584 --- ParallelTerminationStrategy: PID 15756 died... 02:59:43.118361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15756): Terminated: ok {rc=0} 02:59:43.162123 --- ParallelTerminationStrategy: PID 15759 died... 02:59:43.180853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15759): Terminated: ok {rc=0} 02:59:43.224928 --- ParallelTerminationStrategy: PID 15762 died... 02:59:43.243570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15762): Terminated: ok {rc=0} 02:59:43.328833 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:59:44.476066 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:44.487628 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:59:44.563483 tst iperf3m4.py: using LAC 18600 02:59:44.682532 tst iperf3m4.py: using RAC 240 02:59:44.799840 tst iperf3m4.py: using CellId 18600 02:59:44.915988 tst iperf3m4.py: using BVCI 18601 02:59:45.025484 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:45.036360 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:45.047113 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:45.058082 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:45.068872 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:45.079876 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:45.090919 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:45.101937 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:45.113560 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:45.228025 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:45.350693 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:45.466523 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:45.585125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:59:45.803252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:46.152821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15764): Launched 02:59:46.450460 run iperf3-srv_10.42.42.10(pid=15765): Launched 02:59:46.574688 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:59:46.784330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:47.110654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15766): Launched 02:59:47.382820 run iperf3-srv_10.42.42.10(pid=15767): Launched 02:59:47.495626 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:59:47.697302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:47.999873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15768): Launched 02:59:48.261940 run iperf3-srv_10.42.42.10(pid=15769): Launched 02:59:48.374081 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:59:48.574871 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:48.876890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15770): Launched 02:59:49.138156 run iperf3-srv_10.42.42.10(pid=15771): Launched 02:59:49.250275 tst iperf3m4.py:8: start network... 02:59:49.450381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:49.915627 run create_hlr_db(pid=15772): Launched 02:59:50.029894 bus /gobi_6: Setting Powered False 02:59:51.089698 run create_hlr_db(pid=15772): Terminated: ok {rc=0} 02:59:51.529098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15774): Launched 02:59:51.849911 run osmo-hlr_10.42.42.2(pid=15775): Launched 02:59:51.973389 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:52.531050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15777): Launched 02:59:52.852178 run osmo-stp_10.42.42.5(pid=15778): Launched 02:59:52.974755 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:53.528775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15780): Launched 02:59:53.651270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:53.922764 run patchelf(pid=15781): Launched 02:59:54.101383 run osmo-stp_10.42.42.5(pid=15778): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15778)] 02:59:54.236882 run osmo-stp_10.42.42.5(pid=15778): stdout: | (launched: 2022-12-09_02:59:52.793711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:54.374757 run osmo-stp_10.42.42.5(pid=15778): stderr: | 20221209025952983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025952983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025952983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025952984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025952984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025952984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025952984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:54.511974 run osmo-stp_10.42.42.5(pid=15778): stdout: | (launched: 2022-12-09_02:59:52.793711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:54.643416 run osmo-stp_10.42.42.5(pid=15778): stderr: | 20221209025952983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209025952983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209025952983 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209025952984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209025952984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209025952984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209025952984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:54.799408 run patchelf(pid=15781): Terminating (SIGINT) 02:59:54.978354 run patchelf(pid=15781): Terminated: ok {rc=0} 02:59:55.107260 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15778): Process ended prematurely: osmo-stp_10.42.42.5(pid=15778) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15778)] [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:59:55.117375 tst iperf3m4.py:8: Test FAILED (10.7 sec) 02:59:55.146021 run osmo-hlr_10.42.42.2(pid=15775): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15775)] 02:59:55.195832 run osmo-hlr_10.42.42.2(pid=15775): stdout: | (launched: 2022-12-09_02:59:51.791331) 02:59:55.247811 run osmo-hlr_10.42.42.2(pid=15775): stderr: | 20221209025951989 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209025951989 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209025951989 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209025951989 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209025951989 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209025951989 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209025952003 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209025952013 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209025952013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209025952013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:55.300207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15764): Terminating (SIGTERM) 02:59:55.342140 run iperf3-srv_10.42.42.10(pid=15765): Terminating (SIGTERM) 02:59:55.383838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15766): Terminating (SIGTERM) 02:59:55.425905 run iperf3-srv_10.42.42.10(pid=15767): Terminating (SIGTERM) 02:59:55.467601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15768): Terminating (SIGTERM) 02:59:55.509211 run iperf3-srv_10.42.42.10(pid=15769): Terminating (SIGTERM) 02:59:55.550860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15770): Terminating (SIGTERM) 02:59:55.592518 run iperf3-srv_10.42.42.10(pid=15771): Terminating (SIGTERM) 02:59:55.634036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15774): Terminating (SIGTERM) 02:59:55.675654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15777): Terminating (SIGTERM) 02:59:55.717390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15780): Terminating (SIGTERM) 02:59:55.759267 --- ParallelTerminationStrategy: PID 15764 died... 02:59:55.779310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15764): Terminated: ok {rc=0} 02:59:55.825532 --- ParallelTerminationStrategy: PID 15765 died... 02:59:55.844864 run iperf3-srv_10.42.42.10(pid=15765): Terminated {rc=256} 02:59:55.891323 --- ParallelTerminationStrategy: PID 15766 died... 02:59:55.911080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15766): Terminated: ok {rc=0} 02:59:55.956728 --- ParallelTerminationStrategy: PID 15767 died... 02:59:55.976284 run iperf3-srv_10.42.42.10(pid=15767): Terminated {rc=256} 02:59:56.021867 --- ParallelTerminationStrategy: PID 15768 died... 02:59:56.041379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15768): Terminated: ok {rc=0} 02:59:56.086768 --- ParallelTerminationStrategy: PID 15769 died... 02:59:56.106372 run iperf3-srv_10.42.42.10(pid=15769): Terminated {rc=256} 02:59:56.151876 --- ParallelTerminationStrategy: PID 15770 died... 02:59:56.171377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=15770): Terminated: ok {rc=0} 02:59:56.217117 --- ParallelTerminationStrategy: PID 15771 died... 02:59:56.236296 run iperf3-srv_10.42.42.10(pid=15771): Terminated {rc=256} 02:59:56.282341 --- ParallelTerminationStrategy: PID 15774 died... 02:59:56.301998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15774): Terminated: ok {rc=0} 02:59:56.348114 --- ParallelTerminationStrategy: PID 15777 died... 02:59:56.367574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15777): Terminated: ok {rc=0} 02:59:56.413133 --- ParallelTerminationStrategy: PID 15780 died... 02:59:56.432567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15780): Terminated: ok {rc=0} 02:59:56.518531 bus /gobi_4: Setting Powered False 02:59:57.616428 bus /gobi_4: Setting Powered False 02:59:58.732349 bus /gobi_1: Setting Powered False 02:59:59.830877 bus /gobi_1: Setting Powered False 03:00:00.957024 bus /gobi_0: Setting Powered False 03:00:02.075790 bus /gobi_0: Setting Powered False 03:00:03.228136 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 03:00:04.331071 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:04.342815 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:00:04.414750 tst ping.py: using LAC 18601 03:00:04.532724 tst ping.py: using RAC 241 03:00:04.648153 tst ping.py: using CellId 18601 03:00:04.763677 tst ping.py: using BVCI 18602 03:00:04.879935 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:04.891600 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:04.903106 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:04.914641 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:04.926019 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:04.937468 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:04.948888 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:04.961287 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:00:05.075578 tst ping.py:19: start network... 03:00:05.272446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:05.729473 run create_hlr_db(pid=15825): Launched 03:00:05.843570 bus /gobi_6: Setting Powered False 03:00:06.902321 run create_hlr_db(pid=15825): Terminated: ok {rc=0} 03:00:07.314667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15827): Launched 03:00:07.609943 run osmo-hlr_10.42.42.2(pid=15828): Launched 03:00:07.723141 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:08.250789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15830): Launched 03:00:08.553708 run osmo-stp_10.42.42.5(pid=15832): Launched 03:00:08.667292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:00:09.177548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15834): Launched 03:00:09.290492 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:00:09.540421 run patchelf(pid=15835): Launched 03:00:09.705325 run osmo-stp_10.42.42.5(pid=15832): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15832)] 03:00:09.830207 run osmo-stp_10.42.42.5(pid=15832): stdout: | (launched: 2022-12-09_03:00:08.499213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:09.956833 run osmo-stp_10.42.42.5(pid=15832): stderr: | 20221209030008669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030008669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030008669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030008670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030008670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030008670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030008670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:10.083917 run osmo-stp_10.42.42.5(pid=15832): stdout: | (launched: 2022-12-09_03:00:08.499213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:10.204931 run osmo-stp_10.42.42.5(pid=15832): stderr: | 20221209030008669 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030008669 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030008669 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030008670 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030008670 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030008670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030008670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:10.348642 run patchelf(pid=15835): Terminating (SIGINT) 03:00:10.513899 run patchelf(pid=15835): Terminated: ok {rc=0} 03:00:10.633374 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=15832): Process ended prematurely: osmo-stp_10.42.42.5(pid=15832) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15832)] [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 03:00:10.642406 tst ping.py:22: Test FAILED (6.3 sec) 03:00:10.669859 run osmo-hlr_10.42.42.2(pid=15828): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15828)] 03:00:10.717553 run osmo-hlr_10.42.42.2(pid=15828): stdout: | (launched: 2022-12-09_03:00:07.555389) 03:00:10.766985 run osmo-hlr_10.42.42.2(pid=15828): stderr: | 20221209030007732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030007732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030007732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030007732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030007732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030007732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030007742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030007750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030007751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030007751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:10.816762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15827): Terminating (SIGTERM) 03:00:10.856645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15830): Terminating (SIGTERM) 03:00:10.896893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15834): Terminating (SIGTERM) 03:00:10.937845 --- ParallelTerminationStrategy: PID 15827 died... 03:00:10.957443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15827): Terminated: ok {rc=0} 03:00:11.002069 --- ParallelTerminationStrategy: PID 15830 died... 03:00:11.020597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15830): Terminated: ok {rc=0} 03:00:11.065366 --- ParallelTerminationStrategy: PID 15834 died... 03:00:11.083832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15834): Terminated: ok {rc=0} 03:00:11.169569 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 03:00:12.256280 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:12.268333 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:00:12.341829 tst ping_idle_ping.py: using LAC 18602 03:00:12.466949 tst ping_idle_ping.py: using RAC 242 03:00:12.593096 tst ping_idle_ping.py: using CellId 18602 03:00:12.718291 tst ping_idle_ping.py: using BVCI 18603 03:00:12.833581 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:12.845037 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:12.856233 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:12.867491 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:12.878845 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:12.890192 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:12.901728 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:00:12.912791 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:00:13.028920 tst ping_idle_ping.py:24: start network... 03:00:13.225633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:13.689507 run create_hlr_db(pid=15837): Launched 03:00:13.803389 bus /gobi_6: Setting Powered False 03:00:14.862879 run create_hlr_db(pid=15837): Terminated: ok {rc=0} 03:00:15.297814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15839): Launched 03:00:15.613989 run osmo-hlr_10.42.42.2(pid=15840): Launched 03:00:15.734753 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:16.361753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15842): Launched 03:00:16.685744 run osmo-stp_10.42.42.5(pid=15843): Launched 03:00:16.888497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:00:17.515683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15845): Launched 03:00:17.636461 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:00:17.902493 run patchelf(pid=15846): Launched 03:00:18.077633 run osmo-stp_10.42.42.5(pid=15843): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15843)] 03:00:18.210838 run osmo-stp_10.42.42.5(pid=15843): stdout: | (launched: 2022-12-09_03:00:16.619033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:18.346314 run osmo-stp_10.42.42.5(pid=15843): stderr: | 20221209030016928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030016929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030016932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030016936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030016936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030016936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030016937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:18.481154 run osmo-stp_10.42.42.5(pid=15843): stdout: | (launched: 2022-12-09_03:00:16.619033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:18.610645 run osmo-stp_10.42.42.5(pid=15843): stderr: | 20221209030016928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030016929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030016932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030016936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030016936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030016936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030016937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:18.763727 run patchelf(pid=15846): Terminating (SIGINT) 03:00:18.940313 run patchelf(pid=15846): Terminated: ok {rc=0} 03:00:19.067417 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=15843): Process ended prematurely: osmo-stp_10.42.42.5(pid=15843) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15843)] [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 03:00:19.076733 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 03:00:19.104730 run osmo-hlr_10.42.42.2(pid=15840): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15840)] 03:00:19.154636 run osmo-hlr_10.42.42.2(pid=15840): stdout: | (launched: 2022-12-09_03:00:15.555874) 03:00:19.206085 run osmo-hlr_10.42.42.2(pid=15840): stderr: | 20221209030015754 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030015754 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030015754 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030015754 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030015754 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030015754 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030015768 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030015778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030015779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030015779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:19.257929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15839): Terminating (SIGTERM) 03:00:19.300226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15842): Terminating (SIGTERM) 03:00:19.342230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15845): Terminating (SIGTERM) 03:00:19.384221 --- ParallelTerminationStrategy: PID 15839 died... 03:00:19.404040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15839): Terminated: ok {rc=0} 03:00:19.450396 --- ParallelTerminationStrategy: PID 15842 died... 03:00:19.470455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15842): Terminated: ok {rc=0} 03:00:19.516380 --- ParallelTerminationStrategy: PID 15845 died... 03:00:19.536112 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15845): Terminated: ok {rc=0} 03:00:19.623395 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:00:20.927509 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:20.934177 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:00:20.969645 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:00:21.004937 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:00:21.059688 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:00:21.094158 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:00:21.129123 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:00:21.682812 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:00:21.688060 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:00:21.699305 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:00:21.772471 tst switch_tch_pdch.py: using LAC 18603 03:00:21.886629 tst switch_tch_pdch.py: using RAC 243 03:00:22.004618 tst switch_tch_pdch.py: using CellId 18603 03:00:22.121597 tst switch_tch_pdch.py: using BVCI 18604 03:00:22.228897 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:00:22.240091 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:00:22.251109 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:00:22.262096 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:00:22.274518 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:00:22.286358 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:00:22.298349 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:00:22.310010 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:00:22.428510 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:00:22.552499 tst switch_tch_pdch.py:51: start network... 03:00:22.750859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:23.208941 run create_hlr_db(pid=15850): Launched 03:00:23.321253 bus /gobi_6: Setting Powered False 03:00:24.380628 run create_hlr_db(pid=15850): Terminated: ok {rc=0} 03:00:24.812445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15852): Launched 03:00:25.131507 run osmo-hlr_10.42.42.2(pid=15853): Launched 03:00:25.252903 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:25.869941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15857): Launched 03:00:26.184361 run osmo-stp_10.42.42.5(pid=15858): Launched 03:00:26.304881 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:00:26.849999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15860): Launched 03:00:26.969603 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:00:27.236465 run patchelf(pid=15861): Launched 03:00:27.411523 run osmo-stp_10.42.42.5(pid=15858): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15858)] 03:00:27.544134 run osmo-stp_10.42.42.5(pid=15858): stdout: | (launched: 2022-12-09_03:00:26.126646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:27.678887 run osmo-stp_10.42.42.5(pid=15858): stderr: | 20221209030026321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030026321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030026321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030026322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030026322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030026322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030026322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:27.813218 run osmo-stp_10.42.42.5(pid=15858): stdout: | (launched: 2022-12-09_03:00:26.126646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:27.942429 run osmo-stp_10.42.42.5(pid=15858): stderr: | 20221209030026321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030026321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030026321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030026322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030026322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030026322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030026322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:28.094960 run patchelf(pid=15861): Terminating (SIGINT) 03:00:28.270663 run patchelf(pid=15861): Terminated: ok {rc=0} 03:00:28.397620 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15858): Process ended prematurely: osmo-stp_10.42.42.5(pid=15858) [trial-2353↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15858)] [trial-2353↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:00:28.407009 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 03:00:28.434671 run osmo-hlr_10.42.42.2(pid=15853): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15853)] 03:00:28.483720 run osmo-hlr_10.42.42.2(pid=15853): stdout: | (launched: 2022-12-09_03:00:25.070047) 03:00:28.534633 run osmo-hlr_10.42.42.2(pid=15853): stderr: | 20221209030025268 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030025268 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030025268 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030025268 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030025268 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030025268 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030025306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030025323 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030025323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030025323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:28.585669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15852): Terminating (SIGTERM) 03:00:28.626783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15857): Terminating (SIGTERM) 03:00:28.668059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15860): Terminating (SIGTERM) 03:00:28.709533 --- ParallelTerminationStrategy: PID 15852 died... 03:00:28.729384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15852): Terminated: ok {rc=0} 03:00:28.775067 --- ParallelTerminationStrategy: PID 15857 died... 03:00:28.794418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15857): Terminated: ok {rc=0} 03:00:28.839724 --- ParallelTerminationStrategy: PID 15860 died... 03:00:28.859082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15860): Terminated: ok {rc=0} 03:00:28.945855 bus /gobi_0: Setting Powered False 03:00:30.044280 bus /gobi_0: Setting Powered False 03:00:31.167432 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 03:00:32.419041 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:32.424871 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 03:00:32.459143 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 03:00:32.493520 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 03:00:32.547013 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 03:00:32.580370 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 03:00:32.614894 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 03:00:33.172212 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 03:00:33.178483 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:00:33.190372 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 03:00:33.264259 tst switch_tch_pdch.py: using LAC 18604 03:00:33.391519 tst switch_tch_pdch.py: using RAC 244 03:00:33.517624 tst switch_tch_pdch.py: using CellId 18604 03:00:33.643656 tst switch_tch_pdch.py: using BVCI 18605 03:00:33.758339 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:00:33.769796 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:00:33.780880 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:00:33.792115 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:00:33.803220 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:00:33.814544 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:00:33.825858 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:00:33.837014 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:00:33.951989 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:00:34.069647 tst switch_tch_pdch.py:51: start network... 03:00:34.281841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:34.743674 run create_hlr_db(pid=15865): Launched 03:00:34.871162 bus /gobi_6: Setting Powered False 03:00:35.933927 run create_hlr_db(pid=15865): Terminated: ok {rc=0} 03:00:36.347265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15867): Launched 03:00:36.661976 run osmo-hlr_10.42.42.2(pid=15868): Launched 03:00:36.781624 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:37.296910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15870): Launched 03:00:37.611228 run osmo-stp_10.42.42.5(pid=15871): Launched 03:00:37.730833 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:00:38.249844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15873): Launched 03:00:38.370319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:00:38.636167 run patchelf(pid=15874): Launched 03:00:38.811334 run osmo-stp_10.42.42.5(pid=15871): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15871)] 03:00:38.944484 run osmo-stp_10.42.42.5(pid=15871): stdout: | (launched: 2022-12-09_03:00:37.553647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:39.079661 run osmo-stp_10.42.42.5(pid=15871): stderr: | 20221209030037745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030037746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030037746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030037746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030037747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030037747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030037747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:39.215566 run osmo-stp_10.42.42.5(pid=15871): stdout: | (launched: 2022-12-09_03:00:37.553647) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:39.345787 run osmo-stp_10.42.42.5(pid=15871): stderr: | 20221209030037745 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030037746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030037746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030037746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030037747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030037747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030037747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:39.498794 run patchelf(pid=15874): Terminating (SIGINT) 03:00:39.675658 run patchelf(pid=15874): Terminated: ok {rc=0} 03:00:39.802657 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=15871): Process ended prematurely: osmo-stp_10.42.42.5(pid=15871) [trial-2353↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15871)] [trial-2353↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 03:00:39.812117 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 03:00:39.839715 run osmo-hlr_10.42.42.2(pid=15868): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15868)] 03:00:39.888809 run osmo-hlr_10.42.42.2(pid=15868): stdout: | (launched: 2022-12-09_03:00:36.604381) 03:00:39.939985 run osmo-hlr_10.42.42.2(pid=15868): stderr: | 20221209030036805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030036805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030036805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030036805 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030036805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030036805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030036818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030036828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030036828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030036828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:39.991426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15867): Terminating (SIGTERM) 03:00:40.032569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15870): Terminating (SIGTERM) 03:00:40.073839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15873): Terminating (SIGTERM) 03:00:40.115224 --- ParallelTerminationStrategy: PID 15867 died... 03:00:40.135039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15867): Terminated: ok {rc=0} 03:00:40.180690 --- ParallelTerminationStrategy: PID 15870 died... 03:00:40.200156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15870): Terminated: ok {rc=0} 03:00:40.245578 --- ParallelTerminationStrategy: PID 15873 died... 03:00:40.264913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=15873): Terminated: ok {rc=0} 03:00:40.352002 bus /gobi_0: Setting Powered False 03:00:41.450234 bus /gobi_0: Setting Powered False 03:00:42.564200 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 03:00:43.815937 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:43.820737 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:00:43.850776 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 03:00:43.857538 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:00:43.908550 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:00:43.938617 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 03:00:43.945837 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:00:44.487027 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 03:00:44.492315 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 03:00:44.503796 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:00:44.548733 tst mo_mt_sms.py: using LAC 18605 03:00:44.673299 tst mo_mt_sms.py: using RAC 245 03:00:44.796113 tst mo_mt_sms.py: using CellId 18605 03:00:44.918549 tst mo_mt_sms.py: using BVCI 18606 03:00:45.033070 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:00:45.148065 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:00:45.265581 tst mo_mt_sms.py:9: start nitb and bts... 03:00:45.481044 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:00:46.185678 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15878): Launched 03:00:46.504414 run osmo-nitb_10.42.42.2(pid=15879): Launched 03:00:46.676048 run osmo-nitb_10.42.42.2(pid=15879): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15879)] 03:00:46.812079 run osmo-nitb_10.42.42.2(pid=15879): stdout: | (launched: 2022-12-09_03:00:46.438649) 03:00:46.950514 run osmo-nitb_10.42.42.2(pid=15879): stderr: | (launched: 2022-12-09_03:00:46.484145) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:00:47.117641 run osmo-nitb_10.42.42.2(pid=15879): stdout: | (launched: 2022-12-09_03:00:46.438649) 03:00:47.253175 run osmo-nitb_10.42.42.2(pid=15879): stderr: | (launched: 2022-12-09_03:00:46.484145) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15879): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15879) [trial-2353↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15879)] 03:00:47.621244 tst osmo-nitb_10.42.42.2(pid=15879): stdout: | (launched: 2022-12-09_03:00:46.438649) 03:00:47.739246 tst osmo-nitb_10.42.42.2(pid=15879): stderr: | (launched: 2022-12-09_03:00:46.484145) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:00:47.878518 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=15879): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15879) [trial-2353↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15879)] [trial-2353↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 03:00:47.886780 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 03:00:47.893256 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15878): Terminating (SIGTERM) 03:00:48.101645 --- ParallelTerminationStrategy: PID 15878 died... 03:00:48.122466 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15878): Terminated: ok {rc=0} 03:00:48.207016 bus /sierra_3: Setting Powered False 03:00:49.306517 bus /sierra_3: Setting Powered False 03:00:50.421739 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 03:00:51.616559 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:51.620573 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:00:51.650123 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:00:51.676709 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:00:51.729658 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:00:51.760225 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:00:51.786605 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:00:52.335849 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 03:00:52.341483 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:52.352850 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:00:52.398056 tst mo_mt_sms.py: using LAC 18606 03:00:52.515082 tst mo_mt_sms.py: using RAC 246 03:00:52.631975 tst mo_mt_sms.py: using CellId 18606 03:00:52.748226 tst mo_mt_sms.py: using BVCI 18607 03:00:52.855157 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:52.865999 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:52.876627 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:52.887504 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:52.898298 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:52.909187 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:00:53.024074 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:00:53.142838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:53.633554 run create_hlr_db(pid=15883): Launched 03:00:53.761699 bus /sierra_2: Setting Powered False 03:00:54.823961 run create_hlr_db(pid=15883): Terminated: ok {rc=0} 03:00:55.245722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15885): Launched 03:00:55.539689 run osmo-hlr_10.42.42.2(pid=15886): Launched 03:00:55.652939 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:56.172781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15888): Launched 03:00:56.466004 run osmo-stp_10.42.42.5(pid=15889): Launched 03:00:56.577480 run osmo-msc_10.42.42.6: Starting osmo-msc 03:00:57.113583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15891): Launched 03:00:57.432523 run osmo-msc_10.42.42.6(pid=15892): Launched 03:00:57.609812 run osmo-stp_10.42.42.5(pid=15889): ERR: Terminated: ERROR {rc=1} [trial-2353↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15889)] 03:00:57.743601 run osmo-stp_10.42.42.5(pid=15889): stdout: | (launched: 2022-12-09_03:00:56.411738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:57.877505 run osmo-stp_10.42.42.5(pid=15889): stderr: | 20221209030056580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030056581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030056581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030056581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030056582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030056582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030056582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:58.010877 run osmo-stp_10.42.42.5(pid=15889): stdout: | (launched: 2022-12-09_03:00:56.411738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:58.136931 run osmo-stp_10.42.42.5(pid=15889): stderr: | 20221209030056580 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030056581 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030056581 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030056581 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030056582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030056582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030056582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:58.287943 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=15889): Process ended prematurely: osmo-stp_10.42.42.5(pid=15889) [trial-2353↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15889)] [trial-2353↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 03:00:58.297309 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 03:00:58.325467 run osmo-hlr_10.42.42.2(pid=15886): ERR: Terminated: ERROR {rc=237} [trial-2353↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15886)] 03:00:58.375930 run osmo-hlr_10.42.42.2(pid=15886): stdout: | (launched: 2022-12-09_03:00:55.485626) 03:00:58.427928 run osmo-hlr_10.42.42.2(pid=15886): stderr: | 20221209030055660 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030055660 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030055660 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030055660 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030055661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030055661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030055674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030055684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030055684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030055684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:58.500376 run osmo-msc_10.42.42.6(pid=15892): ERR: Terminated: ERROR {rc=2} [trial-2353↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15892)] 03:00:58.551118 run osmo-msc_10.42.42.6(pid=15892): stdout: | (launched: 2022-12-09_03:00:57.374659) 03:00:58.602651 run osmo-msc_10.42.42.6(pid=15892): stderr: | 20221209030057699 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030057699 DLGLOBAL DEBUG validating counter group 0x7f7ad85eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030057700 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030057700 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030057700 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030057700 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030057702 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030057702 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030057702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030057702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:00:58.654393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15885): Terminating (SIGTERM) 03:00:58.696538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15888): Terminating (SIGTERM) 03:00:58.738499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15891): Terminating (SIGTERM) 03:00:58.781446 --- ParallelTerminationStrategy: PID 15885 died... 03:00:58.801336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15885): Terminated: ok {rc=0} 03:00:58.847683 --- ParallelTerminationStrategy: PID 15888 died... 03:00:58.867295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15888): Terminated: ok {rc=0} 03:00:58.913468 --- ParallelTerminationStrategy: PID 15891 died... 03:00:58.933060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15891): Terminated: ok {rc=0} 03:00:59.020866 bus /sierra_3: Setting Powered False 03:01:00.119236 bus /sierra_3: Setting Powered False 03:01:01.232236 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 03:01:02.456599 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:01:02.460347 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:01:02.490206 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 03:01:02.496931 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 03:01:02.532473 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:01:02.561369 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 03:01:02.568247 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 03:01:03.088529 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2353 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 03:01:03.093513 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 03:01:03.104366 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:01:03.147545 tst assert_extension.py: using LAC 18607 03:01:03.265243 tst assert_extension.py: using RAC 247 03:01:03.386154 tst assert_extension.py: using CellId 18607 03:01:03.502011 tst assert_extension.py: using BVCI 18608 03:01:03.608422 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 03:01:03.722010 tst assert_extension.py:10: start nitb and bts... 03:01:03.918592 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:01:04.522882 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15897): Launched 03:01:04.817135 run osmo-nitb_10.42.42.2(pid=15898): Launched 03:01:04.980127 run osmo-nitb_10.42.42.2(pid=15898): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15898)] 03:01:05.112261 run osmo-nitb_10.42.42.2(pid=15898): stdout: | (launched: 2022-12-09_03:01:04.762520) 03:01:05.245763 run osmo-nitb_10.42.42.2(pid=15898): stderr: | (launched: 2022-12-09_03:01:04.806175) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:01:05.379588 run osmo-nitb_10.42.42.2(pid=15898): stdout: | (launched: 2022-12-09_03:01:04.762520) 03:01:05.507548 run osmo-nitb_10.42.42.2(pid=15898): stderr: | (launched: 2022-12-09_03:01:04.806175) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=15898): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15898) [trial-2353↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15898)] 03:01:05.928023 tst osmo-nitb_10.42.42.2(pid=15898): stdout: | (launched: 2022-12-09_03:01:04.762520) 03:01:06.047000 tst osmo-nitb_10.42.42.2(pid=15898): stderr: | (launched: 2022-12-09_03:01:04.806175) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:01:06.186839 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=15898): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15898) [trial-2353↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15898)] [trial-2353↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 03:01:06.195103 tst assert_extension.py:12: Test FAILED (3.1 sec) 03:01:06.201745 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15897): Terminating (SIGTERM) 03:01:06.412193 --- ParallelTerminationStrategy: PID 15897 died... 03:01:06.432582 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=15897): Terminated: ok {rc=0} 03:01:06.519131 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 03:01:07.695161 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:01:07.699447 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:01:07.729469 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:01:07.757119 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 03:01:07.793352 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:01:07.823373 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:01:07.850566 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 03:01:08.378675 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2353 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 03:01:08.384371 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:01:08.395557 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:01:08.439176 tst assert_extension.py: using LAC 18608 03:01:08.561744 tst assert_extension.py: using RAC 248 03:01:08.687584 tst assert_extension.py: using CellId 18608 03:01:08.810923 tst assert_extension.py: using BVCI 18609 03:01:08.927591 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:01:08.938947 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:01:08.950346 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:01:08.961686 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:01:08.972650 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:01:08.983661 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 03:01:09.097408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:09.554900 run create_hlr_db(pid=15902): Launched 03:01:09.668064 bus /sierra_2: Setting Powered False 03:01:10.727808 run create_hlr_db(pid=15902): Terminated: ok {rc=0} 03:01:11.141497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15904): Launched 03:01:11.435485 run osmo-hlr_10.42.42.2(pid=15905): Launched 03:01:11.548010 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:12.055367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15907): Launched 03:01:12.349511 run osmo-stp_10.42.42.5(pid=15908): Launched 03:01:12.462727 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:12.994574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15910): Launched 03:01:13.287999 run osmo-msc_10.42.42.6(pid=15911): Launched 03:01:13.453521 run osmo-stp_10.42.42.5(pid=15908): ERR: Terminated: ERROR {rc=1} [trial-2353↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15908)] 03:01:13.579049 run osmo-stp_10.42.42.5(pid=15908): stdout: | (launched: 2022-12-09_03:01:12.295112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:13.704438 run osmo-stp_10.42.42.5(pid=15908): stderr: | 20221209030112464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030112465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030112465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030112465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030112466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030112466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030112466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:13.827189 run osmo-stp_10.42.42.5(pid=15908): stdout: | (launched: 2022-12-09_03:01:12.295112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:13.944034 run osmo-stp_10.42.42.5(pid=15908): stderr: | 20221209030112464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030112465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030112465 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030112465 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030112466 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030112466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030112466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:14.083967 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=15908): Process ended prematurely: osmo-stp_10.42.42.5(pid=15908) [trial-2353↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15908)] [trial-2353↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 03:01:14.092175 tst assert_extension.py:17: Test FAILED (5.7 sec) 03:01:14.118382 run osmo-hlr_10.42.42.2(pid=15905): ERR: Terminated: ERROR {rc=237} [trial-2353↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15905)] 03:01:14.165742 run osmo-hlr_10.42.42.2(pid=15905): stdout: | (launched: 2022-12-09_03:01:11.381640) 03:01:14.214568 run osmo-hlr_10.42.42.2(pid=15905): stderr: | 20221209030111558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030111559 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030111559 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030111559 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030111559 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030111559 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030111571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030111580 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030111580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030111581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:14.282723 run osmo-msc_10.42.42.6(pid=15911): ERR: Terminated: ERROR {rc=2} [trial-2353↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15911)] 03:01:14.329927 run osmo-msc_10.42.42.6(pid=15911): stdout: | (launched: 2022-12-09_03:01:13.233646) 03:01:14.378642 run osmo-msc_10.42.42.6(pid=15911): stderr: | 20221209030113507 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030113507 DLGLOBAL DEBUG validating counter group 0x7f03d5c6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030113507 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030113507 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030113507 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030113507 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030113509 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030113509 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030113510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030113510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:14.427850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15904): Terminating (SIGTERM) 03:01:14.466723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15907): Terminating (SIGTERM) 03:01:14.506297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15910): Terminating (SIGTERM) 03:01:14.545878 --- ParallelTerminationStrategy: PID 15904 died... 03:01:14.564478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15904): Terminated: ok {rc=0} 03:01:14.608432 --- ParallelTerminationStrategy: PID 15907 died... 03:01:14.626813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15907): Terminated: ok {rc=0} 03:01:14.670649 --- ParallelTerminationStrategy: PID 15910 died... 03:01:14.689024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15910): Terminated: ok {rc=0} 03:01:14.771469 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:01:15.995348 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:01:16.001849 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:01:16.035510 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:01:16.063104 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:01:16.120342 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:01:16.164914 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:01:16.192380 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:01:16.723784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:01:16.774508 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:01:16.786449 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:01:16.851682 tst mo_mt_call.py: using LAC 18609 03:01:16.974848 tst mo_mt_call.py: using RAC 249 03:01:17.095796 tst mo_mt_call.py: using CellId 18609 03:01:17.259208 tst mo_mt_call.py: using BVCI 18610 03:01:17.383825 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:01:17.396360 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:01:17.408815 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:01:17.421826 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:01:17.434388 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:01:17.446643 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:01:17.565557 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:01:17.684938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:18.184382 run create_hlr_db(pid=15916): Launched 03:01:18.314785 bus /sierra_2: Setting Powered False 03:01:19.378470 run create_hlr_db(pid=15916): Terminated: ok {rc=0} 03:01:19.808588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15918): Launched 03:01:20.107177 run osmo-hlr_10.42.42.2(pid=15919): Launched 03:01:20.221420 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:20.752288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15921): Launched 03:01:21.051208 run osmo-stp_10.42.42.5(pid=15922): Launched 03:01:21.165107 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:21.706260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15924): Launched 03:01:22.005093 run osmo-msc_10.42.42.6(pid=15925): Launched 03:01:22.173540 run osmo-stp_10.42.42.5(pid=15922): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15922)] 03:01:22.301345 run osmo-stp_10.42.42.5(pid=15922): stdout: | (launched: 2022-12-09_03:01:20.996483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:22.428736 run osmo-stp_10.42.42.5(pid=15922): stderr: | 20221209030121165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030121165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030121165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030121166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030121168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030121168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030121168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:22.553246 run osmo-stp_10.42.42.5(pid=15922): stdout: | (launched: 2022-12-09_03:01:20.996483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:22.672745 run osmo-stp_10.42.42.5(pid=15922): stderr: | 20221209030121165 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030121165 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030121165 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030121166 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030121168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030121168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030121168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:22.815406 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15922): Process ended prematurely: osmo-stp_10.42.42.5(pid=15922) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15922)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:01:22.824293 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:01:22.851408 run osmo-hlr_10.42.42.2(pid=15919): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15919)] 03:01:22.899426 run osmo-hlr_10.42.42.2(pid=15919): stdout: | (launched: 2022-12-09_03:01:20.052532) 03:01:22.949204 run osmo-hlr_10.42.42.2(pid=15919): stderr: | 20221209030120228 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030120228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030120228 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030120228 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030120228 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030120228 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030120240 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030120249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030120250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030120250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:23.017847 run osmo-msc_10.42.42.6(pid=15925): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15925)] 03:01:23.065498 run osmo-msc_10.42.42.6(pid=15925): stdout: | (launched: 2022-12-09_03:01:21.950249) 03:01:23.114768 run osmo-msc_10.42.42.6(pid=15925): stderr: | 20221209030122219 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030122219 DLGLOBAL DEBUG validating counter group 0x7fb0a37f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030122219 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030122219 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030122219 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030122219 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030122221 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030122222 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030122222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030122222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:23.164159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15918): Terminating (SIGTERM) 03:01:23.203887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15921): Terminating (SIGTERM) 03:01:23.243644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15924): Terminating (SIGTERM) 03:01:23.283756 --- ParallelTerminationStrategy: PID 15918 died... 03:01:23.302804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15918): Terminated: ok {rc=0} 03:01:23.346938 --- ParallelTerminationStrategy: PID 15921 died... 03:01:23.365697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15921): Terminated: ok {rc=0} 03:01:23.410066 --- ParallelTerminationStrategy: PID 15924 died... 03:01:23.428706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15924): Terminated: ok {rc=0} 03:01:23.514690 bus /sierra_3: Setting Powered False 03:01:24.612830 bus /sierra_3: Setting Powered False 03:01:25.724984 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:01:26.872523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:01:26.885236 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:01:26.952861 tst mo_mt_call_osmux.py: using LAC 18610 03:01:27.078616 tst mo_mt_call_osmux.py: using RAC 250 03:01:27.211035 tst mo_mt_call_osmux.py: using CellId 18610 03:01:27.336930 tst mo_mt_call_osmux.py: using BVCI 18611 03:01:27.453676 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:01:27.465493 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:01:27.477700 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:01:27.489718 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:01:27.501689 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:01:27.513875 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:01:27.628285 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:01:27.749432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:28.214794 run create_hlr_db(pid=15927): Launched 03:01:28.329356 bus /sierra_2: Setting Powered False 03:01:29.393184 run create_hlr_db(pid=15927): Terminated: ok {rc=0} 03:01:29.840507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15929): Launched 03:01:30.161265 run osmo-hlr_10.42.42.2(pid=15930): Launched 03:01:30.285264 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:30.849753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15932): Launched 03:01:31.169842 run osmo-stp_10.42.42.5(pid=15933): Launched 03:01:31.332422 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:32.069729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15935): Launched 03:01:32.381734 run osmo-msc_10.42.42.6(pid=15936): Launched 03:01:32.551825 run osmo-stp_10.42.42.5(pid=15933): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15933)] 03:01:32.679861 run osmo-stp_10.42.42.5(pid=15933): stdout: | (launched: 2022-12-09_03:01:31.113086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:32.807719 run osmo-stp_10.42.42.5(pid=15933): stderr: | 20221209030131405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030131405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030131405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030131406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030131406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030131406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030131406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:32.932382 run osmo-stp_10.42.42.5(pid=15933): stdout: | (launched: 2022-12-09_03:01:31.113086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:33.051907 run osmo-stp_10.42.42.5(pid=15933): stderr: | 20221209030131405 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030131405 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030131405 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030131406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030131406 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030131406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030131406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:33.195012 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15933): Process ended prematurely: osmo-stp_10.42.42.5(pid=15933) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15933)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:01:33.203867 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:01:33.231378 run osmo-hlr_10.42.42.2(pid=15930): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15930)] 03:01:33.279335 run osmo-hlr_10.42.42.2(pid=15930): stdout: | (launched: 2022-12-09_03:01:30.103061) 03:01:33.328692 run osmo-hlr_10.42.42.2(pid=15930): stderr: | 20221209030130300 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030130300 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030130300 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030130300 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030130300 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030130300 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030130311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030130320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030130320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030130320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:33.397653 run osmo-msc_10.42.42.6(pid=15936): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15936)] 03:01:33.445185 run osmo-msc_10.42.42.6(pid=15936): stdout: | (launched: 2022-12-09_03:01:32.326648) 03:01:33.494271 run osmo-msc_10.42.42.6(pid=15936): stderr: | 20221209030132596 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030132596 DLGLOBAL DEBUG validating counter group 0x7f88d209bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030132596 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030132596 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030132597 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030132597 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030132600 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030132601 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030132601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030132601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:33.544213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15929): Terminating (SIGTERM) 03:01:33.584041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15932): Terminating (SIGTERM) 03:01:33.623766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15935): Terminating (SIGTERM) 03:01:33.663871 --- ParallelTerminationStrategy: PID 15929 died... 03:01:33.682938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15929): Terminated: ok {rc=0} 03:01:33.727486 --- ParallelTerminationStrategy: PID 15932 died... 03:01:33.746211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15932): Terminated: ok {rc=0} 03:01:33.790377 --- ParallelTerminationStrategy: PID 15935 died... 03:01:33.809189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15935): Terminated: ok {rc=0} 03:01:33.894398 bus /sierra_3: Setting Powered False 03:01:34.993357 bus /sierra_3: Setting Powered False 03:01:36.108336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:01:37.351061 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:01:37.357627 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:01:37.387535 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:01:37.414555 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:01:37.466398 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:01:37.495744 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:01:37.522636 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:01:38.073794 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:01:38.123324 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:38.134730 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:01:38.199719 tst mo_mt_call.py: using LAC 18611 03:01:38.328492 tst mo_mt_call.py: using RAC 251 03:01:38.449132 tst mo_mt_call.py: using CellId 18611 03:01:38.576868 tst mo_mt_call.py: using BVCI 18612 03:01:38.694149 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:38.706045 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:38.717747 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:38.729597 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:38.741452 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:38.753224 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:01:38.873067 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:01:38.990347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:39.457683 run create_hlr_db(pid=15941): Launched 03:01:39.573647 bus /sierra_2: Setting Powered False 03:01:40.634691 run create_hlr_db(pid=15941): Terminated: ok {rc=0} 03:01:41.073711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15943): Launched 03:01:41.394018 run osmo-hlr_10.42.42.2(pid=15944): Launched 03:01:41.516650 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:42.070152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15946): Launched 03:01:42.391615 run osmo-stp_10.42.42.5(pid=15947): Launched 03:01:42.514869 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:43.095956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15949): Launched 03:01:43.417900 run osmo-msc_10.42.42.6(pid=15950): Launched 03:01:43.598497 run osmo-stp_10.42.42.5(pid=15947): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15947)] 03:01:43.733827 run osmo-stp_10.42.42.5(pid=15947): stdout: | (launched: 2022-12-09_03:01:42.333188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:43.869483 run osmo-stp_10.42.42.5(pid=15947): stderr: | 20221209030142526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030142526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030142526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030142527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030142527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030142527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030142527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:44.003856 run osmo-stp_10.42.42.5(pid=15947): stdout: | (launched: 2022-12-09_03:01:42.333188) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:44.131762 run osmo-stp_10.42.42.5(pid=15947): stderr: | 20221209030142526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030142526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030142526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030142527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030142527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030142527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030142527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:44.284756 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15947): Process ended prematurely: osmo-stp_10.42.42.5(pid=15947) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15947)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:01:44.294321 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:01:44.322188 run osmo-hlr_10.42.42.2(pid=15944): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15944)] 03:01:44.372496 run osmo-hlr_10.42.42.2(pid=15944): stdout: | (launched: 2022-12-09_03:01:41.335521) 03:01:44.423736 run osmo-hlr_10.42.42.2(pid=15944): stderr: | 20221209030141532 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030141532 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030141533 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030141533 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030141533 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030141533 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030141548 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030141557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030141557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030141557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:44.495278 run osmo-msc_10.42.42.6(pid=15950): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15950)] 03:01:44.544911 run osmo-msc_10.42.42.6(pid=15950): stdout: | (launched: 2022-12-09_03:01:43.359386) 03:01:44.596342 run osmo-msc_10.42.42.6(pid=15950): stderr: | 20221209030143682 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030143682 DLGLOBAL DEBUG validating counter group 0x7fdd001b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030143682 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030143682 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030143682 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030143683 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030143684 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030143685 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030143685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030143685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:44.648281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15943): Terminating (SIGTERM) 03:01:44.689797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15946): Terminating (SIGTERM) 03:01:44.731243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15949): Terminating (SIGTERM) 03:01:44.773117 --- ParallelTerminationStrategy: PID 15943 died... 03:01:44.792637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15943): Terminated: ok {rc=0} 03:01:44.838335 --- ParallelTerminationStrategy: PID 15946 died... 03:01:44.857938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15946): Terminated: ok {rc=0} 03:01:44.903634 --- ParallelTerminationStrategy: PID 15949 died... 03:01:44.923229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15949): Terminated: ok {rc=0} 03:01:45.009775 bus /sierra_3: Setting Powered False 03:01:46.108209 bus /sierra_3: Setting Powered False 03:01:47.226409 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:01:48.371495 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:48.383678 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:01:48.449939 tst mo_mt_call_osmux.py: using LAC 18612 03:01:48.568865 tst mo_mt_call_osmux.py: using RAC 252 03:01:48.686578 tst mo_mt_call_osmux.py: using CellId 18612 03:01:48.805505 tst mo_mt_call_osmux.py: using BVCI 18613 03:01:48.916655 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:48.928215 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:48.939552 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:48.951211 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:48.962967 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:48.974671 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:01:49.093193 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:01:49.209481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:49.675343 run create_hlr_db(pid=15952): Launched 03:01:49.789242 bus /sierra_2: Setting Powered False 03:01:50.849279 run create_hlr_db(pid=15952): Terminated: ok {rc=0} 03:01:51.266706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15954): Launched 03:01:51.565378 run osmo-hlr_10.42.42.2(pid=15955): Launched 03:01:51.680170 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:52.234803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15957): Launched 03:01:52.556372 run osmo-stp_10.42.42.5(pid=15958): Launched 03:01:52.679662 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:53.260393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15960): Launched 03:01:53.581382 run osmo-msc_10.42.42.6(pid=15961): Launched 03:01:53.760805 run osmo-stp_10.42.42.5(pid=15958): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15958)] 03:01:53.896097 run osmo-stp_10.42.42.5(pid=15958): stdout: | (launched: 2022-12-09_03:01:52.498156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:54.031716 run osmo-stp_10.42.42.5(pid=15958): stderr: | 20221209030152691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030152691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030152691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030152692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030152694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030152694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030152694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:54.166641 run osmo-stp_10.42.42.5(pid=15958): stdout: | (launched: 2022-12-09_03:01:52.498156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:54.294900 run osmo-stp_10.42.42.5(pid=15958): stderr: | 20221209030152691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030152691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030152691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030152692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030152694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030152694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030152694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:54.448792 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15958): Process ended prematurely: osmo-stp_10.42.42.5(pid=15958) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15958)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:01:54.458445 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:01:54.486553 run osmo-hlr_10.42.42.2(pid=15955): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15955)] 03:01:54.536446 run osmo-hlr_10.42.42.2(pid=15955): stdout: | (launched: 2022-12-09_03:01:51.510659) 03:01:54.587886 run osmo-hlr_10.42.42.2(pid=15955): stderr: | 20221209030151686 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030151686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030151686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030151687 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030151687 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030151687 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030151698 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030151706 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030151706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030151706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:54.659744 run osmo-msc_10.42.42.6(pid=15961): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15961)] 03:01:54.709677 run osmo-msc_10.42.42.6(pid=15961): stdout: | (launched: 2022-12-09_03:01:53.522920) 03:01:54.760598 run osmo-msc_10.42.42.6(pid=15961): stderr: | 20221209030153847 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030153848 DLGLOBAL DEBUG validating counter group 0x7fd1c819ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030153848 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030153848 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030153848 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030153848 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030153850 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030153850 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030153850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030153850 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:54.811870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15954): Terminating (SIGTERM) 03:01:54.853206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15957): Terminating (SIGTERM) 03:01:54.895171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15960): Terminating (SIGTERM) 03:01:54.937046 --- ParallelTerminationStrategy: PID 15954 died... 03:01:54.956516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15954): Terminated: ok {rc=0} 03:01:55.002598 --- ParallelTerminationStrategy: PID 15957 died... 03:01:55.022167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15957): Terminated: ok {rc=0} 03:01:55.068165 --- ParallelTerminationStrategy: PID 15960 died... 03:01:55.087838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15960): Terminated: ok {rc=0} 03:01:55.175133 bus /sierra_3: Setting Powered False 03:01:56.273629 bus /sierra_3: Setting Powered False 03:01:57.389761 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:01:58.634230 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:01:58.640477 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:01:58.670198 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:01:58.696722 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:01:58.753743 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:01:58.783865 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:01:58.811427 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:01:59.356688 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:01:59.405290 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:59.416561 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:01:59.479717 tst mo_mt_call.py: using LAC 18613 03:01:59.595969 tst mo_mt_call.py: using RAC 253 03:01:59.711865 tst mo_mt_call.py: using CellId 18613 03:01:59.831278 tst mo_mt_call.py: using BVCI 18614 03:01:59.941339 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:59.952572 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:59.963678 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:59.974985 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:59.986563 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:59.997927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:02:00.111869 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:02:00.226748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:00.692046 run create_hlr_db(pid=15966): Launched 03:02:00.805828 bus /sierra_2: Setting Powered False 03:02:01.867246 run create_hlr_db(pid=15966): Terminated: ok {rc=0} 03:02:02.325642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15968): Launched 03:02:02.627484 run osmo-hlr_10.42.42.2(pid=15969): Launched 03:02:02.742323 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:03.257683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15971): Launched 03:02:03.556601 run osmo-stp_10.42.42.5(pid=15972): Launched 03:02:03.671426 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:04.246503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15974): Launched 03:02:04.570227 run osmo-msc_10.42.42.6(pid=15975): Launched 03:02:04.770428 run osmo-stp_10.42.42.5(pid=15972): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15972)] 03:02:04.919930 run osmo-stp_10.42.42.5(pid=15972): stdout: | (launched: 2022-12-09_03:02:03.501986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:05.072168 run osmo-stp_10.42.42.5(pid=15972): stderr: | 20221209030203675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030203675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030203675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030203675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030203676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030203676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030203676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:05.207103 run osmo-stp_10.42.42.5(pid=15972): stdout: | (launched: 2022-12-09_03:02:03.501986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:05.335665 run osmo-stp_10.42.42.5(pid=15972): stderr: | 20221209030203675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030203675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030203675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030203675 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030203676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030203676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030203676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:05.489626 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15972): Process ended prematurely: osmo-stp_10.42.42.5(pid=15972) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15972)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:02:05.499212 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:02:05.527466 run osmo-hlr_10.42.42.2(pid=15969): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15969)] 03:02:05.578203 run osmo-hlr_10.42.42.2(pid=15969): stdout: | (launched: 2022-12-09_03:02:02.572189) 03:02:05.630312 run osmo-hlr_10.42.42.2(pid=15969): stderr: | 20221209030202749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030202749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030202749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030202749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030202749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030202749 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030202761 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030202770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030202771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030202771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:05.702774 run osmo-msc_10.42.42.6(pid=15975): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15975)] 03:02:05.753132 run osmo-msc_10.42.42.6(pid=15975): stdout: | (launched: 2022-12-09_03:02:04.510696) 03:02:05.805152 run osmo-msc_10.42.42.6(pid=15975): stderr: | 20221209030204812 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030204812 DLGLOBAL DEBUG validating counter group 0x7f06fd579c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030204812 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030204812 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030204812 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030204813 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030204814 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030204815 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030204815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030204815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:05.856919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15968): Terminating (SIGTERM) 03:02:05.899188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15971): Terminating (SIGTERM) 03:02:05.941476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15974): Terminating (SIGTERM) 03:02:05.984060 --- ParallelTerminationStrategy: PID 15968 died... 03:02:06.004134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15968): Terminated: ok {rc=0} 03:02:06.051267 --- ParallelTerminationStrategy: PID 15971 died... 03:02:06.071015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15971): Terminated: ok {rc=0} 03:02:06.117870 --- ParallelTerminationStrategy: PID 15974 died... 03:02:06.137624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15974): Terminated: ok {rc=0} 03:02:06.225233 bus /sierra_3: Setting Powered False 03:02:07.323312 bus /sierra_3: Setting Powered False 03:02:08.438377 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:02:09.585868 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:02:09.598375 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:02:09.678841 tst mo_mt_call_osmux.py: using LAC 18614 03:02:09.806118 tst mo_mt_call_osmux.py: using RAC 254 03:02:09.932710 tst mo_mt_call_osmux.py: using CellId 18614 03:02:10.058854 tst mo_mt_call_osmux.py: using BVCI 18615 03:02:10.175656 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:02:10.187458 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:02:10.199011 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:02:10.210736 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:02:10.222655 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:02:10.234215 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:02:10.350674 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:02:10.473221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:10.971607 run create_hlr_db(pid=15977): Launched 03:02:11.101918 bus /sierra_2: Setting Powered False 03:02:12.166000 run create_hlr_db(pid=15977): Terminated: ok {rc=0} 03:02:12.593095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15979): Launched 03:02:12.891310 run osmo-hlr_10.42.42.2(pid=15980): Launched 03:02:13.005378 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:13.521306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15982): Launched 03:02:13.821493 run osmo-stp_10.42.42.5(pid=15983): Launched 03:02:13.935919 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:14.477617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15985): Launched 03:02:14.776580 run osmo-msc_10.42.42.6(pid=15986): Launched 03:02:14.945374 run osmo-stp_10.42.42.5(pid=15983): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15983)] 03:02:15.072405 run osmo-stp_10.42.42.5(pid=15983): stdout: | (launched: 2022-12-09_03:02:13.766265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:15.199714 run osmo-stp_10.42.42.5(pid=15983): stderr: | 20221209030213937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030213937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030213937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030213938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030213940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030213940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030213940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:15.324304 run osmo-stp_10.42.42.5(pid=15983): stdout: | (launched: 2022-12-09_03:02:13.766265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:15.445316 run osmo-stp_10.42.42.5(pid=15983): stderr: | 20221209030213937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030213937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030213937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030213938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030213940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030213940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030213940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:15.588014 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15983): Process ended prematurely: osmo-stp_10.42.42.5(pid=15983) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15983)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:02:15.597096 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:02:15.624242 run osmo-hlr_10.42.42.2(pid=15980): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15980)] 03:02:15.671826 run osmo-hlr_10.42.42.2(pid=15980): stdout: | (launched: 2022-12-09_03:02:12.836767) 03:02:15.721205 run osmo-hlr_10.42.42.2(pid=15980): stderr: | 20221209030213012 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030213012 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030213012 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030213012 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030213012 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030213013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030213024 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030213033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030213034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030213034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:15.790119 run osmo-msc_10.42.42.6(pid=15986): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15986)] 03:02:15.837831 run osmo-msc_10.42.42.6(pid=15986): stdout: | (launched: 2022-12-09_03:02:14.721733) 03:02:15.889112 run osmo-msc_10.42.42.6(pid=15986): stderr: | 20221209030214994 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030214994 DLGLOBAL DEBUG validating counter group 0x7f2fa6072c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030214994 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030214994 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030214994 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030214995 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030214997 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030214997 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030214997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030214998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:15.939640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15979): Terminating (SIGTERM) 03:02:15.980500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15982): Terminating (SIGTERM) 03:02:16.022422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15985): Terminating (SIGTERM) 03:02:16.063387 --- ParallelTerminationStrategy: PID 15979 died... 03:02:16.082562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15979): Terminated: ok {rc=0} 03:02:16.127752 --- ParallelTerminationStrategy: PID 15982 died... 03:02:16.147007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15982): Terminated: ok {rc=0} 03:02:16.192142 --- ParallelTerminationStrategy: PID 15985 died... 03:02:16.211302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15985): Terminated: ok {rc=0} 03:02:16.295733 bus /sierra_3: Setting Powered False 03:02:17.390256 bus /sierra_3: Setting Powered False 03:02:18.504351 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 03:02:19.748471 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:02:19.755130 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 03:02:19.785789 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 03:02:19.812658 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 03:02:19.864604 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 03:02:19.893947 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 03:02:19.920759 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 03:02:20.473193 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 03:02:20.526566 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:02:20.538537 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:02:20.606201 tst mo_mt_call.py: using LAC 18615 03:02:20.732741 tst mo_mt_call.py: using RAC 255 03:02:20.858909 tst mo_mt_call.py: using CellId 18615 03:02:20.989313 tst mo_mt_call.py: using BVCI 18616 03:02:21.107737 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:02:21.119519 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:02:21.131179 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:02:21.142805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:02:21.154471 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:02:21.166056 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:02:21.281731 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:02:21.396294 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:21.862195 run create_hlr_db(pid=15992): Launched 03:02:21.977194 bus /sierra_2: Setting Powered False 03:02:23.037072 run create_hlr_db(pid=15992): Terminated: ok {rc=0} 03:02:23.478137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15994): Launched 03:02:23.799817 run osmo-hlr_10.42.42.2(pid=15995): Launched 03:02:23.923575 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:24.477706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15997): Launched 03:02:24.797077 run osmo-stp_10.42.42.5(pid=15998): Launched 03:02:24.919069 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:25.498948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16000): Launched 03:02:25.821312 run osmo-msc_10.42.42.6(pid=16001): Launched 03:02:26.002065 run osmo-stp_10.42.42.5(pid=15998): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15998)] 03:02:26.137664 run osmo-stp_10.42.42.5(pid=15998): stdout: | (launched: 2022-12-09_03:02:24.738625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:26.274237 run osmo-stp_10.42.42.5(pid=15998): stderr: | 20221209030224929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030224930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030224930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030224930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030224933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030224933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030224933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:26.409834 run osmo-stp_10.42.42.5(pid=15998): stdout: | (launched: 2022-12-09_03:02:24.738625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:26.538137 run osmo-stp_10.42.42.5(pid=15998): stderr: | 20221209030224929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030224930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030224930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030224930 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030224933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030224933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030224933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:26.691643 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15998): Process ended prematurely: osmo-stp_10.42.42.5(pid=15998) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15998)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 03:02:26.701294 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:02:26.729148 run osmo-hlr_10.42.42.2(pid=15995): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15995)] 03:02:26.778508 run osmo-hlr_10.42.42.2(pid=15995): stdout: | (launched: 2022-12-09_03:02:23.741058) 03:02:26.829674 run osmo-hlr_10.42.42.2(pid=15995): stderr: | 20221209030223938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030223938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030223938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030223938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030223938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030223938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030223951 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030223959 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030223959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030223959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:26.901640 run osmo-msc_10.42.42.6(pid=16001): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16001)] 03:02:26.950947 run osmo-msc_10.42.42.6(pid=16001): stdout: | (launched: 2022-12-09_03:02:25.762678) 03:02:27.002314 run osmo-msc_10.42.42.6(pid=16001): stderr: | 20221209030226086 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030226086 DLGLOBAL DEBUG validating counter group 0x7f7b4328bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030226086 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030226086 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030226086 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030226087 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030226088 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030226089 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030226089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030226089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:27.053814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15994): Terminating (SIGTERM) 03:02:27.094866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15997): Terminating (SIGTERM) 03:02:27.136222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16000): Terminating (SIGTERM) 03:02:27.177886 --- ParallelTerminationStrategy: PID 15994 died... 03:02:27.197292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15994): Terminated: ok {rc=0} 03:02:27.243114 --- ParallelTerminationStrategy: PID 15997 died... 03:02:27.262512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15997): Terminated: ok {rc=0} 03:02:27.308235 --- ParallelTerminationStrategy: PID 16000 died... 03:02:27.327582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16000): Terminated: ok {rc=0} 03:02:27.413736 bus /sierra_3: Setting Powered False 03:02:28.511241 bus /sierra_3: Setting Powered False 03:02:29.625061 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 03:02:30.769935 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:02:30.781800 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:02:30.858093 tst mo_mt_call_osmux.py: using LAC 18616 03:02:31.006566 tst mo_mt_call_osmux.py: using RAC 1 03:02:31.134661 tst mo_mt_call_osmux.py: using CellId 18616 03:02:31.286250 tst mo_mt_call_osmux.py: using BVCI 18617 03:02:31.399095 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:02:31.411346 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:02:31.423403 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:02:31.436425 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:02:31.451322 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:02:31.464379 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:02:31.586725 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:02:31.707930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:32.205618 run create_hlr_db(pid=16003): Launched 03:02:32.330573 bus /sierra_2: Setting Powered False 03:02:33.390783 run create_hlr_db(pid=16003): Terminated: ok {rc=0} 03:02:33.828936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16005): Launched 03:02:34.149953 run osmo-hlr_10.42.42.2(pid=16006): Launched 03:02:34.272363 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:34.828243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16008): Launched 03:02:35.149874 run osmo-stp_10.42.42.5(pid=16009): Launched 03:02:35.272855 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:35.858492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16011): Launched 03:02:36.179574 run osmo-msc_10.42.42.6(pid=16012): Launched 03:02:36.360143 run osmo-stp_10.42.42.5(pid=16009): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16009)] 03:02:36.495445 run osmo-stp_10.42.42.5(pid=16009): stdout: | (launched: 2022-12-09_03:02:35.091294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:36.631101 run osmo-stp_10.42.42.5(pid=16009): stderr: | 20221209030235283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030235283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030235284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030235284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030235286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030235286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030235287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:36.765439 run osmo-stp_10.42.42.5(pid=16009): stdout: | (launched: 2022-12-09_03:02:35.091294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:36.893279 run osmo-stp_10.42.42.5(pid=16009): stderr: | 20221209030235283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030235283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030235284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030235284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030235286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030235286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030235287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:37.046688 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16009): Process ended prematurely: osmo-stp_10.42.42.5(pid=16009) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16009)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 03:02:37.056153 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:02:37.083914 run osmo-hlr_10.42.42.2(pid=16006): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16006)] 03:02:37.133401 run osmo-hlr_10.42.42.2(pid=16006): stdout: | (launched: 2022-12-09_03:02:34.091588) 03:02:37.184582 run osmo-hlr_10.42.42.2(pid=16006): stderr: | 20221209030234289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030234289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030234290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030234290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030234290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030234290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030234302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030234311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030234311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030234311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:37.255792 run osmo-msc_10.42.42.6(pid=16012): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16012)] 03:02:37.305316 run osmo-msc_10.42.42.6(pid=16012): stdout: | (launched: 2022-12-09_03:02:36.120928) 03:02:37.356523 run osmo-msc_10.42.42.6(pid=16012): stderr: | 20221209030236441 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030236441 DLGLOBAL DEBUG validating counter group 0x7f046fb94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030236441 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030236441 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030236442 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030236442 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030236443 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030236444 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030236444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030236444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:37.407862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16005): Terminating (SIGTERM) 03:02:37.448834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16008): Terminating (SIGTERM) 03:02:37.489917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16011): Terminating (SIGTERM) 03:02:37.531623 --- ParallelTerminationStrategy: PID 16005 died... 03:02:37.551454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16005): Terminated: ok {rc=0} 03:02:37.597421 --- ParallelTerminationStrategy: PID 16008 died... 03:02:37.617029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16008): Terminated: ok {rc=0} 03:02:37.662541 --- ParallelTerminationStrategy: PID 16011 died... 03:02:37.682402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16011): Terminated: ok {rc=0} 03:02:37.769728 bus /sierra_3: Setting Powered False 03:02:38.868548 bus /sierra_3: Setting Powered False 03:02:39.983213 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:02:41.221343 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:02:41.227770 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:02:41.257804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:02:41.284729 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:02:41.335027 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:02:41.364171 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:02:41.390563 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:02:41.949967 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:02:41.998660 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:42.010075 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:02:42.077258 tst mo_mt_call.py: using LAC 18617 03:02:42.200739 tst mo_mt_call.py: using RAC 2 03:02:42.319236 tst mo_mt_call.py: using CellId 18617 03:02:42.435952 tst mo_mt_call.py: using BVCI 18618 03:02:42.544485 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:42.555865 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:42.566915 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:42.578352 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:42.590353 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:42.601947 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:02:42.721381 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:02:42.837967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:43.303634 run create_hlr_db(pid=16017): Launched 03:02:43.417147 bus /sierra_2: Setting Powered False 03:02:44.477844 run create_hlr_db(pid=16017): Terminated: ok {rc=0} 03:02:44.916495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16019): Launched 03:02:45.237390 run osmo-hlr_10.42.42.2(pid=16020): Launched 03:02:45.361561 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:45.932886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16022): Launched 03:02:46.259080 run osmo-stp_10.42.42.5(pid=16023): Launched 03:02:46.543353 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:47.233965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16025): Launched 03:02:47.538598 run osmo-msc_10.42.42.6(pid=16026): Launched 03:02:47.708335 run osmo-stp_10.42.42.5(pid=16023): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16023)] 03:02:47.836497 run osmo-stp_10.42.42.5(pid=16023): stdout: | (launched: 2022-12-09_03:02:46.197938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:47.965116 run osmo-stp_10.42.42.5(pid=16023): stderr: | 20221209030246562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030246562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030246562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030246563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030246564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030246564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030246564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:48.090220 run osmo-stp_10.42.42.5(pid=16023): stdout: | (launched: 2022-12-09_03:02:46.197938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:48.211025 run osmo-stp_10.42.42.5(pid=16023): stderr: | 20221209030246562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030246562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030246562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030246563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030246564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030246564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030246564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:48.354445 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16023): Process ended prematurely: osmo-stp_10.42.42.5(pid=16023) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16023)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:02:48.363565 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:02:48.390141 run osmo-hlr_10.42.42.2(pid=16020): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16020)] 03:02:48.438415 run osmo-hlr_10.42.42.2(pid=16020): stdout: | (launched: 2022-12-09_03:02:45.179199) 03:02:48.487763 run osmo-hlr_10.42.42.2(pid=16020): stderr: | 20221209030245379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030245379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030245379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030245379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030245379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030245379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030245392 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030245402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030245402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030245403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:48.556138 run osmo-msc_10.42.42.6(pid=16026): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16026)] 03:02:48.603563 run osmo-msc_10.42.42.6(pid=16026): stdout: | (launched: 2022-12-09_03:02:47.483432) 03:02:48.652362 run osmo-msc_10.42.42.6(pid=16026): stderr: | 20221209030247753 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030247753 DLGLOBAL DEBUG validating counter group 0x7f0ecb694c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030247754 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030247754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030247754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030247754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030247757 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030247758 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030247758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030247758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:48.701767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16019): Terminating (SIGTERM) 03:02:48.741545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16022): Terminating (SIGTERM) 03:02:48.781163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16025): Terminating (SIGTERM) 03:02:48.821046 --- ParallelTerminationStrategy: PID 16019 died... 03:02:48.840001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16019): Terminated: ok {rc=0} 03:02:48.884202 --- ParallelTerminationStrategy: PID 16022 died... 03:02:48.902667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16022): Terminated: ok {rc=0} 03:02:48.946138 --- ParallelTerminationStrategy: PID 16025 died... 03:02:48.964483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16025): Terminated: ok {rc=0} 03:02:49.050294 bus /sierra_3: Setting Powered False 03:02:50.147869 bus /sierra_3: Setting Powered False 03:02:51.262691 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:02:52.407906 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:52.419845 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:02:52.489275 tst mo_mt_call_osmux.py: using LAC 18618 03:02:52.607198 tst mo_mt_call_osmux.py: using RAC 3 03:02:52.723216 tst mo_mt_call_osmux.py: using CellId 18618 03:02:52.840122 tst mo_mt_call_osmux.py: using BVCI 18619 03:02:52.960099 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:52.972348 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:52.984171 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:52.996457 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:53.008768 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:53.020808 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:02:53.136051 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:02:53.251627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:53.717040 run create_hlr_db(pid=16028): Launched 03:02:53.831419 bus /sierra_2: Setting Powered False 03:02:54.892353 run create_hlr_db(pid=16028): Terminated: ok {rc=0} 03:02:55.330789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16030): Launched 03:02:55.652862 run osmo-hlr_10.42.42.2(pid=16031): Launched 03:02:55.775758 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:56.329832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16033): Launched 03:02:56.652101 run osmo-stp_10.42.42.5(pid=16034): Launched 03:02:56.775303 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:57.355901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16036): Launched 03:02:57.678797 run osmo-msc_10.42.42.6(pid=16037): Launched 03:02:57.857787 run osmo-stp_10.42.42.5(pid=16034): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16034)] 03:02:57.992360 run osmo-stp_10.42.42.5(pid=16034): stdout: | (launched: 2022-12-09_03:02:56.593717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:58.127590 run osmo-stp_10.42.42.5(pid=16034): stderr: | 20221209030256789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030256789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030256789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030256790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030256790 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030256790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030256790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:58.262690 run osmo-stp_10.42.42.5(pid=16034): stdout: | (launched: 2022-12-09_03:02:56.593717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:58.391276 run osmo-stp_10.42.42.5(pid=16034): stderr: | 20221209030256789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030256789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030256789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030256790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030256790 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030256790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030256790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:58.544561 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16034): Process ended prematurely: osmo-stp_10.42.42.5(pid=16034) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16034)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:02:58.554348 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:02:58.582635 run osmo-hlr_10.42.42.2(pid=16031): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16031)] 03:02:58.632695 run osmo-hlr_10.42.42.2(pid=16031): stdout: | (launched: 2022-12-09_03:02:55.594396) 03:02:58.684347 run osmo-hlr_10.42.42.2(pid=16031): stderr: | 20221209030255796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030255796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030255796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030255796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030255796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030255796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030255809 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030255817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030255817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030255817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:58.756135 run osmo-msc_10.42.42.6(pid=16037): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16037)] 03:02:58.806284 run osmo-msc_10.42.42.6(pid=16037): stdout: | (launched: 2022-12-09_03:02:57.618780) 03:02:58.857635 run osmo-msc_10.42.42.6(pid=16037): stderr: | 20221209030257940 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030257940 DLGLOBAL DEBUG validating counter group 0x7f029c4cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030257940 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030257940 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030257940 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030257941 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030257942 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030257943 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030257943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030257943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:58.909666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16030): Terminating (SIGTERM) 03:02:58.951173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16033): Terminating (SIGTERM) 03:02:58.992572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16036): Terminating (SIGTERM) 03:02:59.034616 --- ParallelTerminationStrategy: PID 16030 died... 03:02:59.054275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16030): Terminated: ok {rc=0} 03:02:59.100336 --- ParallelTerminationStrategy: PID 16033 died... 03:02:59.119948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16033): Terminated: ok {rc=0} 03:02:59.165382 --- ParallelTerminationStrategy: PID 16036 died... 03:02:59.184532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16036): Terminated: ok {rc=0} 03:02:59.271248 bus /sierra_3: Setting Powered False 03:03:00.369302 bus /sierra_3: Setting Powered False 03:03:01.495569 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:03:02.747053 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:03:02.753715 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:03:02.783390 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:03:02.810036 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:03:02.859639 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:03:02.888615 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:03:02.914967 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:03:03.469899 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:03:03.518324 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:03:03.529723 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:03:03.592518 tst mo_mt_call.py: using LAC 18619 03:03:03.708616 tst mo_mt_call.py: using RAC 4 03:03:03.829178 tst mo_mt_call.py: using CellId 18619 03:03:03.947771 tst mo_mt_call.py: using BVCI 18620 03:03:04.066970 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:03:04.079177 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:03:04.091031 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:03:04.102897 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:03:04.114979 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:03:04.126861 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:03:04.243933 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:03:04.359595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:04.825092 run create_hlr_db(pid=16045): Launched 03:03:04.940734 bus /sierra_2: Setting Powered False 03:03:05.999708 run create_hlr_db(pid=16045): Terminated: ok {rc=0} 03:03:06.418459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16047): Launched 03:03:06.718087 run osmo-hlr_10.42.42.2(pid=16048): Launched 03:03:06.833079 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:07.364166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16050): Launched 03:03:07.662730 run osmo-stp_10.42.42.5(pid=16051): Launched 03:03:07.776901 run osmo-msc_10.42.42.6: Starting osmo-msc 03:03:08.319360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16053): Launched 03:03:08.618290 run osmo-msc_10.42.42.6(pid=16054): Launched 03:03:08.786690 run osmo-stp_10.42.42.5(pid=16051): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16051)] 03:03:08.914116 run osmo-stp_10.42.42.5(pid=16051): stdout: | (launched: 2022-12-09_03:03:07.607381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:09.041547 run osmo-stp_10.42.42.5(pid=16051): stderr: | 20221209030307777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030307778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030307778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030307778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030307779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030307779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030307779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:09.166263 run osmo-stp_10.42.42.5(pid=16051): stdout: | (launched: 2022-12-09_03:03:07.607381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:09.285818 run osmo-stp_10.42.42.5(pid=16051): stderr: | 20221209030307777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030307778 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030307778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030307778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030307779 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030307779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030307779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:09.428763 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16051): Process ended prematurely: osmo-stp_10.42.42.5(pid=16051) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16051)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:03:09.438042 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:03:09.464774 run osmo-hlr_10.42.42.2(pid=16048): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16048)] 03:03:09.512110 run osmo-hlr_10.42.42.2(pid=16048): stdout: | (launched: 2022-12-09_03:03:06.663320) 03:03:09.561127 run osmo-hlr_10.42.42.2(pid=16048): stderr: | 20221209030306840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030306840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030306840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030306840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030306840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030306840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030306852 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030306861 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030306861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030306861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:09.629500 run osmo-msc_10.42.42.6(pid=16054): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16054)] 03:03:09.676810 run osmo-msc_10.42.42.6(pid=16054): stdout: | (launched: 2022-12-09_03:03:08.563077) 03:03:09.725558 run osmo-msc_10.42.42.6(pid=16054): stderr: | 20221209030308832 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030308833 DLGLOBAL DEBUG validating counter group 0x7f1075ffcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030308833 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030308833 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030308833 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030308833 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030308835 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030308835 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030308835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030308835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:03:09.774849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16047): Terminating (SIGTERM) 03:03:09.814136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16050): Terminating (SIGTERM) 03:03:09.853280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16053): Terminating (SIGTERM) 03:03:09.893323 --- ParallelTerminationStrategy: PID 16047 died... 03:03:09.912196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16047): Terminated: ok {rc=0} 03:03:09.956085 --- ParallelTerminationStrategy: PID 16050 died... 03:03:09.974479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16050): Terminated: ok {rc=0} 03:03:10.018643 --- ParallelTerminationStrategy: PID 16053 died... 03:03:10.037186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16053): Terminated: ok {rc=0} 03:03:10.119465 bus /sierra_3: Setting Powered False 03:03:11.215992 bus /sierra_3: Setting Powered False 03:03:12.332214 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:03:13.482047 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:03:13.494544 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:03:13.564726 tst mo_mt_call_osmux.py: using LAC 18620 03:03:13.691199 tst mo_mt_call_osmux.py: using RAC 5 03:03:13.817816 tst mo_mt_call_osmux.py: using CellId 18620 03:03:13.942515 tst mo_mt_call_osmux.py: using BVCI 18621 03:03:14.059390 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:03:14.071435 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:03:14.083414 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:03:14.095174 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:03:14.107115 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:03:14.119183 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:03:14.234595 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:03:14.350854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:14.816905 run create_hlr_db(pid=16056): Launched 03:03:14.931844 bus /sierra_2: Setting Powered False 03:03:15.991306 run create_hlr_db(pid=16056): Terminated: ok {rc=0} 03:03:16.423235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16058): Launched 03:03:16.756436 run osmo-hlr_10.42.42.2(pid=16059): Launched 03:03:16.926035 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:17.633882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16061): Launched 03:03:17.956093 run osmo-stp_10.42.42.5(pid=16062): Launched 03:03:18.079669 run osmo-msc_10.42.42.6: Starting osmo-msc 03:03:18.662125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16064): Launched 03:03:18.983758 run osmo-msc_10.42.42.6(pid=16065): Launched 03:03:19.164071 run osmo-stp_10.42.42.5(pid=16062): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16062)] 03:03:19.299523 run osmo-stp_10.42.42.5(pid=16062): stdout: | (launched: 2022-12-09_03:03:17.897442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:19.436682 run osmo-stp_10.42.42.5(pid=16062): stderr: | 20221209030318090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030318090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030318090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030318090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030318091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030318091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030318091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:19.572234 run osmo-stp_10.42.42.5(pid=16062): stdout: | (launched: 2022-12-09_03:03:17.897442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:19.700520 run osmo-stp_10.42.42.5(pid=16062): stderr: | 20221209030318090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030318090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030318090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030318090 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030318091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030318091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030318091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:19.853987 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16062): Process ended prematurely: osmo-stp_10.42.42.5(pid=16062) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16062)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:03:19.863564 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:03:19.892186 run osmo-hlr_10.42.42.2(pid=16059): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16059)] 03:03:19.942465 run osmo-hlr_10.42.42.2(pid=16059): stdout: | (launched: 2022-12-09_03:03:16.698191) 03:03:19.994031 run osmo-hlr_10.42.42.2(pid=16059): stderr: | 20221209030317016 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030317016 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030317016 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030317016 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030317016 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030317017 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030317034 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030317046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030317046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030317046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:20.066385 run osmo-msc_10.42.42.6(pid=16065): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16065)] 03:03:20.116687 run osmo-msc_10.42.42.6(pid=16065): stdout: | (launched: 2022-12-09_03:03:18.924798) 03:03:20.168274 run osmo-msc_10.42.42.6(pid=16065): stderr: | 20221209030319245 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030319245 DLGLOBAL DEBUG validating counter group 0x7fa74c9b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030319245 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030319245 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030319245 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030319245 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030319247 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030319247 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030319248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030319248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:03:20.220358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16058): Terminating (SIGTERM) 03:03:20.261990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16061): Terminating (SIGTERM) 03:03:20.303455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16064): Terminating (SIGTERM) 03:03:20.346042 --- ParallelTerminationStrategy: PID 16058 died... 03:03:20.366094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16058): Terminated: ok {rc=0} 03:03:20.413541 --- ParallelTerminationStrategy: PID 16061 died... 03:03:20.433247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16061): Terminated: ok {rc=0} 03:03:20.480070 --- ParallelTerminationStrategy: PID 16064 died... 03:03:20.499634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16064): Terminated: ok {rc=0} 03:03:20.587286 bus /sierra_3: Setting Powered False 03:03:21.685046 bus /sierra_3: Setting Powered False 03:03:22.801795 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:03:24.056205 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:03:24.062178 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:03:24.091816 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 03:03:24.118367 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 03:03:24.169722 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:03:24.199357 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 03:03:24.225918 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 03:03:24.775028 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 03:03:24.823778 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:24.834906 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:03:24.900287 tst mo_mt_call.py: using LAC 18621 03:03:25.018583 tst mo_mt_call.py: using RAC 6 03:03:25.137406 tst mo_mt_call.py: using CellId 18621 03:03:25.265692 tst mo_mt_call.py: using BVCI 18622 03:03:25.383374 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:25.395268 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:25.406950 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:25.418532 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:25.430408 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:25.441822 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:03:25.558732 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:03:25.676218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:26.175373 run create_hlr_db(pid=16070): Launched 03:03:26.305229 bus /sierra_2: Setting Powered False 03:03:27.369259 run create_hlr_db(pid=16070): Terminated: ok {rc=0} 03:03:27.798463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16072): Launched 03:03:28.097980 run osmo-hlr_10.42.42.2(pid=16073): Launched 03:03:28.212940 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:28.747291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16075): Launched 03:03:29.046364 run osmo-stp_10.42.42.5(pid=16076): Launched 03:03:29.161008 run osmo-msc_10.42.42.6: Starting osmo-msc 03:03:29.704782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16078): Launched 03:03:30.005539 run osmo-msc_10.42.42.6(pid=16079): Launched 03:03:30.175167 run osmo-stp_10.42.42.5(pid=16076): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16076)] 03:03:30.303088 run osmo-stp_10.42.42.5(pid=16076): stdout: | (launched: 2022-12-09_03:03:28.991443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:30.431424 run osmo-stp_10.42.42.5(pid=16076): stderr: | 20221209030329162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030329162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030329163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030329163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030329164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030329164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030329164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:30.557380 run osmo-stp_10.42.42.5(pid=16076): stdout: | (launched: 2022-12-09_03:03:28.991443) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:30.677207 run osmo-stp_10.42.42.5(pid=16076): stderr: | 20221209030329162 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030329162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030329163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030329163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030329164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030329164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030329164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:30.820815 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16076): Process ended prematurely: osmo-stp_10.42.42.5(pid=16076) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16076)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 03:03:30.838730 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:03:30.867325 run osmo-hlr_10.42.42.2(pid=16073): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16073)] 03:03:30.916934 run osmo-hlr_10.42.42.2(pid=16073): stdout: | (launched: 2022-12-09_03:03:28.042963) 03:03:30.967834 run osmo-hlr_10.42.42.2(pid=16073): stderr: | 20221209030328217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030328217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030328217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030328217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030328217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030328217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030328230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030328238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030328238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030328238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:31.038692 run osmo-msc_10.42.42.6(pid=16079): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16079)] 03:03:31.088853 run osmo-msc_10.42.42.6(pid=16079): stdout: | (launched: 2022-12-09_03:03:29.950338) 03:03:31.140210 run osmo-msc_10.42.42.6(pid=16079): stderr: | 20221209030330221 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030330222 DLGLOBAL DEBUG validating counter group 0x7fbc63968c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030330222 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030330222 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030330222 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030330222 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030330224 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030330224 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030330224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030330225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:03:31.192379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16072): Terminating (SIGTERM) 03:03:31.234383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16075): Terminating (SIGTERM) 03:03:31.276752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16078): Terminating (SIGTERM) 03:03:31.319414 --- ParallelTerminationStrategy: PID 16072 died... 03:03:31.340201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16072): Terminated: ok {rc=0} 03:03:31.387525 --- ParallelTerminationStrategy: PID 16075 died... 03:03:31.407137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16075): Terminated: ok {rc=0} 03:03:31.454299 --- ParallelTerminationStrategy: PID 16078 died... 03:03:31.473974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16078): Terminated: ok {rc=0} 03:03:31.561944 bus /sierra_3: Setting Powered False 03:03:32.659940 bus /sierra_3: Setting Powered False 03:03:33.774278 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 03:03:34.921807 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:34.934098 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:03:35.002880 tst mo_mt_call_osmux.py: using LAC 18622 03:03:35.131543 tst mo_mt_call_osmux.py: using RAC 7 03:03:35.261632 tst mo_mt_call_osmux.py: using CellId 18622 03:03:35.388059 tst mo_mt_call_osmux.py: using BVCI 18623 03:03:35.505484 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:35.517432 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:35.528698 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:35.540128 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:35.551622 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:35.563084 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:03:35.678305 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:03:35.793494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:36.261215 run create_hlr_db(pid=16081): Launched 03:03:36.376857 bus /sierra_2: Setting Powered False 03:03:37.437122 run create_hlr_db(pid=16081): Terminated: ok {rc=0} 03:03:37.877736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16083): Launched 03:03:38.200513 run osmo-hlr_10.42.42.2(pid=16084): Launched 03:03:38.324528 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:38.882713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16086): Launched 03:03:39.203506 run osmo-stp_10.42.42.5(pid=16087): Launched 03:03:39.326471 run osmo-msc_10.42.42.6: Starting osmo-msc 03:03:39.909236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16089): Launched 03:03:40.231312 run osmo-msc_10.42.42.6(pid=16090): Launched 03:03:40.412080 run osmo-stp_10.42.42.5(pid=16087): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16087)] 03:03:40.548117 run osmo-stp_10.42.42.5(pid=16087): stdout: | (launched: 2022-12-09_03:03:39.144933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:40.684459 run osmo-stp_10.42.42.5(pid=16087): stderr: | 20221209030339336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030339336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030339336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030339337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030339337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030339337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030339337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:40.819525 run osmo-stp_10.42.42.5(pid=16087): stdout: | (launched: 2022-12-09_03:03:39.144933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:40.948226 run osmo-stp_10.42.42.5(pid=16087): stderr: | 20221209030339336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030339336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030339336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030339337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030339337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030339337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030339337 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:41.102105 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16087): Process ended prematurely: osmo-stp_10.42.42.5(pid=16087) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16087)] [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 03:03:41.111590 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:03:41.139322 run osmo-hlr_10.42.42.2(pid=16084): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16084)] 03:03:41.188537 run osmo-hlr_10.42.42.2(pid=16084): stdout: | (launched: 2022-12-09_03:03:38.141910) 03:03:41.239632 run osmo-hlr_10.42.42.2(pid=16084): stderr: | 20221209030338341 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030338341 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030338341 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030338341 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030338341 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030338341 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030338353 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030338361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030338362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030338362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:41.310898 run osmo-msc_10.42.42.6(pid=16090): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16090)] 03:03:41.360178 run osmo-msc_10.42.42.6(pid=16090): stdout: | (launched: 2022-12-09_03:03:40.172236) 03:03:41.411387 run osmo-msc_10.42.42.6(pid=16090): stderr: | 20221209030340495 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030340495 DLGLOBAL DEBUG validating counter group 0x7f18c446cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030340495 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030340495 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030340495 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030340495 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030340499 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030340499 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030340499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030340500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:03:41.462528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16083): Terminating (SIGTERM) 03:03:41.503724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16086): Terminating (SIGTERM) 03:03:41.545085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16089): Terminating (SIGTERM) 03:03:41.587034 --- ParallelTerminationStrategy: PID 16083 died... 03:03:41.607102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16083): Terminated: ok {rc=0} 03:03:41.653146 --- ParallelTerminationStrategy: PID 16086 died... 03:03:41.672690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16086): Terminated: ok {rc=0} 03:03:41.718194 --- ParallelTerminationStrategy: PID 16089 died... 03:03:41.737765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16089): Terminated: ok {rc=0} 03:03:41.824672 bus /sierra_3: Setting Powered False 03:03:42.923199 bus /sierra_3: Setting Powered False 03:03:44.041686 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 03:03:45.281899 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:03:45.286146 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:03:45.315305 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:03:45.342665 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 03:03:45.427364 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:03:45.456150 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:03:45.482401 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 03:03:46.068531 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2353 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 03:03:46.075077 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:46.086988 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:03:46.137846 tst emergency_mo_mt_call.py: using LAC 18623 03:03:46.305160 tst emergency_mo_mt_call.py: using RAC 8 03:03:46.423314 tst emergency_mo_mt_call.py: using CellId 18623 03:03:46.572189 tst emergency_mo_mt_call.py: using BVCI 18624 03:03:46.687257 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:46.699576 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:46.711639 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:46.724452 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:46.737547 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:46.750684 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:46.872020 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:46.990590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:47.501793 run create_hlr_db(pid=16096): Launched 03:03:47.615419 bus /sierra_2: Setting Powered False 03:03:48.674595 run create_hlr_db(pid=16096): Terminated: ok {rc=0} 03:03:49.086487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16098): Launched 03:03:49.381287 run osmo-hlr_10.42.42.2(pid=16099): Launched 03:03:49.492902 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:50.015733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16101): Launched 03:03:50.310810 run osmo-stp_10.42.42.5(pid=16102): Launched 03:03:50.433447 tst emergency_mo_mt_call.py: using MSISDN 6989 03:03:50.596333 run osmo-msc_10.42.42.6: Starting osmo-msc 03:03:51.129792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16104): Launched 03:03:51.423405 run osmo-msc_10.42.42.6(pid=16105): Launched 03:03:51.588768 run osmo-stp_10.42.42.5(pid=16102): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16102)] 03:03:51.714438 run osmo-stp_10.42.42.5(pid=16102): stdout: | (launched: 2022-12-09_03:03:50.256835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:51.840073 run osmo-stp_10.42.42.5(pid=16102): stderr: | 20221209030350427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030350427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030350428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030350428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030350429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030350429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030350429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:51.963047 run osmo-stp_10.42.42.5(pid=16102): stdout: | (launched: 2022-12-09_03:03:50.256835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:52.080405 run osmo-stp_10.42.42.5(pid=16102): stderr: | 20221209030350427 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030350427 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030350428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030350428 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030350429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030350429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030350429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:52.220662 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=16102): Process ended prematurely: osmo-stp_10.42.42.5(pid=16102) [trial-2353↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16102)] [trial-2353↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 03:03:52.228900 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 03:03:52.254868 run osmo-hlr_10.42.42.2(pid=16099): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16099)] 03:03:52.302793 run osmo-hlr_10.42.42.2(pid=16099): stdout: | (launched: 2022-12-09_03:03:49.327015) 03:03:52.351814 run osmo-hlr_10.42.42.2(pid=16099): stderr: | 20221209030349502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030349502 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030349502 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030349502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030349502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030349502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030349514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030349523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030349523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030349523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:52.420045 run osmo-msc_10.42.42.6(pid=16105): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16105)] 03:03:52.467332 run osmo-msc_10.42.42.6(pid=16105): stdout: | (launched: 2022-12-09_03:03:51.369177) 03:03:52.516094 run osmo-msc_10.42.42.6(pid=16105): stderr: | 20221209030351639 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030351639 DLGLOBAL DEBUG validating counter group 0x7f39c5129c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030351639 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030351639 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030351639 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030351639 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030351641 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030351642 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030351642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030351642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:03:52.565403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16098): Terminating (SIGTERM) 03:03:52.604670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16101): Terminating (SIGTERM) 03:03:52.644174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16104): Terminating (SIGTERM) 03:03:52.683882 --- ParallelTerminationStrategy: PID 16098 died... 03:03:52.702824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16098): Terminated: ok {rc=0} 03:03:52.747056 --- ParallelTerminationStrategy: PID 16101 died... 03:03:52.765561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16101): Terminated: ok {rc=0} 03:03:52.809267 --- ParallelTerminationStrategy: PID 16104 died... 03:03:52.827777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16104): Terminated: ok {rc=0} 03:03:52.912536 bus /sierra_3: Setting Powered False 03:03:54.011192 bus /sierra_3: Setting Powered False 03:03:55.123108 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 03:03:56.210433 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:56.222292 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:03:56.268895 tst emergency_preemptive_call.py: using LAC 18624 03:03:56.395187 tst emergency_preemptive_call.py: using RAC 9 03:03:56.519674 tst emergency_preemptive_call.py: using CellId 18624 03:03:56.643569 tst emergency_preemptive_call.py: using BVCI 18625 03:03:56.760461 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:56.771950 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:56.783508 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:56.794600 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:56.805905 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:56.816900 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:56.930760 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:57.049594 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:57.167924 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:57.281481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:57.776582 run create_hlr_db(pid=16107): Launched 03:03:57.905349 bus /sierra_2: Setting Powered False 03:03:58.968453 run create_hlr_db(pid=16107): Terminated: ok {rc=0} 03:03:59.390097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16109): Launched 03:03:59.683798 run osmo-hlr_10.42.42.2(pid=16110): Launched 03:03:59.795328 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:00.302395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16112): Launched 03:04:00.595686 run osmo-stp_10.42.42.5(pid=16113): Launched 03:04:00.717489 tst emergency_preemptive_call.py: using MSISDN 6990 03:04:00.906028 run osmo-msc_10.42.42.6: Starting osmo-msc 03:04:01.494448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16115): Launched 03:04:01.829834 run osmo-msc_10.42.42.6(pid=16116): Launched 03:04:02.188216 run osmo-stp_10.42.42.5(pid=16113): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16113)] 03:04:02.366676 run osmo-stp_10.42.42.5(pid=16113): stdout: | (launched: 2022-12-09_03:04:00.541357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:02.499587 run osmo-stp_10.42.42.5(pid=16113): stderr: | 20221209030400713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030400713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030400713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030400714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030400717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030400717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030400717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:02.631982 run osmo-stp_10.42.42.5(pid=16113): stdout: | (launched: 2022-12-09_03:04:00.541357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:02.758682 run osmo-stp_10.42.42.5(pid=16113): stderr: | 20221209030400713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030400713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030400713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030400714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030400717 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030400717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030400717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:02.909468 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=16113): Process ended prematurely: osmo-stp_10.42.42.5(pid=16113) [trial-2353↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16113)] [trial-2353↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 03:04:02.918474 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 03:04:02.946018 run osmo-hlr_10.42.42.2(pid=16110): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16110)] 03:04:02.995959 run osmo-hlr_10.42.42.2(pid=16110): stdout: | (launched: 2022-12-09_03:03:59.629881) 03:04:03.047400 run osmo-hlr_10.42.42.2(pid=16110): stderr: | 20221209030359803 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030359803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030359803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030359803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030359803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030359803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030359816 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030359826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030359826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030359826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:03.119269 run osmo-msc_10.42.42.6(pid=16116): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16116)] 03:04:03.168812 run osmo-msc_10.42.42.6(pid=16116): stdout: | (launched: 2022-12-09_03:04:01.766611) 03:04:03.219903 run osmo-msc_10.42.42.6(pid=16116): stderr: | 20221209030402263 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030402264 DLGLOBAL DEBUG validating counter group 0x7fbb0bc91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030402264 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030402264 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030402264 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030402264 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030402271 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030402271 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030402272 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030402272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:04:03.271408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16109): Terminating (SIGTERM) 03:04:03.312817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16112): Terminating (SIGTERM) 03:04:03.354473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16115): Terminating (SIGTERM) 03:04:03.396696 --- ParallelTerminationStrategy: PID 16109 died... 03:04:03.416845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16109): Terminated: ok {rc=0} 03:04:03.462867 --- ParallelTerminationStrategy: PID 16112 died... 03:04:03.482410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16112): Terminated: ok {rc=0} 03:04:03.527981 --- ParallelTerminationStrategy: PID 16115 died... 03:04:03.547518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16115): Terminated: ok {rc=0} 03:04:03.633864 bus /sierra_9: Setting Powered False 03:04:04.731380 bus /sierra_9: Setting Powered False 03:04:05.846786 bus /sierra_8: Setting Powered False 03:04:06.944249 bus /sierra_8: Setting Powered False 03:04:08.056898 bus /sierra_3: Setting Powered False 03:04:09.155299 bus /sierra_3: Setting Powered False 03:04:10.270642 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 03:04:11.547575 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:04:11.552850 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:04:11.583124 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 03:04:11.621504 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 03:04:11.707040 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:04:11.736237 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 03:04:11.774626 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 03:04:12.372891 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 03:04:12.427728 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:12.439092 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:04:12.489471 tst cs_paging_gprs_active.py: using LAC 18625 03:04:12.617458 tst cs_paging_gprs_active.py: using RAC 10 03:04:12.743536 tst cs_paging_gprs_active.py: using CellId 18625 03:04:12.869830 tst cs_paging_gprs_active.py: using BVCI 18626 03:04:12.980303 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:12.991272 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:13.002121 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:13.013132 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:13.023947 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:13.034867 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:13.045753 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:13.056436 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:13.067301 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:13.180455 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:13.298761 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:04:13.518740 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:13.844126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16121): Launched 03:04:14.125422 run iperf3-srv_10.42.42.10(pid=16122): Launched 03:04:14.246804 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:04:14.465582 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:14.790114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16123): Launched 03:04:15.071964 run iperf3-srv_10.42.42.10(pid=16124): Launched 03:04:15.193239 tst cs_paging_gprs_active.py:38: start network... 03:04:15.411922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:15.925652 run create_hlr_db(pid=16125): Launched 03:04:16.107834 bus /sierra_2: Setting Powered False 03:04:17.170839 run create_hlr_db(pid=16125): Terminated: ok {rc=0} 03:04:17.620931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16127): Launched 03:04:17.942058 run osmo-hlr_10.42.42.2(pid=16128): Launched 03:04:18.064261 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:18.618370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16130): Launched 03:04:18.940534 run osmo-stp_10.42.42.5(pid=16131): Launched 03:04:19.062857 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:19.618415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16133): Launched 03:04:19.741511 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:20.013814 run patchelf(pid=16134): Launched 03:04:20.192417 run osmo-stp_10.42.42.5(pid=16131): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16131)] 03:04:20.328403 run osmo-stp_10.42.42.5(pid=16131): stdout: | (launched: 2022-12-09_03:04:18.881826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:20.466242 run osmo-stp_10.42.42.5(pid=16131): stderr: | 20221209030419074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030419074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030419075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030419075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030419076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030419076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030419076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:20.603628 run osmo-stp_10.42.42.5(pid=16131): stdout: | (launched: 2022-12-09_03:04:18.881826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:20.735653 run osmo-stp_10.42.42.5(pid=16131): stderr: | 20221209030419074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030419074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030419075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030419075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030419076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030419076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030419076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:20.892702 run patchelf(pid=16134): Terminating (SIGINT) 03:04:21.072559 run patchelf(pid=16134): Terminated: ok {rc=0} 03:04:21.202535 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16131): Process ended prematurely: osmo-stp_10.42.42.5(pid=16131) [trial-2353↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16131)] [trial-2353↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 03:04:21.212523 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 03:04:21.240637 run osmo-hlr_10.42.42.2(pid=16128): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16128)] 03:04:21.289571 run osmo-hlr_10.42.42.2(pid=16128): stdout: | (launched: 2022-12-09_03:04:17.883259) 03:04:21.340581 run osmo-hlr_10.42.42.2(pid=16128): stderr: | 20221209030418081 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030418081 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030418081 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030418081 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030418081 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030418081 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030418093 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030418101 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030418101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030418101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:21.391841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16121): Terminating (SIGTERM) 03:04:21.433338 run iperf3-srv_10.42.42.10(pid=16122): Terminating (SIGTERM) 03:04:21.474402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16123): Terminating (SIGTERM) 03:04:21.515418 run iperf3-srv_10.42.42.10(pid=16124): Terminating (SIGTERM) 03:04:21.556235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16127): Terminating (SIGTERM) 03:04:21.597295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16130): Terminating (SIGTERM) 03:04:21.638258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16133): Terminating (SIGTERM) 03:04:21.679588 --- ParallelTerminationStrategy: PID 16121 died... 03:04:21.699459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16121): Terminated: ok {rc=0} 03:04:21.745038 --- ParallelTerminationStrategy: PID 16122 died... 03:04:21.764036 run iperf3-srv_10.42.42.10(pid=16122): Terminated {rc=256} 03:04:21.809645 --- ParallelTerminationStrategy: PID 16123 died... 03:04:21.829041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16123): Terminated: ok {rc=0} 03:04:21.874295 --- ParallelTerminationStrategy: PID 16124 died... 03:04:21.893902 run iperf3-srv_10.42.42.10(pid=16124): Terminated {rc=256} 03:04:21.939261 --- ParallelTerminationStrategy: PID 16127 died... 03:04:21.958612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16127): Terminated: ok {rc=0} 03:04:22.003990 --- ParallelTerminationStrategy: PID 16130 died... 03:04:22.023370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16130): Terminated: ok {rc=0} 03:04:22.069065 --- ParallelTerminationStrategy: PID 16133 died... 03:04:22.088492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16133): Terminated: ok {rc=0} 03:04:22.174840 bus /gobi_0: Setting Powered False 03:04:23.273762 bus /gobi_0: Setting Powered False 03:04:24.387679 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 03:04:25.530052 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:25.541369 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:04:25.595053 tst iperf3.py: using LAC 18626 03:04:25.721427 tst iperf3.py: using RAC 11 03:04:25.850591 tst iperf3.py: using CellId 18626 03:04:25.978808 tst iperf3.py: using BVCI 18627 03:04:26.097959 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.109335 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.120406 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.131565 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.142835 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.153879 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.165101 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.176112 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:26.187277 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:26.307962 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:04:26.525507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:26.848686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16135): Launched 03:04:27.129110 run iperf3-srv_10.42.42.10(pid=16136): Launched 03:04:27.249039 tst iperf3.py:8: start network... 03:04:27.466085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:27.965255 run create_hlr_db(pid=16137): Launched 03:04:28.095361 bus /gobi_6: Setting Powered False 03:04:29.158511 run create_hlr_db(pid=16137): Terminated: ok {rc=0} 03:04:29.586293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16139): Launched 03:04:29.886141 run osmo-hlr_10.42.42.2(pid=16140): Launched 03:04:30.000754 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:30.534564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16142): Launched 03:04:30.847440 run osmo-stp_10.42.42.5(pid=16143): Launched 03:04:31.079042 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:31.715840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16145): Launched 03:04:31.851544 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:32.135579 run patchelf(pid=16146): Launched 03:04:32.329446 run osmo-stp_10.42.42.5(pid=16143): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16143)] 03:04:32.465847 run osmo-stp_10.42.42.5(pid=16143): stdout: | (launched: 2022-12-09_03:04:30.779105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:32.603892 run osmo-stp_10.42.42.5(pid=16143): stderr: | 20221209030431008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030431008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030431008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030431009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030431009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030431009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030431009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:32.741820 run osmo-stp_10.42.42.5(pid=16143): stdout: | (launched: 2022-12-09_03:04:30.779105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:32.873793 run osmo-stp_10.42.42.5(pid=16143): stderr: | 20221209030431008 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030431008 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030431008 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030431009 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030431009 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030431009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030431009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:33.031023 run patchelf(pid=16146): Terminating (SIGINT) 03:04:33.211303 run patchelf(pid=16146): Terminated: ok {rc=0} 03:04:33.341104 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16143): Process ended prematurely: osmo-stp_10.42.42.5(pid=16143) [trial-2353↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16143)] [trial-2353↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 03:04:33.351149 tst iperf3.py:8: Test FAILED (7.9 sec) 03:04:33.379348 run osmo-hlr_10.42.42.2(pid=16140): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16140)] 03:04:33.429480 run osmo-hlr_10.42.42.2(pid=16140): stdout: | (launched: 2022-12-09_03:04:29.831407) 03:04:33.480699 run osmo-hlr_10.42.42.2(pid=16140): stderr: | 20221209030430004 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030430004 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030430004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030430004 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030430004 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030430004 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030430016 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030430026 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030430026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030430027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:33.532239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16135): Terminating (SIGTERM) 03:04:33.573784 run iperf3-srv_10.42.42.10(pid=16136): Terminating (SIGTERM) 03:04:33.615273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16139): Terminating (SIGTERM) 03:04:33.656610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16142): Terminating (SIGTERM) 03:04:33.697983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16145): Terminating (SIGTERM) 03:04:33.739810 --- ParallelTerminationStrategy: PID 16135 died... 03:04:33.759691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16135): Terminated: ok {rc=0} 03:04:33.805651 --- ParallelTerminationStrategy: PID 16136 died... 03:04:33.825085 run iperf3-srv_10.42.42.10(pid=16136): Terminated {rc=256} 03:04:33.870536 --- ParallelTerminationStrategy: PID 16139 died... 03:04:33.890022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16139): Terminated: ok {rc=0} 03:04:33.935552 --- ParallelTerminationStrategy: PID 16142 died... 03:04:33.954940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16142): Terminated: ok {rc=0} 03:04:34.001326 --- ParallelTerminationStrategy: PID 16145 died... 03:04:34.020663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16145): Terminated: ok {rc=0} 03:04:34.107000 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 03:04:35.249547 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:35.261214 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:04:35.306243 tst iperf3m4.py: using LAC 18627 03:04:35.425218 tst iperf3m4.py: using RAC 12 03:04:35.543649 tst iperf3m4.py: using CellId 18627 03:04:35.666467 tst iperf3m4.py: using BVCI 18628 03:04:35.778023 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:35.788794 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:35.799457 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:35.810458 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:35.821498 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:35.832298 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:35.843619 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:35.854667 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:35.865980 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:35.982030 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:36.104056 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:36.220277 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:36.344054 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:04:36.563666 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:36.888763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16147): Launched 03:04:37.169906 run iperf3-srv_10.42.42.10(pid=16148): Launched 03:04:37.290691 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:04:37.508439 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:37.832579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16149): Launched 03:04:38.111632 run iperf3-srv_10.42.42.10(pid=16150): Launched 03:04:38.231856 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:04:38.448808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:38.772807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16151): Launched 03:04:39.053732 run iperf3-srv_10.42.42.10(pid=16152): Launched 03:04:39.174136 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:04:39.391151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:39.716191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16153): Launched 03:04:39.997093 run iperf3-srv_10.42.42.10(pid=16154): Launched 03:04:40.117807 tst iperf3m4.py:8: start network... 03:04:40.335531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:40.838725 run create_hlr_db(pid=16155): Launched 03:04:40.966722 bus /gobi_6: Setting Powered False 03:04:42.027504 run create_hlr_db(pid=16155): Terminated: ok {rc=0} 03:04:42.446072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16157): Launched 03:04:42.746171 run osmo-hlr_10.42.42.2(pid=16158): Launched 03:04:42.860867 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:43.502626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16160): Launched 03:04:43.795853 run osmo-stp_10.42.42.5(pid=16161): Launched 03:04:43.908522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:44.416204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16163): Launched 03:04:44.529674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:44.779462 run patchelf(pid=16164): Launched 03:04:44.943248 run osmo-stp_10.42.42.5(pid=16161): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16161)] 03:04:45.068112 run osmo-stp_10.42.42.5(pid=16161): stdout: | (launched: 2022-12-09_03:04:43.742045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:45.194592 run osmo-stp_10.42.42.5(pid=16161): stderr: | 20221209030443909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030443910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030443910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030443910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030443911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030443911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030443911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:45.320466 run osmo-stp_10.42.42.5(pid=16161): stdout: | (launched: 2022-12-09_03:04:43.742045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:45.441453 run osmo-stp_10.42.42.5(pid=16161): stderr: | 20221209030443909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030443910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030443910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030443910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030443911 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030443911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030443911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:45.584458 run patchelf(pid=16164): Terminating (SIGINT) 03:04:45.749679 run patchelf(pid=16164): Terminated: ok {rc=0} 03:04:45.880822 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16161): Process ended prematurely: osmo-stp_10.42.42.5(pid=16161) [trial-2353↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16161)] [trial-2353↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 03:04:45.893818 tst iperf3m4.py:8: Test FAILED (10.7 sec) 03:04:45.926076 run osmo-hlr_10.42.42.2(pid=16158): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16158)] 03:04:45.978482 run osmo-hlr_10.42.42.2(pid=16158): stdout: | (launched: 2022-12-09_03:04:42.690696) 03:04:46.032767 run osmo-hlr_10.42.42.2(pid=16158): stderr: | 20221209030442863 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030442863 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030442863 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030442863 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030442863 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030442863 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030442876 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030442886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030442886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030442886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:46.088398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16147): Terminating (SIGTERM) 03:04:46.132720 run iperf3-srv_10.42.42.10(pid=16148): Terminating (SIGTERM) 03:04:46.178754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16149): Terminating (SIGTERM) 03:04:46.223243 run iperf3-srv_10.42.42.10(pid=16150): Terminating (SIGTERM) 03:04:46.269712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16151): Terminating (SIGTERM) 03:04:46.315092 run iperf3-srv_10.42.42.10(pid=16152): Terminating (SIGTERM) 03:04:46.359252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16153): Terminating (SIGTERM) 03:04:46.403668 run iperf3-srv_10.42.42.10(pid=16154): Terminating (SIGTERM) 03:04:46.448265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16157): Terminating (SIGTERM) 03:04:46.493736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16160): Terminating (SIGTERM) 03:04:46.540007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16163): Terminating (SIGTERM) 03:04:46.586417 --- ParallelTerminationStrategy: PID 16147 died... 03:04:46.607332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16147): Terminated: ok {rc=0} 03:04:46.658528 --- ParallelTerminationStrategy: PID 16148 died... 03:04:46.679709 run iperf3-srv_10.42.42.10(pid=16148): Terminated {rc=256} 03:04:46.730069 --- ParallelTerminationStrategy: PID 16149 died... 03:04:46.751785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16149): Terminated: ok {rc=0} 03:04:46.801545 --- ParallelTerminationStrategy: PID 16150 died... 03:04:46.821941 run iperf3-srv_10.42.42.10(pid=16150): Terminated {rc=256} 03:04:46.871424 --- ParallelTerminationStrategy: PID 16151 died... 03:04:46.893207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16151): Terminated: ok {rc=0} 03:04:46.942765 --- ParallelTerminationStrategy: PID 16152 died... 03:04:46.963386 run iperf3-srv_10.42.42.10(pid=16152): Terminated {rc=256} 03:04:47.012732 --- ParallelTerminationStrategy: PID 16153 died... 03:04:47.033453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16153): Terminated: ok {rc=0} 03:04:47.083114 --- ParallelTerminationStrategy: PID 16154 died... 03:04:47.104631 run iperf3-srv_10.42.42.10(pid=16154): Terminated {rc=256} 03:04:47.153366 --- ParallelTerminationStrategy: PID 16157 died... 03:04:47.173038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16157): Terminated: ok {rc=0} 03:04:47.219869 --- ParallelTerminationStrategy: PID 16160 died... 03:04:47.239404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16160): Terminated: ok {rc=0} 03:04:47.286208 --- ParallelTerminationStrategy: PID 16163 died... 03:04:47.305871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16163): Terminated: ok {rc=0} 03:04:47.394013 bus /gobi_4: Setting Powered False 03:04:48.492253 bus /gobi_4: Setting Powered False 03:04:49.607556 bus /gobi_1: Setting Powered False 03:04:50.702680 bus /gobi_1: Setting Powered False 03:04:51.816128 bus /gobi_0: Setting Powered False 03:04:52.912701 bus /gobi_0: Setting Powered False 03:04:54.029310 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 03:04:55.130399 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:55.141780 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:04:55.190242 tst ping.py: using LAC 18628 03:04:55.304021 tst ping.py: using RAC 13 03:04:55.416762 tst ping.py: using CellId 18628 03:04:55.534061 tst ping.py: using BVCI 18629 03:04:55.640136 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:55.650834 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:55.661416 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:55.672219 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:55.682974 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:55.693745 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:55.704565 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:55.715479 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:55.832359 tst ping.py:19: start network... 03:04:56.040470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:56.521021 run create_hlr_db(pid=16165): Launched 03:04:56.648106 bus /gobi_6: Setting Powered False 03:04:57.710045 run create_hlr_db(pid=16165): Terminated: ok {rc=0} 03:04:58.126021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16167): Launched 03:04:58.414878 run osmo-hlr_10.42.42.2(pid=16168): Launched 03:04:58.525372 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:59.025261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16170): Launched 03:04:59.315543 run osmo-stp_10.42.42.5(pid=16171): Launched 03:04:59.426093 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:59.925445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16173): Launched 03:05:00.035482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:00.279510 run patchelf(pid=16174): Launched 03:05:00.439972 run osmo-stp_10.42.42.5(pid=16171): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16171)] 03:05:00.563026 run osmo-stp_10.42.42.5(pid=16171): stdout: | (launched: 2022-12-09_03:04:59.262491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:00.687510 run osmo-stp_10.42.42.5(pid=16171): stderr: | 20221209030459430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030459430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030459431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030459431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030459431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030459432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030459432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:00.811739 run osmo-stp_10.42.42.5(pid=16171): stdout: | (launched: 2022-12-09_03:04:59.262491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:00.963727 run osmo-stp_10.42.42.5(pid=16171): stderr: | 20221209030459430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030459430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030459431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030459431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030459431 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030459432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030459432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:01.125561 run patchelf(pid=16174): Terminating (SIGINT) 03:05:01.292879 run patchelf(pid=16174): Terminated: ok {rc=0} 03:05:01.425148 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16171): Process ended prematurely: osmo-stp_10.42.42.5(pid=16171) [trial-2353↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16171)] [trial-2353↪gprs:trx-lms-limenet-micro↪ping.py:22] 03:05:01.434921 tst ping.py:22: Test FAILED (6.3 sec) 03:05:01.464307 run osmo-hlr_10.42.42.2(pid=16168): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16168)] 03:05:01.514149 run osmo-hlr_10.42.42.2(pid=16168): stdout: | (launched: 2022-12-09_03:04:58.361880) 03:05:01.565633 run osmo-hlr_10.42.42.2(pid=16168): stderr: | 20221209030458535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030458536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030458536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030458536 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030458536 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030458536 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030458569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030458578 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030458579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030458579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:01.617549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16167): Terminating (SIGTERM) 03:05:01.660025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16170): Terminating (SIGTERM) 03:05:01.703054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16173): Terminating (SIGTERM) 03:05:01.745279 --- ParallelTerminationStrategy: PID 16167 died... 03:05:01.764788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16167): Terminated: ok {rc=0} 03:05:01.812210 --- ParallelTerminationStrategy: PID 16170 died... 03:05:01.831651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16170): Terminated: ok {rc=0} 03:05:01.878959 --- ParallelTerminationStrategy: PID 16173 died... 03:05:01.898644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16173): Terminated: ok {rc=0} 03:05:01.985867 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 03:05:03.070945 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:05:03.082680 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:05:03.129201 tst ping_idle_ping.py: using LAC 18629 03:05:03.244887 tst ping_idle_ping.py: using RAC 14 03:05:03.359312 tst ping_idle_ping.py: using CellId 18629 03:05:03.473671 tst ping_idle_ping.py: using BVCI 18630 03:05:03.580375 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:05:03.591113 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:05:03.601723 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:05:03.612565 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:05:03.623199 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:05:03.633995 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:05:03.644804 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:05:03.655568 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:05:03.768405 tst ping_idle_ping.py:24: start network... 03:05:03.962345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:04.414723 run create_hlr_db(pid=16178): Launched 03:05:04.524664 bus /gobi_6: Setting Powered False 03:05:05.583503 run create_hlr_db(pid=16178): Terminated: ok {rc=0} 03:05:05.990057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16180): Launched 03:05:06.279977 run osmo-hlr_10.42.42.2(pid=16181): Launched 03:05:06.391310 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:06.894891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16183): Launched 03:05:07.185164 run osmo-stp_10.42.42.5(pid=16184): Launched 03:05:07.296768 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:07.799109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16186): Launched 03:05:07.909811 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:08.154968 run patchelf(pid=16187): Launched 03:05:08.316408 run osmo-stp_10.42.42.5(pid=16184): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16184)] 03:05:08.439078 run osmo-stp_10.42.42.5(pid=16184): stdout: | (launched: 2022-12-09_03:05:07.131620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:08.564125 run osmo-stp_10.42.42.5(pid=16184): stderr: | 20221209030507299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030507299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030507300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030507300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030507302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030507302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030507302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:08.690129 run osmo-stp_10.42.42.5(pid=16184): stdout: | (launched: 2022-12-09_03:05:07.131620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:08.809679 run osmo-stp_10.42.42.5(pid=16184): stderr: | 20221209030507299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030507299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030507300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030507300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030507302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030507302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030507302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:08.951016 run patchelf(pid=16187): Terminating (SIGINT) 03:05:09.114707 run patchelf(pid=16187): Terminated: ok {rc=0} 03:05:09.232850 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16184): Process ended prematurely: osmo-stp_10.42.42.5(pid=16184) [trial-2353↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16184)] [trial-2353↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 03:05:09.241722 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 03:05:09.267666 run osmo-hlr_10.42.42.2(pid=16181): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16181)] 03:05:09.315006 run osmo-hlr_10.42.42.2(pid=16181): stdout: | (launched: 2022-12-09_03:05:06.226885) 03:05:09.363600 run osmo-hlr_10.42.42.2(pid=16181): stderr: | 20221209030506403 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030506403 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030506403 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030506403 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030506403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030506403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030506416 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030506424 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030506425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030506425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:09.412807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16180): Terminating (SIGTERM) 03:05:09.452265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16183): Terminating (SIGTERM) 03:05:09.491273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16186): Terminating (SIGTERM) 03:05:09.530516 --- ParallelTerminationStrategy: PID 16180 died... 03:05:09.549257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16180): Terminated: ok {rc=0} 03:05:09.592815 --- ParallelTerminationStrategy: PID 16183 died... 03:05:09.611574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16183): Terminated: ok {rc=0} 03:05:09.654678 --- ParallelTerminationStrategy: PID 16186 died... 03:05:09.672926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16186): Terminated: ok {rc=0} 03:05:09.754674 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 03:05:11.052307 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:05:11.057885 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:05:11.087525 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:05:11.126864 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:05:11.215616 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:05:11.245476 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:05:11.284628 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:05:11.882830 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:05:11.934611 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:11.946034 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:05:11.993170 tst cs_paging_gprs_active.py: using LAC 18630 03:05:12.118862 tst cs_paging_gprs_active.py: using RAC 15 03:05:12.243442 tst cs_paging_gprs_active.py: using CellId 18630 03:05:12.369827 tst cs_paging_gprs_active.py: using BVCI 18631 03:05:12.485308 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:12.496857 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:12.508204 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:12.519479 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:12.530766 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:12.542089 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:12.553548 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:12.564716 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:12.576119 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:12.693365 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:12.811663 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:05:13.025930 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:13.345209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16191): Launched 03:05:13.621324 run iperf3-srv_10.42.42.10(pid=16192): Launched 03:05:13.740043 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:05:13.953611 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:14.272442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16193): Launched 03:05:14.548700 run iperf3-srv_10.42.42.10(pid=16194): Launched 03:05:14.668059 tst cs_paging_gprs_active.py:38: start network... 03:05:14.882737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:15.375406 run create_hlr_db(pid=16197): Launched 03:05:15.504448 bus /gobi_6: Setting Powered False 03:05:16.578760 run create_hlr_db(pid=16197): Terminated: ok {rc=0} 03:05:17.074388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16199): Launched 03:05:17.406199 run osmo-hlr_10.42.42.2(pid=16200): Launched 03:05:17.529538 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:18.076136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16202): Launched 03:05:18.392633 run osmo-stp_10.42.42.5(pid=16203): Launched 03:05:18.514233 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:19.063033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16205): Launched 03:05:19.184826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:19.454749 run patchelf(pid=16206): Launched 03:05:19.630212 run osmo-stp_10.42.42.5(pid=16203): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16203)] 03:05:19.764188 run osmo-stp_10.42.42.5(pid=16203): stdout: | (launched: 2022-12-09_03:05:18.335144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:19.899513 run osmo-stp_10.42.42.5(pid=16203): stderr: | 20221209030518526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030518526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030518526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030518527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030518527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030518527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030518527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:20.034706 run osmo-stp_10.42.42.5(pid=16203): stdout: | (launched: 2022-12-09_03:05:18.335144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:20.164567 run osmo-stp_10.42.42.5(pid=16203): stderr: | 20221209030518526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030518526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030518526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030518527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030518527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030518527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030518527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:20.318799 run patchelf(pid=16206): Terminating (SIGINT) 03:05:20.496251 run patchelf(pid=16206): Terminated: ok {rc=0} 03:05:20.624060 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16203): Process ended prematurely: osmo-stp_10.42.42.5(pid=16203) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16203)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:05:20.634093 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 03:05:20.662094 run osmo-hlr_10.42.42.2(pid=16200): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16200)] 03:05:20.711612 run osmo-hlr_10.42.42.2(pid=16200): stdout: | (launched: 2022-12-09_03:05:17.348227) 03:05:20.762404 run osmo-hlr_10.42.42.2(pid=16200): stderr: | 20221209030517545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030517545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030517545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030517545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030517545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030517545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030517558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030517568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030517568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030517568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:20.813943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16191): Terminating (SIGTERM) 03:05:20.855029 run iperf3-srv_10.42.42.10(pid=16192): Terminating (SIGTERM) 03:05:20.895968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16193): Terminating (SIGTERM) 03:05:20.937148 run iperf3-srv_10.42.42.10(pid=16194): Terminating (SIGTERM) 03:05:20.978113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16199): Terminating (SIGTERM) 03:05:21.019386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16202): Terminating (SIGTERM) 03:05:21.060337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16205): Terminating (SIGTERM) 03:05:21.101764 --- ParallelTerminationStrategy: PID 16191 died... 03:05:21.121509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16191): Terminated: ok {rc=0} 03:05:21.167069 --- ParallelTerminationStrategy: PID 16192 died... 03:05:21.186266 run iperf3-srv_10.42.42.10(pid=16192): Terminated {rc=256} 03:05:21.231570 --- ParallelTerminationStrategy: PID 16193 died... 03:05:21.250817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16193): Terminated: ok {rc=0} 03:05:21.296552 --- ParallelTerminationStrategy: PID 16194 died... 03:05:21.315717 run iperf3-srv_10.42.42.10(pid=16194): Terminated {rc=256} 03:05:21.361968 --- ParallelTerminationStrategy: PID 16199 died... 03:05:21.381191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16199): Terminated: ok {rc=0} 03:05:21.426504 --- ParallelTerminationStrategy: PID 16202 died... 03:05:21.446149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16202): Terminated: ok {rc=0} 03:05:21.491901 --- ParallelTerminationStrategy: PID 16205 died... 03:05:21.511267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16205): Terminated: ok {rc=0} 03:05:21.598270 bus /gobi_0: Setting Powered False 03:05:22.696848 bus /gobi_0: Setting Powered False 03:05:23.812600 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:05:24.960392 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:24.972501 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:05:25.021419 tst iperf3.py: using LAC 18631 03:05:25.147922 tst iperf3.py: using RAC 16 03:05:25.272795 tst iperf3.py: using CellId 18631 03:05:25.399264 tst iperf3.py: using BVCI 18632 03:05:25.509062 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.520209 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.531523 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.542705 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.553893 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.565111 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.576346 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.587269 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:25.598664 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:25.713041 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:05:25.927991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:26.246555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16207): Launched 03:05:26.521577 run iperf3-srv_10.42.42.10(pid=16208): Launched 03:05:26.639650 tst iperf3.py:8: start network... 03:05:26.852171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:27.341417 run create_hlr_db(pid=16209): Launched 03:05:27.473043 bus /gobi_6: Setting Powered False 03:05:28.536474 run create_hlr_db(pid=16209): Terminated: ok {rc=0} 03:05:28.977375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16211): Launched 03:05:29.292694 run osmo-hlr_10.42.42.2(pid=16212): Launched 03:05:29.414468 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:29.958161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16214): Launched 03:05:30.273202 run osmo-stp_10.42.42.5(pid=16215): Launched 03:05:30.394195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:30.944902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16217): Launched 03:05:31.075321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:31.350830 run patchelf(pid=16218): Launched 03:05:31.562712 run osmo-stp_10.42.42.5(pid=16215): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16215)] 03:05:31.711502 run osmo-stp_10.42.42.5(pid=16215): stdout: | (launched: 2022-12-09_03:05:30.215629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:31.850058 run osmo-stp_10.42.42.5(pid=16215): stderr: | 20221209030530407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030530407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030530407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030530408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030530408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030530408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030530408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:31.987363 run osmo-stp_10.42.42.5(pid=16215): stdout: | (launched: 2022-12-09_03:05:30.215629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:32.119085 run osmo-stp_10.42.42.5(pid=16215): stderr: | 20221209030530407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030530407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030530407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030530408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030530408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030530408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030530408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:32.274183 run patchelf(pid=16218): Terminating (SIGINT) 03:05:32.451533 run patchelf(pid=16218): Terminated: ok {rc=0} 03:05:32.579171 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16215): Process ended prematurely: osmo-stp_10.42.42.5(pid=16215) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16215)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 03:05:32.589258 tst iperf3.py:8: Test FAILED (7.7 sec) 03:05:32.617365 run osmo-hlr_10.42.42.2(pid=16212): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16212)] 03:05:32.666865 run osmo-hlr_10.42.42.2(pid=16212): stdout: | (launched: 2022-12-09_03:05:29.235290) 03:05:32.718521 run osmo-hlr_10.42.42.2(pid=16212): stderr: | 20221209030529433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030529433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030529433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030529433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030529433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030529433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030529445 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030529453 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030529454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030529454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:32.769980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16207): Terminating (SIGTERM) 03:05:32.811393 run iperf3-srv_10.42.42.10(pid=16208): Terminating (SIGTERM) 03:05:32.852747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16211): Terminating (SIGTERM) 03:05:32.894248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16214): Terminating (SIGTERM) 03:05:32.935573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16217): Terminating (SIGTERM) 03:05:32.977211 --- ParallelTerminationStrategy: PID 16207 died... 03:05:32.997094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16207): Terminated: ok {rc=0} 03:05:33.042875 --- ParallelTerminationStrategy: PID 16208 died... 03:05:33.062135 run iperf3-srv_10.42.42.10(pid=16208): Terminated {rc=256} 03:05:33.108184 --- ParallelTerminationStrategy: PID 16211 died... 03:05:33.127530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16211): Terminated: ok {rc=0} 03:05:33.173114 --- ParallelTerminationStrategy: PID 16214 died... 03:05:33.192330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16214): Terminated: ok {rc=0} 03:05:33.238104 --- ParallelTerminationStrategy: PID 16217 died... 03:05:33.257524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16217): Terminated: ok {rc=0} 03:05:33.344167 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:05:34.495874 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:34.507971 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:05:34.555615 tst iperf3m4.py: using LAC 18632 03:05:34.683703 tst iperf3m4.py: using RAC 17 03:05:34.808363 tst iperf3m4.py: using CellId 18632 03:05:34.932392 tst iperf3m4.py: using BVCI 18633 03:05:35.048835 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:35.060466 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:35.071833 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:35.083213 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:35.094639 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:35.106016 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:35.117461 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:35.128686 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:35.140143 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:35.266811 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:35.381056 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:35.500164 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:35.617459 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:05:35.816641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:36.114429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16219): Launched 03:05:36.372497 run iperf3-srv_10.42.42.10(pid=16220): Launched 03:05:36.483477 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:05:36.681620 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:36.978861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16221): Launched 03:05:37.235959 run iperf3-srv_10.42.42.10(pid=16222): Launched 03:05:37.346928 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:05:37.546189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:37.843367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16223): Launched 03:05:38.100588 run iperf3-srv_10.42.42.10(pid=16224): Launched 03:05:38.211404 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:05:38.409886 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:38.706778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16225): Launched 03:05:38.963751 run iperf3-srv_10.42.42.10(pid=16226): Launched 03:05:39.074790 tst iperf3m4.py:8: start network... 03:05:39.272635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:39.731958 run create_hlr_db(pid=16227): Launched 03:05:39.846531 bus /gobi_6: Setting Powered False 03:05:40.908931 run create_hlr_db(pid=16227): Terminated: ok {rc=0} 03:05:41.349815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16229): Launched 03:05:41.667446 run osmo-hlr_10.42.42.2(pid=16230): Launched 03:05:41.789428 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:42.334987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16232): Launched 03:05:42.651310 run osmo-stp_10.42.42.5(pid=16233): Launched 03:05:42.772839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:43.320817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16235): Launched 03:05:43.441774 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:43.710231 run patchelf(pid=16236): Launched 03:05:43.885551 run osmo-stp_10.42.42.5(pid=16233): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16233)] 03:05:44.019187 run osmo-stp_10.42.42.5(pid=16233): stdout: | (launched: 2022-12-09_03:05:42.593775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:44.154510 run osmo-stp_10.42.42.5(pid=16233): stderr: | 20221209030542781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030542781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030542781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030542782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030542782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030542782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030542782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:44.289869 run osmo-stp_10.42.42.5(pid=16233): stdout: | (launched: 2022-12-09_03:05:42.593775) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:44.419679 run osmo-stp_10.42.42.5(pid=16233): stderr: | 20221209030542781 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030542781 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030542781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030542782 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030542782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030542782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030542782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:44.574280 run patchelf(pid=16236): Terminating (SIGINT) 03:05:44.750960 run patchelf(pid=16236): Terminated: ok {rc=0} 03:05:44.878281 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16233): Process ended prematurely: osmo-stp_10.42.42.5(pid=16233) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16233)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 03:05:44.888451 tst iperf3m4.py:8: Test FAILED (10.4 sec) 03:05:44.916790 run osmo-hlr_10.42.42.2(pid=16230): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16230)] 03:05:44.966145 run osmo-hlr_10.42.42.2(pid=16230): stdout: | (launched: 2022-12-09_03:05:41.609950) 03:05:45.017270 run osmo-hlr_10.42.42.2(pid=16230): stderr: | 20221209030541806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030541806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030541806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030541806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030541806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030541806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030541818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030541826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030541826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030541826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:45.068876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16219): Terminating (SIGTERM) 03:05:45.110429 run iperf3-srv_10.42.42.10(pid=16220): Terminating (SIGTERM) 03:05:45.151791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16221): Terminating (SIGTERM) 03:05:45.193364 run iperf3-srv_10.42.42.10(pid=16222): Terminating (SIGTERM) 03:05:45.234757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16223): Terminating (SIGTERM) 03:05:45.276366 run iperf3-srv_10.42.42.10(pid=16224): Terminating (SIGTERM) 03:05:45.318175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16225): Terminating (SIGTERM) 03:05:45.359622 run iperf3-srv_10.42.42.10(pid=16226): Terminating (SIGTERM) 03:05:45.400731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16229): Terminating (SIGTERM) 03:05:45.442843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16232): Terminating (SIGTERM) 03:05:45.484203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16235): Terminating (SIGTERM) 03:05:45.526183 --- ParallelTerminationStrategy: PID 16219 died... 03:05:45.546106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16219): Terminated: ok {rc=0} 03:05:45.592021 --- ParallelTerminationStrategy: PID 16220 died... 03:05:45.611362 run iperf3-srv_10.42.42.10(pid=16220): Terminated {rc=256} 03:05:45.656739 --- ParallelTerminationStrategy: PID 16221 died... 03:05:45.676040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16221): Terminated: ok {rc=0} 03:05:45.721824 --- ParallelTerminationStrategy: PID 16222 died... 03:05:45.741162 run iperf3-srv_10.42.42.10(pid=16222): Terminated {rc=256} 03:05:45.786438 --- ParallelTerminationStrategy: PID 16223 died... 03:05:45.805722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16223): Terminated: ok {rc=0} 03:05:45.861578 --- ParallelTerminationStrategy: PID 16224 died... 03:05:45.887899 run iperf3-srv_10.42.42.10(pid=16224): Terminated {rc=256} 03:05:45.953882 --- ParallelTerminationStrategy: PID 16225 died... 03:05:45.974191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16225): Terminated: ok {rc=0} 03:05:46.020812 --- ParallelTerminationStrategy: PID 16226 died... 03:05:46.043271 run iperf3-srv_10.42.42.10(pid=16226): Terminated {rc=256} 03:05:46.090173 --- ParallelTerminationStrategy: PID 16229 died... 03:05:46.110398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16229): Terminated: ok {rc=0} 03:05:46.157410 --- ParallelTerminationStrategy: PID 16232 died... 03:05:46.177598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16232): Terminated: ok {rc=0} 03:05:46.224157 --- ParallelTerminationStrategy: PID 16235 died... 03:05:46.244192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16235): Terminated: ok {rc=0} 03:05:46.332312 bus /gobi_4: Setting Powered False 03:05:47.431102 bus /gobi_4: Setting Powered False 03:05:48.547009 bus /gobi_1: Setting Powered False 03:05:49.646059 bus /gobi_1: Setting Powered False 03:05:50.762851 bus /gobi_0: Setting Powered False 03:05:51.860843 bus /gobi_0: Setting Powered False 03:05:52.977132 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 03:05:54.079397 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:54.091564 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:05:54.139965 tst ping.py: using LAC 18633 03:05:54.256940 tst ping.py: using RAC 18 03:05:54.380120 tst ping.py: using CellId 18633 03:05:54.502363 tst ping.py: using BVCI 18634 03:05:54.615358 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:54.626928 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:54.638327 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:54.649796 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:54.661035 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:54.672331 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:54.683874 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:54.695287 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:54.808691 tst ping.py:19: start network... 03:05:55.003232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:55.454580 run create_hlr_db(pid=16237): Launched 03:05:55.567624 bus /gobi_6: Setting Powered False 03:05:56.626006 run create_hlr_db(pid=16237): Terminated: ok {rc=0} 03:05:57.031795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16239): Launched 03:05:57.320590 run osmo-hlr_10.42.42.2(pid=16240): Launched 03:05:57.431634 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:57.948347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16242): Launched 03:05:58.237926 run osmo-stp_10.42.42.5(pid=16243): Launched 03:05:58.348651 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:58.850478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16245): Launched 03:05:58.961787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:59.208370 run patchelf(pid=16246): Launched 03:05:59.370685 run osmo-stp_10.42.42.5(pid=16243): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16243)] 03:05:59.494306 run osmo-stp_10.42.42.5(pid=16243): stdout: | (launched: 2022-12-09_03:05:58.185098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:59.619916 run osmo-stp_10.42.42.5(pid=16243): stderr: | 20221209030558352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030558352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030558352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030558353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030558355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030558355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030558355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:59.745677 run osmo-stp_10.42.42.5(pid=16243): stdout: | (launched: 2022-12-09_03:05:58.185098) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:59.866031 run osmo-stp_10.42.42.5(pid=16243): stderr: | 20221209030558352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030558352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030558352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030558353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030558355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030558355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030558355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:00.008146 run patchelf(pid=16246): Terminating (SIGINT) 03:06:00.172393 run patchelf(pid=16246): Terminated: ok {rc=0} 03:06:00.290718 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16243): Process ended prematurely: osmo-stp_10.42.42.5(pid=16243) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16243)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 03:06:00.299521 tst ping.py:22: Test FAILED (6.2 sec) 03:06:00.326109 run osmo-hlr_10.42.42.2(pid=16240): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16240)] 03:06:00.374101 run osmo-hlr_10.42.42.2(pid=16240): stdout: | (launched: 2022-12-09_03:05:57.267422) 03:06:00.423501 run osmo-hlr_10.42.42.2(pid=16240): stderr: | 20221209030557442 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030557443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030557443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030557443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030557443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030557443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030557458 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030557467 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030557467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030557467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:00.473444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16239): Terminating (SIGTERM) 03:06:00.513158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16242): Terminating (SIGTERM) 03:06:00.552739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16245): Terminating (SIGTERM) 03:06:00.592616 --- ParallelTerminationStrategy: PID 16239 died... 03:06:00.611521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16239): Terminated: ok {rc=0} 03:06:00.655999 --- ParallelTerminationStrategy: PID 16242 died... 03:06:00.674409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16242): Terminated: ok {rc=0} 03:06:00.718867 --- ParallelTerminationStrategy: PID 16245 died... 03:06:00.737414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16245): Terminated: ok {rc=0} 03:06:00.822732 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:06:01.910974 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:06:01.923961 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:06:01.974499 tst ping_idle_ping.py: using LAC 18634 03:06:02.138626 tst ping_idle_ping.py: using RAC 19 03:06:02.265405 tst ping_idle_ping.py: using CellId 18634 03:06:02.388787 tst ping_idle_ping.py: using BVCI 18635 03:06:02.503646 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:06:02.515444 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:06:02.526960 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:06:02.538920 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:06:02.550644 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:06:02.562581 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:06:02.574660 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:06:02.586405 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:06:02.705117 tst ping_idle_ping.py:24: start network... 03:06:02.915120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:03.400867 run create_hlr_db(pid=16247): Launched 03:06:03.528080 bus /gobi_6: Setting Powered False 03:06:04.590496 run create_hlr_db(pid=16247): Terminated: ok {rc=0} 03:06:05.009366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16249): Launched 03:06:05.301502 run osmo-hlr_10.42.42.2(pid=16250): Launched 03:06:05.412909 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:05.930136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16252): Launched 03:06:06.220262 run osmo-stp_10.42.42.5(pid=16253): Launched 03:06:06.331179 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:06.834497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16255): Launched 03:06:06.945245 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:07.190810 run patchelf(pid=16256): Launched 03:06:07.352736 run osmo-stp_10.42.42.5(pid=16253): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16253)] 03:06:07.476016 run osmo-stp_10.42.42.5(pid=16253): stdout: | (launched: 2022-12-09_03:06:06.166935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:07.601680 run osmo-stp_10.42.42.5(pid=16253): stderr: | 20221209030606335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030606335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030606335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030606335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030606336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030606336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030606336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:07.727401 run osmo-stp_10.42.42.5(pid=16253): stdout: | (launched: 2022-12-09_03:06:06.166935) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:07.847091 run osmo-stp_10.42.42.5(pid=16253): stderr: | 20221209030606335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030606335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030606335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030606335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030606336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030606336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030606336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:07.988860 run patchelf(pid=16256): Terminating (SIGINT) 03:06:08.153163 run patchelf(pid=16256): Terminated: ok {rc=0} 03:06:08.271237 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16253): Process ended prematurely: osmo-stp_10.42.42.5(pid=16253) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16253)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 03:06:08.280016 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 03:06:08.306611 run osmo-hlr_10.42.42.2(pid=16250): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16250)] 03:06:08.354263 run osmo-hlr_10.42.42.2(pid=16250): stdout: | (launched: 2022-12-09_03:06:05.247604) 03:06:08.403390 run osmo-hlr_10.42.42.2(pid=16250): stderr: | 20221209030605421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030605421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030605421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030605421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030605421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030605421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030605433 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030605442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030605442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030605442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:08.452767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16249): Terminating (SIGTERM) 03:06:08.492298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16252): Terminating (SIGTERM) 03:06:08.531640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16255): Terminating (SIGTERM) 03:06:08.571382 --- ParallelTerminationStrategy: PID 16249 died... 03:06:08.590232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16249): Terminated: ok {rc=0} 03:06:08.634046 --- ParallelTerminationStrategy: PID 16252 died... 03:06:08.652234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16252): Terminated: ok {rc=0} 03:06:08.696335 --- ParallelTerminationStrategy: PID 16255 died... 03:06:08.714710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16255): Terminated: ok {rc=0} 03:06:08.797543 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:06:10.107342 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:06:10.114223 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:06:10.143703 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:06:10.182267 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:06:10.268523 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:06:10.297485 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:06:10.335737 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:06:10.932404 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:06:10.980858 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:10.991960 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:06:11.058611 tst cs_paging_gprs_active.py: using LAC 18635 03:06:11.175623 tst cs_paging_gprs_active.py: using RAC 20 03:06:11.294123 tst cs_paging_gprs_active.py: using CellId 18635 03:06:11.410354 tst cs_paging_gprs_active.py: using BVCI 18636 03:06:11.517991 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:11.529061 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:11.539920 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:11.551136 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:11.562280 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:11.573343 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:11.584376 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:11.595637 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:11.607032 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:11.722062 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:11.837326 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:06:12.038566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:12.337680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16260): Launched 03:06:12.597397 run iperf3-srv_10.42.42.10(pid=16261): Launched 03:06:12.709378 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:06:12.922104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:13.243531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16262): Launched 03:06:13.520730 run iperf3-srv_10.42.42.10(pid=16263): Launched 03:06:13.640496 tst cs_paging_gprs_active.py:38: start network... 03:06:13.854980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:14.347966 run create_hlr_db(pid=16264): Launched 03:06:14.477802 bus /gobi_6: Setting Powered False 03:06:15.541093 run create_hlr_db(pid=16264): Terminated: ok {rc=0} 03:06:16.016295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16266): Launched 03:06:16.347262 run osmo-hlr_10.42.42.2(pid=16267): Launched 03:06:16.657753 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:17.213642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16269): Launched 03:06:17.531359 run osmo-stp_10.42.42.5(pid=16270): Launched 03:06:17.653098 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:18.205553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16272): Launched 03:06:18.326591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:18.595489 run patchelf(pid=16273): Launched 03:06:18.772044 run osmo-stp_10.42.42.5(pid=16270): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16270)] 03:06:18.906622 run osmo-stp_10.42.42.5(pid=16270): stdout: | (launched: 2022-12-09_03:06:17.473349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:19.042501 run osmo-stp_10.42.42.5(pid=16270): stderr: | 20221209030617664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030617664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030617665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030617665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030617666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030617666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030617666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:19.178213 run osmo-stp_10.42.42.5(pid=16270): stdout: | (launched: 2022-12-09_03:06:17.473349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:19.308681 run osmo-stp_10.42.42.5(pid=16270): stderr: | 20221209030617664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030617664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030617665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030617665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030617666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030617666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030617666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:19.463439 run patchelf(pid=16273): Terminating (SIGINT) 03:06:19.641241 run patchelf(pid=16273): Terminated: ok {rc=0} 03:06:19.769311 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16270): Process ended prematurely: osmo-stp_10.42.42.5(pid=16270) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16270)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:06:19.779367 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 03:06:19.807859 run osmo-hlr_10.42.42.2(pid=16267): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16267)] 03:06:19.857234 run osmo-hlr_10.42.42.2(pid=16267): stdout: | (launched: 2022-12-09_03:06:16.287824) 03:06:19.908192 run osmo-hlr_10.42.42.2(pid=16267): stderr: | 20221209030616471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030616471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030616471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030616471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030616471 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030616471 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030616484 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030616500 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030616500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030616500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:19.959635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16260): Terminating (SIGTERM) 03:06:20.000763 run iperf3-srv_10.42.42.10(pid=16261): Terminating (SIGTERM) 03:06:20.041883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16262): Terminating (SIGTERM) 03:06:20.083120 run iperf3-srv_10.42.42.10(pid=16263): Terminating (SIGTERM) 03:06:20.124025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16266): Terminating (SIGTERM) 03:06:20.165785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16269): Terminating (SIGTERM) 03:06:20.207159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16272): Terminating (SIGTERM) 03:06:20.248428 --- ParallelTerminationStrategy: PID 16260 died... 03:06:20.268151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16260): Terminated: ok {rc=0} 03:06:20.314409 --- ParallelTerminationStrategy: PID 16261 died... 03:06:20.333868 run iperf3-srv_10.42.42.10(pid=16261): Terminated {rc=256} 03:06:20.379410 --- ParallelTerminationStrategy: PID 16262 died... 03:06:20.398857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16262): Terminated: ok {rc=0} 03:06:20.444219 --- ParallelTerminationStrategy: PID 16263 died... 03:06:20.463836 run iperf3-srv_10.42.42.10(pid=16263): Terminated {rc=256} 03:06:20.509494 --- ParallelTerminationStrategy: PID 16266 died... 03:06:20.528914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16266): Terminated: ok {rc=0} 03:06:20.574602 --- ParallelTerminationStrategy: PID 16269 died... 03:06:20.594060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16269): Terminated: ok {rc=0} 03:06:20.639740 --- ParallelTerminationStrategy: PID 16272 died... 03:06:20.659183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16272): Terminated: ok {rc=0} 03:06:20.745972 bus /gobi_0: Setting Powered False 03:06:21.843828 bus /gobi_0: Setting Powered False 03:06:22.980126 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:06:24.128180 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.140575 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:06:24.211247 tst iperf3.py: using LAC 18636 03:06:24.342944 tst iperf3.py: using RAC 21 03:06:24.468577 tst iperf3.py: using CellId 18636 03:06:24.593026 tst iperf3.py: using BVCI 18637 03:06:24.709136 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.720722 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.732165 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.743486 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.754710 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.766067 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.777617 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.788781 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:24.800223 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:24.920052 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:06:25.134560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:25.453473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16274): Launched 03:06:25.730004 run iperf3-srv_10.42.42.10(pid=16275): Launched 03:06:25.849647 tst iperf3.py:8: start network... 03:06:26.064166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:26.556934 run create_hlr_db(pid=16276): Launched 03:06:26.685156 bus /gobi_6: Setting Powered False 03:06:27.748260 run create_hlr_db(pid=16276): Terminated: ok {rc=0} 03:06:28.173507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16278): Launched 03:06:28.471134 run osmo-hlr_10.42.42.2(pid=16279): Launched 03:06:28.586254 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:29.117331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16281): Launched 03:06:29.414880 run osmo-stp_10.42.42.5(pid=16282): Launched 03:06:29.529537 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:30.043312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16284): Launched 03:06:30.156878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:30.408745 run patchelf(pid=16285): Launched 03:06:30.574580 run osmo-stp_10.42.42.5(pid=16282): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16282)] 03:06:30.700123 run osmo-stp_10.42.42.5(pid=16282): stdout: | (launched: 2022-12-09_03:06:29.360597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:30.837689 run osmo-stp_10.42.42.5(pid=16282): stderr: | 20221209030629530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030629530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030629530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030629531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030629531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030629531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030629531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:30.991829 run osmo-stp_10.42.42.5(pid=16282): stdout: | (launched: 2022-12-09_03:06:29.360597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:31.126693 run osmo-stp_10.42.42.5(pid=16282): stderr: | 20221209030629530 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030629530 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030629530 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030629531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030629531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030629531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030629531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:31.285243 run patchelf(pid=16285): Terminating (SIGINT) 03:06:31.469401 run patchelf(pid=16285): Terminated: ok {rc=0} 03:06:31.602448 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16282): Process ended prematurely: osmo-stp_10.42.42.5(pid=16282) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16282)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 03:06:31.613502 tst iperf3.py:8: Test FAILED (7.5 sec) 03:06:31.642870 run osmo-hlr_10.42.42.2(pid=16279): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16279)] 03:06:31.695318 run osmo-hlr_10.42.42.2(pid=16279): stdout: | (launched: 2022-12-09_03:06:28.416507) 03:06:31.748565 run osmo-hlr_10.42.42.2(pid=16279): stderr: | 20221209030628591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030628591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030628591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030628591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030628591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030628591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030628603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030628612 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030628612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030628612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:31.801499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16274): Terminating (SIGTERM) 03:06:31.845343 run iperf3-srv_10.42.42.10(pid=16275): Terminating (SIGTERM) 03:06:31.889866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16278): Terminating (SIGTERM) 03:06:31.934020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16281): Terminating (SIGTERM) 03:06:31.978863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16284): Terminating (SIGTERM) 03:06:32.023871 --- ParallelTerminationStrategy: PID 16274 died... 03:06:32.044655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16274): Terminated: ok {rc=0} 03:06:32.093969 --- ParallelTerminationStrategy: PID 16275 died... 03:06:32.114011 run iperf3-srv_10.42.42.10(pid=16275): Terminated {rc=256} 03:06:32.160642 --- ParallelTerminationStrategy: PID 16278 died... 03:06:32.180543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16278): Terminated: ok {rc=0} 03:06:32.226576 --- ParallelTerminationStrategy: PID 16281 died... 03:06:32.246140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16281): Terminated: ok {rc=0} 03:06:32.291934 --- ParallelTerminationStrategy: PID 16284 died... 03:06:32.312902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16284): Terminated: ok {rc=0} 03:06:32.398381 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:06:33.543077 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:33.554746 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:06:33.620938 tst iperf3m4.py: using LAC 18637 03:06:33.737687 tst iperf3m4.py: using RAC 22 03:06:33.857442 tst iperf3m4.py: using CellId 18637 03:06:33.983223 tst iperf3m4.py: using BVCI 18638 03:06:34.099483 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:34.111319 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:34.123071 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:34.134724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:34.146375 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:34.157809 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:34.169300 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:34.180549 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:34.192064 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:34.310461 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:34.429671 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:34.549571 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:34.669560 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:06:34.884273 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:35.202800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16286): Launched 03:06:35.478648 run iperf3-srv_10.42.42.10(pid=16287): Launched 03:06:35.597733 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:06:35.810946 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:36.129612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16288): Launched 03:06:36.404195 run iperf3-srv_10.42.42.10(pid=16289): Launched 03:06:36.523826 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:06:36.737690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:37.056504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16290): Launched 03:06:37.331732 run iperf3-srv_10.42.42.10(pid=16291): Launched 03:06:37.449870 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:06:37.664165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:37.983137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16292): Launched 03:06:38.258203 run iperf3-srv_10.42.42.10(pid=16293): Launched 03:06:38.376338 tst iperf3m4.py:8: start network... 03:06:38.590714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:39.082394 run create_hlr_db(pid=16294): Launched 03:06:39.210128 bus /gobi_6: Setting Powered False 03:06:40.272023 run create_hlr_db(pid=16294): Terminated: ok {rc=0} 03:06:40.696607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16296): Launched 03:06:40.993879 run osmo-hlr_10.42.42.2(pid=16297): Launched 03:06:41.107238 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:41.631714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16299): Launched 03:06:41.927986 run osmo-stp_10.42.42.5(pid=16300): Launched 03:06:42.041173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:42.551948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16302): Launched 03:06:42.665237 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:42.916303 run patchelf(pid=16303): Launched 03:06:43.080900 run osmo-stp_10.42.42.5(pid=16300): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16300)] 03:06:43.206912 run osmo-stp_10.42.42.5(pid=16300): stdout: | (launched: 2022-12-09_03:06:41.873596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:43.334175 run osmo-stp_10.42.42.5(pid=16300): stderr: | 20221209030642039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030642039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030642039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030642040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030642040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030642040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030642041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:43.461549 run osmo-stp_10.42.42.5(pid=16300): stdout: | (launched: 2022-12-09_03:06:41.873596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:43.583857 run osmo-stp_10.42.42.5(pid=16300): stderr: | 20221209030642039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030642039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030642039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030642040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030642040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030642040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030642041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:43.728377 run patchelf(pid=16303): Terminating (SIGINT) 03:06:43.895996 run patchelf(pid=16303): Terminated: ok {rc=0} 03:06:44.016877 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16300): Process ended prematurely: osmo-stp_10.42.42.5(pid=16300) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16300)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:06:44.026729 tst iperf3m4.py:8: Test FAILED (10.5 sec) 03:06:44.054279 run osmo-hlr_10.42.42.2(pid=16297): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16297)] 03:06:44.102225 run osmo-hlr_10.42.42.2(pid=16297): stdout: | (launched: 2022-12-09_03:06:40.939655) 03:06:44.151612 run osmo-hlr_10.42.42.2(pid=16297): stderr: | 20221209030641113 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030641113 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030641113 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030641113 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030641113 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030641113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030641126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030641134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030641134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030641134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:44.201482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16286): Terminating (SIGTERM) 03:06:44.241407 run iperf3-srv_10.42.42.10(pid=16287): Terminating (SIGTERM) 03:06:44.281156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16288): Terminating (SIGTERM) 03:06:44.320923 run iperf3-srv_10.42.42.10(pid=16289): Terminating (SIGTERM) 03:06:44.360551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16290): Terminating (SIGTERM) 03:06:44.400263 run iperf3-srv_10.42.42.10(pid=16291): Terminating (SIGTERM) 03:06:44.439862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16292): Terminating (SIGTERM) 03:06:44.479688 run iperf3-srv_10.42.42.10(pid=16293): Terminating (SIGTERM) 03:06:44.519436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16296): Terminating (SIGTERM) 03:06:44.559189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16299): Terminating (SIGTERM) 03:06:44.598568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16302): Terminating (SIGTERM) 03:06:44.638708 --- ParallelTerminationStrategy: PID 16286 died... 03:06:44.657636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16286): Terminated: ok {rc=0} 03:06:44.701792 --- ParallelTerminationStrategy: PID 16287 died... 03:06:44.720218 run iperf3-srv_10.42.42.10(pid=16287): Terminated {rc=256} 03:06:44.764098 --- ParallelTerminationStrategy: PID 16288 died... 03:06:44.782678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16288): Terminated: ok {rc=0} 03:06:44.826534 --- ParallelTerminationStrategy: PID 16289 died... 03:06:44.845046 run iperf3-srv_10.42.42.10(pid=16289): Terminated {rc=256} 03:06:44.888781 --- ParallelTerminationStrategy: PID 16290 died... 03:06:44.907764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16290): Terminated: ok {rc=0} 03:06:44.951584 --- ParallelTerminationStrategy: PID 16291 died... 03:06:44.970088 run iperf3-srv_10.42.42.10(pid=16291): Terminated {rc=256} 03:06:45.014541 --- ParallelTerminationStrategy: PID 16292 died... 03:06:45.033163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16292): Terminated: ok {rc=0} 03:06:45.077223 --- ParallelTerminationStrategy: PID 16293 died... 03:06:45.095394 run iperf3-srv_10.42.42.10(pid=16293): Terminated {rc=256} 03:06:45.139368 --- ParallelTerminationStrategy: PID 16296 died... 03:06:45.157917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16296): Terminated: ok {rc=0} 03:06:45.201835 --- ParallelTerminationStrategy: PID 16299 died... 03:06:45.220339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16299): Terminated: ok {rc=0} 03:06:45.264400 --- ParallelTerminationStrategy: PID 16302 died... 03:06:45.283025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16302): Terminated: ok {rc=0} 03:06:45.368066 bus /gobi_4: Setting Powered False 03:06:46.468427 bus /gobi_4: Setting Powered False 03:06:47.584931 bus /gobi_1: Setting Powered False 03:06:48.682701 bus /gobi_1: Setting Powered False 03:06:49.800244 bus /gobi_0: Setting Powered False 03:06:50.897554 bus /gobi_0: Setting Powered False 03:06:52.013800 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:06:53.117338 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:53.129457 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:06:53.197161 tst ping.py: using LAC 18638 03:06:53.321669 tst ping.py: using RAC 23 03:06:53.443930 tst ping.py: using CellId 18638 03:06:53.567655 tst ping.py: using BVCI 18639 03:06:53.682907 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:53.694618 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:53.706053 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:53.717532 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:53.728817 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:53.740264 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:53.752355 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:53.763771 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:53.882354 tst ping.py:19: start network... 03:06:54.094587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:54.579931 run create_hlr_db(pid=16304): Launched 03:06:54.706166 bus /gobi_6: Setting Powered False 03:06:55.768574 run create_hlr_db(pid=16304): Terminated: ok {rc=0} 03:06:56.186343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16306): Launched 03:06:56.478481 run osmo-hlr_10.42.42.2(pid=16307): Launched 03:06:56.591043 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:57.095095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16309): Launched 03:06:57.385341 run osmo-stp_10.42.42.5(pid=16310): Launched 03:06:57.497520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:58.001107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16312): Launched 03:06:58.112918 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:58.358964 run patchelf(pid=16313): Launched 03:06:58.521279 run osmo-stp_10.42.42.5(pid=16310): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16310)] 03:06:58.645443 run osmo-stp_10.42.42.5(pid=16310): stdout: | (launched: 2022-12-09_03:06:57.331812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:58.771239 run osmo-stp_10.42.42.5(pid=16310): stderr: | 20221209030657501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030657501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030657501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030657502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030657502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030657502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030657502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:58.897078 run osmo-stp_10.42.42.5(pid=16310): stdout: | (launched: 2022-12-09_03:06:57.331812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:59.017147 run osmo-stp_10.42.42.5(pid=16310): stderr: | 20221209030657501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030657501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030657501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030657502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030657502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030657502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030657502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:59.159250 run patchelf(pid=16313): Terminating (SIGINT) 03:06:59.322672 run patchelf(pid=16313): Terminated: ok {rc=0} 03:06:59.440487 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16310): Process ended prematurely: osmo-stp_10.42.42.5(pid=16310) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16310)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 03:06:59.449385 tst ping.py:22: Test FAILED (6.3 sec) 03:06:59.475460 run osmo-hlr_10.42.42.2(pid=16307): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16307)] 03:06:59.522940 run osmo-hlr_10.42.42.2(pid=16307): stdout: | (launched: 2022-12-09_03:06:56.425119) 03:06:59.572851 run osmo-hlr_10.42.42.2(pid=16307): stderr: | 20221209030656599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030656599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030656599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030656599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030656599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030656599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030656611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030656620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030656620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030656620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:59.622090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16306): Terminating (SIGTERM) 03:06:59.661516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16309): Terminating (SIGTERM) 03:06:59.700709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16312): Terminating (SIGTERM) 03:06:59.740280 --- ParallelTerminationStrategy: PID 16306 died... 03:06:59.759181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16306): Terminated: ok {rc=0} 03:06:59.803129 --- ParallelTerminationStrategy: PID 16309 died... 03:06:59.821640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16309): Terminated: ok {rc=0} 03:06:59.865421 --- ParallelTerminationStrategy: PID 16312 died... 03:06:59.883749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16312): Terminated: ok {rc=0} 03:06:59.969549 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:07:01.056848 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:07:01.069760 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:07:01.140011 tst ping_idle_ping.py: using LAC 18639 03:07:01.258519 tst ping_idle_ping.py: using RAC 24 03:07:01.386299 tst ping_idle_ping.py: using CellId 18639 03:07:01.513581 tst ping_idle_ping.py: using BVCI 18640 03:07:01.632232 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:07:01.644460 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:07:01.656571 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:07:01.669213 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:07:01.681358 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:07:01.694761 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:07:01.707158 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:07:01.719518 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:07:01.839880 tst ping_idle_ping.py:24: start network... 03:07:02.056831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:02.553183 run create_hlr_db(pid=16314): Launched 03:07:02.681273 bus /gobi_6: Setting Powered False 03:07:03.743980 run create_hlr_db(pid=16314): Terminated: ok {rc=0} 03:07:04.164717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16316): Launched 03:07:04.458049 run osmo-hlr_10.42.42.2(pid=16317): Launched 03:07:04.571078 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:05.074654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16319): Launched 03:07:05.366524 run osmo-stp_10.42.42.5(pid=16320): Launched 03:07:05.477098 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:05.982146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16322): Launched 03:07:06.093587 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:06.341801 run patchelf(pid=16323): Launched 03:07:06.504248 run osmo-stp_10.42.42.5(pid=16320): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16320)] 03:07:06.628322 run osmo-stp_10.42.42.5(pid=16320): stdout: | (launched: 2022-12-09_03:07:05.313001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:06.754423 run osmo-stp_10.42.42.5(pid=16320): stderr: | 20221209030705482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030705482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030705482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030705483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030705483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030705483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030705483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:06.880436 run osmo-stp_10.42.42.5(pid=16320): stdout: | (launched: 2022-12-09_03:07:05.313001) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:07.001175 run osmo-stp_10.42.42.5(pid=16320): stderr: | 20221209030705482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030705482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030705482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030705483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030705483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030705483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030705483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:07.143486 run patchelf(pid=16323): Terminating (SIGINT) 03:07:07.307979 run patchelf(pid=16323): Terminated: ok {rc=0} 03:07:07.426366 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16320): Process ended prematurely: osmo-stp_10.42.42.5(pid=16320) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16320)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:07:07.435076 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 03:07:07.461289 run osmo-hlr_10.42.42.2(pid=16317): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16317)] 03:07:07.507832 run osmo-hlr_10.42.42.2(pid=16317): stdout: | (launched: 2022-12-09_03:07:04.404078) 03:07:07.556190 run osmo-hlr_10.42.42.2(pid=16317): stderr: | 20221209030704579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030704579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030704579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030704579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030704579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030704579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030704591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030704602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030704602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030704602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:07.605179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16316): Terminating (SIGTERM) 03:07:07.644241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16319): Terminating (SIGTERM) 03:07:07.683334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16322): Terminating (SIGTERM) 03:07:07.722695 --- ParallelTerminationStrategy: PID 16316 died... 03:07:07.741547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16316): Terminated: ok {rc=0} 03:07:07.784847 --- ParallelTerminationStrategy: PID 16319 died... 03:07:07.803495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16319): Terminated: ok {rc=0} 03:07:07.846610 --- ParallelTerminationStrategy: PID 16322 died... 03:07:07.864902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16322): Terminated: ok {rc=0} 03:07:07.950247 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:07:09.259237 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:07:09.265995 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:07:09.295800 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 03:07:09.335531 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 03:07:09.424375 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:07:09.454351 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 03:07:09.494052 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 03:07:10.093979 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 03:07:10.143571 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:10.154942 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:07:10.224863 tst cs_paging_gprs_active.py: using LAC 18640 03:07:10.341084 tst cs_paging_gprs_active.py: using RAC 25 03:07:10.456904 tst cs_paging_gprs_active.py: using CellId 18640 03:07:10.582246 tst cs_paging_gprs_active.py: using BVCI 18641 03:07:10.698112 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:10.710292 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:10.721804 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:10.733304 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:10.744674 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:10.756210 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:10.767719 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:10.779056 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:10.790633 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:10.905327 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:11.020397 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:07:11.221616 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:07:11.520750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16327): Launched 03:07:11.781557 run iperf3-srv_10.42.42.10(pid=16328): Launched 03:07:11.893705 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:07:12.093567 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:07:12.393397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16329): Launched 03:07:12.652936 run iperf3-srv_10.42.42.10(pid=16330): Launched 03:07:12.765342 tst cs_paging_gprs_active.py:38: start network... 03:07:12.965683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:13.428522 run create_hlr_db(pid=16331): Launched 03:07:13.543994 bus /gobi_6: Setting Powered False 03:07:14.603549 run create_hlr_db(pid=16331): Terminated: ok {rc=0} 03:07:15.040004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16333): Launched 03:07:15.359568 run osmo-hlr_10.42.42.2(pid=16334): Launched 03:07:15.481213 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:16.048192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16336): Launched 03:07:16.366028 run osmo-stp_10.42.42.5(pid=16337): Launched 03:07:16.528543 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:17.256208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16339): Launched 03:07:17.370556 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:17.629727 run patchelf(pid=16340): Launched 03:07:17.797119 run osmo-stp_10.42.42.5(pid=16337): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16337)] 03:07:17.923863 run osmo-stp_10.42.42.5(pid=16337): stdout: | (launched: 2022-12-09_03:07:16.307133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:18.052326 run osmo-stp_10.42.42.5(pid=16337): stderr: | 20221209030716642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030716642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030716642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030716642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030716643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030716643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030716643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:18.181339 run osmo-stp_10.42.42.5(pid=16337): stdout: | (launched: 2022-12-09_03:07:16.307133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:18.305278 run osmo-stp_10.42.42.5(pid=16337): stderr: | 20221209030716642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030716642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030716642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030716642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030716643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030716643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030716643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:18.451170 run patchelf(pid=16340): Terminating (SIGINT) 03:07:18.619915 run patchelf(pid=16340): Terminated: ok {rc=0} 03:07:18.742267 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16337): Process ended prematurely: osmo-stp_10.42.42.5(pid=16337) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16337)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 03:07:18.751681 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:07:18.779162 run osmo-hlr_10.42.42.2(pid=16334): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16334)] 03:07:18.827043 run osmo-hlr_10.42.42.2(pid=16334): stdout: | (launched: 2022-12-09_03:07:15.301259) 03:07:18.876490 run osmo-hlr_10.42.42.2(pid=16334): stderr: | 20221209030715499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030715499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030715499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030715499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030715499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030715499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030715511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030715520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030715520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030715520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:18.926101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16327): Terminating (SIGTERM) 03:07:18.966081 run iperf3-srv_10.42.42.10(pid=16328): Terminating (SIGTERM) 03:07:19.005973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16329): Terminating (SIGTERM) 03:07:19.045978 run iperf3-srv_10.42.42.10(pid=16330): Terminating (SIGTERM) 03:07:19.085774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16333): Terminating (SIGTERM) 03:07:19.126079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16336): Terminating (SIGTERM) 03:07:19.166130 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16339): Terminating (SIGTERM) 03:07:19.206356 --- ParallelTerminationStrategy: PID 16327 died... 03:07:19.225437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16327): Terminated: ok {rc=0} 03:07:19.269844 --- ParallelTerminationStrategy: PID 16328 died... 03:07:19.288296 run iperf3-srv_10.42.42.10(pid=16328): Terminated {rc=256} 03:07:19.332719 --- ParallelTerminationStrategy: PID 16329 died... 03:07:19.351449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16329): Terminated: ok {rc=0} 03:07:19.395424 --- ParallelTerminationStrategy: PID 16330 died... 03:07:19.414164 run iperf3-srv_10.42.42.10(pid=16330): Terminated {rc=256} 03:07:19.458073 --- ParallelTerminationStrategy: PID 16333 died... 03:07:19.476898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16333): Terminated: ok {rc=0} 03:07:19.521008 --- ParallelTerminationStrategy: PID 16336 died... 03:07:19.540301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16336): Terminated: ok {rc=0} 03:07:19.584391 --- ParallelTerminationStrategy: PID 16339 died... 03:07:19.602987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16339): Terminated: ok {rc=0} 03:07:19.688185 bus /gobi_0: Setting Powered False 03:07:20.787228 bus /gobi_0: Setting Powered False 03:07:21.903862 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 03:07:23.050626 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:23.062425 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:07:23.128400 tst iperf3.py: using LAC 18641 03:07:23.244599 tst iperf3.py: using RAC 26 03:07:23.360857 tst iperf3.py: using CellId 18641 03:07:23.480167 tst iperf3.py: using BVCI 18642 03:07:23.587877 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:23.598961 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:23.609925 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:23.621165 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:23.632274 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:23.643271 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:23.654487 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:23.665500 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:23.676691 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:23.795151 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:07:24.010275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:07:24.330478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16341): Launched 03:07:24.608352 run iperf3-srv_10.42.42.10(pid=16342): Launched 03:07:24.727305 tst iperf3.py:8: start network... 03:07:24.941906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:25.437458 run create_hlr_db(pid=16343): Launched 03:07:25.567233 bus /gobi_6: Setting Powered False 03:07:26.630115 run create_hlr_db(pid=16343): Terminated: ok {rc=0} 03:07:27.055625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16345): Launched 03:07:27.353300 run osmo-hlr_10.42.42.2(pid=16346): Launched 03:07:27.466571 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:27.991401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16348): Launched 03:07:28.289357 run osmo-stp_10.42.42.5(pid=16349): Launched 03:07:28.403719 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:28.916751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16351): Launched 03:07:29.030685 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:29.282927 run patchelf(pid=16352): Launched 03:07:29.448482 run osmo-stp_10.42.42.5(pid=16349): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16349)] 03:07:29.574581 run osmo-stp_10.42.42.5(pid=16349): stdout: | (launched: 2022-12-09_03:07:28.234736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:29.702173 run osmo-stp_10.42.42.5(pid=16349): stderr: | 20221209030728403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030728403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030728404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030728404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030728404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030728405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030728405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:29.830244 run osmo-stp_10.42.42.5(pid=16349): stdout: | (launched: 2022-12-09_03:07:28.234736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:29.952879 run osmo-stp_10.42.42.5(pid=16349): stderr: | 20221209030728403 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030728403 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030728404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030728404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030728404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030728405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030728405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:30.097818 run patchelf(pid=16352): Terminating (SIGINT) 03:07:30.264716 run patchelf(pid=16352): Terminated: ok {rc=0} 03:07:30.385921 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16349): Process ended prematurely: osmo-stp_10.42.42.5(pid=16349) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16349)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 03:07:30.395297 tst iperf3.py:8: Test FAILED (7.4 sec) 03:07:30.423609 run osmo-hlr_10.42.42.2(pid=16346): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16346)] 03:07:30.471391 run osmo-hlr_10.42.42.2(pid=16346): stdout: | (launched: 2022-12-09_03:07:27.298723) 03:07:30.520861 run osmo-hlr_10.42.42.2(pid=16346): stderr: | 20221209030727475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030727475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030727475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030727475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030727476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030727476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030727489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030727498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030727498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030727498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:30.570613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16341): Terminating (SIGTERM) 03:07:30.610410 run iperf3-srv_10.42.42.10(pid=16342): Terminating (SIGTERM) 03:07:30.650462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16345): Terminating (SIGTERM) 03:07:30.690522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16348): Terminating (SIGTERM) 03:07:30.730590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16351): Terminating (SIGTERM) 03:07:30.771077 --- ParallelTerminationStrategy: PID 16341 died... 03:07:30.790081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16341): Terminated: ok {rc=0} 03:07:30.835344 --- ParallelTerminationStrategy: PID 16342 died... 03:07:30.854954 run iperf3-srv_10.42.42.10(pid=16342): Terminated {rc=256} 03:07:30.904676 --- ParallelTerminationStrategy: PID 16345 died... 03:07:30.925281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16345): Terminated: ok {rc=0} 03:07:30.971116 --- ParallelTerminationStrategy: PID 16348 died... 03:07:30.990326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16348): Terminated: ok {rc=0} 03:07:31.036171 --- ParallelTerminationStrategy: PID 16351 died... 03:07:31.055352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16351): Terminated: ok {rc=0} 03:07:31.141270 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 03:07:32.293268 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:32.307591 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:07:32.376523 tst iperf3m4.py: using LAC 18642 03:07:32.501538 tst iperf3m4.py: using RAC 27 03:07:32.618182 tst iperf3m4.py: using CellId 18642 03:07:32.733964 tst iperf3m4.py: using BVCI 18643 03:07:32.841653 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:32.852882 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:32.864002 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:32.875262 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:32.886660 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:32.897823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:32.908886 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:32.919950 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:32.931198 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:33.046535 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:33.169384 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:33.283495 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:33.403571 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:07:33.619956 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:07:33.940919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16353): Launched 03:07:34.218187 run iperf3-srv_10.42.42.10(pid=16354): Launched 03:07:34.337449 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:07:34.554162 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:07:34.875166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16355): Launched 03:07:35.153385 run iperf3-srv_10.42.42.10(pid=16356): Launched 03:07:35.272617 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:07:35.487019 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:07:35.807898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16361): Launched 03:07:36.085759 run iperf3-srv_10.42.42.10(pid=16362): Launched 03:07:36.204788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:07:36.420136 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:07:36.741213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16363): Launched 03:07:37.018043 run iperf3-srv_10.42.42.10(pid=16364): Launched 03:07:37.137484 tst iperf3m4.py:8: start network... 03:07:37.352321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:37.850702 run create_hlr_db(pid=16365): Launched 03:07:37.980020 bus /gobi_6: Setting Powered False 03:07:39.044023 run create_hlr_db(pid=16365): Terminated: ok {rc=0} 03:07:39.469686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16367): Launched 03:07:39.769159 run osmo-hlr_10.42.42.2(pid=16368): Launched 03:07:39.883054 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:40.419105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16371): Launched 03:07:40.717677 run osmo-stp_10.42.42.5(pid=16372): Launched 03:07:40.831169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:41.344122 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16374): Launched 03:07:41.458207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:41.710062 run patchelf(pid=16375): Launched 03:07:41.874855 run osmo-stp_10.42.42.5(pid=16372): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16372)] 03:07:42.000525 run osmo-stp_10.42.42.5(pid=16372): stdout: | (launched: 2022-12-09_03:07:40.662713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:42.127964 run osmo-stp_10.42.42.5(pid=16372): stderr: | 20221209030740830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030740830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030740831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030740831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030740832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030740832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030740832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:42.255298 run osmo-stp_10.42.42.5(pid=16372): stdout: | (launched: 2022-12-09_03:07:40.662713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:42.376904 run osmo-stp_10.42.42.5(pid=16372): stderr: | 20221209030740830 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030740830 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030740831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030740831 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030740832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030740832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030740832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:42.522175 run patchelf(pid=16375): Terminating (SIGINT) 03:07:42.689391 run patchelf(pid=16375): Terminated: ok {rc=0} 03:07:42.809630 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16372): Process ended prematurely: osmo-stp_10.42.42.5(pid=16372) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16372)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 03:07:42.819040 tst iperf3m4.py:8: Test FAILED (10.6 sec) 03:07:42.846858 run osmo-hlr_10.42.42.2(pid=16368): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16368)] 03:07:42.894191 run osmo-hlr_10.42.42.2(pid=16368): stdout: | (launched: 2022-12-09_03:07:39.714265) 03:07:42.943322 run osmo-hlr_10.42.42.2(pid=16368): stderr: | 20221209030739888 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030739888 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030739888 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030739888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030739888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030739888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030739901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030739909 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030739909 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030739909 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:42.992852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16353): Terminating (SIGTERM) 03:07:43.032714 run iperf3-srv_10.42.42.10(pid=16354): Terminating (SIGTERM) 03:07:43.072276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16355): Terminating (SIGTERM) 03:07:43.111834 run iperf3-srv_10.42.42.10(pid=16356): Terminating (SIGTERM) 03:07:43.151224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16361): Terminating (SIGTERM) 03:07:43.190748 run iperf3-srv_10.42.42.10(pid=16362): Terminating (SIGTERM) 03:07:43.230149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16363): Terminating (SIGTERM) 03:07:43.269655 run iperf3-srv_10.42.42.10(pid=16364): Terminating (SIGTERM) 03:07:43.309104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16367): Terminating (SIGTERM) 03:07:43.348495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16371): Terminating (SIGTERM) 03:07:43.387840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16374): Terminating (SIGTERM) 03:07:43.427547 --- ParallelTerminationStrategy: PID 16353 died... 03:07:43.446535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16353): Terminated: ok {rc=0} 03:07:43.490657 --- ParallelTerminationStrategy: PID 16354 died... 03:07:43.508814 run iperf3-srv_10.42.42.10(pid=16354): Terminated {rc=256} 03:07:43.552649 --- ParallelTerminationStrategy: PID 16355 died... 03:07:43.571087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16355): Terminated: ok {rc=0} 03:07:43.614927 --- ParallelTerminationStrategy: PID 16356 died... 03:07:43.633354 run iperf3-srv_10.42.42.10(pid=16356): Terminated {rc=256} 03:07:43.677269 --- ParallelTerminationStrategy: PID 16361 died... 03:07:43.695781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16361): Terminated: ok {rc=0} 03:07:43.739749 --- ParallelTerminationStrategy: PID 16362 died... 03:07:43.758251 run iperf3-srv_10.42.42.10(pid=16362): Terminated {rc=256} 03:07:43.802111 --- ParallelTerminationStrategy: PID 16363 died... 03:07:43.820773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16363): Terminated: ok {rc=0} 03:07:43.864894 --- ParallelTerminationStrategy: PID 16364 died... 03:07:43.883855 run iperf3-srv_10.42.42.10(pid=16364): Terminated {rc=256} 03:07:43.927730 --- ParallelTerminationStrategy: PID 16367 died... 03:07:43.946340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16367): Terminated: ok {rc=0} 03:07:43.990571 --- ParallelTerminationStrategy: PID 16371 died... 03:07:44.009166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16371): Terminated: ok {rc=0} 03:07:44.053288 --- ParallelTerminationStrategy: PID 16374 died... 03:07:44.071698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16374): Terminated: ok {rc=0} 03:07:44.158379 bus /gobi_4: Setting Powered False 03:07:45.256366 bus /gobi_4: Setting Powered False 03:07:46.371335 bus /gobi_1: Setting Powered False 03:07:47.471765 bus /gobi_1: Setting Powered False 03:07:48.587681 bus /gobi_0: Setting Powered False 03:07:49.684280 bus /gobi_0: Setting Powered False 03:07:50.800436 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 03:07:51.906237 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:51.918637 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:07:51.986317 tst ping.py: using LAC 18643 03:07:52.110495 tst ping.py: using RAC 28 03:07:52.234951 tst ping.py: using CellId 18643 03:07:52.359637 tst ping.py: using BVCI 18644 03:07:52.473622 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:52.485451 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:52.496839 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:52.508574 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:52.520038 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:52.531696 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:52.543343 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:52.554877 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:52.674714 tst ping.py:19: start network... 03:07:52.883500 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:53.366301 run create_hlr_db(pid=16376): Launched 03:07:53.492194 bus /gobi_6: Setting Powered False 03:07:54.555406 run create_hlr_db(pid=16376): Terminated: ok {rc=0} 03:07:54.974218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16378): Launched 03:07:55.266477 run osmo-hlr_10.42.42.2(pid=16379): Launched 03:07:55.378004 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:55.884123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16381): Launched 03:07:56.175696 run osmo-stp_10.42.42.5(pid=16382): Launched 03:07:56.287000 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:56.792592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16384): Launched 03:07:56.904092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:57.151380 run patchelf(pid=16385): Launched 03:07:57.313763 run osmo-stp_10.42.42.5(pid=16382): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16382)] 03:07:57.437425 run osmo-stp_10.42.42.5(pid=16382): stdout: | (launched: 2022-12-09_03:07:56.121905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:57.563189 run osmo-stp_10.42.42.5(pid=16382): stderr: | 20221209030756288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030756288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030756288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030756289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030756291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030756291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030756291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:57.688825 run osmo-stp_10.42.42.5(pid=16382): stdout: | (launched: 2022-12-09_03:07:56.121905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:57.808826 run osmo-stp_10.42.42.5(pid=16382): stderr: | 20221209030756288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030756288 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030756288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030756289 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030756291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030756291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030756291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:57.951019 run patchelf(pid=16385): Terminating (SIGINT) 03:07:58.114705 run patchelf(pid=16385): Terminated: ok {rc=0} 03:07:58.232634 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16382): Process ended prematurely: osmo-stp_10.42.42.5(pid=16382) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16382)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 03:07:58.241450 tst ping.py:22: Test FAILED (6.3 sec) 03:07:58.268215 run osmo-hlr_10.42.42.2(pid=16379): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16379)] 03:07:58.315463 run osmo-hlr_10.42.42.2(pid=16379): stdout: | (launched: 2022-12-09_03:07:55.212580) 03:07:58.364870 run osmo-hlr_10.42.42.2(pid=16379): stderr: | 20221209030755386 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030755386 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030755387 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030755387 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030755387 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030755387 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030755399 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030755407 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030755407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030755407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:58.414190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16378): Terminating (SIGTERM) 03:07:58.453710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16381): Terminating (SIGTERM) 03:07:58.493215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16384): Terminating (SIGTERM) 03:07:58.533242 --- ParallelTerminationStrategy: PID 16378 died... 03:07:58.552347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16378): Terminated: ok {rc=0} 03:07:58.597082 --- ParallelTerminationStrategy: PID 16381 died... 03:07:58.615535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16381): Terminated: ok {rc=0} 03:07:58.659701 --- ParallelTerminationStrategy: PID 16384 died... 03:07:58.677945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16384): Terminated: ok {rc=0} 03:07:58.760311 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 03:07:59.845301 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:59.857785 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:07:59.929063 tst ping_idle_ping.py: using LAC 18644 03:08:00.053019 tst ping_idle_ping.py: using RAC 29 03:08:00.177879 tst ping_idle_ping.py: using CellId 18644 03:08:00.300404 tst ping_idle_ping.py: using BVCI 18645 03:08:00.414471 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:08:00.426256 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:08:00.437761 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:08:00.449324 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:08:00.460643 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:08:00.472130 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:08:00.483726 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:08:00.495187 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:08:00.614800 tst ping_idle_ping.py:24: start network... 03:08:00.812284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:01.356864 run create_hlr_db(pid=16389): Launched 03:08:01.558623 bus /gobi_6: Setting Powered False 03:08:02.651262 run create_hlr_db(pid=16389): Terminated: ok {rc=0} 03:08:03.188128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16529): Launched 03:08:03.633695 run osmo-hlr_10.42.42.2(pid=16588): Launched 03:08:03.879390 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:04.596422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16660): Launched 03:08:04.933698 run osmo-stp_10.42.42.5(pid=16661): Launched 03:08:05.173366 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:08:05.855513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16663): Launched 03:08:05.983279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:08:06.249756 run patchelf(pid=16665): Launched 03:08:06.431314 run osmo-stp_10.42.42.5(pid=16661): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16661)] 03:08:06.568457 run osmo-stp_10.42.42.5(pid=16661): stdout: | (launched: 2022-12-09_03:08:04.867342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:06.707869 run osmo-stp_10.42.42.5(pid=16661): stderr: | 20221209030805198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030805198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030805198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030805199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030805199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030805199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030805199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:06.851118 run osmo-stp_10.42.42.5(pid=16661): stdout: | (launched: 2022-12-09_03:08:04.867342) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:06.983742 run osmo-stp_10.42.42.5(pid=16661): stderr: | 20221209030805198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030805198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030805198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030805199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030805199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030805199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030805199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:07.140092 run patchelf(pid=16665): Terminating (SIGINT) 03:08:07.318851 run patchelf(pid=16665): Terminated: ok {rc=0} 03:08:07.447251 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16661): Process ended prematurely: osmo-stp_10.42.42.5(pid=16661) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16661)] [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 03:08:07.457777 tst ping_idle_ping.py:27: Test FAILED (7.6 sec) 03:08:07.487838 run osmo-hlr_10.42.42.2(pid=16588): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16588)] 03:08:07.540494 run osmo-hlr_10.42.42.2(pid=16588): stdout: | (launched: 2022-12-09_03:08:03.563184) 03:08:07.593911 run osmo-hlr_10.42.42.2(pid=16588): stderr: | 20221209030803856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030803856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030803856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030803856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030803856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030803856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030803872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030803884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030803884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030803884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:07.647298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16529): Terminating (SIGTERM) 03:08:07.690373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16660): Terminating (SIGTERM) 03:08:07.734714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16663): Terminating (SIGTERM) 03:08:07.779513 --- ParallelTerminationStrategy: PID 16529 died... 03:08:07.800052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16529): Terminated: ok {rc=0} 03:08:07.848618 --- ParallelTerminationStrategy: PID 16660 died... 03:08:07.869159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16660): Terminated: ok {rc=0} 03:08:07.918153 --- ParallelTerminationStrategy: PID 16663 died... 03:08:07.938542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16663): Terminated: ok {rc=0} 03:08:08.027658 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:08:09.340847 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:09.349104 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:08:09.379928 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:08:09.416474 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:08:09.470816 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:08:09.502949 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:08:09.540582 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:08:10.102525 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:08:10.109568 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:08:10.122897 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:08:10.190779 tst switch_tch_pdch.py: using LAC 18645 03:08:10.317235 tst switch_tch_pdch.py: using RAC 30 03:08:10.443784 tst switch_tch_pdch.py: using CellId 18645 03:08:10.574458 tst switch_tch_pdch.py: using BVCI 18646 03:08:10.694718 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:08:10.709361 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:08:10.722265 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:08:10.735290 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:08:10.748685 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:08:10.762135 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:08:10.775945 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:08:10.788699 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:08:10.915235 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:08:11.040627 tst switch_tch_pdch.py:51: start network... 03:08:11.258362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:11.772526 run create_hlr_db(pid=16671): Launched 03:08:11.937679 bus /gobi_6: Setting Powered False 03:08:13.002085 run create_hlr_db(pid=16671): Terminated: ok {rc=0} 03:08:13.453911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16673): Launched 03:08:13.791100 run osmo-hlr_10.42.42.2(pid=16674): Launched 03:08:14.033052 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:14.684717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16676): Launched 03:08:15.022186 run osmo-stp_10.42.42.5(pid=16677): Launched 03:08:15.260453 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:08:15.937862 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16679): Launched 03:08:16.139000 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:08:16.426256 run patchelf(pid=16680): Launched 03:08:16.607609 run osmo-stp_10.42.42.5(pid=16677): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16677)] 03:08:16.735009 run osmo-stp_10.42.42.5(pid=16677): stdout: | (launched: 2022-12-09_03:08:14.961236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:16.864285 run osmo-stp_10.42.42.5(pid=16677): stderr: | 20221209030815254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030815254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030815255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030815255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030815255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030815256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030815256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:16.994145 run osmo-stp_10.42.42.5(pid=16677): stdout: | (launched: 2022-12-09_03:08:14.961236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:17.117189 run osmo-stp_10.42.42.5(pid=16677): stderr: | 20221209030815254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030815254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030815255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030815255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030815255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030815256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030815256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:17.263251 run patchelf(pid=16680): Terminating (SIGINT) 03:08:17.431895 run patchelf(pid=16680): Terminated: ok {rc=0} 03:08:17.554124 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16677): Process ended prematurely: osmo-stp_10.42.42.5(pid=16677) [trial-2353↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16677)] [trial-2353↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:08:17.564149 tst switch_tch_pdch.py:54: Test FAILED (7.4 sec) 03:08:17.594419 run osmo-hlr_10.42.42.2(pid=16674): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16674)] 03:08:17.644639 run osmo-hlr_10.42.42.2(pid=16674): stdout: | (launched: 2022-12-09_03:08:13.728514) 03:08:17.696921 run osmo-hlr_10.42.42.2(pid=16674): stderr: | 20221209030814034 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030814034 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030814034 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030814035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030814035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030814035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030814055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030814068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030814068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030814068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:17.749706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16673): Terminating (SIGTERM) 03:08:17.792909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16676): Terminating (SIGTERM) 03:08:17.836678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16679): Terminating (SIGTERM) 03:08:17.879876 --- ParallelTerminationStrategy: PID 16673 died... 03:08:17.900034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16673): Terminated: ok {rc=0} 03:08:17.948627 --- ParallelTerminationStrategy: PID 16676 died... 03:08:17.968096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16676): Terminated: ok {rc=0} 03:08:18.015826 --- ParallelTerminationStrategy: PID 16679 died... 03:08:18.035573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16679): Terminated: ok {rc=0} 03:08:18.133935 bus /gobi_0: Setting Powered False 03:08:19.246928 bus /gobi_0: Setting Powered False 03:08:20.365858 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 03:08:21.627348 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:21.633906 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 03:08:21.668312 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 03:08:21.706575 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 03:08:21.760362 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 03:08:21.791803 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 03:08:21.828722 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 03:08:22.384109 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 03:08:22.390953 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:08:22.403235 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 03:08:22.473965 tst switch_tch_pdch.py: using LAC 18646 03:08:22.595320 tst switch_tch_pdch.py: using RAC 31 03:08:22.716420 tst switch_tch_pdch.py: using CellId 18646 03:08:22.836597 tst switch_tch_pdch.py: using BVCI 18647 03:08:22.950066 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:08:22.962288 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:08:22.974346 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:08:22.987555 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:08:23.000090 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:08:23.013407 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:08:23.026770 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:08:23.040862 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:08:23.165234 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:08:23.286341 tst switch_tch_pdch.py:51: start network... 03:08:23.499740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:23.967164 run create_hlr_db(pid=16684): Launched 03:08:24.127946 bus /gobi_6: Setting Powered False 03:08:25.186477 run create_hlr_db(pid=16684): Terminated: ok {rc=0} 03:08:25.589158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16687): Launched 03:08:25.905697 run osmo-hlr_10.42.42.2(pid=16688): Launched 03:08:26.018948 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:26.509189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16690): Launched 03:08:26.800861 run osmo-stp_10.42.42.5(pid=16691): Launched 03:08:26.912872 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:08:27.393316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16693): Launched 03:08:27.505615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:08:27.752762 run patchelf(pid=16694): Launched 03:08:27.915027 run osmo-stp_10.42.42.5(pid=16691): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16691)] 03:08:28.038337 run osmo-stp_10.42.42.5(pid=16691): stdout: | (launched: 2022-12-09_03:08:26.746565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:28.163762 run osmo-stp_10.42.42.5(pid=16691): stderr: | 20221209030826919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030826919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030826919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030826920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030826920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030826920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030826920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:28.288932 run osmo-stp_10.42.42.5(pid=16691): stdout: | (launched: 2022-12-09_03:08:26.746565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:28.408628 run osmo-stp_10.42.42.5(pid=16691): stderr: | 20221209030826919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030826919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030826919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030826920 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030826920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030826920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030826920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:28.550752 run patchelf(pid=16694): Terminating (SIGINT) 03:08:28.714648 run patchelf(pid=16694): Terminated: ok {rc=0} 03:08:28.833199 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=16691): Process ended prematurely: osmo-stp_10.42.42.5(pid=16691) [trial-2353↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16691)] [trial-2353↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 03:08:28.841963 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 03:08:28.868686 run osmo-hlr_10.42.42.2(pid=16688): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16688)] 03:08:28.916383 run osmo-hlr_10.42.42.2(pid=16688): stdout: | (launched: 2022-12-09_03:08:25.844295) 03:08:28.965477 run osmo-hlr_10.42.42.2(pid=16688): stderr: | 20221209030826028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030826028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030826028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030826028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030826028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030826028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030826039 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030826047 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030826048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030826048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:29.014719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16687): Terminating (SIGTERM) 03:08:29.054173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16690): Terminating (SIGTERM) 03:08:29.093587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16693): Terminating (SIGTERM) 03:08:29.133498 --- ParallelTerminationStrategy: PID 16687 died... 03:08:29.152305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16687): Terminated: ok {rc=0} 03:08:29.196567 --- ParallelTerminationStrategy: PID 16690 died... 03:08:29.215004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16690): Terminated: ok {rc=0} 03:08:29.258654 --- ParallelTerminationStrategy: PID 16693 died... 03:08:29.276876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16693): Terminated: ok {rc=0} 03:08:29.362961 bus /gobi_0: Setting Powered False 03:08:30.463836 bus /gobi_0: Setting Powered False 03:08:31.585316 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_sms:nanobts --------------------------------------------------------------------- 03:08:32.840582 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:32.844453 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 03:08:32.868646 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 03:08:32.876440 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 03:08:32.931983 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 03:08:32.957696 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 03:08:32.964814 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 03:08:33.496669 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 03:08:33.503742 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 03:08:33.516667 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 03:08:33.556105 tst mo_mt_sms.py: using LAC 18647 03:08:33.671825 tst mo_mt_sms.py: using RAC 32 03:08:33.789494 tst mo_mt_sms.py: using CellId 18647 03:08:33.907471 tst mo_mt_sms.py: using BVCI 18648 03:08:34.014745 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 03:08:34.132886 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 03:08:34.247785 tst mo_mt_sms.py:9: start nitb and bts... 03:08:34.443402 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:08:35.043095 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16698): Launched 03:08:35.334549 run osmo-nitb_10.42.42.2(pid=16699): Launched 03:08:35.496823 run osmo-nitb_10.42.42.2(pid=16699): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16699)] 03:08:35.628923 run osmo-nitb_10.42.42.2(pid=16699): stdout: | (launched: 2022-12-09_03:08:35.280698) 03:08:35.761840 run osmo-nitb_10.42.42.2(pid=16699): stderr: | (launched: 2022-12-09_03:08:35.324195) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:08:35.906751 run osmo-nitb_10.42.42.2(pid=16699): stdout: | (launched: 2022-12-09_03:08:35.280698) 03:08:36.044158 run osmo-nitb_10.42.42.2(pid=16699): stderr: | (launched: 2022-12-09_03:08:35.324195) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16699): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16699) [trial-2353↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16699)] 03:08:36.445123 tst osmo-nitb_10.42.42.2(pid=16699): stdout: | (launched: 2022-12-09_03:08:35.280698) 03:08:36.571815 tst osmo-nitb_10.42.42.2(pid=16699): stderr: | (launched: 2022-12-09_03:08:35.324195) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:08:36.721259 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=16699): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16699) [trial-2353↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16699)] [trial-2353↪nitb_sms:nanobts↪mo_mt_sms.py:11] 03:08:36.730497 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 03:08:36.737721 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16698): Terminating (SIGTERM) 03:08:36.948434 --- ParallelTerminationStrategy: PID 16698 died... 03:08:36.969808 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16698): Terminated: ok {rc=0} 03:08:37.055641 bus /sierra_3: Setting Powered False 03:08:38.155332 bus /sierra_3: Setting Powered False 03:08:39.272290 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 sms:nanobts+band-1900 --------------------------------------------------------------------- 03:08:40.460502 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:40.465992 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:08:40.490563 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 03:08:40.518188 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 03:08:40.571009 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:08:40.595681 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 03:08:40.623088 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 03:08:41.172080 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 03:08:41.177623 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:41.188930 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:08:41.228335 tst mo_mt_sms.py: using LAC 18648 03:08:41.351500 tst mo_mt_sms.py: using RAC 33 03:08:41.474582 tst mo_mt_sms.py: using CellId 18648 03:08:41.600007 tst mo_mt_sms.py: using BVCI 18649 03:08:41.714186 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:41.725378 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:41.736337 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:41.747644 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:41.758841 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:41.770021 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 03:08:41.883863 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 03:08:42.001247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:42.487878 run create_hlr_db(pid=16703): Launched 03:08:42.615606 bus /sierra_2: Setting Powered False 03:08:43.676596 run create_hlr_db(pid=16703): Terminated: ok {rc=0} 03:08:44.096735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16705): Launched 03:08:44.388932 run osmo-hlr_10.42.42.2(pid=16706): Launched 03:08:44.502050 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:45.016801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16708): Launched 03:08:45.308221 run osmo-stp_10.42.42.5(pid=16709): Launched 03:08:45.419717 run osmo-msc_10.42.42.6: Starting osmo-msc 03:08:45.978219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16711): Launched 03:08:46.288558 run osmo-msc_10.42.42.6(pid=16712): Launched 03:08:46.679312 run osmo-stp_10.42.42.5(pid=16709): ERR: Terminated: ERROR {rc=1} [trial-2353↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16709)] 03:08:46.909487 run osmo-stp_10.42.42.5(pid=16709): stdout: | (launched: 2022-12-09_03:08:45.254168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:47.119672 run osmo-stp_10.42.42.5(pid=16709): stderr: | 20221209030845423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030845423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030845424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030845424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030845424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030845425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030845425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:47.245254 run osmo-stp_10.42.42.5(pid=16709): stdout: | (launched: 2022-12-09_03:08:45.254168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:47.363789 run osmo-stp_10.42.42.5(pid=16709): stderr: | 20221209030845423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030845423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030845424 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030845424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030845424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030845425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030845425 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:47.503896 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=16709): Process ended prematurely: osmo-stp_10.42.42.5(pid=16709) [trial-2353↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16709)] [trial-2353↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 03:08:47.512459 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 03:08:47.539121 run osmo-hlr_10.42.42.2(pid=16706): ERR: Terminated: ERROR {rc=237} [trial-2353↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16706)] 03:08:47.587137 run osmo-hlr_10.42.42.2(pid=16706): stdout: | (launched: 2022-12-09_03:08:44.335069) 03:08:47.636923 run osmo-hlr_10.42.42.2(pid=16706): stderr: | 20221209030844511 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030844511 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030844511 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030844511 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030844512 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030844512 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030844523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030844532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030844532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030844532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:47.706301 run osmo-msc_10.42.42.6(pid=16712): ERR: Terminated: ERROR {rc=2} [trial-2353↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16712)] 03:08:47.754273 run osmo-msc_10.42.42.6(pid=16712): stdout: | (launched: 2022-12-09_03:08:46.224010) 03:08:47.803641 run osmo-msc_10.42.42.6(pid=16712): stderr: | 20221209030846672 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030846672 DLGLOBAL DEBUG validating counter group 0x7fed3e828c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030846672 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030846672 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030846681 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030846681 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030846683 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030846683 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030846683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030846683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:08:47.853614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16705): Terminating (SIGTERM) 03:08:47.893771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16708): Terminating (SIGTERM) 03:08:47.933836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16711): Terminating (SIGTERM) 03:08:47.974164 --- ParallelTerminationStrategy: PID 16705 died... 03:08:47.993291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16705): Terminated: ok {rc=0} 03:08:48.038109 --- ParallelTerminationStrategy: PID 16708 died... 03:08:48.056870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16708): Terminated: ok {rc=0} 03:08:48.101242 --- ParallelTerminationStrategy: PID 16711 died... 03:08:48.119950 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16711): Terminated: ok {rc=0} 03:08:48.206553 bus /sierra_3: Setting Powered False 03:08:49.306767 bus /sierra_3: Setting Powered False 03:08:50.419631 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 03:08:51.637586 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:51.642268 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:08:51.665672 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 03:08:51.673722 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 03:08:51.710358 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:08:51.734415 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 03:08:51.741035 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 03:08:52.258854 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2353 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 03:08:52.264015 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 03:08:52.274910 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:08:52.312518 tst assert_extension.py: using LAC 18649 03:08:52.427212 tst assert_extension.py: using RAC 34 03:08:52.548366 tst assert_extension.py: using CellId 18649 03:08:52.663283 tst assert_extension.py: using BVCI 18650 03:08:52.769229 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 03:08:52.886956 tst assert_extension.py:10: start nitb and bts... 03:08:53.099246 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:08:53.738213 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16717): Launched 03:08:54.050755 run osmo-nitb_10.42.42.2(pid=16718): Launched 03:08:54.224489 run osmo-nitb_10.42.42.2(pid=16718): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16718)] 03:08:54.365561 run osmo-nitb_10.42.42.2(pid=16718): stdout: | (launched: 2022-12-09_03:08:53.993715) 03:08:54.507741 run osmo-nitb_10.42.42.2(pid=16718): stderr: | (launched: 2022-12-09_03:08:54.040198) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:08:54.650516 run osmo-nitb_10.42.42.2(pid=16718): stdout: | (launched: 2022-12-09_03:08:53.993715) 03:08:54.787953 run osmo-nitb_10.42.42.2(pid=16718): stderr: | (launched: 2022-12-09_03:08:54.040198) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=16718): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16718) [trial-2353↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16718)] 03:08:55.169444 tst osmo-nitb_10.42.42.2(pid=16718): stdout: | (launched: 2022-12-09_03:08:53.993715) 03:08:55.295145 tst osmo-nitb_10.42.42.2(pid=16718): stderr: | (launched: 2022-12-09_03:08:54.040198) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:08:55.444248 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=16718): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16718) [trial-2353↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16718)] [trial-2353↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 03:08:55.453482 tst assert_extension.py:12: Test FAILED (3.2 sec) 03:08:55.460579 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16717): Terminating (SIGTERM) 03:08:55.671336 --- ParallelTerminationStrategy: PID 16717 died... 03:08:55.692917 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=16717): Terminated: ok {rc=0} 03:08:55.780215 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 ussd:nanobts+band-1900 --------------------------------------------------------------------- 03:08:56.949402 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:56.954886 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:08:56.979564 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 03:08:57.007104 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 03:08:57.043657 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:08:57.068289 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 03:08:57.095945 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 03:08:57.627191 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2353 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 03:08:57.632740 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:57.644151 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:08:57.683841 tst assert_extension.py: using LAC 18650 03:08:57.809661 tst assert_extension.py: using RAC 35 03:08:57.934489 tst assert_extension.py: using CellId 18650 03:08:58.060372 tst assert_extension.py: using BVCI 18651 03:08:58.174768 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:58.185973 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:58.197033 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:58.208147 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:58.219351 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:58.230593 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 03:08:58.343468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:58.798452 run create_hlr_db(pid=16723): Launched 03:08:58.910204 bus /sierra_2: Setting Powered False 03:08:59.969578 run create_hlr_db(pid=16723): Terminated: ok {rc=0} 03:09:00.398517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16725): Launched 03:09:00.713384 run osmo-hlr_10.42.42.2(pid=16726): Launched 03:09:00.849671 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:01.495629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16728): Launched 03:09:01.832045 run osmo-stp_10.42.42.5(pid=16729): Launched 03:09:02.083459 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:02.693193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16731): Launched 03:09:03.006075 run osmo-msc_10.42.42.6(pid=16732): Launched 03:09:03.181267 run osmo-stp_10.42.42.5(pid=16729): ERR: Terminated: ERROR {rc=1} [trial-2353↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16729)] 03:09:03.313470 run osmo-stp_10.42.42.5(pid=16729): stdout: | (launched: 2022-12-09_03:09:01.765889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:03.445763 run osmo-stp_10.42.42.5(pid=16729): stderr: | 20221209030902059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030902060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030902060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030902060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030902061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030902061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030902061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:03.578067 run osmo-stp_10.42.42.5(pid=16729): stdout: | (launched: 2022-12-09_03:09:01.765889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:03.703276 run osmo-stp_10.42.42.5(pid=16729): stderr: | 20221209030902059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030902060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030902060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030902060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030902061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030902061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030902061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:03.852662 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=16729): Process ended prematurely: osmo-stp_10.42.42.5(pid=16729) [trial-2353↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16729)] [trial-2353↪ussd:nanobts+band-1900↪assert_extension.py:17] 03:09:03.861655 tst assert_extension.py:17: Test FAILED (6.2 sec) 03:09:03.889376 run osmo-hlr_10.42.42.2(pid=16726): ERR: Terminated: ERROR {rc=237} [trial-2353↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16726)] 03:09:03.939317 run osmo-hlr_10.42.42.2(pid=16726): stdout: | (launched: 2022-12-09_03:09:00.655819) 03:09:03.991001 run osmo-hlr_10.42.42.2(pid=16726): stderr: | 20221209030900860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030900860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030900860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030900860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030900860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030900860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030900882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030900899 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030900899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030900899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:04.062670 run osmo-msc_10.42.42.6(pid=16732): ERR: Terminated: ERROR {rc=2} [trial-2353↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16732)] 03:09:04.112576 run osmo-msc_10.42.42.6(pid=16732): stdout: | (launched: 2022-12-09_03:09:02.948611) 03:09:04.163959 run osmo-msc_10.42.42.6(pid=16732): stderr: | 20221209030903268 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030903269 DLGLOBAL DEBUG validating counter group 0x7f45781fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030903269 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030903269 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030903269 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030903269 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030903271 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030903271 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030903271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030903272 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:04.215527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16725): Terminating (SIGTERM) 03:09:04.256891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16728): Terminating (SIGTERM) 03:09:04.298142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16731): Terminating (SIGTERM) 03:09:04.339723 --- ParallelTerminationStrategy: PID 16725 died... 03:09:04.359470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16725): Terminated: ok {rc=0} 03:09:04.405508 --- ParallelTerminationStrategy: PID 16728 died... 03:09:04.424691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16728): Terminated: ok {rc=0} 03:09:04.470714 --- ParallelTerminationStrategy: PID 16731 died... 03:09:04.490110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16731): Terminated: ok {rc=0} 03:09:04.576809 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:09:05.779363 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:09:05.787625 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:09:05.811858 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:09:05.838815 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:09:05.890859 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:09:05.915520 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:09:05.942559 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:09:06.492266 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:09:06.541175 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:09:06.552417 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:09:06.611273 tst mo_mt_call.py: using LAC 18651 03:09:06.729954 tst mo_mt_call.py: using RAC 36 03:09:06.849113 tst mo_mt_call.py: using CellId 18651 03:09:06.966329 tst mo_mt_call.py: using BVCI 18652 03:09:07.076839 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:09:07.088140 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:09:07.099175 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:09:07.110413 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:09:07.121908 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:09:07.133192 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:09:07.250964 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:09:07.370897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:07.867670 run create_hlr_db(pid=16737): Launched 03:09:07.997592 bus /sierra_2: Setting Powered False 03:09:09.060902 run create_hlr_db(pid=16737): Terminated: ok {rc=0} 03:09:09.486830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16739): Launched 03:09:09.806831 run osmo-hlr_10.42.42.2(pid=16740): Launched 03:09:09.928886 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:10.482719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16742): Launched 03:09:10.801691 run osmo-stp_10.42.42.5(pid=16743): Launched 03:09:10.922664 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:11.499806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16745): Launched 03:09:11.820280 run osmo-msc_10.42.42.6(pid=16746): Launched 03:09:11.998873 run osmo-stp_10.42.42.5(pid=16743): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16743)] 03:09:12.137744 run osmo-stp_10.42.42.5(pid=16743): stdout: | (launched: 2022-12-09_03:09:10.743631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:12.272645 run osmo-stp_10.42.42.5(pid=16743): stderr: | 20221209030910936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030910936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030910937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030910937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030910938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030910938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030910938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:12.407201 run osmo-stp_10.42.42.5(pid=16743): stdout: | (launched: 2022-12-09_03:09:10.743631) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:12.535016 run osmo-stp_10.42.42.5(pid=16743): stderr: | 20221209030910936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030910936 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030910937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030910937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030910938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030910938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030910938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:12.688317 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16743): Process ended prematurely: osmo-stp_10.42.42.5(pid=16743) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16743)] [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:09:12.698119 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:09:12.726069 run osmo-hlr_10.42.42.2(pid=16740): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16740)] 03:09:12.776245 run osmo-hlr_10.42.42.2(pid=16740): stdout: | (launched: 2022-12-09_03:09:09.748368) 03:09:12.827949 run osmo-hlr_10.42.42.2(pid=16740): stderr: | 20221209030909947 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030909947 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030909947 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030909947 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030909947 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030909947 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030909962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030909972 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030909972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030909972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:12.899995 run osmo-msc_10.42.42.6(pid=16746): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16746)] 03:09:12.949871 run osmo-msc_10.42.42.6(pid=16746): stdout: | (launched: 2022-12-09_03:09:11.761764) 03:09:13.000799 run osmo-msc_10.42.42.6(pid=16746): stderr: | 20221209030912083 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030912083 DLGLOBAL DEBUG validating counter group 0x7f5387983c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030912083 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030912083 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030912083 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030912083 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030912085 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030912086 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030912086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030912086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:13.052203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16739): Terminating (SIGTERM) 03:09:13.093531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16742): Terminating (SIGTERM) 03:09:13.134968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16745): Terminating (SIGTERM) 03:09:13.176889 --- ParallelTerminationStrategy: PID 16739 died... 03:09:13.197029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16739): Terminated: ok {rc=0} 03:09:13.243167 --- ParallelTerminationStrategy: PID 16742 died... 03:09:13.262647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16742): Terminated: ok {rc=0} 03:09:13.308683 --- ParallelTerminationStrategy: PID 16745 died... 03:09:13.328307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16745): Terminated: ok {rc=0} 03:09:13.416372 bus /sierra_3: Setting Powered False 03:09:14.514067 bus /sierra_3: Setting Powered False 03:09:15.629580 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:09:16.774690 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:09:16.787829 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:09:16.855302 tst mo_mt_call_osmux.py: using LAC 18652 03:09:17.015595 tst mo_mt_call_osmux.py: using RAC 37 03:09:17.181352 tst mo_mt_call_osmux.py: using CellId 18652 03:09:17.311749 tst mo_mt_call_osmux.py: using BVCI 18653 03:09:17.423552 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:09:17.434865 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:09:17.446027 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:09:17.457772 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:09:17.469739 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:09:17.481665 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:09:17.597776 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:09:17.716696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:18.214037 run create_hlr_db(pid=16748): Launched 03:09:18.343295 bus /sierra_2: Setting Powered False 03:09:19.406962 run create_hlr_db(pid=16748): Terminated: ok {rc=0} 03:09:19.833512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16750): Launched 03:09:20.131789 run osmo-hlr_10.42.42.2(pid=16751): Launched 03:09:20.245941 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:20.775798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16753): Launched 03:09:21.073716 run osmo-stp_10.42.42.5(pid=16754): Launched 03:09:21.188310 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:21.729499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16756): Launched 03:09:22.029030 run osmo-msc_10.42.42.6(pid=16757): Launched 03:09:22.197211 run osmo-stp_10.42.42.5(pid=16754): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16754)] 03:09:22.323889 run osmo-stp_10.42.42.5(pid=16754): stdout: | (launched: 2022-12-09_03:09:21.018949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:22.450731 run osmo-stp_10.42.42.5(pid=16754): stderr: | 20221209030921191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030921191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030921191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030921191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030921192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030921192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030921192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:22.574796 run osmo-stp_10.42.42.5(pid=16754): stdout: | (launched: 2022-12-09_03:09:21.018949) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:22.693756 run osmo-stp_10.42.42.5(pid=16754): stderr: | 20221209030921191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030921191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030921191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030921191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030921192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030921192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030921192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:22.836237 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16754): Process ended prematurely: osmo-stp_10.42.42.5(pid=16754) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16754)] [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:09:22.845216 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:09:22.871990 run osmo-hlr_10.42.42.2(pid=16751): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16751)] 03:09:22.919492 run osmo-hlr_10.42.42.2(pid=16751): stdout: | (launched: 2022-12-09_03:09:20.076783) 03:09:22.969066 run osmo-hlr_10.42.42.2(pid=16751): stderr: | 20221209030920254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030920254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030920254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030920254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030920254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030920254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030920266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030920275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030920275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030920275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:23.037527 run osmo-msc_10.42.42.6(pid=16757): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16757)] 03:09:23.084735 run osmo-msc_10.42.42.6(pid=16757): stdout: | (launched: 2022-12-09_03:09:21.973696) 03:09:23.133832 run osmo-msc_10.42.42.6(pid=16757): stderr: | 20221209030922244 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030922244 DLGLOBAL DEBUG validating counter group 0x7f849af0bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030922244 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030922244 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030922244 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030922245 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030922246 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030922247 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030922247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030922247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:23.183223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16750): Terminating (SIGTERM) 03:09:23.222778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16753): Terminating (SIGTERM) 03:09:23.262568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16756): Terminating (SIGTERM) 03:09:23.302245 --- ParallelTerminationStrategy: PID 16750 died... 03:09:23.321167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16750): Terminated: ok {rc=0} 03:09:23.365682 --- ParallelTerminationStrategy: PID 16753 died... 03:09:23.383874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16753): Terminated: ok {rc=0} 03:09:23.427772 --- ParallelTerminationStrategy: PID 16756 died... 03:09:23.446141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16756): Terminated: ok {rc=0} 03:09:23.529528 bus /sierra_3: Setting Powered False 03:09:24.625231 bus /sierra_3: Setting Powered False 03:09:25.740135 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:09:26.981550 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:09:26.989170 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:09:27.013302 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:09:27.040195 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:09:27.091540 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:09:27.114922 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:09:27.141442 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:09:27.693319 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:09:27.741281 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:27.752400 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:09:27.811005 tst mo_mt_call.py: using LAC 18653 03:09:27.929355 tst mo_mt_call.py: using RAC 38 03:09:28.048650 tst mo_mt_call.py: using CellId 18653 03:09:28.165637 tst mo_mt_call.py: using BVCI 18654 03:09:28.283313 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:28.295255 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:28.307112 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:28.319019 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:28.331179 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:28.343259 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:09:28.459829 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:09:28.578720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:29.073593 run create_hlr_db(pid=16762): Launched 03:09:29.202322 bus /sierra_2: Setting Powered False 03:09:30.263017 run create_hlr_db(pid=16762): Terminated: ok {rc=0} 03:09:30.706412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16764): Launched 03:09:31.044671 run osmo-hlr_10.42.42.2(pid=16765): Launched 03:09:31.185148 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:31.844016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16767): Launched 03:09:32.179363 run osmo-stp_10.42.42.5(pid=16768): Launched 03:09:32.317792 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:32.930341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16770): Launched 03:09:33.229552 run osmo-msc_10.42.42.6(pid=16771): Launched 03:09:33.398126 run osmo-stp_10.42.42.5(pid=16768): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16768)] 03:09:33.525075 run osmo-stp_10.42.42.5(pid=16768): stdout: | (launched: 2022-12-09_03:09:32.119379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:33.652529 run osmo-stp_10.42.42.5(pid=16768): stderr: | 20221209030932488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030932488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030932488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030932501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030932501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030932501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030932501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:33.776899 run osmo-stp_10.42.42.5(pid=16768): stdout: | (launched: 2022-12-09_03:09:32.119379) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:33.895463 run osmo-stp_10.42.42.5(pid=16768): stderr: | 20221209030932488 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030932488 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030932488 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030932501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030932501 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030932501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030932501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:34.037957 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16768): Process ended prematurely: osmo-stp_10.42.42.5(pid=16768) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16768)] [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:09:34.046784 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:09:34.073338 run osmo-hlr_10.42.42.2(pid=16765): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16765)] 03:09:34.120679 run osmo-hlr_10.42.42.2(pid=16765): stdout: | (launched: 2022-12-09_03:09:30.982694) 03:09:34.169842 run osmo-hlr_10.42.42.2(pid=16765): stderr: | 20221209030931338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030931338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030931339 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030931339 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030931339 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030931339 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030931355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030931365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030931365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030931365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:34.238338 run osmo-msc_10.42.42.6(pid=16771): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16771)] 03:09:34.285711 run osmo-msc_10.42.42.6(pid=16771): stdout: | (launched: 2022-12-09_03:09:33.174361) 03:09:34.334589 run osmo-msc_10.42.42.6(pid=16771): stderr: | 20221209030933446 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030933446 DLGLOBAL DEBUG validating counter group 0x7f4e6a296c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030933446 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030933446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030933446 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030933447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030933449 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030933449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030933449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030933449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:34.383931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16764): Terminating (SIGTERM) 03:09:34.423313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16767): Terminating (SIGTERM) 03:09:34.462779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16770): Terminating (SIGTERM) 03:09:34.502627 --- ParallelTerminationStrategy: PID 16764 died... 03:09:34.521333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16764): Terminated: ok {rc=0} 03:09:34.565258 --- ParallelTerminationStrategy: PID 16767 died... 03:09:34.583557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16767): Terminated: ok {rc=0} 03:09:34.627122 --- ParallelTerminationStrategy: PID 16770 died... 03:09:34.645489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16770): Terminated: ok {rc=0} 03:09:34.728618 bus /sierra_3: Setting Powered False 03:09:35.825991 bus /sierra_3: Setting Powered False 03:09:36.942144 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:09:38.090623 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:38.103096 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:09:38.164618 tst mo_mt_call_osmux.py: using LAC 18654 03:09:38.290434 tst mo_mt_call_osmux.py: using RAC 39 03:09:38.415491 tst mo_mt_call_osmux.py: using CellId 18654 03:09:38.533358 tst mo_mt_call_osmux.py: using BVCI 18655 03:09:38.642101 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:38.653566 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:38.664621 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:38.676155 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:38.687488 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:38.698728 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:09:38.818163 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:09:38.935566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:39.398631 run create_hlr_db(pid=16773): Launched 03:09:39.512047 bus /sierra_2: Setting Powered False 03:09:40.572209 run create_hlr_db(pid=16773): Terminated: ok {rc=0} 03:09:40.987913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16775): Launched 03:09:41.286249 run osmo-hlr_10.42.42.2(pid=16776): Launched 03:09:41.401041 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:41.927062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16778): Launched 03:09:42.224415 run osmo-stp_10.42.42.5(pid=16779): Launched 03:09:42.338355 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:42.878561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16781): Launched 03:09:43.176794 run osmo-msc_10.42.42.6(pid=16782): Launched 03:09:43.344090 run osmo-stp_10.42.42.5(pid=16779): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16779)] 03:09:43.471890 run osmo-stp_10.42.42.5(pid=16779): stdout: | (launched: 2022-12-09_03:09:42.169828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:43.599448 run osmo-stp_10.42.42.5(pid=16779): stderr: | 20221209030942340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030942340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030942340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030942340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030942341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030942341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030942341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:43.723699 run osmo-stp_10.42.42.5(pid=16779): stdout: | (launched: 2022-12-09_03:09:42.169828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:43.842877 run osmo-stp_10.42.42.5(pid=16779): stderr: | 20221209030942340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030942340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030942340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030942340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030942341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030942341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030942341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:43.985483 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16779): Process ended prematurely: osmo-stp_10.42.42.5(pid=16779) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16779)] [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:09:43.994421 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 03:09:44.020990 run osmo-hlr_10.42.42.2(pid=16776): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16776)] 03:09:44.069353 run osmo-hlr_10.42.42.2(pid=16776): stdout: | (launched: 2022-12-09_03:09:41.231396) 03:09:44.118661 run osmo-hlr_10.42.42.2(pid=16776): stderr: | 20221209030941408 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030941408 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030941408 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030941408 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030941408 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030941408 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030941420 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030941429 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030941429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030941429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:44.187270 run osmo-msc_10.42.42.6(pid=16782): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16782)] 03:09:44.234787 run osmo-msc_10.42.42.6(pid=16782): stdout: | (launched: 2022-12-09_03:09:43.122033) 03:09:44.283917 run osmo-msc_10.42.42.6(pid=16782): stderr: | 20221209030943392 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030943392 DLGLOBAL DEBUG validating counter group 0x7fa297c9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030943392 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030943392 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030943392 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030943393 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030943396 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030943397 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030943397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030943397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:44.333385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16775): Terminating (SIGTERM) 03:09:44.372917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16778): Terminating (SIGTERM) 03:09:44.412489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16781): Terminating (SIGTERM) 03:09:44.452000 --- ParallelTerminationStrategy: PID 16775 died... 03:09:44.470994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16775): Terminated: ok {rc=0} 03:09:44.514958 --- ParallelTerminationStrategy: PID 16778 died... 03:09:44.533563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16778): Terminated: ok {rc=0} 03:09:44.577398 --- ParallelTerminationStrategy: PID 16781 died... 03:09:44.596011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16781): Terminated: ok {rc=0} 03:09:44.679515 bus /sierra_3: Setting Powered False 03:09:45.774738 bus /sierra_3: Setting Powered False 03:09:46.892348 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:09:48.145360 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:09:48.153366 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:09:48.178407 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:09:48.206056 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:09:48.260085 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:09:48.285083 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:09:48.312822 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:09:48.864301 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:09:48.915937 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:48.927839 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:09:48.989119 tst mo_mt_call.py: using LAC 18655 03:09:49.116243 tst mo_mt_call.py: using RAC 40 03:09:49.242223 tst mo_mt_call.py: using CellId 18655 03:09:49.369098 tst mo_mt_call.py: using BVCI 18656 03:09:49.486344 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:49.498259 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:49.509679 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:49.521331 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:49.533377 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:49.544891 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:09:49.661371 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:09:49.778505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:50.241638 run create_hlr_db(pid=16787): Launched 03:09:50.355686 bus /sierra_2: Setting Powered False 03:09:51.415917 run create_hlr_db(pid=16787): Terminated: ok {rc=0} 03:09:51.830687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16789): Launched 03:09:52.129788 run osmo-hlr_10.42.42.2(pid=16790): Launched 03:09:52.243769 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:52.755887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16792): Launched 03:09:53.053302 run osmo-stp_10.42.42.5(pid=16793): Launched 03:09:53.166900 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:53.707318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16795): Launched 03:09:54.005699 run osmo-msc_10.42.42.6(pid=16796): Launched 03:09:54.173207 run osmo-stp_10.42.42.5(pid=16793): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16793)] 03:09:54.300013 run osmo-stp_10.42.42.5(pid=16793): stdout: | (launched: 2022-12-09_03:09:52.998540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:54.426874 run osmo-stp_10.42.42.5(pid=16793): stderr: | 20221209030953167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030953167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030953168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030953168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030953170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030953171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030953171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:54.551614 run osmo-stp_10.42.42.5(pid=16793): stdout: | (launched: 2022-12-09_03:09:52.998540) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:54.670549 run osmo-stp_10.42.42.5(pid=16793): stderr: | 20221209030953167 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209030953167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209030953168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209030953168 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209030953170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209030953171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209030953171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:54.812919 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16793): Process ended prematurely: osmo-stp_10.42.42.5(pid=16793) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16793)] [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:09:54.821853 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 03:09:54.848580 run osmo-hlr_10.42.42.2(pid=16790): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16790)] 03:09:54.896196 run osmo-hlr_10.42.42.2(pid=16790): stdout: | (launched: 2022-12-09_03:09:52.073891) 03:09:54.945208 run osmo-hlr_10.42.42.2(pid=16790): stderr: | 20221209030952250 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209030952250 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209030952250 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209030952250 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209030952250 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209030952251 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209030952434 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209030952443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209030952443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209030952443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:55.013984 run osmo-msc_10.42.42.6(pid=16796): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16796)] 03:09:55.061386 run osmo-msc_10.42.42.6(pid=16796): stdout: | (launched: 2022-12-09_03:09:53.950637) 03:09:55.110380 run osmo-msc_10.42.42.6(pid=16796): stderr: | 20221209030954220 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209030954220 DLGLOBAL DEBUG validating counter group 0x7f66149a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209030954220 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209030954220 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209030954220 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209030954221 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209030954223 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209030954223 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209030954223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209030954224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:55.159786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16789): Terminating (SIGTERM) 03:09:55.199187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16792): Terminating (SIGTERM) 03:09:55.238687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16795): Terminating (SIGTERM) 03:09:55.278589 --- ParallelTerminationStrategy: PID 16789 died... 03:09:55.297527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16789): Terminated: ok {rc=0} 03:09:55.341455 --- ParallelTerminationStrategy: PID 16792 died... 03:09:55.359904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16792): Terminated: ok {rc=0} 03:09:55.404152 --- ParallelTerminationStrategy: PID 16795 died... 03:09:55.422484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16795): Terminated: ok {rc=0} 03:09:55.506907 bus /sierra_3: Setting Powered False 03:09:56.608936 bus /sierra_3: Setting Powered False 03:09:57.726274 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:09:58.871033 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:58.882878 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:09:58.943308 tst mo_mt_call_osmux.py: using LAC 18656 03:09:59.061249 tst mo_mt_call_osmux.py: using RAC 41 03:09:59.187630 tst mo_mt_call_osmux.py: using CellId 18656 03:09:59.313376 tst mo_mt_call_osmux.py: using BVCI 18657 03:09:59.431182 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:59.443140 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:59.454844 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:59.466659 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:59.478300 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:59.489878 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:09:59.610991 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:09:59.725354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:00.186976 run create_hlr_db(pid=16798): Launched 03:10:00.300248 bus /sierra_2: Setting Powered False 03:10:01.359221 run create_hlr_db(pid=16798): Terminated: ok {rc=0} 03:10:01.803101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16803): Launched 03:10:02.161657 run osmo-hlr_10.42.42.2(pid=16804): Launched 03:10:02.306798 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:02.860546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16806): Launched 03:10:03.178965 run osmo-stp_10.42.42.5(pid=16807): Launched 03:10:03.300819 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:03.888257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16809): Launched 03:10:04.207591 run osmo-msc_10.42.42.6(pid=16810): Launched 03:10:04.385830 run osmo-stp_10.42.42.5(pid=16807): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16807)] 03:10:04.520088 run osmo-stp_10.42.42.5(pid=16807): stdout: | (launched: 2022-12-09_03:10:03.120820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:04.655343 run osmo-stp_10.42.42.5(pid=16807): stderr: | 20221209031003310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031003310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031003311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031003311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031003312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031003312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031003312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:04.789809 run osmo-stp_10.42.42.5(pid=16807): stdout: | (launched: 2022-12-09_03:10:03.120820) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:04.917076 run osmo-stp_10.42.42.5(pid=16807): stderr: | 20221209031003310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031003310 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031003311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031003311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031003312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031003312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031003312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:05.069390 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16807): Process ended prematurely: osmo-stp_10.42.42.5(pid=16807) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16807)] [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:10:05.079103 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:10:05.106792 run osmo-hlr_10.42.42.2(pid=16804): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16804)] 03:10:05.156173 run osmo-hlr_10.42.42.2(pid=16804): stdout: | (launched: 2022-12-09_03:10:02.098014) 03:10:05.207383 run osmo-hlr_10.42.42.2(pid=16804): stderr: | 20221209031002345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031002345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031002345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031002345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031002345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031002345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031002359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031002369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031002369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031002369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:05.278473 run osmo-msc_10.42.42.6(pid=16810): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16810)] 03:10:05.327848 run osmo-msc_10.42.42.6(pid=16810): stdout: | (launched: 2022-12-09_03:10:04.149351) 03:10:05.378835 run osmo-msc_10.42.42.6(pid=16810): stderr: | 20221209031004471 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031004471 DLGLOBAL DEBUG validating counter group 0x7fb0f80aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031004471 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031004472 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031004472 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031004472 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031004474 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031004474 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031004474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031004474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:05.430851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16803): Terminating (SIGTERM) 03:10:05.472041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16806): Terminating (SIGTERM) 03:10:05.513293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16809): Terminating (SIGTERM) 03:10:05.554858 --- ParallelTerminationStrategy: PID 16803 died... 03:10:05.575009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16803): Terminated: ok {rc=0} 03:10:05.621708 --- ParallelTerminationStrategy: PID 16806 died... 03:10:05.640918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16806): Terminated: ok {rc=0} 03:10:05.686852 --- ParallelTerminationStrategy: PID 16809 died... 03:10:05.706159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16809): Terminated: ok {rc=0} 03:10:05.793528 bus /sierra_3: Setting Powered False 03:10:06.892226 bus /sierra_3: Setting Powered False 03:10:08.009064 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:10:09.252852 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:10:09.260788 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:10:09.285441 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:10:09.312808 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:10:09.366835 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:10:09.391592 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:10:09.418684 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:10:09.971855 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:10:10.022864 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:10:10.034659 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:10:10.099001 tst mo_mt_call.py: using LAC 18657 03:10:10.223411 tst mo_mt_call.py: using RAC 42 03:10:10.347219 tst mo_mt_call.py: using CellId 18657 03:10:10.470402 tst mo_mt_call.py: using BVCI 18658 03:10:10.588240 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:10:10.599992 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:10:10.611466 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:10:10.623006 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:10:10.634801 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:10:10.646259 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:10:10.763038 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:10:10.877062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:11.338271 run create_hlr_db(pid=16815): Launched 03:10:11.451350 bus /sierra_2: Setting Powered False 03:10:12.510581 run create_hlr_db(pid=16815): Terminated: ok {rc=0} 03:10:12.925075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16817): Launched 03:10:13.221601 run osmo-hlr_10.42.42.2(pid=16818): Launched 03:10:13.335016 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:13.884882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16820): Launched 03:10:14.202995 run osmo-stp_10.42.42.5(pid=16821): Launched 03:10:14.324585 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:14.902704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16823): Launched 03:10:15.221757 run osmo-msc_10.42.42.6(pid=16824): Launched 03:10:15.399549 run osmo-stp_10.42.42.5(pid=16821): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16821)] 03:10:15.534003 run osmo-stp_10.42.42.5(pid=16821): stdout: | (launched: 2022-12-09_03:10:14.144819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:15.669885 run osmo-stp_10.42.42.5(pid=16821): stderr: | 20221209031014337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031014338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031014338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031014338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031014339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031014339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031014339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:15.804228 run osmo-stp_10.42.42.5(pid=16821): stdout: | (launched: 2022-12-09_03:10:14.144819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:15.945133 run osmo-stp_10.42.42.5(pid=16821): stderr: | 20221209031014337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031014338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031014338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031014338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031014339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031014339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031014339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:16.093777 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16821): Process ended prematurely: osmo-stp_10.42.42.5(pid=16821) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16821)] [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:10:16.103763 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:10:16.134862 run osmo-hlr_10.42.42.2(pid=16818): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16818)] 03:10:16.185669 run osmo-hlr_10.42.42.2(pid=16818): stdout: | (launched: 2022-12-09_03:10:13.167077) 03:10:16.237854 run osmo-hlr_10.42.42.2(pid=16818): stderr: | 20221209031013344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031013344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031013344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031013344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031013344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031013344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031013361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031013369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031013369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031013369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:16.310721 run osmo-msc_10.42.42.6(pid=16824): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16824)] 03:10:16.362324 run osmo-msc_10.42.42.6(pid=16824): stdout: | (launched: 2022-12-09_03:10:15.163322) 03:10:16.414052 run osmo-msc_10.42.42.6(pid=16824): stderr: | 20221209031015486 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031015486 DLGLOBAL DEBUG validating counter group 0x7f97810b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031015486 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031015486 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031015486 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031015487 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031015488 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031015489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031015489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031015489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:16.466388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16817): Terminating (SIGTERM) 03:10:16.508348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16820): Terminating (SIGTERM) 03:10:16.553015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16823): Terminating (SIGTERM) 03:10:16.598688 --- ParallelTerminationStrategy: PID 16817 died... 03:10:16.619039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16817): Terminated: ok {rc=0} 03:10:16.667213 --- ParallelTerminationStrategy: PID 16820 died... 03:10:16.686913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16820): Terminated: ok {rc=0} 03:10:16.735284 --- ParallelTerminationStrategy: PID 16823 died... 03:10:16.755047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16823): Terminated: ok {rc=0} 03:10:16.851521 bus /sierra_3: Setting Powered False 03:10:17.962940 bus /sierra_3: Setting Powered False 03:10:19.078139 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:10:20.224356 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:10:20.236558 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:10:20.300941 tst mo_mt_call_osmux.py: using LAC 18658 03:10:20.427401 tst mo_mt_call_osmux.py: using RAC 43 03:10:20.545290 tst mo_mt_call_osmux.py: using CellId 18658 03:10:20.661363 tst mo_mt_call_osmux.py: using BVCI 18659 03:10:20.769441 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:10:20.780629 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:10:20.791775 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:10:20.803070 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:10:20.814607 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:10:20.825908 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:10:20.943083 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:10:21.058948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:21.523987 run create_hlr_db(pid=16826): Launched 03:10:21.636921 bus /sierra_2: Setting Powered False 03:10:22.697569 run create_hlr_db(pid=16826): Terminated: ok {rc=0} 03:10:23.113857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16828): Launched 03:10:23.412661 run osmo-hlr_10.42.42.2(pid=16829): Launched 03:10:23.526981 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:24.053540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16831): Launched 03:10:24.350976 run osmo-stp_10.42.42.5(pid=16832): Launched 03:10:24.464671 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:25.006014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16834): Launched 03:10:25.303524 run osmo-msc_10.42.42.6(pid=16835): Launched 03:10:25.471434 run osmo-stp_10.42.42.5(pid=16832): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16832)] 03:10:25.598015 run osmo-stp_10.42.42.5(pid=16832): stdout: | (launched: 2022-12-09_03:10:24.295558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:25.724239 run osmo-stp_10.42.42.5(pid=16832): stderr: | 20221209031024466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031024466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031024466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031024467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031024467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031024467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031024467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:25.849088 run osmo-stp_10.42.42.5(pid=16832): stdout: | (launched: 2022-12-09_03:10:24.295558) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:25.967695 run osmo-stp_10.42.42.5(pid=16832): stderr: | 20221209031024466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031024466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031024466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031024467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031024467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031024467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031024467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:26.109947 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16832): Process ended prematurely: osmo-stp_10.42.42.5(pid=16832) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16832)] [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:10:26.118784 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 03:10:26.145488 run osmo-hlr_10.42.42.2(pid=16829): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16829)] 03:10:26.193847 run osmo-hlr_10.42.42.2(pid=16829): stdout: | (launched: 2022-12-09_03:10:23.357574) 03:10:26.243243 run osmo-hlr_10.42.42.2(pid=16829): stderr: | 20221209031023534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031023534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031023534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031023534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031023534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031023535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031023547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031023555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031023555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031023555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:26.312158 run osmo-msc_10.42.42.6(pid=16835): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16835)] 03:10:26.359813 run osmo-msc_10.42.42.6(pid=16835): stdout: | (launched: 2022-12-09_03:10:25.248351) 03:10:26.409157 run osmo-msc_10.42.42.6(pid=16835): stderr: | 20221209031025518 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031025518 DLGLOBAL DEBUG validating counter group 0x7f2ba4efec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031025518 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031025518 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031025518 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031025518 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031025520 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031025520 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031025521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031025521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:26.458534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16828): Terminating (SIGTERM) 03:10:26.498095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16831): Terminating (SIGTERM) 03:10:26.537596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16834): Terminating (SIGTERM) 03:10:26.577304 --- ParallelTerminationStrategy: PID 16828 died... 03:10:26.596007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16828): Terminated: ok {rc=0} 03:10:26.640578 --- ParallelTerminationStrategy: PID 16831 died... 03:10:26.659091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16831): Terminated: ok {rc=0} 03:10:26.702837 --- ParallelTerminationStrategy: PID 16834 died... 03:10:26.721223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16834): Terminated: ok {rc=0} 03:10:26.803827 bus /sierra_3: Setting Powered False 03:10:27.898130 bus /sierra_3: Setting Powered False 03:10:29.012191 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:10:30.248610 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:10:30.255845 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:10:30.279343 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:10:30.306197 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:10:30.358739 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:10:30.383484 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:10:30.410367 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:10:30.978027 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:10:31.033329 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:31.046272 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:10:31.108844 tst mo_mt_call.py: using LAC 18659 03:10:31.262456 tst mo_mt_call.py: using RAC 44 03:10:31.407867 tst mo_mt_call.py: using CellId 18659 03:10:31.579187 tst mo_mt_call.py: using BVCI 18660 03:10:31.720369 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:31.733139 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:31.745735 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:31.758948 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:31.772061 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:31.785544 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:10:31.909118 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:10:32.028416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:32.561778 run create_hlr_db(pid=16842): Launched 03:10:32.691203 bus /sierra_2: Setting Powered False 03:10:33.754453 run create_hlr_db(pid=16842): Terminated: ok {rc=0} 03:10:34.180365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16844): Launched 03:10:34.479312 run osmo-hlr_10.42.42.2(pid=16845): Launched 03:10:34.594055 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:35.106006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16847): Launched 03:10:35.404566 run osmo-stp_10.42.42.5(pid=16848): Launched 03:10:35.518510 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:36.062508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16850): Launched 03:10:36.359811 run osmo-msc_10.42.42.6(pid=16851): Launched 03:10:36.527904 run osmo-stp_10.42.42.5(pid=16848): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16848)] 03:10:36.655120 run osmo-stp_10.42.42.5(pid=16848): stdout: | (launched: 2022-12-09_03:10:35.349714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:36.782159 run osmo-stp_10.42.42.5(pid=16848): stderr: | 20221209031035519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031035519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031035519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031035520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031035520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031035520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031035520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:36.906991 run osmo-stp_10.42.42.5(pid=16848): stdout: | (launched: 2022-12-09_03:10:35.349714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:37.026016 run osmo-stp_10.42.42.5(pid=16848): stderr: | 20221209031035519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031035519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031035519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031035520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031035520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031035520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031035520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:37.168201 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16848): Process ended prematurely: osmo-stp_10.42.42.5(pid=16848) [trial-2353↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16848)] [trial-2353↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:10:37.177495 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:10:37.204457 run osmo-hlr_10.42.42.2(pid=16845): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16845)] 03:10:37.252357 run osmo-hlr_10.42.42.2(pid=16845): stdout: | (launched: 2022-12-09_03:10:34.424394) 03:10:37.301824 run osmo-hlr_10.42.42.2(pid=16845): stderr: | 20221209031034603 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031034603 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031034603 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031034603 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031034603 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031034604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031034615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031034623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031034624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031034624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:37.370771 run osmo-msc_10.42.42.6(pid=16851): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16851)] 03:10:37.419137 run osmo-msc_10.42.42.6(pid=16851): stdout: | (launched: 2022-12-09_03:10:36.305206) 03:10:37.468331 run osmo-msc_10.42.42.6(pid=16851): stderr: | 20221209031036578 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031036578 DLGLOBAL DEBUG validating counter group 0x7f8107ea0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031036578 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031036578 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031036579 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031036579 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031036580 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031036581 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031036581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031036581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:37.518143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16844): Terminating (SIGTERM) 03:10:37.557826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16847): Terminating (SIGTERM) 03:10:37.597502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16850): Terminating (SIGTERM) 03:10:37.637179 --- ParallelTerminationStrategy: PID 16844 died... 03:10:37.656025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16844): Terminated: ok {rc=0} 03:10:37.700768 --- ParallelTerminationStrategy: PID 16847 died... 03:10:37.719492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16847): Terminated: ok {rc=0} 03:10:37.763988 --- ParallelTerminationStrategy: PID 16850 died... 03:10:37.782484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16850): Terminated: ok {rc=0} 03:10:37.868547 bus /sierra_3: Setting Powered False 03:10:38.967183 bus /sierra_3: Setting Powered False 03:10:40.079868 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:10:41.221544 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:41.233311 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:10:41.293095 tst mo_mt_call_osmux.py: using LAC 18660 03:10:41.411702 tst mo_mt_call_osmux.py: using RAC 45 03:10:41.531623 tst mo_mt_call_osmux.py: using CellId 18660 03:10:41.658174 tst mo_mt_call_osmux.py: using BVCI 18661 03:10:41.774149 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:41.786080 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:41.797634 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:41.809183 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:41.821075 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:41.832767 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:10:41.951117 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:10:42.065907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:42.529774 run create_hlr_db(pid=16853): Launched 03:10:42.645083 bus /sierra_2: Setting Powered False 03:10:43.705198 run create_hlr_db(pid=16853): Terminated: ok {rc=0} 03:10:44.143734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16855): Launched 03:10:44.464858 run osmo-hlr_10.42.42.2(pid=16856): Launched 03:10:44.588110 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:45.140148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16858): Launched 03:10:45.459664 run osmo-stp_10.42.42.5(pid=16859): Launched 03:10:45.582217 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:46.223277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16861): Launched 03:10:46.618478 run osmo-msc_10.42.42.6(pid=16862): Launched 03:10:46.855515 run osmo-stp_10.42.42.5(pid=16859): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16859)] 03:10:47.021936 run osmo-stp_10.42.42.5(pid=16859): stdout: | (launched: 2022-12-09_03:10:45.401433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:47.322756 run osmo-stp_10.42.42.5(pid=16859): stderr: | 20221209031045593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031045593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031045593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031045594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031045594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031045594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031045594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:47.591467 run osmo-stp_10.42.42.5(pid=16859): stdout: | (launched: 2022-12-09_03:10:45.401433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:47.711387 run osmo-stp_10.42.42.5(pid=16859): stderr: | 20221209031045593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031045593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031045593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031045594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031045594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031045594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031045594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:47.854837 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16859): Process ended prematurely: osmo-stp_10.42.42.5(pid=16859) [trial-2353↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16859)] [trial-2353↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:10:47.863653 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 03:10:47.890853 run osmo-hlr_10.42.42.2(pid=16856): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16856)] 03:10:47.938816 run osmo-hlr_10.42.42.2(pid=16856): stdout: | (launched: 2022-12-09_03:10:44.406550) 03:10:47.988204 run osmo-hlr_10.42.42.2(pid=16856): stderr: | 20221209031044605 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031044605 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031044605 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031044605 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031044605 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031044605 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031044618 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031044626 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031044626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031044626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:48.057182 run osmo-msc_10.42.42.6(pid=16862): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16862)] 03:10:48.104804 run osmo-msc_10.42.42.6(pid=16862): stdout: | (launched: 2022-12-09_03:10:46.554189) 03:10:48.154148 run osmo-msc_10.42.42.6(pid=16862): stderr: | 20221209031047218 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031047218 DLGLOBAL DEBUG validating counter group 0x7fe47adf4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031047218 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031047218 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031047219 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031047219 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031047221 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031047223 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031047223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031047223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:48.204009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16855): Terminating (SIGTERM) 03:10:48.243876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16858): Terminating (SIGTERM) 03:10:48.283811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16861): Terminating (SIGTERM) 03:10:48.323853 --- ParallelTerminationStrategy: PID 16855 died... 03:10:48.342911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16855): Terminated: ok {rc=0} 03:10:48.387114 --- ParallelTerminationStrategy: PID 16858 died... 03:10:48.405647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16858): Terminated: ok {rc=0} 03:10:48.449826 --- ParallelTerminationStrategy: PID 16861 died... 03:10:48.468267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16861): Terminated: ok {rc=0} 03:10:48.554233 bus /sierra_3: Setting Powered False 03:10:49.656469 bus /sierra_3: Setting Powered False 03:10:50.771012 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 emergency:nanobts+band-1900 --------------------------------------------------------------------- 03:10:52.006721 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:10:52.011975 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:10:52.035593 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 03:10:52.062107 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 03:10:52.147356 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:10:52.171834 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 03:10:52.199184 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 03:10:52.781109 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2353 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 03:10:52.786251 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:52.797128 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:10:52.835522 tst emergency_mo_mt_call.py: using LAC 18661 03:10:52.960741 tst emergency_mo_mt_call.py: using RAC 46 03:10:53.084514 tst emergency_mo_mt_call.py: using CellId 18661 03:10:53.208862 tst emergency_mo_mt_call.py: using BVCI 18662 03:10:53.316144 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:53.327090 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:53.337978 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:53.348593 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:53.359300 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:53.369971 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:53.488220 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:53.606742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:54.095151 run create_hlr_db(pid=16867): Launched 03:10:54.222249 bus /sierra_2: Setting Powered False 03:10:55.284752 run create_hlr_db(pid=16867): Terminated: ok {rc=0} 03:10:55.705298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16869): Launched 03:10:55.998957 run osmo-hlr_10.42.42.2(pid=16870): Launched 03:10:56.111010 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:56.614155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16872): Launched 03:10:56.906486 run osmo-stp_10.42.42.5(pid=16873): Launched 03:10:57.030316 tst emergency_mo_mt_call.py: using MSISDN 6991 03:10:57.184342 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:57.713004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16875): Launched 03:10:58.005609 run osmo-msc_10.42.42.6(pid=16876): Launched 03:10:58.170922 run osmo-stp_10.42.42.5(pid=16873): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16873)] 03:10:58.295926 run osmo-stp_10.42.42.5(pid=16873): stdout: | (launched: 2022-12-09_03:10:56.852535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:58.421155 run osmo-stp_10.42.42.5(pid=16873): stderr: | 20221209031057021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031057022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031057022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031057022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031057024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031057025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031057025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:58.543418 run osmo-stp_10.42.42.5(pid=16873): stdout: | (launched: 2022-12-09_03:10:56.852535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:58.660452 run osmo-stp_10.42.42.5(pid=16873): stderr: | 20221209031057021 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031057022 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031057022 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031057022 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031057024 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031057025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031057025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:58.800186 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=16873): Process ended prematurely: osmo-stp_10.42.42.5(pid=16873) [trial-2353↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16873)] [trial-2353↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 03:10:58.808577 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 03:10:58.834708 run osmo-hlr_10.42.42.2(pid=16870): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16870)] 03:10:58.882712 run osmo-hlr_10.42.42.2(pid=16870): stdout: | (launched: 2022-12-09_03:10:55.944487) 03:10:58.931881 run osmo-hlr_10.42.42.2(pid=16870): stderr: | 20221209031056120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031056121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031056121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031056121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031056121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031056121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031056133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031056141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031056141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031056141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:59.000502 run osmo-msc_10.42.42.6(pid=16876): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16876)] 03:10:59.048161 run osmo-msc_10.42.42.6(pid=16876): stdout: | (launched: 2022-12-09_03:10:57.950925) 03:10:59.097252 run osmo-msc_10.42.42.6(pid=16876): stderr: | 20221209031058220 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031058221 DLGLOBAL DEBUG validating counter group 0x7fb9834cbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031058221 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031058221 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031058221 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031058221 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031058223 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031058223 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031058224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031058224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:59.146434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16869): Terminating (SIGTERM) 03:10:59.185867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16872): Terminating (SIGTERM) 03:10:59.225465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16875): Terminating (SIGTERM) 03:10:59.265241 --- ParallelTerminationStrategy: PID 16869 died... 03:10:59.284085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16869): Terminated: ok {rc=0} 03:10:59.328126 --- ParallelTerminationStrategy: PID 16872 died... 03:10:59.346720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16872): Terminated: ok {rc=0} 03:10:59.390392 --- ParallelTerminationStrategy: PID 16875 died... 03:10:59.408753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16875): Terminated: ok {rc=0} 03:10:59.491416 bus /sierra_3: Setting Powered False 03:11:00.589090 bus /sierra_3: Setting Powered False 03:11:01.704884 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 03:11:02.792520 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:11:02.804382 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:11:02.849679 tst emergency_preemptive_call.py: using LAC 18662 03:11:02.972873 tst emergency_preemptive_call.py: using RAC 47 03:11:03.094652 tst emergency_preemptive_call.py: using CellId 18662 03:11:03.216271 tst emergency_preemptive_call.py: using BVCI 18663 03:11:03.330031 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:11:03.341347 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:11:03.352484 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:11:03.363608 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:11:03.374733 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:11:03.386097 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:03.503242 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:03.618600 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:03.735361 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:03.848358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:04.306648 run create_hlr_db(pid=16878): Launched 03:11:04.419725 bus /sierra_2: Setting Powered False 03:11:05.479647 run create_hlr_db(pid=16878): Terminated: ok {rc=0} 03:11:05.890751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16880): Launched 03:11:06.185175 run osmo-hlr_10.42.42.2(pid=16881): Launched 03:11:06.297658 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:06.803423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16883): Launched 03:11:07.097780 run osmo-stp_10.42.42.5(pid=16884): Launched 03:11:07.220149 tst emergency_preemptive_call.py: using MSISDN 6992 03:11:07.370703 run osmo-msc_10.42.42.6: Starting osmo-msc 03:11:07.898943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16886): Launched 03:11:08.194102 run osmo-msc_10.42.42.6(pid=16887): Launched 03:11:08.359284 run osmo-stp_10.42.42.5(pid=16884): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16884)] 03:11:08.484285 run osmo-stp_10.42.42.5(pid=16884): stdout: | (launched: 2022-12-09_03:11:07.042718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:08.609407 run osmo-stp_10.42.42.5(pid=16884): stderr: | 20221209031107212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031107212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031107212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031107213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031107213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031107213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031107213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:08.732022 run osmo-stp_10.42.42.5(pid=16884): stdout: | (launched: 2022-12-09_03:11:07.042718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:08.849180 run osmo-stp_10.42.42.5(pid=16884): stderr: | 20221209031107212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031107212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031107212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031107213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031107213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031107213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031107213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:08.988928 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=16884): Process ended prematurely: osmo-stp_10.42.42.5(pid=16884) [trial-2353↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16884)] [trial-2353↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 03:11:08.997190 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 03:11:09.023901 run osmo-hlr_10.42.42.2(pid=16881): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16881)] 03:11:09.071473 run osmo-hlr_10.42.42.2(pid=16881): stdout: | (launched: 2022-12-09_03:11:06.130327) 03:11:09.120823 run osmo-hlr_10.42.42.2(pid=16881): stderr: | 20221209031106305 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031106305 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031106305 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031106305 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031106305 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031106305 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031106316 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031106325 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031106325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031106326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:09.189724 run osmo-msc_10.42.42.6(pid=16887): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16887)] 03:11:09.237298 run osmo-msc_10.42.42.6(pid=16887): stdout: | (launched: 2022-12-09_03:11:08.139195) 03:11:09.286530 run osmo-msc_10.42.42.6(pid=16887): stderr: | 20221209031108407 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031108408 DLGLOBAL DEBUG validating counter group 0x7f8b2d546c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031108408 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031108408 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031108408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031108408 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031108410 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031108411 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031108411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031108411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:11:09.336205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16880): Terminating (SIGTERM) 03:11:09.375697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16883): Terminating (SIGTERM) 03:11:09.415503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16886): Terminating (SIGTERM) 03:11:09.455328 --- ParallelTerminationStrategy: PID 16880 died... 03:11:09.474379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16880): Terminated: ok {rc=0} 03:11:09.518497 --- ParallelTerminationStrategy: PID 16883 died... 03:11:09.537187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16883): Terminated: ok {rc=0} 03:11:09.581174 --- ParallelTerminationStrategy: PID 16886 died... 03:11:09.599578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16886): Terminated: ok {rc=0} 03:11:09.685996 bus /sierra_9: Setting Powered False 03:11:10.784234 bus /sierra_9: Setting Powered False 03:11:11.899908 bus /sierra_8: Setting Powered False 03:11:12.999566 bus /sierra_8: Setting Powered False 03:11:14.116583 bus /sierra_3: Setting Powered False 03:11:15.215330 bus /sierra_3: Setting Powered False 03:11:16.330848 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-1900 --------------------------------------------------------------------- 03:11:17.596851 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:11:17.602406 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:11:17.625919 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 03:11:17.664216 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 03:11:17.750431 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:11:17.774032 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 03:11:17.812525 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 03:11:18.409854 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 03:11:18.460908 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:18.471663 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:11:18.512864 tst cs_paging_gprs_active.py: using LAC 18663 03:11:18.630350 tst cs_paging_gprs_active.py: using RAC 48 03:11:18.747635 tst cs_paging_gprs_active.py: using CellId 18663 03:11:18.863543 tst cs_paging_gprs_active.py: using BVCI 18664 03:11:18.971624 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:18.982418 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:18.992861 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:19.003611 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:19.014486 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:19.025278 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:19.036053 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:19.047021 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:19.057948 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:19.171283 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:19.290496 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:11:19.508039 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:19.830879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16893): Launched 03:11:20.109946 run iperf3-srv_10.42.42.10(pid=16894): Launched 03:11:20.230458 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:11:20.446757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:20.769088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16895): Launched 03:11:21.048668 run iperf3-srv_10.42.42.10(pid=16896): Launched 03:11:21.168462 tst cs_paging_gprs_active.py:38: start network... 03:11:21.384522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:21.881777 run create_hlr_db(pid=16897): Launched 03:11:22.011826 bus /sierra_2: Setting Powered False 03:11:23.074890 run create_hlr_db(pid=16897): Terminated: ok {rc=0} 03:11:23.503931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16899): Launched 03:11:23.803660 run osmo-hlr_10.42.42.2(pid=16900): Launched 03:11:23.918102 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:24.438546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16902): Launched 03:11:24.738457 run osmo-stp_10.42.42.5(pid=16903): Launched 03:11:24.853268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:25.370912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16905): Launched 03:11:25.485972 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:25.739602 run patchelf(pid=16906): Launched 03:11:25.905998 run osmo-stp_10.42.42.5(pid=16903): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16903)] 03:11:26.032424 run osmo-stp_10.42.42.5(pid=16903): stdout: | (launched: 2022-12-09_03:11:24.683325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:26.160758 run osmo-stp_10.42.42.5(pid=16903): stderr: | 20221209031124854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031124854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031124854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031124855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031124855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031124855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031124855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:26.289627 run osmo-stp_10.42.42.5(pid=16903): stdout: | (launched: 2022-12-09_03:11:24.683325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:26.412340 run osmo-stp_10.42.42.5(pid=16903): stderr: | 20221209031124854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031124854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031124854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031124855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031124855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031124855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031124855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:26.558306 run patchelf(pid=16906): Terminating (SIGINT) 03:11:26.727037 run patchelf(pid=16906): Terminated: ok {rc=0} 03:11:26.848475 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16903): Process ended prematurely: osmo-stp_10.42.42.5(pid=16903) [trial-2353↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16903)] [trial-2353↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 03:11:26.857876 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 03:11:26.885266 run osmo-hlr_10.42.42.2(pid=16900): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16900)] 03:11:26.932490 run osmo-hlr_10.42.42.2(pid=16900): stdout: | (launched: 2022-12-09_03:11:23.748608) 03:11:26.981440 run osmo-hlr_10.42.42.2(pid=16900): stderr: | 20221209031123923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031123923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031123923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031123923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031123923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031123923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031123938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031123947 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031123948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031123948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:27.030966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16893): Terminating (SIGTERM) 03:11:27.070542 run iperf3-srv_10.42.42.10(pid=16894): Terminating (SIGTERM) 03:11:27.109763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16895): Terminating (SIGTERM) 03:11:27.149192 run iperf3-srv_10.42.42.10(pid=16896): Terminating (SIGTERM) 03:11:27.188447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16899): Terminating (SIGTERM) 03:11:27.228051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16902): Terminating (SIGTERM) 03:11:27.267481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16905): Terminating (SIGTERM) 03:11:27.307207 --- ParallelTerminationStrategy: PID 16893 died... 03:11:27.326172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16893): Terminated: ok {rc=0} 03:11:27.370595 --- ParallelTerminationStrategy: PID 16894 died... 03:11:27.388733 run iperf3-srv_10.42.42.10(pid=16894): Terminated {rc=256} 03:11:27.432381 --- ParallelTerminationStrategy: PID 16895 died... 03:11:27.450734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16895): Terminated: ok {rc=0} 03:11:27.494924 --- ParallelTerminationStrategy: PID 16896 died... 03:11:27.513275 run iperf3-srv_10.42.42.10(pid=16896): Terminated {rc=256} 03:11:27.556929 --- ParallelTerminationStrategy: PID 16899 died... 03:11:27.575425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16899): Terminated: ok {rc=0} 03:11:27.619131 --- ParallelTerminationStrategy: PID 16902 died... 03:11:27.637350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16902): Terminated: ok {rc=0} 03:11:27.681243 --- ParallelTerminationStrategy: PID 16905 died... 03:11:27.699606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16905): Terminated: ok {rc=0} 03:11:27.784352 bus /gobi_0: Setting Powered False 03:11:28.883214 bus /gobi_0: Setting Powered False 03:11:29.995617 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 03:11:31.139500 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.151605 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:11:31.191841 tst iperf3.py: using LAC 18664 03:11:31.322159 tst iperf3.py: using RAC 49 03:11:31.450950 tst iperf3.py: using CellId 18664 03:11:31.574554 tst iperf3.py: using BVCI 18665 03:11:31.727069 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.741628 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.756512 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.773331 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.787948 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.800783 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.815304 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.831540 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.847311 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:31.971613 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:11:32.176795 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:32.480457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16907): Launched 03:11:32.740509 run iperf3-srv_10.42.42.10(pid=16908): Launched 03:11:32.852759 tst iperf3.py:8: start network... 03:11:33.053074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:33.550860 run create_hlr_db(pid=16909): Launched 03:11:33.681385 bus /gobi_6: Setting Powered False 03:11:34.744880 run create_hlr_db(pid=16909): Terminated: ok {rc=0} 03:11:35.173550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16913): Launched 03:11:35.472213 run osmo-hlr_10.42.42.2(pid=16914): Launched 03:11:35.586441 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:36.100155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16916): Launched 03:11:36.397672 run osmo-stp_10.42.42.5(pid=16917): Launched 03:11:36.511493 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:37.028296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16919): Launched 03:11:37.143516 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:37.397691 run patchelf(pid=16920): Launched 03:11:37.564114 run osmo-stp_10.42.42.5(pid=16917): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16917)] 03:11:37.690680 run osmo-stp_10.42.42.5(pid=16917): stdout: | (launched: 2022-12-09_03:11:36.342710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:37.819250 run osmo-stp_10.42.42.5(pid=16917): stderr: | 20221209031136512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031136512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031136512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031136513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031136513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031136513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031136513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:37.947802 run osmo-stp_10.42.42.5(pid=16917): stdout: | (launched: 2022-12-09_03:11:36.342710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:38.071075 run osmo-stp_10.42.42.5(pid=16917): stderr: | 20221209031136512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031136512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031136512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031136513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031136513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031136513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031136513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:38.216553 run patchelf(pid=16920): Terminating (SIGINT) 03:11:38.385418 run patchelf(pid=16920): Terminated: ok {rc=0} 03:11:38.506442 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16917): Process ended prematurely: osmo-stp_10.42.42.5(pid=16917) [trial-2353↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16917)] [trial-2353↪gprs:nanobts+band-1900↪iperf3.py:8] 03:11:38.515812 tst iperf3.py:8: Test FAILED (7.4 sec) 03:11:38.543030 run osmo-hlr_10.42.42.2(pid=16914): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16914)] 03:11:38.590667 run osmo-hlr_10.42.42.2(pid=16914): stdout: | (launched: 2022-12-09_03:11:35.417234) 03:11:38.639688 run osmo-hlr_10.42.42.2(pid=16914): stderr: | 20221209031135595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031135595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031135595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031135595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031135595 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031135595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031135607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031135618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031135618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031135618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:38.689309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16907): Terminating (SIGTERM) 03:11:38.728757 run iperf3-srv_10.42.42.10(pid=16908): Terminating (SIGTERM) 03:11:38.768166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16913): Terminating (SIGTERM) 03:11:38.807926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16916): Terminating (SIGTERM) 03:11:38.847589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16919): Terminating (SIGTERM) 03:11:38.887445 --- ParallelTerminationStrategy: PID 16907 died... 03:11:38.906419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16907): Terminated: ok {rc=0} 03:11:38.950698 --- ParallelTerminationStrategy: PID 16908 died... 03:11:38.968903 run iperf3-srv_10.42.42.10(pid=16908): Terminated {rc=256} 03:11:39.012857 --- ParallelTerminationStrategy: PID 16913 died... 03:11:39.031651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16913): Terminated: ok {rc=0} 03:11:39.075834 --- ParallelTerminationStrategy: PID 16916 died... 03:11:39.094425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16916): Terminated: ok {rc=0} 03:11:39.138442 --- ParallelTerminationStrategy: PID 16919 died... 03:11:39.156877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16919): Terminated: ok {rc=0} 03:11:39.240287 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 03:11:40.385516 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:40.396646 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:11:40.435875 tst iperf3m4.py: using LAC 18665 03:11:40.554894 tst iperf3m4.py: using RAC 50 03:11:40.673135 tst iperf3m4.py: using CellId 18665 03:11:40.801202 tst iperf3m4.py: using BVCI 18666 03:11:40.918804 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:40.930277 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:40.941631 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:40.953440 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:40.964926 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:40.976624 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:40.988596 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:41.000147 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:41.011881 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:41.132833 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:41.250868 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:41.370134 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:41.488861 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:11:41.706776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:42.030904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16921): Launched 03:11:42.310572 run iperf3-srv_10.42.42.10(pid=16922): Launched 03:11:42.431409 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:11:42.648802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:42.973439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16923): Launched 03:11:43.252847 run iperf3-srv_10.42.42.10(pid=16924): Launched 03:11:43.372852 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:11:43.589055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:43.914071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16925): Launched 03:11:44.193416 run iperf3-srv_10.42.42.10(pid=16926): Launched 03:11:44.313444 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:11:44.530041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:44.853891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16927): Launched 03:11:45.134052 run iperf3-srv_10.42.42.10(pid=16928): Launched 03:11:45.254068 tst iperf3m4.py:8: start network... 03:11:45.470486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:46.006614 run create_hlr_db(pid=16929): Launched 03:11:46.139082 bus /gobi_6: Setting Powered False 03:11:47.208175 run create_hlr_db(pid=16929): Terminated: ok {rc=0} 03:11:47.630518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16931): Launched 03:11:47.931226 run osmo-hlr_10.42.42.2(pid=16932): Launched 03:11:48.047246 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:48.578712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16934): Launched 03:11:48.878434 run osmo-stp_10.42.42.5(pid=16935): Launched 03:11:48.992823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:49.510944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16937): Launched 03:11:49.625464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:49.879451 run patchelf(pid=16938): Launched 03:11:50.047976 run osmo-stp_10.42.42.5(pid=16935): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16935)] 03:11:50.174888 run osmo-stp_10.42.42.5(pid=16935): stdout: | (launched: 2022-12-09_03:11:48.823078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:50.304061 run osmo-stp_10.42.42.5(pid=16935): stderr: | 20221209031148992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031148992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031148992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031148993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031148993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031148993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031148993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:50.433105 run osmo-stp_10.42.42.5(pid=16935): stdout: | (launched: 2022-12-09_03:11:48.823078) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:50.556482 run osmo-stp_10.42.42.5(pid=16935): stderr: | 20221209031148992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031148992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031148992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031148993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031148993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031148993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031148993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:50.702570 run patchelf(pid=16938): Terminating (SIGINT) 03:11:50.871520 run patchelf(pid=16938): Terminated: ok {rc=0} 03:11:50.992874 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16935): Process ended prematurely: osmo-stp_10.42.42.5(pid=16935) [trial-2353↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16935)] [trial-2353↪gprs:nanobts+band-1900↪iperf3m4.py:8] 03:11:51.002578 tst iperf3m4.py:8: Test FAILED (10.7 sec) 03:11:51.030162 run osmo-hlr_10.42.42.2(pid=16932): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16932)] 03:11:51.077613 run osmo-hlr_10.42.42.2(pid=16932): stdout: | (launched: 2022-12-09_03:11:47.875246) 03:11:51.126340 run osmo-hlr_10.42.42.2(pid=16932): stderr: | 20221209031148049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031148049 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031148049 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031148049 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031148049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031148049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031148072 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031148081 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031148081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031148081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:51.175817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16921): Terminating (SIGTERM) 03:11:51.215530 run iperf3-srv_10.42.42.10(pid=16922): Terminating (SIGTERM) 03:11:51.255316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16923): Terminating (SIGTERM) 03:11:51.295312 run iperf3-srv_10.42.42.10(pid=16924): Terminating (SIGTERM) 03:11:51.334961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16925): Terminating (SIGTERM) 03:11:51.374956 run iperf3-srv_10.42.42.10(pid=16926): Terminating (SIGTERM) 03:11:51.414526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16927): Terminating (SIGTERM) 03:11:51.454279 run iperf3-srv_10.42.42.10(pid=16928): Terminating (SIGTERM) 03:11:51.493966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16931): Terminating (SIGTERM) 03:11:51.533591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16934): Terminating (SIGTERM) 03:11:51.573216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16937): Terminating (SIGTERM) 03:11:51.613220 --- ParallelTerminationStrategy: PID 16921 died... 03:11:51.632227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16921): Terminated: ok {rc=0} 03:11:51.676660 --- ParallelTerminationStrategy: PID 16922 died... 03:11:51.695560 run iperf3-srv_10.42.42.10(pid=16922): Terminated {rc=256} 03:11:51.740064 --- ParallelTerminationStrategy: PID 16923 died... 03:11:51.758751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16923): Terminated: ok {rc=0} 03:11:51.802955 --- ParallelTerminationStrategy: PID 16924 died... 03:11:51.821508 run iperf3-srv_10.42.42.10(pid=16924): Terminated {rc=256} 03:11:51.865360 --- ParallelTerminationStrategy: PID 16925 died... 03:11:51.884055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16925): Terminated: ok {rc=0} 03:11:51.928111 --- ParallelTerminationStrategy: PID 16926 died... 03:11:51.946660 run iperf3-srv_10.42.42.10(pid=16926): Terminated {rc=256} 03:11:51.990747 --- ParallelTerminationStrategy: PID 16927 died... 03:11:52.009391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16927): Terminated: ok {rc=0} 03:11:52.053676 --- ParallelTerminationStrategy: PID 16928 died... 03:11:52.072149 run iperf3-srv_10.42.42.10(pid=16928): Terminated {rc=256} 03:11:52.116683 --- ParallelTerminationStrategy: PID 16931 died... 03:11:52.135310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16931): Terminated: ok {rc=0} 03:11:52.179169 --- ParallelTerminationStrategy: PID 16934 died... 03:11:52.197700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16934): Terminated: ok {rc=0} 03:11:52.241628 --- ParallelTerminationStrategy: PID 16937 died... 03:11:52.260107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16937): Terminated: ok {rc=0} 03:11:52.345092 bus /gobi_4: Setting Powered False 03:11:53.444424 bus /gobi_4: Setting Powered False 03:11:54.559478 bus /gobi_1: Setting Powered False 03:11:55.655454 bus /gobi_1: Setting Powered False 03:11:56.771406 bus /gobi_0: Setting Powered False 03:11:57.867899 bus /gobi_0: Setting Powered False 03:11:58.982435 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 03:12:00.084423 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:00.096401 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:12:00.136595 tst ping.py: using LAC 18666 03:12:00.254188 tst ping.py: using RAC 51 03:12:00.371908 tst ping.py: using CellId 18666 03:12:00.488472 tst ping.py: using BVCI 18667 03:12:00.595604 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:00.606274 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:00.616784 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:00.627575 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:00.638313 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:00.649050 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:00.659810 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:00.670616 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:12:00.783652 tst ping.py:19: start network... 03:12:00.983510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:01.455571 run create_hlr_db(pid=16939): Launched 03:12:01.631561 bus /gobi_6: Setting Powered False 03:12:02.694185 run create_hlr_db(pid=16939): Terminated: ok {rc=0} 03:12:03.116881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16941): Launched 03:12:03.411089 run osmo-hlr_10.42.42.2(pid=16942): Launched 03:12:03.523197 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:04.031544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16944): Launched 03:12:04.326535 run osmo-stp_10.42.42.5(pid=16945): Launched 03:12:04.439080 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:04.948051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16947): Launched 03:12:05.060773 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:05.309893 run patchelf(pid=16948): Launched 03:12:05.473322 run osmo-stp_10.42.42.5(pid=16945): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16945)] 03:12:05.597836 run osmo-stp_10.42.42.5(pid=16945): stdout: | (launched: 2022-12-09_03:12:04.271939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:05.724246 run osmo-stp_10.42.42.5(pid=16945): stderr: | 20221209031204441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031204441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031204441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031204442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031204444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031204444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031204444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:05.850569 run osmo-stp_10.42.42.5(pid=16945): stdout: | (launched: 2022-12-09_03:12:04.271939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:05.971518 run osmo-stp_10.42.42.5(pid=16945): stderr: | 20221209031204441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031204441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031204441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031204442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031204444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031204444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031204444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:06.115031 run patchelf(pid=16948): Terminating (SIGINT) 03:12:06.280519 run patchelf(pid=16948): Terminated: ok {rc=0} 03:12:06.399369 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=16945): Process ended prematurely: osmo-stp_10.42.42.5(pid=16945) [trial-2353↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16945)] [trial-2353↪gprs:nanobts+band-1900↪ping.py:22] 03:12:06.408206 tst ping.py:22: Test FAILED (6.3 sec) 03:12:06.435298 run osmo-hlr_10.42.42.2(pid=16942): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16942)] 03:12:06.483225 run osmo-hlr_10.42.42.2(pid=16942): stdout: | (launched: 2022-12-09_03:12:03.356915) 03:12:06.532470 run osmo-hlr_10.42.42.2(pid=16942): stderr: | 20221209031203530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031203530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031203530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031203530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031203530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031203530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031203542 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031203551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031203551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031203551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:06.582521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16941): Terminating (SIGTERM) 03:12:06.622168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16944): Terminating (SIGTERM) 03:12:06.661777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16947): Terminating (SIGTERM) 03:12:06.701851 --- ParallelTerminationStrategy: PID 16941 died... 03:12:06.720776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16941): Terminated: ok {rc=0} 03:12:06.765389 --- ParallelTerminationStrategy: PID 16944 died... 03:12:06.784400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16944): Terminated: ok {rc=0} 03:12:06.828805 --- ParallelTerminationStrategy: PID 16947 died... 03:12:06.847725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16947): Terminated: ok {rc=0} 03:12:06.931292 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 03:12:08.017845 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:08.030389 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:12:08.071700 tst ping_idle_ping.py: using LAC 18667 03:12:08.198347 tst ping_idle_ping.py: using RAC 52 03:12:08.327958 tst ping_idle_ping.py: using CellId 18667 03:12:08.443456 tst ping_idle_ping.py: using BVCI 18668 03:12:08.551856 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:08.562805 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:08.573640 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:08.584519 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:08.595377 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:08.606097 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:08.616848 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:12:08.627776 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:12:08.745962 tst ping_idle_ping.py:24: start network... 03:12:08.960073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:09.455956 run create_hlr_db(pid=16949): Launched 03:12:09.585247 bus /gobi_6: Setting Powered False 03:12:10.649298 run create_hlr_db(pid=16949): Terminated: ok {rc=0} 03:12:11.073344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16951): Launched 03:12:11.370386 run osmo-hlr_10.42.42.2(pid=16952): Launched 03:12:11.482889 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:12.030408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16954): Launched 03:12:12.346894 run osmo-stp_10.42.42.5(pid=16955): Launched 03:12:12.466904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:13.013841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16957): Launched 03:12:13.134175 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:13.401676 run patchelf(pid=16958): Launched 03:12:13.577500 run osmo-stp_10.42.42.5(pid=16955): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16955)] 03:12:13.711847 run osmo-stp_10.42.42.5(pid=16955): stdout: | (launched: 2022-12-09_03:12:12.288614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:13.847757 run osmo-stp_10.42.42.5(pid=16955): stderr: | 20221209031212478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031212479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031212479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031212479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031212480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031212480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031212480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:13.983621 run osmo-stp_10.42.42.5(pid=16955): stdout: | (launched: 2022-12-09_03:12:12.288614) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:14.113833 run osmo-stp_10.42.42.5(pid=16955): stderr: | 20221209031212478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031212479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031212479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031212479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031212480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031212480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031212480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:14.267778 run patchelf(pid=16958): Terminating (SIGINT) 03:12:14.445690 run patchelf(pid=16958): Terminated: ok {rc=0} 03:12:14.572918 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=16955): Process ended prematurely: osmo-stp_10.42.42.5(pid=16955) [trial-2353↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16955)] [trial-2353↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 03:12:14.582444 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:12:14.610359 run osmo-hlr_10.42.42.2(pid=16952): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16952)] 03:12:14.660478 run osmo-hlr_10.42.42.2(pid=16952): stdout: | (launched: 2022-12-09_03:12:11.315234) 03:12:14.711692 run osmo-hlr_10.42.42.2(pid=16952): stderr: | 20221209031211491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031211491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031211491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031211491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031211491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031211491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031211504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031211513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031211513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031211513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:14.763078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16951): Terminating (SIGTERM) 03:12:14.804551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16954): Terminating (SIGTERM) 03:12:14.846075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16957): Terminating (SIGTERM) 03:12:14.887990 --- ParallelTerminationStrategy: PID 16951 died... 03:12:14.907999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16951): Terminated: ok {rc=0} 03:12:14.954061 --- ParallelTerminationStrategy: PID 16954 died... 03:12:14.973516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16954): Terminated: ok {rc=0} 03:12:15.019512 --- ParallelTerminationStrategy: PID 16957 died... 03:12:15.038900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16957): Terminated: ok {rc=0} 03:12:15.126168 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 03:12:16.419156 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:12:16.425394 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:12:16.451216 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:12:16.492299 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:12:16.580838 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:12:16.606379 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:12:16.646590 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:12:17.250506 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:12:17.300230 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:17.311157 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:12:17.352207 tst cs_paging_gprs_active.py: using LAC 18668 03:12:17.471592 tst cs_paging_gprs_active.py: using RAC 53 03:12:17.590816 tst cs_paging_gprs_active.py: using CellId 18668 03:12:17.708619 tst cs_paging_gprs_active.py: using BVCI 18669 03:12:17.818430 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:17.829514 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:17.840198 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:17.851586 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:17.862928 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:17.874371 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:17.888009 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:17.899854 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:17.911704 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:18.027749 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:18.146090 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:12:18.363588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:18.687664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16962): Launched 03:12:18.966656 run iperf3-srv_10.42.42.10(pid=16963): Launched 03:12:19.086885 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:12:19.303435 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:19.627038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16964): Launched 03:12:19.906702 run iperf3-srv_10.42.42.10(pid=16965): Launched 03:12:20.026828 tst cs_paging_gprs_active.py:38: start network... 03:12:20.242903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:20.742903 run create_hlr_db(pid=16966): Launched 03:12:20.874659 bus /gobi_6: Setting Powered False 03:12:21.938643 run create_hlr_db(pid=16966): Terminated: ok {rc=0} 03:12:22.388368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16968): Launched 03:12:22.711335 run osmo-hlr_10.42.42.2(pid=16969): Launched 03:12:22.834240 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:23.386747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16971): Launched 03:12:23.708485 run osmo-stp_10.42.42.5(pid=16972): Launched 03:12:23.831367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:24.386590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16974): Launched 03:12:24.509030 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:24.781749 run patchelf(pid=16975): Launched 03:12:24.959981 run osmo-stp_10.42.42.5(pid=16972): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16972)] 03:12:25.095817 run osmo-stp_10.42.42.5(pid=16972): stdout: | (launched: 2022-12-09_03:12:23.649636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:25.233187 run osmo-stp_10.42.42.5(pid=16972): stderr: | 20221209031223840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031223840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031223841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031223841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031223842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031223842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031223842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:25.370214 run osmo-stp_10.42.42.5(pid=16972): stdout: | (launched: 2022-12-09_03:12:23.649636) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:25.502298 run osmo-stp_10.42.42.5(pid=16972): stderr: | 20221209031223840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031223840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031223841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031223841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031223842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031223842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031223842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:25.659233 run patchelf(pid=16975): Terminating (SIGINT) 03:12:25.839223 run patchelf(pid=16975): Terminated: ok {rc=0} 03:12:25.969053 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=16972): Process ended prematurely: osmo-stp_10.42.42.5(pid=16972) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16972)] [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:12:25.979534 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 03:12:26.008131 run osmo-hlr_10.42.42.2(pid=16969): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16969)] 03:12:26.057746 run osmo-hlr_10.42.42.2(pid=16969): stdout: | (launched: 2022-12-09_03:12:22.651578) 03:12:26.109078 run osmo-hlr_10.42.42.2(pid=16969): stderr: | 20221209031222853 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031222853 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031222853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031222853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031222853 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031222853 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031222866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031222874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031222874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031222875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:26.160853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16962): Terminating (SIGTERM) 03:12:26.202277 run iperf3-srv_10.42.42.10(pid=16963): Terminating (SIGTERM) 03:12:26.243630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16964): Terminating (SIGTERM) 03:12:26.285083 run iperf3-srv_10.42.42.10(pid=16965): Terminating (SIGTERM) 03:12:26.326545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16968): Terminating (SIGTERM) 03:12:26.368027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16971): Terminating (SIGTERM) 03:12:26.409540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16974): Terminating (SIGTERM) 03:12:26.451705 --- ParallelTerminationStrategy: PID 16962 died... 03:12:26.471663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16962): Terminated: ok {rc=0} 03:12:26.517986 --- ParallelTerminationStrategy: PID 16963 died... 03:12:26.537556 run iperf3-srv_10.42.42.10(pid=16963): Terminated {rc=256} 03:12:26.583115 --- ParallelTerminationStrategy: PID 16964 died... 03:12:26.602724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16964): Terminated: ok {rc=0} 03:12:26.648828 --- ParallelTerminationStrategy: PID 16965 died... 03:12:26.668336 run iperf3-srv_10.42.42.10(pid=16965): Terminated {rc=256} 03:12:26.714496 --- ParallelTerminationStrategy: PID 16968 died... 03:12:26.734255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16968): Terminated: ok {rc=0} 03:12:26.779935 --- ParallelTerminationStrategy: PID 16971 died... 03:12:26.799532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16971): Terminated: ok {rc=0} 03:12:26.845289 --- ParallelTerminationStrategy: PID 16974 died... 03:12:26.864916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16974): Terminated: ok {rc=0} 03:12:26.951547 bus /gobi_0: Setting Powered False 03:12:28.049613 bus /gobi_0: Setting Powered False 03:12:29.163262 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:12:30.308138 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.319663 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:12:30.363080 tst iperf3.py: using LAC 18669 03:12:30.483020 tst iperf3.py: using RAC 54 03:12:30.600844 tst iperf3.py: using CellId 18669 03:12:30.719658 tst iperf3.py: using BVCI 18670 03:12:30.848914 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.861519 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.873728 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.887433 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.899264 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.914404 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.926903 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.939173 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.951687 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:31.080174 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:12:31.287596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:31.601908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16976): Launched 03:12:31.887053 run iperf3-srv_10.42.42.10(pid=16977): Launched 03:12:32.055381 tst iperf3.py:8: start network... 03:12:32.319541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:32.821876 run create_hlr_db(pid=16978): Launched 03:12:32.951790 bus /gobi_6: Setting Powered False 03:12:34.015107 run create_hlr_db(pid=16978): Terminated: ok {rc=0} 03:12:34.462813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16980): Launched 03:12:34.789246 run osmo-hlr_10.42.42.2(pid=16981): Launched 03:12:34.912135 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:35.472596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16983): Launched 03:12:35.797073 run osmo-stp_10.42.42.5(pid=16985): Launched 03:12:35.913287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:36.435083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16987): Launched 03:12:36.550536 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:36.805804 run patchelf(pid=16988): Launched 03:12:36.972782 run osmo-stp_10.42.42.5(pid=16985): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16985)] 03:12:37.100378 run osmo-stp_10.42.42.5(pid=16985): stdout: | (launched: 2022-12-09_03:12:35.735708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:37.229729 run osmo-stp_10.42.42.5(pid=16985): stderr: | 20221209031235910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031235910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031235910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031235910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031235913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031235913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031235913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:37.359133 run osmo-stp_10.42.42.5(pid=16985): stdout: | (launched: 2022-12-09_03:12:35.735708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:37.482521 run osmo-stp_10.42.42.5(pid=16985): stderr: | 20221209031235910 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031235910 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031235910 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031235910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031235913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031235913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031235913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:37.628924 run patchelf(pid=16988): Terminating (SIGINT) 03:12:37.797623 run patchelf(pid=16988): Terminated: ok {rc=0} 03:12:37.919176 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=16985): Process ended prematurely: osmo-stp_10.42.42.5(pid=16985) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16985)] [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 03:12:37.928661 tst iperf3.py:8: Test FAILED (7.7 sec) 03:12:37.956168 run osmo-hlr_10.42.42.2(pid=16981): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16981)] 03:12:38.003957 run osmo-hlr_10.42.42.2(pid=16981): stdout: | (launched: 2022-12-09_03:12:34.725981) 03:12:38.053283 run osmo-hlr_10.42.42.2(pid=16981): stderr: | 20221209031234927 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031234927 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031234927 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031234927 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031234927 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031234927 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031234945 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031234955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031234955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031234955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:38.103346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16976): Terminating (SIGTERM) 03:12:38.143298 run iperf3-srv_10.42.42.10(pid=16977): Terminating (SIGTERM) 03:12:38.183051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16980): Terminating (SIGTERM) 03:12:38.222736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16983): Terminating (SIGTERM) 03:12:38.262270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16987): Terminating (SIGTERM) 03:12:38.302318 --- ParallelTerminationStrategy: PID 16976 died... 03:12:38.321359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16976): Terminated: ok {rc=0} 03:12:38.365425 --- ParallelTerminationStrategy: PID 16977 died... 03:12:38.383773 run iperf3-srv_10.42.42.10(pid=16977): Terminated {rc=256} 03:12:38.427729 --- ParallelTerminationStrategy: PID 16980 died... 03:12:38.446291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16980): Terminated: ok {rc=0} 03:12:38.490231 --- ParallelTerminationStrategy: PID 16983 died... 03:12:38.508750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16983): Terminated: ok {rc=0} 03:12:38.552688 --- ParallelTerminationStrategy: PID 16987 died... 03:12:38.571261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=16987): Terminated: ok {rc=0} 03:12:38.656670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:12:39.803006 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:39.814589 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:12:39.855786 tst iperf3m4.py: using LAC 18670 03:12:39.974681 tst iperf3m4.py: using RAC 55 03:12:40.091097 tst iperf3m4.py: using CellId 18670 03:12:40.210893 tst iperf3m4.py: using BVCI 18671 03:12:40.319472 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:40.330677 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:40.341718 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:40.352642 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:40.363650 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:40.374621 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:40.385764 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:40.396684 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:40.407860 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:40.523391 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:40.647043 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:40.763666 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:40.886329 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:12:41.103367 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:41.426484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16989): Launched 03:12:41.706077 run iperf3-srv_10.42.42.10(pid=16990): Launched 03:12:41.825810 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:12:42.041949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:42.365020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16991): Launched 03:12:42.643669 run iperf3-srv_10.42.42.10(pid=16992): Launched 03:12:42.764438 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:12:42.981637 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:43.304703 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16993): Launched 03:12:43.583722 run iperf3-srv_10.42.42.10(pid=16994): Launched 03:12:43.704467 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:12:43.920271 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:44.242630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16995): Launched 03:12:44.522077 run iperf3-srv_10.42.42.10(pid=16996): Launched 03:12:44.641875 tst iperf3m4.py:8: start network... 03:12:44.859064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:45.359070 run create_hlr_db(pid=16997): Launched 03:12:45.488310 bus /gobi_6: Setting Powered False 03:12:46.552215 run create_hlr_db(pid=16997): Terminated: ok {rc=0} 03:12:47.012130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16999): Launched 03:12:47.346701 run osmo-hlr_10.42.42.2(pid=17000): Launched 03:12:47.470565 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:48.026741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17002): Launched 03:12:48.348668 run osmo-stp_10.42.42.5(pid=17003): Launched 03:12:48.471517 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:49.028830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17005): Launched 03:12:49.151270 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:49.423791 run patchelf(pid=17006): Launched 03:12:49.602874 run osmo-stp_10.42.42.5(pid=17003): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17003)] 03:12:49.738861 run osmo-stp_10.42.42.5(pid=17003): stdout: | (launched: 2022-12-09_03:12:48.289381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:49.875859 run osmo-stp_10.42.42.5(pid=17003): stderr: | 20221209031248479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031248479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031248479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031248480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031248480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031248480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031248480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:50.013344 run osmo-stp_10.42.42.5(pid=17003): stdout: | (launched: 2022-12-09_03:12:48.289381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:50.145377 run osmo-stp_10.42.42.5(pid=17003): stderr: | 20221209031248479 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031248479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031248479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031248480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031248480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031248480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031248480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:50.301672 run patchelf(pid=17006): Terminating (SIGINT) 03:12:50.481367 run patchelf(pid=17006): Terminated: ok {rc=0} 03:12:50.610690 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17003): Process ended prematurely: osmo-stp_10.42.42.5(pid=17003) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17003)] [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 03:12:50.620726 tst iperf3m4.py:8: Test FAILED (10.9 sec) 03:12:50.649425 run osmo-hlr_10.42.42.2(pid=17000): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17000)] 03:12:50.699472 run osmo-hlr_10.42.42.2(pid=17000): stdout: | (launched: 2022-12-09_03:12:47.287552) 03:12:50.750782 run osmo-hlr_10.42.42.2(pid=17000): stderr: | 20221209031247485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031247485 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031247485 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031247485 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031247485 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031247485 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031247497 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031247506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031247506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031247506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:50.802456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16989): Terminating (SIGTERM) 03:12:50.843737 run iperf3-srv_10.42.42.10(pid=16990): Terminating (SIGTERM) 03:12:50.885057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16991): Terminating (SIGTERM) 03:12:50.926950 run iperf3-srv_10.42.42.10(pid=16992): Terminating (SIGTERM) 03:12:50.968087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16993): Terminating (SIGTERM) 03:12:51.009487 run iperf3-srv_10.42.42.10(pid=16994): Terminating (SIGTERM) 03:12:51.050629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16995): Terminating (SIGTERM) 03:12:51.091956 run iperf3-srv_10.42.42.10(pid=16996): Terminating (SIGTERM) 03:12:51.133138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16999): Terminating (SIGTERM) 03:12:51.174352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17002): Terminating (SIGTERM) 03:12:51.215517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17005): Terminating (SIGTERM) 03:12:51.257182 --- ParallelTerminationStrategy: PID 16989 died... 03:12:51.277077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16989): Terminated: ok {rc=0} 03:12:51.322901 --- ParallelTerminationStrategy: PID 16990 died... 03:12:51.342238 run iperf3-srv_10.42.42.10(pid=16990): Terminated {rc=256} 03:12:51.387659 --- ParallelTerminationStrategy: PID 16991 died... 03:12:51.407029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16991): Terminated: ok {rc=0} 03:12:51.452447 --- ParallelTerminationStrategy: PID 16992 died... 03:12:51.471745 run iperf3-srv_10.42.42.10(pid=16992): Terminated {rc=256} 03:12:51.516911 --- ParallelTerminationStrategy: PID 16993 died... 03:12:51.536331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16993): Terminated: ok {rc=0} 03:12:51.581693 --- ParallelTerminationStrategy: PID 16994 died... 03:12:51.600697 run iperf3-srv_10.42.42.10(pid=16994): Terminated {rc=256} 03:12:51.646189 --- ParallelTerminationStrategy: PID 16995 died... 03:12:51.665839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=16995): Terminated: ok {rc=0} 03:12:51.711272 --- ParallelTerminationStrategy: PID 16996 died... 03:12:51.730548 run iperf3-srv_10.42.42.10(pid=16996): Terminated {rc=256} 03:12:51.775706 --- ParallelTerminationStrategy: PID 16999 died... 03:12:51.794965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16999): Terminated: ok {rc=0} 03:12:51.840362 --- ParallelTerminationStrategy: PID 17002 died... 03:12:51.859732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17002): Terminated: ok {rc=0} 03:12:51.905159 --- ParallelTerminationStrategy: PID 17005 died... 03:12:51.924460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17005): Terminated: ok {rc=0} 03:12:52.009321 bus /gobi_4: Setting Powered False 03:12:53.108161 bus /gobi_4: Setting Powered False 03:12:54.222846 bus /gobi_1: Setting Powered False 03:12:55.321424 bus /gobi_1: Setting Powered False 03:12:56.437145 bus /gobi_0: Setting Powered False 03:12:57.533686 bus /gobi_0: Setting Powered False 03:12:58.648988 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 03:12:59.750593 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:59.762527 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:12:59.804277 tst ping.py: using LAC 18671 03:12:59.929345 tst ping.py: using RAC 56 03:13:00.056119 tst ping.py: using CellId 18671 03:13:00.179306 tst ping.py: using BVCI 18672 03:13:00.295598 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:00.307148 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:00.318634 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:00.330049 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:00.341491 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:00.352689 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:00.364295 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:00.375663 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:13:00.493055 tst ping.py:19: start network... 03:13:00.705336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:01.201145 run create_hlr_db(pid=17007): Launched 03:13:01.360009 bus /gobi_6: Setting Powered False 03:13:02.420169 run create_hlr_db(pid=17007): Terminated: ok {rc=0} 03:13:02.861983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17009): Launched 03:13:03.176459 run osmo-hlr_10.42.42.2(pid=17010): Launched 03:13:03.295994 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:03.845068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17012): Launched 03:13:04.159952 run osmo-stp_10.42.42.5(pid=17013): Launched 03:13:04.279205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:04.828080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17015): Launched 03:13:04.948184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:05.214438 run patchelf(pid=17016): Launched 03:13:05.388702 run osmo-stp_10.42.42.5(pid=17013): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17013)] 03:13:05.521225 run osmo-stp_10.42.42.5(pid=17013): stdout: | (launched: 2022-12-09_03:13:04.102094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:05.656093 run osmo-stp_10.42.42.5(pid=17013): stderr: | 20221209031304293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031304293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031304293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031304294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031304296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031304296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031304296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:05.791329 run osmo-stp_10.42.42.5(pid=17013): stdout: | (launched: 2022-12-09_03:13:04.102094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:05.920182 run osmo-stp_10.42.42.5(pid=17013): stderr: | 20221209031304293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031304293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031304293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031304294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031304296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031304296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031304296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:06.072796 run patchelf(pid=17016): Terminating (SIGINT) 03:13:06.248579 run patchelf(pid=17016): Terminated: ok {rc=0} 03:13:06.375513 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17013): Process ended prematurely: osmo-stp_10.42.42.5(pid=17013) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17013)] [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 03:13:06.384851 tst ping.py:22: Test FAILED (6.6 sec) 03:13:06.412744 run osmo-hlr_10.42.42.2(pid=17010): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17010)] 03:13:06.462095 run osmo-hlr_10.42.42.2(pid=17010): stdout: | (launched: 2022-12-09_03:13:03.118689) 03:13:06.512863 run osmo-hlr_10.42.42.2(pid=17010): stderr: | 20221209031303315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031303315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031303315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031303315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031303315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031303315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031303329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031303338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031303338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031303338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:06.564433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17009): Terminating (SIGTERM) 03:13:06.605848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17012): Terminating (SIGTERM) 03:13:06.647306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17015): Terminating (SIGTERM) 03:13:06.689342 --- ParallelTerminationStrategy: PID 17009 died... 03:13:06.709075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17009): Terminated: ok {rc=0} 03:13:06.754639 --- ParallelTerminationStrategy: PID 17012 died... 03:13:06.773911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17012): Terminated: ok {rc=0} 03:13:06.819795 --- ParallelTerminationStrategy: PID 17015 died... 03:13:06.839121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17015): Terminated: ok {rc=0} 03:13:06.926312 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:13:08.014478 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:08.026880 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:13:08.069802 tst ping_idle_ping.py: using LAC 18672 03:13:08.194690 tst ping_idle_ping.py: using RAC 57 03:13:08.318506 tst ping_idle_ping.py: using CellId 18672 03:13:08.444016 tst ping_idle_ping.py: using BVCI 18673 03:13:08.560127 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:08.571764 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:08.583048 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:08.594412 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:08.605621 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:08.616791 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:08.628346 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:13:08.639607 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:13:08.757830 tst ping_idle_ping.py:24: start network... 03:13:08.970149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:09.468217 run create_hlr_db(pid=17017): Launched 03:13:09.596129 bus /gobi_6: Setting Powered False 03:13:10.659330 run create_hlr_db(pid=17017): Terminated: ok {rc=0} 03:13:11.083924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17019): Launched 03:13:11.380259 run osmo-hlr_10.42.42.2(pid=17020): Launched 03:13:11.493403 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:12.007178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17022): Launched 03:13:12.302823 run osmo-stp_10.42.42.5(pid=17023): Launched 03:13:12.415919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:12.925149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17025): Launched 03:13:13.038378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:13.287992 run patchelf(pid=17026): Launched 03:13:13.451590 run osmo-stp_10.42.42.5(pid=17023): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17023)] 03:13:13.576179 run osmo-stp_10.42.42.5(pid=17023): stdout: | (launched: 2022-12-09_03:13:12.248111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:13.702812 run osmo-stp_10.42.42.5(pid=17023): stderr: | 20221209031312416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031312417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031312417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031312417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031312418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031312418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031312418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:13.829536 run osmo-stp_10.42.42.5(pid=17023): stdout: | (launched: 2022-12-09_03:13:12.248111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:13.950457 run osmo-stp_10.42.42.5(pid=17023): stderr: | 20221209031312416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031312417 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031312417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031312417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031312418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031312418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031312418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:14.094352 run patchelf(pid=17026): Terminating (SIGINT) 03:13:14.260200 run patchelf(pid=17026): Terminated: ok {rc=0} 03:13:14.379862 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17023): Process ended prematurely: osmo-stp_10.42.42.5(pid=17023) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17023)] [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 03:13:14.388912 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 03:13:14.416224 run osmo-hlr_10.42.42.2(pid=17020): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17020)] 03:13:14.463914 run osmo-hlr_10.42.42.2(pid=17020): stdout: | (launched: 2022-12-09_03:13:11.325533) 03:13:14.513480 run osmo-hlr_10.42.42.2(pid=17020): stderr: | 20221209031311500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031311500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031311500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031311500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031311500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031311500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031311512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031311520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031311521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031311521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:14.563221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17019): Terminating (SIGTERM) 03:13:14.603119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17022): Terminating (SIGTERM) 03:13:14.643087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17025): Terminating (SIGTERM) 03:13:14.683401 --- ParallelTerminationStrategy: PID 17019 died... 03:13:14.702557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17019): Terminated: ok {rc=0} 03:13:14.746984 --- ParallelTerminationStrategy: PID 17022 died... 03:13:14.765444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17022): Terminated: ok {rc=0} 03:13:14.809580 --- ParallelTerminationStrategy: PID 17025 died... 03:13:14.827852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17025): Terminated: ok {rc=0} 03:13:14.913635 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:13:16.203119 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:13:16.210927 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:13:16.236778 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:13:16.282530 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:13:16.370795 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:13:16.402414 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:13:16.451945 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:13:17.037909 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:13:17.091849 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:17.104790 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:13:17.166206 tst cs_paging_gprs_active.py: using LAC 18673 03:13:17.291715 tst cs_paging_gprs_active.py: using RAC 58 03:13:17.420802 tst cs_paging_gprs_active.py: using CellId 18673 03:13:17.545888 tst cs_paging_gprs_active.py: using BVCI 18674 03:13:17.662888 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:17.675249 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:17.686987 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:17.698525 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:17.710064 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:17.721701 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:17.733365 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:17.744738 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:17.756429 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:17.872739 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:17.988085 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:13:18.189324 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:18.489707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17030): Launched 03:13:18.750171 run iperf3-srv_10.42.42.10(pid=17031): Launched 03:13:18.862281 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:13:19.061641 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:19.383927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17033): Launched 03:13:19.662103 run iperf3-srv_10.42.42.10(pid=17034): Launched 03:13:19.782400 tst cs_paging_gprs_active.py:38: start network... 03:13:19.998247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:20.494418 run create_hlr_db(pid=17035): Launched 03:13:20.624771 bus /gobi_6: Setting Powered False 03:13:21.688832 run create_hlr_db(pid=17035): Terminated: ok {rc=0} 03:13:22.117866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17037): Launched 03:13:22.417505 run osmo-hlr_10.42.42.2(pid=17038): Launched 03:13:22.531765 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:23.051456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17040): Launched 03:13:23.351094 run osmo-stp_10.42.42.5(pid=17041): Launched 03:13:23.465855 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:23.983282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17043): Launched 03:13:24.097360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:24.351228 run patchelf(pid=17044): Launched 03:13:24.518778 run osmo-stp_10.42.42.5(pid=17041): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17041)] 03:13:24.645505 run osmo-stp_10.42.42.5(pid=17041): stdout: | (launched: 2022-12-09_03:13:23.295903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:24.774581 run osmo-stp_10.42.42.5(pid=17041): stderr: | 20221209031323465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031323465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031323466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031323466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031323467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031323467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031323467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:24.903509 run osmo-stp_10.42.42.5(pid=17041): stdout: | (launched: 2022-12-09_03:13:23.295903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:25.026912 run osmo-stp_10.42.42.5(pid=17041): stderr: | 20221209031323465 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031323465 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031323466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031323466 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031323467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031323467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031323467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:25.173367 run patchelf(pid=17044): Terminating (SIGINT) 03:13:25.342506 run patchelf(pid=17044): Terminated: ok {rc=0} 03:13:25.464129 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17041): Process ended prematurely: osmo-stp_10.42.42.5(pid=17041) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17041)] [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:13:25.473583 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 03:13:25.500997 run osmo-hlr_10.42.42.2(pid=17038): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17038)] 03:13:25.549173 run osmo-hlr_10.42.42.2(pid=17038): stdout: | (launched: 2022-12-09_03:13:22.362148) 03:13:25.598679 run osmo-hlr_10.42.42.2(pid=17038): stderr: | 20221209031322537 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031322537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031322537 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031322537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031322537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031322537 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031322549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031322558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031322558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031322558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:25.648639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17030): Terminating (SIGTERM) 03:13:25.688807 run iperf3-srv_10.42.42.10(pid=17031): Terminating (SIGTERM) 03:13:25.728892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17033): Terminating (SIGTERM) 03:13:25.768932 run iperf3-srv_10.42.42.10(pid=17034): Terminating (SIGTERM) 03:13:25.808901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17037): Terminating (SIGTERM) 03:13:25.849070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17040): Terminating (SIGTERM) 03:13:25.889276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17043): Terminating (SIGTERM) 03:13:25.930155 --- ParallelTerminationStrategy: PID 17030 died... 03:13:25.949414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17030): Terminated: ok {rc=0} 03:13:25.994115 --- ParallelTerminationStrategy: PID 17031 died... 03:13:26.012661 run iperf3-srv_10.42.42.10(pid=17031): Terminated {rc=256} 03:13:26.057230 --- ParallelTerminationStrategy: PID 17033 died... 03:13:26.076115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17033): Terminated: ok {rc=0} 03:13:26.120821 --- ParallelTerminationStrategy: PID 17034 died... 03:13:26.139884 run iperf3-srv_10.42.42.10(pid=17034): Terminated {rc=256} 03:13:26.184471 --- ParallelTerminationStrategy: PID 17037 died... 03:13:26.203112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17037): Terminated: ok {rc=0} 03:13:26.247295 --- ParallelTerminationStrategy: PID 17040 died... 03:13:26.266130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17040): Terminated: ok {rc=0} 03:13:26.310471 --- ParallelTerminationStrategy: PID 17043 died... 03:13:26.329244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17043): Terminated: ok {rc=0} 03:13:26.415454 bus /gobi_0: Setting Powered False 03:13:27.514509 bus /gobi_0: Setting Powered False 03:13:28.626773 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:13:29.774699 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:29.786715 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:13:29.850503 tst iperf3.py: using LAC 18674 03:13:29.976500 tst iperf3.py: using RAC 59 03:13:30.104319 tst iperf3.py: using CellId 18674 03:13:30.235180 tst iperf3.py: using BVCI 18675 03:13:30.353294 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.364783 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.376053 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.387329 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.398648 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.409961 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.421329 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.432516 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.444019 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:30.564515 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:13:30.783251 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:31.131836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17046): Launched 03:13:31.415992 run iperf3-srv_10.42.42.10(pid=17047): Launched 03:13:31.546223 tst iperf3.py:8: start network... 03:13:31.755801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:32.236933 run create_hlr_db(pid=17048): Launched 03:13:32.373637 bus /gobi_6: Setting Powered False 03:13:33.436822 run create_hlr_db(pid=17048): Terminated: ok {rc=0} 03:13:33.865303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17050): Launched 03:13:34.165352 run osmo-hlr_10.42.42.2(pid=17051): Launched 03:13:34.279180 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:34.812406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17053): Launched 03:13:35.112627 run osmo-stp_10.42.42.5(pid=17054): Launched 03:13:35.227693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:35.745538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17056): Launched 03:13:35.859628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:36.112890 run patchelf(pid=17057): Launched 03:13:36.278601 run osmo-stp_10.42.42.5(pid=17054): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17054)] 03:13:36.405112 run osmo-stp_10.42.42.5(pid=17054): stdout: | (launched: 2022-12-09_03:13:35.057242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:36.533235 run osmo-stp_10.42.42.5(pid=17054): stderr: | 20221209031335230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031335230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031335230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031335231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031335231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031335231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031335231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:36.661244 run osmo-stp_10.42.42.5(pid=17054): stdout: | (launched: 2022-12-09_03:13:35.057242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:36.784083 run osmo-stp_10.42.42.5(pid=17054): stderr: | 20221209031335230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031335230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031335230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031335231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031335231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031335231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031335231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:36.929671 run patchelf(pid=17057): Terminating (SIGINT) 03:13:37.097752 run patchelf(pid=17057): Terminated: ok {rc=0} 03:13:37.218524 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17054): Process ended prematurely: osmo-stp_10.42.42.5(pid=17054) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17054)] [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 03:13:37.228028 tst iperf3.py:8: Test FAILED (7.5 sec) 03:13:37.255455 run osmo-hlr_10.42.42.2(pid=17051): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17051)] 03:13:37.303466 run osmo-hlr_10.42.42.2(pid=17051): stdout: | (launched: 2022-12-09_03:13:34.109828) 03:13:37.352837 run osmo-hlr_10.42.42.2(pid=17051): stderr: | 20221209031334287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031334287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031334287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031334287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031334287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031334287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031334299 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031334307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031334308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031334308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:37.402379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17046): Terminating (SIGTERM) 03:13:37.441949 run iperf3-srv_10.42.42.10(pid=17047): Terminating (SIGTERM) 03:13:37.481382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17050): Terminating (SIGTERM) 03:13:37.520930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17053): Terminating (SIGTERM) 03:13:37.560303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17056): Terminating (SIGTERM) 03:13:37.600141 --- ParallelTerminationStrategy: PID 17046 died... 03:13:37.619158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17046): Terminated: ok {rc=0} 03:13:37.663406 --- ParallelTerminationStrategy: PID 17047 died... 03:13:37.681932 run iperf3-srv_10.42.42.10(pid=17047): Terminated {rc=256} 03:13:37.725959 --- ParallelTerminationStrategy: PID 17050 died... 03:13:37.744570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17050): Terminated: ok {rc=0} 03:13:37.788458 --- ParallelTerminationStrategy: PID 17053 died... 03:13:37.807128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17053): Terminated: ok {rc=0} 03:13:37.851729 --- ParallelTerminationStrategy: PID 17056 died... 03:13:37.870281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17056): Terminated: ok {rc=0} 03:13:37.953552 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:13:39.101379 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.113762 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:13:39.176559 tst iperf3m4.py: using LAC 18675 03:13:39.295948 tst iperf3m4.py: using RAC 60 03:13:39.426457 tst iperf3m4.py: using CellId 18675 03:13:39.551877 tst iperf3m4.py: using BVCI 18676 03:13:39.661492 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.672487 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.683399 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.694494 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.705509 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.716430 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.727670 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.738760 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.749955 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:39.868359 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:39.992740 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:40.114305 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:40.235890 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:13:40.452440 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:40.775125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17058): Launched 03:13:41.054293 run iperf3-srv_10.42.42.10(pid=17059): Launched 03:13:41.174404 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:13:41.391434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:41.714326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17060): Launched 03:13:41.992771 run iperf3-srv_10.42.42.10(pid=17061): Launched 03:13:42.113252 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:13:42.329865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:42.652492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17062): Launched 03:13:42.931509 run iperf3-srv_10.42.42.10(pid=17063): Launched 03:13:43.051158 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:13:43.266469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:43.588687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17064): Launched 03:13:43.867826 run iperf3-srv_10.42.42.10(pid=17065): Launched 03:13:43.987771 tst iperf3m4.py:8: start network... 03:13:44.203376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:44.703016 run create_hlr_db(pid=17066): Launched 03:13:44.833672 bus /gobi_6: Setting Powered False 03:13:45.916851 run create_hlr_db(pid=17066): Terminated: ok {rc=0} 03:13:46.367519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17068): Launched 03:13:46.705729 run osmo-hlr_10.42.42.2(pid=17069): Launched 03:13:46.882333 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:47.566245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17071): Launched 03:13:47.866545 run osmo-stp_10.42.42.5(pid=17072): Launched 03:13:47.980323 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:48.496557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17074): Launched 03:13:48.611134 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:48.865913 run patchelf(pid=17075): Launched 03:13:49.031926 run osmo-stp_10.42.42.5(pid=17072): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17072)] 03:13:49.158393 run osmo-stp_10.42.42.5(pid=17072): stdout: | (launched: 2022-12-09_03:13:47.810806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:49.287366 run osmo-stp_10.42.42.5(pid=17072): stderr: | 20221209031347978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031347978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031347978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031347979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031347979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031347979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031347979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:49.416448 run osmo-stp_10.42.42.5(pid=17072): stdout: | (launched: 2022-12-09_03:13:47.810806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:49.540027 run osmo-stp_10.42.42.5(pid=17072): stderr: | 20221209031347978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031347978 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031347978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031347979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031347979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031347979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031347979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:49.685566 run patchelf(pid=17075): Terminating (SIGINT) 03:13:49.854060 run patchelf(pid=17075): Terminated: ok {rc=0} 03:13:49.975339 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17072): Process ended prematurely: osmo-stp_10.42.42.5(pid=17072) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17072)] [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:13:49.984887 tst iperf3m4.py:8: Test FAILED (10.9 sec) 03:13:50.012668 run osmo-hlr_10.42.42.2(pid=17069): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17069)] 03:13:50.059776 run osmo-hlr_10.42.42.2(pid=17069): stdout: | (launched: 2022-12-09_03:13:46.638056) 03:13:50.108489 run osmo-hlr_10.42.42.2(pid=17069): stderr: | 20221209031347048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031347048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031347048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031347048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031347051 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031347051 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031347077 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031347096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031347096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031347096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:50.157534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17058): Terminating (SIGTERM) 03:13:50.197122 run iperf3-srv_10.42.42.10(pid=17059): Terminating (SIGTERM) 03:13:50.236595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17060): Terminating (SIGTERM) 03:13:50.276153 run iperf3-srv_10.42.42.10(pid=17061): Terminating (SIGTERM) 03:13:50.315556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17062): Terminating (SIGTERM) 03:13:50.355163 run iperf3-srv_10.42.42.10(pid=17063): Terminating (SIGTERM) 03:13:50.394635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17064): Terminating (SIGTERM) 03:13:50.434330 run iperf3-srv_10.42.42.10(pid=17065): Terminating (SIGTERM) 03:13:50.473715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17068): Terminating (SIGTERM) 03:13:50.513398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17071): Terminating (SIGTERM) 03:13:50.552932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17074): Terminating (SIGTERM) 03:13:50.592785 --- ParallelTerminationStrategy: PID 17058 died... 03:13:50.611834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17058): Terminated: ok {rc=0} 03:13:50.655974 --- ParallelTerminationStrategy: PID 17059 died... 03:13:50.674485 run iperf3-srv_10.42.42.10(pid=17059): Terminated {rc=256} 03:13:50.718574 --- ParallelTerminationStrategy: PID 17060 died... 03:13:50.737318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17060): Terminated: ok {rc=0} 03:13:50.781203 --- ParallelTerminationStrategy: PID 17061 died... 03:13:50.799681 run iperf3-srv_10.42.42.10(pid=17061): Terminated {rc=256} 03:13:50.843581 --- ParallelTerminationStrategy: PID 17062 died... 03:13:50.862147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17062): Terminated: ok {rc=0} 03:13:50.905946 --- ParallelTerminationStrategy: PID 17063 died... 03:13:50.924332 run iperf3-srv_10.42.42.10(pid=17063): Terminated {rc=256} 03:13:50.968008 --- ParallelTerminationStrategy: PID 17064 died... 03:13:50.986582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17064): Terminated: ok {rc=0} 03:13:51.030283 --- ParallelTerminationStrategy: PID 17065 died... 03:13:51.048576 run iperf3-srv_10.42.42.10(pid=17065): Terminated {rc=256} 03:13:51.092097 --- ParallelTerminationStrategy: PID 17068 died... 03:13:51.110444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17068): Terminated: ok {rc=0} 03:13:51.154086 --- ParallelTerminationStrategy: PID 17071 died... 03:13:51.172509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17071): Terminated: ok {rc=0} 03:13:51.216163 --- ParallelTerminationStrategy: PID 17074 died... 03:13:51.234801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17074): Terminated: ok {rc=0} 03:13:51.320506 bus /gobi_4: Setting Powered False 03:13:52.421811 bus /gobi_4: Setting Powered False 03:13:53.540472 bus /gobi_1: Setting Powered False 03:13:54.637881 bus /gobi_1: Setting Powered False 03:13:55.752359 bus /gobi_0: Setting Powered False 03:13:56.851340 bus /gobi_0: Setting Powered False 03:13:57.965310 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:13:59.066486 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:59.078818 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:13:59.140681 tst ping.py: using LAC 18676 03:13:59.266492 tst ping.py: using RAC 61 03:13:59.390884 tst ping.py: using CellId 18676 03:13:59.515882 tst ping.py: using BVCI 18677 03:13:59.632544 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:59.644141 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:59.655474 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:59.666830 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:59.678164 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:59.689530 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:59.701409 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:59.712647 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:59.825962 tst ping.py:19: start network... 03:14:00.022942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:00.479984 run create_hlr_db(pid=17076): Launched 03:14:00.593464 bus /gobi_6: Setting Powered False 03:14:01.653324 run create_hlr_db(pid=17076): Terminated: ok {rc=0} 03:14:02.085819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17078): Launched 03:14:02.416281 run osmo-hlr_10.42.42.2(pid=17079): Launched 03:14:02.536349 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:03.090043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17081): Launched 03:14:03.404849 run osmo-stp_10.42.42.5(pid=17082): Launched 03:14:03.525965 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:14:04.071897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17084): Launched 03:14:04.192109 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:14:04.458133 run patchelf(pid=17085): Launched 03:14:04.633050 run osmo-stp_10.42.42.5(pid=17082): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17082)] 03:14:04.766884 run osmo-stp_10.42.42.5(pid=17082): stdout: | (launched: 2022-12-09_03:14:03.347020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:04.902245 run osmo-stp_10.42.42.5(pid=17082): stderr: | 20221209031403540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031403540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031403540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031403540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031403541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031403541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031403541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:05.037631 run osmo-stp_10.42.42.5(pid=17082): stdout: | (launched: 2022-12-09_03:14:03.347020) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:05.167155 run osmo-stp_10.42.42.5(pid=17082): stderr: | 20221209031403540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031403540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031403540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031403540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031403541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031403541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031403541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:05.320105 run patchelf(pid=17085): Terminating (SIGINT) 03:14:05.497241 run patchelf(pid=17085): Terminated: ok {rc=0} 03:14:05.624738 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17082): Process ended prematurely: osmo-stp_10.42.42.5(pid=17082) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17082)] [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 03:14:05.634685 tst ping.py:22: Test FAILED (6.6 sec) 03:14:05.662704 run osmo-hlr_10.42.42.2(pid=17079): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17079)] 03:14:05.712637 run osmo-hlr_10.42.42.2(pid=17079): stdout: | (launched: 2022-12-09_03:14:02.358244) 03:14:05.764165 run osmo-hlr_10.42.42.2(pid=17079): stderr: | 20221209031402556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031402556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031402556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031402556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031402556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031402556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031402569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031402577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031402578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031402578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:05.815980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17078): Terminating (SIGTERM) 03:14:05.857289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17081): Terminating (SIGTERM) 03:14:05.898880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17084): Terminating (SIGTERM) 03:14:05.940650 --- ParallelTerminationStrategy: PID 17078 died... 03:14:05.960627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17078): Terminated: ok {rc=0} 03:14:06.006922 --- ParallelTerminationStrategy: PID 17081 died... 03:14:06.026508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17081): Terminated: ok {rc=0} 03:14:06.072345 --- ParallelTerminationStrategy: PID 17084 died... 03:14:06.091888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17084): Terminated: ok {rc=0} 03:14:06.179470 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:14:07.267416 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:14:07.280202 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:14:07.346908 tst ping_idle_ping.py: using LAC 18677 03:14:07.476299 tst ping_idle_ping.py: using RAC 62 03:14:07.594210 tst ping_idle_ping.py: using CellId 18677 03:14:07.711762 tst ping_idle_ping.py: using BVCI 18678 03:14:07.819504 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:14:07.830772 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:14:07.841800 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:14:07.853522 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:14:07.865194 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:14:07.876785 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:14:07.888428 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:14:07.899972 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:14:08.014684 tst ping_idle_ping.py:24: start network... 03:14:08.212405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:08.672405 run create_hlr_db(pid=17086): Launched 03:14:08.784362 bus /gobi_6: Setting Powered False 03:14:09.843809 run create_hlr_db(pid=17086): Terminated: ok {rc=0} 03:14:10.277277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17088): Launched 03:14:10.593210 run osmo-hlr_10.42.42.2(pid=17089): Launched 03:14:10.714915 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:11.262881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17091): Launched 03:14:11.578301 run osmo-stp_10.42.42.5(pid=17092): Launched 03:14:11.698634 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:14:12.243187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17094): Launched 03:14:12.363297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:14:12.630449 run patchelf(pid=17095): Launched 03:14:12.805872 run osmo-stp_10.42.42.5(pid=17092): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17092)] 03:14:12.939059 run osmo-stp_10.42.42.5(pid=17092): stdout: | (launched: 2022-12-09_03:14:11.519780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:13.074356 run osmo-stp_10.42.42.5(pid=17092): stderr: | 20221209031411713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031411713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031411713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031411714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031411714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031411714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031411714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:13.209579 run osmo-stp_10.42.42.5(pid=17092): stdout: | (launched: 2022-12-09_03:14:11.519780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:13.339250 run osmo-stp_10.42.42.5(pid=17092): stderr: | 20221209031411713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031411713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031411713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031411714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031411714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031411714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031411714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:13.492901 run patchelf(pid=17095): Terminating (SIGINT) 03:14:13.670211 run patchelf(pid=17095): Terminated: ok {rc=0} 03:14:13.797766 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17092): Process ended prematurely: osmo-stp_10.42.42.5(pid=17092) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17092)] [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:14:13.806999 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:14:13.834733 run osmo-hlr_10.42.42.2(pid=17089): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17089)] 03:14:13.883818 run osmo-hlr_10.42.42.2(pid=17089): stdout: | (launched: 2022-12-09_03:14:10.535167) 03:14:13.934606 run osmo-hlr_10.42.42.2(pid=17089): stderr: | 20221209031410733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031410733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031410733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031410734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031410734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031410734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031410746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031410754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031410754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031410754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:13.985759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17088): Terminating (SIGTERM) 03:14:14.026935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17091): Terminating (SIGTERM) 03:14:14.068248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17094): Terminating (SIGTERM) 03:14:14.109893 --- ParallelTerminationStrategy: PID 17088 died... 03:14:14.129609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17088): Terminated: ok {rc=0} 03:14:14.175432 --- ParallelTerminationStrategy: PID 17091 died... 03:14:14.194820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17091): Terminated: ok {rc=0} 03:14:14.240356 --- ParallelTerminationStrategy: PID 17094 died... 03:14:14.259671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17094): Terminated: ok {rc=0} 03:14:14.346350 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 03:14:15.646791 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:15.655302 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:14:15.680054 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:14:15.715949 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:14:15.771276 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:14:15.796137 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:14:15.831423 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:14:16.407830 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:14:16.414795 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:14:16.428071 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:14:16.490193 tst switch_tch_pdch.py: using LAC 18678 03:14:16.618213 tst switch_tch_pdch.py: using RAC 63 03:14:16.763782 tst switch_tch_pdch.py: using CellId 18678 03:14:16.919554 tst switch_tch_pdch.py: using BVCI 18679 03:14:17.038110 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:14:17.051039 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:14:17.063775 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:14:17.076675 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:14:17.089473 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:14:17.102166 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:14:17.115087 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:14:17.128115 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:14:17.252155 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:14:17.372624 tst switch_tch_pdch.py:51: start network... 03:14:17.586222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:18.076354 run create_hlr_db(pid=17100): Launched 03:14:18.204166 bus /gobi_6: Setting Powered False 03:14:19.267650 run create_hlr_db(pid=17100): Terminated: ok {rc=0} 03:14:19.690674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17102): Launched 03:14:19.984716 run osmo-hlr_10.42.42.2(pid=17103): Launched 03:14:20.096857 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:20.615538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17105): Launched 03:14:20.910525 run osmo-stp_10.42.42.5(pid=17106): Launched 03:14:21.022758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:14:21.532373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17108): Launched 03:14:21.645970 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:14:21.895772 run patchelf(pid=17109): Launched 03:14:22.059465 run osmo-stp_10.42.42.5(pid=17106): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17106)] 03:14:22.184269 run osmo-stp_10.42.42.5(pid=17106): stdout: | (launched: 2022-12-09_03:14:20.856202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:22.310931 run osmo-stp_10.42.42.5(pid=17106): stderr: | 20221209031421024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031421024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031421024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031421025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031421027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031421027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031421027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:22.437615 run osmo-stp_10.42.42.5(pid=17106): stdout: | (launched: 2022-12-09_03:14:20.856202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:22.558594 run osmo-stp_10.42.42.5(pid=17106): stderr: | 20221209031421024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031421024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031421024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031421025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031421027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031421027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031421027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:22.702297 run patchelf(pid=17109): Terminating (SIGINT) 03:14:22.867447 run patchelf(pid=17109): Terminated: ok {rc=0} 03:14:22.986356 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17106): Process ended prematurely: osmo-stp_10.42.42.5(pid=17106) [trial-2353↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17106)] [trial-2353↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:14:22.995198 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 03:14:23.022141 run osmo-hlr_10.42.42.2(pid=17103): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17103)] 03:14:23.069785 run osmo-hlr_10.42.42.2(pid=17103): stdout: | (launched: 2022-12-09_03:14:19.930367) 03:14:23.119065 run osmo-hlr_10.42.42.2(pid=17103): stderr: | 20221209031420106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031420106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031420106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031420106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031420106 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031420106 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031420119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031420128 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031420128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031420128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:23.168717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17102): Terminating (SIGTERM) 03:14:23.208650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17105): Terminating (SIGTERM) 03:14:23.248421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17108): Terminating (SIGTERM) 03:14:23.288416 --- ParallelTerminationStrategy: PID 17102 died... 03:14:23.307290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17102): Terminated: ok {rc=0} 03:14:23.351765 --- ParallelTerminationStrategy: PID 17105 died... 03:14:23.370324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17105): Terminated: ok {rc=0} 03:14:23.414107 --- ParallelTerminationStrategy: PID 17108 died... 03:14:23.432487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17108): Terminated: ok {rc=0} 03:14:23.517389 bus /gobi_0: Setting Powered False 03:14:24.615672 bus /gobi_0: Setting Powered False 03:14:25.732680 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 sms:nanobts+band-900 --------------------------------------------------------------------- 03:14:26.981580 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:26.986797 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:14:27.019850 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 03:14:27.047250 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 03:14:27.099816 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:14:27.132670 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 03:14:27.159987 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 03:14:27.710820 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 03:14:27.715894 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:27.727071 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 03:14:27.774273 tst mo_mt_sms.py: using LAC 18679 03:14:27.899766 tst mo_mt_sms.py: using RAC 64 03:14:28.023955 tst mo_mt_sms.py: using CellId 18679 03:14:28.148232 tst mo_mt_sms.py: using BVCI 18680 03:14:28.262876 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:28.274095 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:28.285147 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:28.296181 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:28.307206 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:28.318232 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 03:14:28.435065 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 03:14:28.550410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:29.009054 run create_hlr_db(pid=17114): Launched 03:14:29.121980 bus /gobi_6: Setting Powered False 03:14:30.181051 run create_hlr_db(pid=17114): Terminated: ok {rc=0} 03:14:30.592671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17116): Launched 03:14:30.913820 run osmo-hlr_10.42.42.2(pid=17117): Launched 03:14:31.067463 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:31.812062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17119): Launched 03:14:32.245717 run osmo-stp_10.42.42.5(pid=17120): Launched 03:14:32.367245 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:32.933238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17122): Launched 03:14:33.228913 run osmo-msc_10.42.42.6(pid=17123): Launched 03:14:33.394710 run osmo-stp_10.42.42.5(pid=17120): ERR: Terminated: ERROR {rc=1} [trial-2353↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17120)] 03:14:33.529150 run osmo-stp_10.42.42.5(pid=17120): stdout: | (launched: 2022-12-09_03:14:32.182973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:33.663673 run osmo-stp_10.42.42.5(pid=17120): stderr: | 20221209031432495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031432495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031432495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031432495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031432498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031432498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031432498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:33.795883 run osmo-stp_10.42.42.5(pid=17120): stdout: | (launched: 2022-12-09_03:14:32.182973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:33.921554 run osmo-stp_10.42.42.5(pid=17120): stderr: | 20221209031432495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031432495 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031432495 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031432495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031432498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031432498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031432498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:34.071960 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=17120): Process ended prematurely: osmo-stp_10.42.42.5(pid=17120) [trial-2353↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17120)] [trial-2353↪sms:nanobts+band-900↪mo_mt_sms.py:16] 03:14:34.080864 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 03:14:34.107932 run osmo-hlr_10.42.42.2(pid=17117): ERR: Terminated: ERROR {rc=237} [trial-2353↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17117)] 03:14:34.157422 run osmo-hlr_10.42.42.2(pid=17117): stdout: | (launched: 2022-12-09_03:14:30.837841) 03:14:34.208443 run osmo-hlr_10.42.42.2(pid=17117): stderr: | 20221209031431224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031431224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031431224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031431224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031431224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031431224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031431246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031431273 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031431273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031431274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:34.279878 run osmo-msc_10.42.42.6(pid=17123): ERR: Terminated: ERROR {rc=2} [trial-2353↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17123)] 03:14:34.329434 run osmo-msc_10.42.42.6(pid=17123): stdout: | (launched: 2022-12-09_03:14:33.174116) 03:14:34.380902 run osmo-msc_10.42.42.6(pid=17123): stderr: | 20221209031433442 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031433442 DLGLOBAL DEBUG validating counter group 0x7f0dee775c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031433442 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031433442 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031433442 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031433443 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031433445 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031433445 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031433445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031433445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:34.432178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17116): Terminating (SIGTERM) 03:14:34.473237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17119): Terminating (SIGTERM) 03:14:34.514489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17122): Terminating (SIGTERM) 03:14:34.556223 --- ParallelTerminationStrategy: PID 17116 died... 03:14:34.576136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17116): Terminated: ok {rc=0} 03:14:34.621840 --- ParallelTerminationStrategy: PID 17119 died... 03:14:34.641237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17119): Terminated: ok {rc=0} 03:14:34.686866 --- ParallelTerminationStrategy: PID 17122 died... 03:14:34.706238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17122): Terminated: ok {rc=0} 03:14:34.793372 bus /sierra_3: Setting Powered False 03:14:35.891176 bus /sierra_3: Setting Powered False 03:14:37.007466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 03:14:38.245988 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:38.251043 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:14:38.283832 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 03:14:38.291168 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 03:14:38.328079 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:14:38.360230 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 03:14:38.366850 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 03:14:38.886056 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2353 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 03:14:38.891431 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 03:14:38.902873 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 03:14:38.950425 tst assert_extension.py: using LAC 18680 03:14:39.076860 tst assert_extension.py: using RAC 65 03:14:39.200936 tst assert_extension.py: using CellId 18680 03:14:39.325363 tst assert_extension.py: using BVCI 18681 03:14:39.439961 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 03:14:39.554013 tst assert_extension.py:10: start nitb and bts... 03:14:39.751856 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:14:40.356003 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17129): Launched 03:14:40.650093 run osmo-nitb_10.42.42.2(pid=17130): Launched 03:14:40.812785 run osmo-nitb_10.42.42.2(pid=17130): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17130)] 03:14:40.944926 run osmo-nitb_10.42.42.2(pid=17130): stdout: | (launched: 2022-12-09_03:14:40.595617) 03:14:41.078467 run osmo-nitb_10.42.42.2(pid=17130): stderr: | (launched: 2022-12-09_03:14:40.639323) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:14:41.211990 run osmo-nitb_10.42.42.2(pid=17130): stdout: | (launched: 2022-12-09_03:14:40.595617) 03:14:41.340221 run osmo-nitb_10.42.42.2(pid=17130): stderr: | (launched: 2022-12-09_03:14:40.639323) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17130): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17130) [trial-2353↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17130)] 03:14:41.761195 tst osmo-nitb_10.42.42.2(pid=17130): stdout: | (launched: 2022-12-09_03:14:40.595617) 03:14:41.880295 tst osmo-nitb_10.42.42.2(pid=17130): stderr: | (launched: 2022-12-09_03:14:40.639323) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:14:42.020261 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=17130): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17130) [trial-2353↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17130)] [trial-2353↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 03:14:42.028634 tst assert_extension.py:12: Test FAILED (3.1 sec) 03:14:42.035117 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17129): Terminating (SIGTERM) 03:14:42.244019 --- ParallelTerminationStrategy: PID 17129 died... 03:14:42.264567 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17129): Terminated: ok {rc=0} 03:14:42.350409 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 ussd:nanobts+band-900 --------------------------------------------------------------------- 03:14:43.523511 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:43.528107 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:14:43.560646 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 03:14:43.587924 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 03:14:43.622622 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:14:43.654880 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 03:14:43.681261 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 03:14:44.210863 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2353 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 03:14:44.215820 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:44.226524 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 03:14:44.275371 tst assert_extension.py: using LAC 18681 03:14:44.389570 tst assert_extension.py: using RAC 66 03:14:44.515644 tst assert_extension.py: using CellId 18681 03:14:44.642829 tst assert_extension.py: using BVCI 18682 03:14:44.759703 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:44.771025 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:44.782131 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:44.793210 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:44.804245 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:44.815261 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 03:14:44.927591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:45.384276 run create_hlr_db(pid=17134): Launched 03:14:45.496749 bus /sierra_2: Setting Powered False 03:14:46.562052 run create_hlr_db(pid=17134): Terminated: ok {rc=0} 03:14:46.987881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17136): Launched 03:14:47.299677 run osmo-hlr_10.42.42.2(pid=17137): Launched 03:14:47.414231 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:47.934599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17139): Launched 03:14:48.228126 run osmo-stp_10.42.42.5(pid=17140): Launched 03:14:48.340858 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:48.872778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17142): Launched 03:14:49.167116 run osmo-msc_10.42.42.6(pid=17143): Launched 03:14:49.331717 run osmo-stp_10.42.42.5(pid=17140): ERR: Terminated: ERROR {rc=1} [trial-2353↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17140)] 03:14:49.456464 run osmo-stp_10.42.42.5(pid=17140): stdout: | (launched: 2022-12-09_03:14:48.173210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:49.581199 run osmo-stp_10.42.42.5(pid=17140): stderr: | 20221209031448344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031448344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031448345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031448345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031448346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031448346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031448346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:49.703663 run osmo-stp_10.42.42.5(pid=17140): stdout: | (launched: 2022-12-09_03:14:48.173210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:49.820422 run osmo-stp_10.42.42.5(pid=17140): stderr: | 20221209031448344 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031448344 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031448345 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031448345 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031448346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031448346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031448346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:49.960794 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=17140): Process ended prematurely: osmo-stp_10.42.42.5(pid=17140) [trial-2353↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17140)] [trial-2353↪ussd:nanobts+band-900↪assert_extension.py:17] 03:14:49.969130 tst assert_extension.py:17: Test FAILED (5.7 sec) 03:14:49.995414 run osmo-hlr_10.42.42.2(pid=17137): ERR: Terminated: ERROR {rc=237} [trial-2353↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17137)] 03:14:50.043062 run osmo-hlr_10.42.42.2(pid=17137): stdout: | (launched: 2022-12-09_03:14:47.245162) 03:14:50.092401 run osmo-hlr_10.42.42.2(pid=17137): stderr: | 20221209031447418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031447418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031447418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031447418 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031447418 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031447418 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031447430 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031447438 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031447439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031447439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:50.161121 run osmo-msc_10.42.42.6(pid=17143): ERR: Terminated: ERROR {rc=2} [trial-2353↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17143)] 03:14:50.208640 run osmo-msc_10.42.42.6(pid=17143): stdout: | (launched: 2022-12-09_03:14:49.112375) 03:14:50.257574 run osmo-msc_10.42.42.6(pid=17143): stderr: | 20221209031449384 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031449385 DLGLOBAL DEBUG validating counter group 0x7f2e80af7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031449385 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031449385 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031449385 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031449385 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031449387 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031449387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031449388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031449388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:50.307082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17136): Terminating (SIGTERM) 03:14:50.346576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17139): Terminating (SIGTERM) 03:14:50.386007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17142): Terminating (SIGTERM) 03:14:50.425930 --- ParallelTerminationStrategy: PID 17136 died... 03:14:50.444991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17136): Terminated: ok {rc=0} 03:14:50.489171 --- ParallelTerminationStrategy: PID 17139 died... 03:14:50.507592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17139): Terminated: ok {rc=0} 03:14:50.551878 --- ParallelTerminationStrategy: PID 17142 died... 03:14:50.570404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17142): Terminated: ok {rc=0} 03:14:50.652611 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:14:51.864582 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:51.872673 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:14:51.906155 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:14:51.933641 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:14:51.990844 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:14:52.023872 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:14:52.050966 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:14:52.600683 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:14:52.652920 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:52.664674 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:14:52.731002 tst mo_mt_call.py: using LAC 18682 03:14:52.855312 tst mo_mt_call.py: using RAC 67 03:14:52.979737 tst mo_mt_call.py: using CellId 18682 03:14:53.104243 tst mo_mt_call.py: using BVCI 18683 03:14:53.220656 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:53.232406 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:53.243960 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:53.255505 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:53.267525 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:53.279369 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:14:53.395423 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:14:53.511110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:54.010560 run create_hlr_db(pid=17148): Launched 03:14:54.139933 bus /sierra_2: Setting Powered False 03:14:55.202931 run create_hlr_db(pid=17148): Terminated: ok {rc=0} 03:14:55.649636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17150): Launched 03:14:55.970160 run osmo-hlr_10.42.42.2(pid=17151): Launched 03:14:56.092852 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:56.650050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17153): Launched 03:14:56.969975 run osmo-stp_10.42.42.5(pid=17154): Launched 03:14:57.092547 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:57.672408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17156): Launched 03:14:57.994164 run osmo-msc_10.42.42.6(pid=17157): Launched 03:14:58.172916 run osmo-stp_10.42.42.5(pid=17154): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17154)] 03:14:58.308638 run osmo-stp_10.42.42.5(pid=17154): stdout: | (launched: 2022-12-09_03:14:56.911242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:58.443540 run osmo-stp_10.42.42.5(pid=17154): stderr: | 20221209031457102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031457102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031457102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031457103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031457103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031457103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031457103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:58.578546 run osmo-stp_10.42.42.5(pid=17154): stdout: | (launched: 2022-12-09_03:14:56.911242) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:58.706259 run osmo-stp_10.42.42.5(pid=17154): stderr: | 20221209031457102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031457102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031457102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031457103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031457103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031457103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031457103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:58.859626 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17154): Process ended prematurely: osmo-stp_10.42.42.5(pid=17154) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17154)] [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:14:58.869136 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:14:58.896802 run osmo-hlr_10.42.42.2(pid=17151): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17151)] 03:14:58.946631 run osmo-hlr_10.42.42.2(pid=17151): stdout: | (launched: 2022-12-09_03:14:55.911410) 03:14:58.998016 run osmo-hlr_10.42.42.2(pid=17151): stderr: | 20221209031456110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031456110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031456110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031456110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031456110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031456110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031456122 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031456130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031456130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031456130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:59.070109 run osmo-msc_10.42.42.6(pid=17157): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17157)] 03:14:59.119674 run osmo-msc_10.42.42.6(pid=17157): stdout: | (launched: 2022-12-09_03:14:57.935337) 03:14:59.170680 run osmo-msc_10.42.42.6(pid=17157): stderr: | 20221209031458258 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031458258 DLGLOBAL DEBUG validating counter group 0x7f4859d09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031458258 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031458258 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031458258 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031458258 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031458260 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031458260 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031458260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031458261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:59.222191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17150): Terminating (SIGTERM) 03:14:59.263355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17153): Terminating (SIGTERM) 03:14:59.304554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17156): Terminating (SIGTERM) 03:14:59.346252 --- ParallelTerminationStrategy: PID 17150 died... 03:14:59.365742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17150): Terminated: ok {rc=0} 03:14:59.411271 --- ParallelTerminationStrategy: PID 17153 died... 03:14:59.430637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17153): Terminated: ok {rc=0} 03:14:59.475980 --- ParallelTerminationStrategy: PID 17156 died... 03:14:59.495284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17156): Terminated: ok {rc=0} 03:14:59.580889 bus /sierra_3: Setting Powered False 03:15:00.680084 bus /sierra_3: Setting Powered False 03:15:01.796059 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:15:02.947428 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:15:02.959603 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:15:03.028013 tst mo_mt_call_osmux.py: using LAC 18683 03:15:03.153387 tst mo_mt_call_osmux.py: using RAC 68 03:15:03.270986 tst mo_mt_call_osmux.py: using CellId 18683 03:15:03.388229 tst mo_mt_call_osmux.py: using BVCI 18684 03:15:03.497312 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:15:03.508370 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:15:03.519268 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:15:03.530594 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:15:03.541923 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:15:03.553150 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:15:03.670103 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:15:03.786006 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:04.250876 run create_hlr_db(pid=17162): Launched 03:15:04.364490 bus /sierra_2: Setting Powered False 03:15:05.425340 run create_hlr_db(pid=17162): Terminated: ok {rc=0} 03:15:05.865133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17164): Launched 03:15:06.187486 run osmo-hlr_10.42.42.2(pid=17165): Launched 03:15:06.310289 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:06.870051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17167): Launched 03:15:07.193303 run osmo-stp_10.42.42.5(pid=17168): Launched 03:15:07.317402 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:07.903132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17170): Launched 03:15:08.226393 run osmo-msc_10.42.42.6(pid=17171): Launched 03:15:08.407155 run osmo-stp_10.42.42.5(pid=17168): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17168)] 03:15:08.546414 run osmo-stp_10.42.42.5(pid=17168): stdout: | (launched: 2022-12-09_03:15:07.134055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:08.682805 run osmo-stp_10.42.42.5(pid=17168): stderr: | 20221209031507326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031507327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031507327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031507327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031507330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031507330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031507330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:08.818538 run osmo-stp_10.42.42.5(pid=17168): stdout: | (launched: 2022-12-09_03:15:07.134055) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:08.947364 run osmo-stp_10.42.42.5(pid=17168): stderr: | 20221209031507326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031507327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031507327 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031507327 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031507330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031507330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031507330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:09.101383 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17168): Process ended prematurely: osmo-stp_10.42.42.5(pid=17168) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17168)] [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:15:09.110963 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:15:09.138788 run osmo-hlr_10.42.42.2(pid=17165): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17165)] 03:15:09.188361 run osmo-hlr_10.42.42.2(pid=17165): stdout: | (launched: 2022-12-09_03:15:06.128438) 03:15:09.239571 run osmo-hlr_10.42.42.2(pid=17165): stderr: | 20221209031506326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031506326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031506326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031506326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031506326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031506326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031506338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031506349 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031506350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031506350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:09.311468 run osmo-msc_10.42.42.6(pid=17171): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17171)] 03:15:09.361192 run osmo-msc_10.42.42.6(pid=17171): stdout: | (launched: 2022-12-09_03:15:08.167109) 03:15:09.412356 run osmo-msc_10.42.42.6(pid=17171): stderr: | 20221209031508490 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031508491 DLGLOBAL DEBUG validating counter group 0x7f7814140c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031508491 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031508491 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031508491 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031508491 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031508493 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031508493 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031508493 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031508493 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:09.463989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17164): Terminating (SIGTERM) 03:15:09.505746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17167): Terminating (SIGTERM) 03:15:09.547425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17170): Terminating (SIGTERM) 03:15:09.589272 --- ParallelTerminationStrategy: PID 17164 died... 03:15:09.609219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17164): Terminated: ok {rc=0} 03:15:09.655357 --- ParallelTerminationStrategy: PID 17167 died... 03:15:09.674918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17167): Terminated: ok {rc=0} 03:15:09.720665 --- ParallelTerminationStrategy: PID 17170 died... 03:15:09.740641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17170): Terminated: ok {rc=0} 03:15:09.827892 bus /sierra_3: Setting Powered False 03:15:10.926207 bus /sierra_3: Setting Powered False 03:15:12.041228 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:15:13.299231 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:15:13.307513 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:15:13.340819 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:15:13.368225 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:15:13.420238 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:15:13.452932 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:15:13.480117 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:15:14.035943 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:15:14.087528 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:15:14.099256 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:15:14.165537 tst mo_mt_call.py: using LAC 18684 03:15:14.289870 tst mo_mt_call.py: using RAC 69 03:15:14.413858 tst mo_mt_call.py: using CellId 18684 03:15:14.538330 tst mo_mt_call.py: using BVCI 18685 03:15:14.654724 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:15:14.666442 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:15:14.677874 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:15:14.689417 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:15:14.700910 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:15:14.712367 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:15:14.829841 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:15:14.946896 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:15.413124 run create_hlr_db(pid=17176): Launched 03:15:15.527376 bus /sierra_2: Setting Powered False 03:15:16.587701 run create_hlr_db(pid=17176): Terminated: ok {rc=0} 03:15:17.069907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17178): Launched 03:15:17.387659 run osmo-hlr_10.42.42.2(pid=17179): Launched 03:15:17.504583 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:18.025925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17181): Launched 03:15:18.326565 run osmo-stp_10.42.42.5(pid=17182): Launched 03:15:18.441827 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:18.984918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17184): Launched 03:15:19.285807 run osmo-msc_10.42.42.6(pid=17185): Launched 03:15:19.455382 run osmo-stp_10.42.42.5(pid=17182): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17182)] 03:15:19.583480 run osmo-stp_10.42.42.5(pid=17182): stdout: | (launched: 2022-12-09_03:15:18.271317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:19.710912 run osmo-stp_10.42.42.5(pid=17182): stderr: | 20221209031518440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031518440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031518440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031518441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031518443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031518443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031518443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:19.836082 run osmo-stp_10.42.42.5(pid=17182): stdout: | (launched: 2022-12-09_03:15:18.271317) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:19.955555 run osmo-stp_10.42.42.5(pid=17182): stderr: | 20221209031518440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031518440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031518440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031518441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031518443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031518443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031518443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:20.099238 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17182): Process ended prematurely: osmo-stp_10.42.42.5(pid=17182) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17182)] [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:15:20.108232 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:15:20.135056 run osmo-hlr_10.42.42.2(pid=17179): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17179)] 03:15:20.182773 run osmo-hlr_10.42.42.2(pid=17179): stdout: | (launched: 2022-12-09_03:15:17.332651) 03:15:20.232053 run osmo-hlr_10.42.42.2(pid=17179): stderr: | 20221209031517508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031517508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031517508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031517508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031517508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031517508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031517523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031517533 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031517533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031517533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:20.300744 run osmo-msc_10.42.42.6(pid=17185): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17185)] 03:15:20.348417 run osmo-msc_10.42.42.6(pid=17185): stdout: | (launched: 2022-12-09_03:15:19.230515) 03:15:20.397424 run osmo-msc_10.42.42.6(pid=17185): stderr: | 20221209031519500 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031519500 DLGLOBAL DEBUG validating counter group 0x7fcc1037ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031519500 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031519500 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031519500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031519501 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031519502 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031519503 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031519503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031519503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:20.446795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17178): Terminating (SIGTERM) 03:15:20.486407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17181): Terminating (SIGTERM) 03:15:20.526435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17184): Terminating (SIGTERM) 03:15:20.566520 --- ParallelTerminationStrategy: PID 17178 died... 03:15:20.585530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17178): Terminated: ok {rc=0} 03:15:20.629682 --- ParallelTerminationStrategy: PID 17181 died... 03:15:20.648115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17181): Terminated: ok {rc=0} 03:15:20.692231 --- ParallelTerminationStrategy: PID 17184 died... 03:15:20.710822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17184): Terminated: ok {rc=0} 03:15:20.796235 bus /sierra_3: Setting Powered False 03:15:21.895786 bus /sierra_3: Setting Powered False 03:15:23.008065 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:15:24.157258 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:15:24.169639 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:15:24.242599 tst mo_mt_call_osmux.py: using LAC 18685 03:15:24.369626 tst mo_mt_call_osmux.py: using RAC 70 03:15:24.497396 tst mo_mt_call_osmux.py: using CellId 18685 03:15:24.624721 tst mo_mt_call_osmux.py: using BVCI 18686 03:15:24.742224 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:15:24.754173 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:15:24.765876 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:15:24.777560 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:15:24.789324 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:15:24.800636 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:15:24.919585 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:15:25.035886 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:25.536250 run create_hlr_db(pid=17187): Launched 03:15:25.666515 bus /sierra_2: Setting Powered False 03:15:26.730480 run create_hlr_db(pid=17187): Terminated: ok {rc=0} 03:15:27.159344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17189): Launched 03:15:27.459122 run osmo-hlr_10.42.42.2(pid=17190): Launched 03:15:27.575113 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:28.096102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17192): Launched 03:15:28.396612 run osmo-stp_10.42.42.5(pid=17193): Launched 03:15:28.512068 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:29.057187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17195): Launched 03:15:29.359241 run osmo-msc_10.42.42.6(pid=17196): Launched 03:15:29.528398 run osmo-stp_10.42.42.5(pid=17193): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17193)] 03:15:29.657248 run osmo-stp_10.42.42.5(pid=17193): stdout: | (launched: 2022-12-09_03:15:28.341344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:29.784832 run osmo-stp_10.42.42.5(pid=17193): stderr: | 20221209031528512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031528512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031528512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031528513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031528513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031528513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031528513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:29.910833 run osmo-stp_10.42.42.5(pid=17193): stdout: | (launched: 2022-12-09_03:15:28.341344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:30.031034 run osmo-stp_10.42.42.5(pid=17193): stderr: | 20221209031528512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031528512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031528512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031528513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031528513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031528513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031528513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:30.175407 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17193): Process ended prematurely: osmo-stp_10.42.42.5(pid=17193) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17193)] [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:15:30.184490 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:15:30.211221 run osmo-hlr_10.42.42.2(pid=17190): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17190)] 03:15:30.258801 run osmo-hlr_10.42.42.2(pid=17190): stdout: | (launched: 2022-12-09_03:15:27.404079) 03:15:30.307607 run osmo-hlr_10.42.42.2(pid=17190): stderr: | 20221209031527579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031527579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031527579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031527579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031527579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031527579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031527591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031527600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031527601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031527601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:30.376059 run osmo-msc_10.42.42.6(pid=17196): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17196)] 03:15:30.423494 run osmo-msc_10.42.42.6(pid=17196): stdout: | (launched: 2022-12-09_03:15:29.303609) 03:15:30.472369 run osmo-msc_10.42.42.6(pid=17196): stderr: | 20221209031529574 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031529574 DLGLOBAL DEBUG validating counter group 0x7f76ca8c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031529575 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031529575 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031529575 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031529575 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031529577 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031529577 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031529578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031529578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:30.521678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17189): Terminating (SIGTERM) 03:15:30.561324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17192): Terminating (SIGTERM) 03:15:30.601074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17195): Terminating (SIGTERM) 03:15:30.641043 --- ParallelTerminationStrategy: PID 17189 died... 03:15:30.659970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17189): Terminated: ok {rc=0} 03:15:30.704400 --- ParallelTerminationStrategy: PID 17192 died... 03:15:30.723229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17192): Terminated: ok {rc=0} 03:15:30.767337 --- ParallelTerminationStrategy: PID 17195 died... 03:15:30.786026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17195): Terminated: ok {rc=0} 03:15:30.868653 bus /sierra_3: Setting Powered False 03:15:31.971941 bus /sierra_3: Setting Powered False 03:15:33.086501 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:15:34.331106 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:15:34.338482 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:15:34.371141 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:15:34.398153 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:15:34.450353 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:15:34.483954 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:15:34.510760 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:15:35.060740 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:15:35.109690 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:35.121128 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:15:35.186524 tst mo_mt_call.py: using LAC 18686 03:15:35.305459 tst mo_mt_call.py: using RAC 71 03:15:35.433733 tst mo_mt_call.py: using CellId 18686 03:15:35.563498 tst mo_mt_call.py: using BVCI 18687 03:15:35.683208 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:35.694910 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:35.706516 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:35.718526 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:35.731164 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:35.743161 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:15:35.859785 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:15:35.976082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:36.444002 run create_hlr_db(pid=17201): Launched 03:15:36.558861 bus /sierra_2: Setting Powered False 03:15:37.618177 run create_hlr_db(pid=17201): Terminated: ok {rc=0} 03:15:38.056719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17203): Launched 03:15:38.378743 run osmo-hlr_10.42.42.2(pid=17204): Launched 03:15:38.502284 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:39.059340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17206): Launched 03:15:39.381904 run osmo-stp_10.42.42.5(pid=17207): Launched 03:15:39.505063 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:40.089195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17209): Launched 03:15:40.411719 run osmo-msc_10.42.42.6(pid=17210): Launched 03:15:40.591718 run osmo-stp_10.42.42.5(pid=17207): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17207)] 03:15:40.727277 run osmo-stp_10.42.42.5(pid=17207): stdout: | (launched: 2022-12-09_03:15:39.322936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:40.863781 run osmo-stp_10.42.42.5(pid=17207): stderr: | 20221209031539514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031539514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031539514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031539514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031539515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031539515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031539515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:40.998639 run osmo-stp_10.42.42.5(pid=17207): stdout: | (launched: 2022-12-09_03:15:39.322936) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:41.126881 run osmo-stp_10.42.42.5(pid=17207): stderr: | 20221209031539514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031539514 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031539514 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031539514 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031539515 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031539515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031539515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:41.279857 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17207): Process ended prematurely: osmo-stp_10.42.42.5(pid=17207) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17207)] [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:15:41.289343 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:15:41.316905 run osmo-hlr_10.42.42.2(pid=17204): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17204)] 03:15:41.366817 run osmo-hlr_10.42.42.2(pid=17204): stdout: | (launched: 2022-12-09_03:15:38.320020) 03:15:41.417813 run osmo-hlr_10.42.42.2(pid=17204): stderr: | 20221209031538518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031538518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031538518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031538518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031538518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031538518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031538531 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031538542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031538542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031538542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:41.489228 run osmo-msc_10.42.42.6(pid=17210): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17210)] 03:15:41.538700 run osmo-msc_10.42.42.6(pid=17210): stdout: | (launched: 2022-12-09_03:15:40.352639) 03:15:41.589738 run osmo-msc_10.42.42.6(pid=17210): stderr: | 20221209031540675 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031540675 DLGLOBAL DEBUG validating counter group 0x7f61c6129c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031540675 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031540675 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031540675 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031540676 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031540677 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031540678 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031540678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031540678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:41.641323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17203): Terminating (SIGTERM) 03:15:41.682478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17206): Terminating (SIGTERM) 03:15:41.723508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17209): Terminating (SIGTERM) 03:15:41.765462 --- ParallelTerminationStrategy: PID 17203 died... 03:15:41.785388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17203): Terminated: ok {rc=0} 03:15:41.831164 --- ParallelTerminationStrategy: PID 17206 died... 03:15:41.850575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17206): Terminated: ok {rc=0} 03:15:41.896685 --- ParallelTerminationStrategy: PID 17209 died... 03:15:41.916115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17209): Terminated: ok {rc=0} 03:15:42.001968 bus /sierra_3: Setting Powered False 03:15:43.099489 bus /sierra_3: Setting Powered False 03:15:44.213310 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:15:45.363155 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:45.375559 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:15:45.445527 tst mo_mt_call_osmux.py: using LAC 18687 03:15:45.575000 tst mo_mt_call_osmux.py: using RAC 72 03:15:45.701177 tst mo_mt_call_osmux.py: using CellId 18687 03:15:45.826766 tst mo_mt_call_osmux.py: using BVCI 18688 03:15:45.965605 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:45.978077 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:45.991274 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:46.004687 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:46.018941 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:46.032088 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:15:46.151236 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:15:46.277507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:46.868382 run create_hlr_db(pid=17212): Launched 03:15:47.055301 bus /sierra_2: Setting Powered False 03:15:48.119379 run create_hlr_db(pid=17212): Terminated: ok {rc=0} 03:15:48.555317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17214): Launched 03:15:48.856428 run osmo-hlr_10.42.42.2(pid=17215): Launched 03:15:48.972050 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:49.504571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17217): Launched 03:15:49.805327 run osmo-stp_10.42.42.5(pid=17218): Launched 03:15:49.920177 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:50.464732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17220): Launched 03:15:50.765701 run osmo-msc_10.42.42.6(pid=17221): Launched 03:15:50.933829 run osmo-stp_10.42.42.5(pid=17218): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17218)] 03:15:51.060738 run osmo-stp_10.42.42.5(pid=17218): stdout: | (launched: 2022-12-09_03:15:49.749896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:51.188155 run osmo-stp_10.42.42.5(pid=17218): stderr: | 20221209031549918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031549918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031549918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031549919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031549919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031549919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031549919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:51.313426 run osmo-stp_10.42.42.5(pid=17218): stdout: | (launched: 2022-12-09_03:15:49.749896) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:51.433196 run osmo-stp_10.42.42.5(pid=17218): stderr: | 20221209031549918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031549918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031549918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031549919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031549919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031549919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031549919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:51.579674 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17218): Process ended prematurely: osmo-stp_10.42.42.5(pid=17218) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17218)] [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:15:51.588747 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:15:51.615497 run osmo-hlr_10.42.42.2(pid=17215): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17215)] 03:15:51.663363 run osmo-hlr_10.42.42.2(pid=17215): stdout: | (launched: 2022-12-09_03:15:48.800863) 03:15:51.712577 run osmo-hlr_10.42.42.2(pid=17215): stderr: | 20221209031548977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031548977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031548977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031548977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031548977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031548978 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031548989 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031548998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031548998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031548999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:51.781841 run osmo-msc_10.42.42.6(pid=17221): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17221)] 03:15:51.829217 run osmo-msc_10.42.42.6(pid=17221): stdout: | (launched: 2022-12-09_03:15:50.710110) 03:15:51.878258 run osmo-msc_10.42.42.6(pid=17221): stderr: | 20221209031550979 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031550980 DLGLOBAL DEBUG validating counter group 0x7ffb1c5a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031550980 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031550980 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031550980 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031550980 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031550982 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031550982 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031550983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031550983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:51.927819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17214): Terminating (SIGTERM) 03:15:51.967876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17217): Terminating (SIGTERM) 03:15:52.007921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17220): Terminating (SIGTERM) 03:15:52.048456 --- ParallelTerminationStrategy: PID 17214 died... 03:15:52.067522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17214): Terminated: ok {rc=0} 03:15:52.112089 --- ParallelTerminationStrategy: PID 17217 died... 03:15:52.130706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17217): Terminated: ok {rc=0} 03:15:52.174603 --- ParallelTerminationStrategy: PID 17220 died... 03:15:52.193183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17220): Terminated: ok {rc=0} 03:15:52.276400 bus /sierra_3: Setting Powered False 03:15:53.373240 bus /sierra_3: Setting Powered False 03:15:54.491185 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:15:55.737017 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:15:55.744358 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:15:55.777209 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:15:55.803847 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:15:55.856694 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:15:55.889416 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:15:55.915726 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:15:56.465289 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:15:56.513781 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:56.525080 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:15:56.594464 tst mo_mt_call.py: using LAC 18688 03:15:56.712151 tst mo_mt_call.py: using RAC 73 03:15:56.829633 tst mo_mt_call.py: using CellId 18688 03:15:56.956803 tst mo_mt_call.py: using BVCI 18689 03:15:57.073936 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:57.085721 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:57.097220 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:57.108592 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:57.120184 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:57.131677 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:15:57.246558 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:15:57.361273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:57.825093 run create_hlr_db(pid=17226): Launched 03:15:57.940727 bus /sierra_2: Setting Powered False 03:15:59.001144 run create_hlr_db(pid=17226): Terminated: ok {rc=0} 03:15:59.417866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17228): Launched 03:15:59.716142 run osmo-hlr_10.42.42.2(pid=17229): Launched 03:15:59.831265 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:00.345711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17231): Launched 03:16:00.667598 run osmo-stp_10.42.42.5(pid=17232): Launched 03:16:00.790784 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:01.511013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17234): Launched 03:16:01.849671 run osmo-msc_10.42.42.6(pid=17235): Launched 03:16:02.266601 run osmo-stp_10.42.42.5(pid=17232): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17232)] 03:16:02.394166 run osmo-stp_10.42.42.5(pid=17232): stdout: | (launched: 2022-12-09_03:16:00.609340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:02.518521 run osmo-stp_10.42.42.5(pid=17232): stderr: | 20221209031600801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031600801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031600801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031600801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031600802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031600802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031600802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:02.642172 run osmo-stp_10.42.42.5(pid=17232): stdout: | (launched: 2022-12-09_03:16:00.609340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:02.760114 run osmo-stp_10.42.42.5(pid=17232): stderr: | 20221209031600801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031600801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031600801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031600801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031600802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031600802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031600802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:02.901383 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17232): Process ended prematurely: osmo-stp_10.42.42.5(pid=17232) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17232)] [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:16:02.910103 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:16:02.936538 run osmo-hlr_10.42.42.2(pid=17229): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17229)] 03:16:02.984287 run osmo-hlr_10.42.42.2(pid=17229): stdout: | (launched: 2022-12-09_03:15:59.661530) 03:16:03.033336 run osmo-hlr_10.42.42.2(pid=17229): stderr: | 20221209031559836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031559837 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031559837 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031559837 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031559837 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031559837 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031559849 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031559857 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031559857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031559857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:03.101857 run osmo-msc_10.42.42.6(pid=17235): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17235)] 03:16:03.149379 run osmo-msc_10.42.42.6(pid=17235): stdout: | (launched: 2022-12-09_03:16:01.787826) 03:16:03.198432 run osmo-msc_10.42.42.6(pid=17235): stderr: | 20221209031602156 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031602157 DLGLOBAL DEBUG validating counter group 0x7fe1a695ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031602157 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031602157 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031602157 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031602157 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031602161 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031602163 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031602163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031602163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:03.247689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17228): Terminating (SIGTERM) 03:16:03.287284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17231): Terminating (SIGTERM) 03:16:03.326700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17234): Terminating (SIGTERM) 03:16:03.366606 --- ParallelTerminationStrategy: PID 17228 died... 03:16:03.385529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17228): Terminated: ok {rc=0} 03:16:03.429516 --- ParallelTerminationStrategy: PID 17231 died... 03:16:03.447875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17231): Terminated: ok {rc=0} 03:16:03.491704 --- ParallelTerminationStrategy: PID 17234 died... 03:16:03.510192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17234): Terminated: ok {rc=0} 03:16:03.595281 bus /sierra_3: Setting Powered False 03:16:04.693942 bus /sierra_3: Setting Powered False 03:16:05.808155 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:16:06.951454 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:16:06.963162 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:16:07.029201 tst mo_mt_call_osmux.py: using LAC 18689 03:16:07.155014 tst mo_mt_call_osmux.py: using RAC 74 03:16:07.279907 tst mo_mt_call_osmux.py: using CellId 18689 03:16:07.407640 tst mo_mt_call_osmux.py: using BVCI 18690 03:16:07.524682 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:16:07.536437 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:16:07.548090 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:16:07.559571 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:16:07.571113 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:16:07.582521 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:16:07.696867 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:16:07.815403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:08.306955 run create_hlr_db(pid=17237): Launched 03:16:08.436037 bus /sierra_2: Setting Powered False 03:16:09.499946 run create_hlr_db(pid=17237): Terminated: ok {rc=0} 03:16:09.921570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17239): Launched 03:16:10.217203 run osmo-hlr_10.42.42.2(pid=17240): Launched 03:16:10.331033 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:10.854228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17242): Launched 03:16:11.150158 run osmo-stp_10.42.42.5(pid=17243): Launched 03:16:11.262505 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:11.811014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17245): Launched 03:16:12.105755 run osmo-msc_10.42.42.6(pid=17246): Launched 03:16:12.272605 run osmo-stp_10.42.42.5(pid=17243): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17243)] 03:16:12.398350 run osmo-stp_10.42.42.5(pid=17243): stdout: | (launched: 2022-12-09_03:16:11.095014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:12.524617 run osmo-stp_10.42.42.5(pid=17243): stderr: | 20221209031611262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031611262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031611263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031611263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031611264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031611264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031611264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:12.647671 run osmo-stp_10.42.42.5(pid=17243): stdout: | (launched: 2022-12-09_03:16:11.095014) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:12.765505 run osmo-stp_10.42.42.5(pid=17243): stderr: | 20221209031611262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031611262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031611263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031611263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031611264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031611264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031611264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:12.906463 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17243): Process ended prematurely: osmo-stp_10.42.42.5(pid=17243) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17243)] [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:16:12.915168 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 03:16:12.941320 run osmo-hlr_10.42.42.2(pid=17240): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17240)] 03:16:12.988604 run osmo-hlr_10.42.42.2(pid=17240): stdout: | (launched: 2022-12-09_03:16:10.163089) 03:16:13.037220 run osmo-hlr_10.42.42.2(pid=17240): stderr: | 20221209031610337 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031610337 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031610337 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031610337 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031610337 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031610337 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031610351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031610361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031610361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031610361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:13.105283 run osmo-msc_10.42.42.6(pid=17246): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17246)] 03:16:13.152159 run osmo-msc_10.42.42.6(pid=17246): stdout: | (launched: 2022-12-09_03:16:12.051652) 03:16:13.200606 run osmo-msc_10.42.42.6(pid=17246): stderr: | 20221209031612321 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031612321 DLGLOBAL DEBUG validating counter group 0x7fc671d42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031612321 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031612321 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031612321 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031612321 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031612323 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031612324 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031612324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031612324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:13.249552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17239): Terminating (SIGTERM) 03:16:13.288989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17242): Terminating (SIGTERM) 03:16:13.328633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17245): Terminating (SIGTERM) 03:16:13.368565 --- ParallelTerminationStrategy: PID 17239 died... 03:16:13.387331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17239): Terminated: ok {rc=0} 03:16:13.430971 --- ParallelTerminationStrategy: PID 17242 died... 03:16:13.449324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17242): Terminated: ok {rc=0} 03:16:13.493378 --- ParallelTerminationStrategy: PID 17245 died... 03:16:13.511646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17245): Terminated: ok {rc=0} 03:16:13.595941 bus /sierra_3: Setting Powered False 03:16:14.691968 bus /sierra_3: Setting Powered False 03:16:15.801716 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:16:17.112932 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:16:17.124239 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:16:17.159640 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:16:17.187223 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:16:17.241722 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:16:17.275517 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:16:17.303697 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:16:17.852598 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:16:17.903455 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:17.915236 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:16:17.983399 tst mo_mt_call.py: using LAC 18690 03:16:18.108358 tst mo_mt_call.py: using RAC 75 03:16:18.232941 tst mo_mt_call.py: using CellId 18690 03:16:18.357392 tst mo_mt_call.py: using BVCI 18691 03:16:18.472422 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:18.484079 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:18.495566 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:18.507044 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:18.518695 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:18.530537 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:16:18.645577 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:16:18.767353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:19.259309 run create_hlr_db(pid=17251): Launched 03:16:19.387751 bus /sierra_2: Setting Powered False 03:16:20.451882 run create_hlr_db(pid=17251): Terminated: ok {rc=0} 03:16:20.876307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17253): Launched 03:16:21.170734 run osmo-hlr_10.42.42.2(pid=17254): Launched 03:16:21.282907 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:21.804483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17256): Launched 03:16:22.098241 run osmo-stp_10.42.42.5(pid=17257): Launched 03:16:22.210484 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:22.744430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17259): Launched 03:16:23.038162 run osmo-msc_10.42.42.6(pid=17260): Launched 03:16:23.202910 run osmo-stp_10.42.42.5(pid=17257): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17257)] 03:16:23.328182 run osmo-stp_10.42.42.5(pid=17257): stdout: | (launched: 2022-12-09_03:16:22.044276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:23.454418 run osmo-stp_10.42.42.5(pid=17257): stderr: | 20221209031622216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031622217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031622217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031622217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031622219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031622220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031622220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:23.577137 run osmo-stp_10.42.42.5(pid=17257): stdout: | (launched: 2022-12-09_03:16:22.044276) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:23.694709 run osmo-stp_10.42.42.5(pid=17257): stderr: | 20221209031622216 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031622217 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031622217 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031622217 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031622219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031622220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031622220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:23.835459 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17257): Process ended prematurely: osmo-stp_10.42.42.5(pid=17257) [trial-2353↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17257)] [trial-2353↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:16:23.844215 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:16:23.870391 run osmo-hlr_10.42.42.2(pid=17254): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17254)] 03:16:23.917733 run osmo-hlr_10.42.42.2(pid=17254): stdout: | (launched: 2022-12-09_03:16:21.116777) 03:16:23.966491 run osmo-hlr_10.42.42.2(pid=17254): stderr: | 20221209031621289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031621289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031621289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031621289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031621289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031621289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031621302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031621310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031621310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031621311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:24.034501 run osmo-msc_10.42.42.6(pid=17260): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17260)] 03:16:24.081543 run osmo-msc_10.42.42.6(pid=17260): stdout: | (launched: 2022-12-09_03:16:22.984317) 03:16:24.130197 run osmo-msc_10.42.42.6(pid=17260): stderr: | 20221209031623256 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031623256 DLGLOBAL DEBUG validating counter group 0x7f5c01333c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031623256 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031623256 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031623256 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031623256 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031623258 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031623258 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031623259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031623259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:24.179136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17253): Terminating (SIGTERM) 03:16:24.218473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17256): Terminating (SIGTERM) 03:16:24.257814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17259): Terminating (SIGTERM) 03:16:24.297534 --- ParallelTerminationStrategy: PID 17253 died... 03:16:24.316164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17253): Terminated: ok {rc=0} 03:16:24.360125 --- ParallelTerminationStrategy: PID 17256 died... 03:16:24.378542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17256): Terminated: ok {rc=0} 03:16:24.422210 --- ParallelTerminationStrategy: PID 17259 died... 03:16:24.440524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17259): Terminated: ok {rc=0} 03:16:24.524028 bus /sierra_3: Setting Powered False 03:16:25.617712 bus /sierra_3: Setting Powered False 03:16:26.732452 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:16:27.881548 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:27.893572 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:16:27.963181 tst mo_mt_call_osmux.py: using LAC 18691 03:16:28.090119 tst mo_mt_call_osmux.py: using RAC 76 03:16:28.216367 tst mo_mt_call_osmux.py: using CellId 18691 03:16:28.343893 tst mo_mt_call_osmux.py: using BVCI 18692 03:16:28.461096 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:28.472648 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:28.484156 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:28.495645 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:28.507217 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:28.518707 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:16:28.639294 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:16:28.755676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:29.214397 run create_hlr_db(pid=17262): Launched 03:16:29.327495 bus /sierra_2: Setting Powered False 03:16:30.386375 run create_hlr_db(pid=17262): Terminated: ok {rc=0} 03:16:30.820425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17264): Launched 03:16:31.162051 run osmo-hlr_10.42.42.2(pid=17265): Launched 03:16:31.287862 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:32.068035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17267): Launched 03:16:32.423826 run osmo-stp_10.42.42.5(pid=17268): Launched 03:16:32.538175 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:33.085794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17270): Launched 03:16:33.380306 run osmo-msc_10.42.42.6(pid=17271): Launched 03:16:33.545995 run osmo-stp_10.42.42.5(pid=17268): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17268)] 03:16:33.672936 run osmo-stp_10.42.42.5(pid=17268): stdout: | (launched: 2022-12-09_03:16:32.369130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:33.798725 run osmo-stp_10.42.42.5(pid=17268): stderr: | 20221209031632540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031632540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031632540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031632541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031632541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031632541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031632541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:33.921859 run osmo-stp_10.42.42.5(pid=17268): stdout: | (launched: 2022-12-09_03:16:32.369130) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:34.039448 run osmo-stp_10.42.42.5(pid=17268): stderr: | 20221209031632540 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031632540 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031632540 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031632541 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031632541 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031632541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031632541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:34.180724 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17268): Process ended prematurely: osmo-stp_10.42.42.5(pid=17268) [trial-2353↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17268)] [trial-2353↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:16:34.189560 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:16:34.216073 run osmo-hlr_10.42.42.2(pid=17265): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17265)] 03:16:34.263553 run osmo-hlr_10.42.42.2(pid=17265): stdout: | (launched: 2022-12-09_03:16:31.090516) 03:16:34.312273 run osmo-hlr_10.42.42.2(pid=17265): stderr: | 20221209031631458 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031631458 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031631458 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031631458 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031631458 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031631459 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031631475 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031631492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031631492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031631492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:34.380462 run osmo-msc_10.42.42.6(pid=17271): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17271)] 03:16:34.427884 run osmo-msc_10.42.42.6(pid=17271): stdout: | (launched: 2022-12-09_03:16:33.326267) 03:16:34.476599 run osmo-msc_10.42.42.6(pid=17271): stderr: | 20221209031633595 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031633595 DLGLOBAL DEBUG validating counter group 0x7fa334305c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031633595 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031633595 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031633595 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031633595 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031633598 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031633598 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031633598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031633598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:34.526008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17264): Terminating (SIGTERM) 03:16:34.565351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17267): Terminating (SIGTERM) 03:16:34.605268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17270): Terminating (SIGTERM) 03:16:34.645036 --- ParallelTerminationStrategy: PID 17264 died... 03:16:34.663906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17264): Terminated: ok {rc=0} 03:16:34.708354 --- ParallelTerminationStrategy: PID 17267 died... 03:16:34.726699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17267): Terminated: ok {rc=0} 03:16:34.770781 --- ParallelTerminationStrategy: PID 17270 died... 03:16:34.789189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17270): Terminated: ok {rc=0} 03:16:34.871711 bus /sierra_3: Setting Powered False 03:16:35.969061 bus /sierra_3: Setting Powered False 03:16:37.084114 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 03:16:38.335247 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:16:38.342784 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 03:16:38.376130 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 03:16:38.403310 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 03:16:38.457739 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 03:16:38.491071 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 03:16:38.518301 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 03:16:39.071638 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 03:16:39.122572 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:39.134399 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:16:39.185076 tst mo_mt_call.py: using LAC 18692 03:16:39.310374 tst mo_mt_call.py: using RAC 77 03:16:39.436813 tst mo_mt_call.py: using CellId 18692 03:16:39.560879 tst mo_mt_call.py: using BVCI 18693 03:16:39.669887 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:39.681457 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:39.692565 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:39.704018 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:39.715537 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:39.727049 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:16:39.844162 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:16:39.959283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:40.416410 run create_hlr_db(pid=17277): Launched 03:16:40.528414 bus /sierra_2: Setting Powered False 03:16:41.593646 run create_hlr_db(pid=17277): Terminated: ok {rc=0} 03:16:42.033865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17281): Launched 03:16:42.349185 run osmo-hlr_10.42.42.2(pid=17282): Launched 03:16:42.470292 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:43.015874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17284): Launched 03:16:43.331486 run osmo-stp_10.42.42.5(pid=17285): Launched 03:16:43.452283 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:44.024492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17287): Launched 03:16:44.340077 run osmo-msc_10.42.42.6(pid=17288): Launched 03:16:44.517263 run osmo-stp_10.42.42.5(pid=17285): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17285)] 03:16:44.651308 run osmo-stp_10.42.42.5(pid=17285): stdout: | (launched: 2022-12-09_03:16:43.274176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:44.786451 run osmo-stp_10.42.42.5(pid=17285): stderr: | 20221209031643466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031643466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031643466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031643467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031643467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031643467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031643467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:44.919861 run osmo-stp_10.42.42.5(pid=17285): stdout: | (launched: 2022-12-09_03:16:43.274176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:45.046461 run osmo-stp_10.42.42.5(pid=17285): stderr: | 20221209031643466 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031643466 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031643466 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031643467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031643467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031643467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031643467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:45.197773 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17285): Process ended prematurely: osmo-stp_10.42.42.5(pid=17285) [trial-2353↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17285)] [trial-2353↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 03:16:45.207100 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 03:16:45.234473 run osmo-hlr_10.42.42.2(pid=17282): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17282)] 03:16:45.283796 run osmo-hlr_10.42.42.2(pid=17282): stdout: | (launched: 2022-12-09_03:16:42.291142) 03:16:45.334964 run osmo-hlr_10.42.42.2(pid=17282): stderr: | 20221209031642489 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031642489 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031642489 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031642489 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031642489 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031642489 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031642501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031642509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031642510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031642510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:45.406357 run osmo-msc_10.42.42.6(pid=17288): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17288)] 03:16:45.455503 run osmo-msc_10.42.42.6(pid=17288): stdout: | (launched: 2022-12-09_03:16:44.282732) 03:16:45.506146 run osmo-msc_10.42.42.6(pid=17288): stderr: | 20221209031644604 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031644604 DLGLOBAL DEBUG validating counter group 0x7f075d173c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031644604 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031644604 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031644605 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031644605 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031644607 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031644607 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031644607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031644607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:45.557323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17281): Terminating (SIGTERM) 03:16:45.598368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17284): Terminating (SIGTERM) 03:16:45.639286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17287): Terminating (SIGTERM) 03:16:45.680611 --- ParallelTerminationStrategy: PID 17281 died... 03:16:45.699758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17281): Terminated: ok {rc=0} 03:16:45.747865 --- ParallelTerminationStrategy: PID 17284 died... 03:16:45.767168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17284): Terminated: ok {rc=0} 03:16:45.812153 --- ParallelTerminationStrategy: PID 17287 died... 03:16:45.830920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17287): Terminated: ok {rc=0} 03:16:45.942383 bus /sierra_3: Setting Powered False 03:16:47.040154 bus /sierra_3: Setting Powered False 03:16:48.156689 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 03:16:49.300783 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:49.312609 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:16:49.361908 tst mo_mt_call_osmux.py: using LAC 18693 03:16:49.480693 tst mo_mt_call_osmux.py: using RAC 78 03:16:49.606167 tst mo_mt_call_osmux.py: using CellId 18693 03:16:49.732854 tst mo_mt_call_osmux.py: using BVCI 18694 03:16:49.848757 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:49.860620 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:49.872287 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:49.883996 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:49.895788 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:49.907432 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:16:50.022631 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:16:50.141117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:50.634202 run create_hlr_db(pid=17290): Launched 03:16:50.762002 bus /sierra_2: Setting Powered False 03:16:51.825155 run create_hlr_db(pid=17290): Terminated: ok {rc=0} 03:16:52.246874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17292): Launched 03:16:52.541021 run osmo-hlr_10.42.42.2(pid=17293): Launched 03:16:52.654059 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:53.176292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17295): Launched 03:16:53.470960 run osmo-stp_10.42.42.5(pid=17296): Launched 03:16:53.583776 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:54.116832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17298): Launched 03:16:54.412742 run osmo-msc_10.42.42.6(pid=17299): Launched 03:16:54.579650 run osmo-stp_10.42.42.5(pid=17296): ERR: Terminated: ERROR {rc=1} [trial-2353↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17296)] 03:16:54.705247 run osmo-stp_10.42.42.5(pid=17296): stdout: | (launched: 2022-12-09_03:16:53.417234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:54.831256 run osmo-stp_10.42.42.5(pid=17296): stderr: | 20221209031653586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031653586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031653586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031653587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031653589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031653589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031653589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:54.954932 run osmo-stp_10.42.42.5(pid=17296): stdout: | (launched: 2022-12-09_03:16:53.417234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:55.073212 run osmo-stp_10.42.42.5(pid=17296): stderr: | 20221209031653586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031653586 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031653586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031653587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031653589 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031653589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031653589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:55.214479 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17296): Process ended prematurely: osmo-stp_10.42.42.5(pid=17296) [trial-2353↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17296)] [trial-2353↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 03:16:55.223173 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 03:16:55.249654 run osmo-hlr_10.42.42.2(pid=17293): ERR: Terminated: ERROR {rc=237} [trial-2353↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17293)] 03:16:55.296895 run osmo-hlr_10.42.42.2(pid=17293): stdout: | (launched: 2022-12-09_03:16:52.487050) 03:16:55.345581 run osmo-hlr_10.42.42.2(pid=17293): stderr: | 20221209031652664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031652664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031652664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031652664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031652664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031652664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031652677 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031652685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031652685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031652685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:55.413733 run osmo-msc_10.42.42.6(pid=17299): ERR: Terminated: ERROR {rc=2} [trial-2353↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17299)] 03:16:55.460693 run osmo-msc_10.42.42.6(pid=17299): stdout: | (launched: 2022-12-09_03:16:54.358282) 03:16:55.509200 run osmo-msc_10.42.42.6(pid=17299): stderr: | 20221209031654628 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031654628 DLGLOBAL DEBUG validating counter group 0x7f52506d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031654628 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031654628 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031654629 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031654629 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031654631 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031654631 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031654631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031654631 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:55.558433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17292): Terminating (SIGTERM) 03:16:55.597895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17295): Terminating (SIGTERM) 03:16:55.637153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17298): Terminating (SIGTERM) 03:16:55.676891 --- ParallelTerminationStrategy: PID 17292 died... 03:16:55.695859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17292): Terminated: ok {rc=0} 03:16:55.739537 --- ParallelTerminationStrategy: PID 17295 died... 03:16:55.757924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17295): Terminated: ok {rc=0} 03:16:55.802197 --- ParallelTerminationStrategy: PID 17298 died... 03:16:55.820646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17298): Terminated: ok {rc=0} 03:16:55.904133 bus /sierra_3: Setting Powered False 03:16:57.001207 bus /sierra_3: Setting Powered False 03:16:58.115925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 emergency:nanobts+band-900 --------------------------------------------------------------------- 03:16:59.370839 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:16:59.376457 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:16:59.408848 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 03:16:59.435874 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 03:16:59.520363 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:16:59.552612 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 03:16:59.579493 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 03:17:00.167317 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2353 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 03:17:00.172406 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:17:00.183473 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:00.231497 tst emergency_mo_mt_call.py: using LAC 18694 03:17:00.351071 tst emergency_mo_mt_call.py: using RAC 79 03:17:00.466766 tst emergency_mo_mt_call.py: using CellId 18694 03:17:00.581421 tst emergency_mo_mt_call.py: using BVCI 18695 03:17:00.686597 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:17:00.697523 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:17:00.707958 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:17:00.718782 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:17:00.729554 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:17:00.740222 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:00.857849 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:00.992348 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:01.467744 run create_hlr_db(pid=17304): Launched 03:17:01.629327 bus /sierra_2: Setting Powered False 03:17:02.687891 run create_hlr_db(pid=17304): Terminated: ok {rc=0} 03:17:03.113222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17309): Launched 03:17:03.423122 run osmo-hlr_10.42.42.2(pid=17310): Launched 03:17:03.540676 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:04.074797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17312): Launched 03:17:04.382979 run osmo-stp_10.42.42.5(pid=17313): Launched 03:17:04.515111 tst emergency_mo_mt_call.py: using MSISDN 6993 03:17:04.675287 run osmo-msc_10.42.42.6: Starting osmo-msc 03:17:05.234245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17315): Launched 03:17:05.543753 run osmo-msc_10.42.42.6(pid=17316): Launched 03:17:05.716615 run osmo-stp_10.42.42.5(pid=17313): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17313)] 03:17:05.847765 run osmo-stp_10.42.42.5(pid=17313): stdout: | (launched: 2022-12-09_03:17:04.326751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:05.979064 run osmo-stp_10.42.42.5(pid=17313): stderr: | 20221209031704516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031704516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031704516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031704516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031704519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031704519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031704519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:06.109260 run osmo-stp_10.42.42.5(pid=17313): stdout: | (launched: 2022-12-09_03:17:04.326751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:06.232931 run osmo-stp_10.42.42.5(pid=17313): stderr: | 20221209031704516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031704516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031704516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031704516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031704519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031704519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031704519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:06.380534 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=17313): Process ended prematurely: osmo-stp_10.42.42.5(pid=17313) [trial-2353↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17313)] [trial-2353↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 03:17:06.389322 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 03:17:06.416341 run osmo-hlr_10.42.42.2(pid=17310): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17310)] 03:17:06.465889 run osmo-hlr_10.42.42.2(pid=17310): stdout: | (launched: 2022-12-09_03:17:03.366653) 03:17:06.517099 run osmo-hlr_10.42.42.2(pid=17310): stderr: | 20221209031703562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031703562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031703562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031703562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031703562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031703562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031703575 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031703583 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031703584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031703584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:06.588495 run osmo-msc_10.42.42.6(pid=17316): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17316)] 03:17:06.637886 run osmo-msc_10.42.42.6(pid=17316): stdout: | (launched: 2022-12-09_03:17:05.487343) 03:17:06.688826 run osmo-msc_10.42.42.6(pid=17316): stderr: | 20221209031705808 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031705809 DLGLOBAL DEBUG validating counter group 0x7f5451fc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031705809 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031705809 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031705809 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031705809 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031705811 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031705811 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031705812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031705812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:17:06.740143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17309): Terminating (SIGTERM) 03:17:06.781255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17312): Terminating (SIGTERM) 03:17:06.822704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17315): Terminating (SIGTERM) 03:17:06.864164 --- ParallelTerminationStrategy: PID 17309 died... 03:17:06.883939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17309): Terminated: ok {rc=0} 03:17:06.930076 --- ParallelTerminationStrategy: PID 17312 died... 03:17:06.949557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17312): Terminated: ok {rc=0} 03:17:06.994828 --- ParallelTerminationStrategy: PID 17315 died... 03:17:07.014062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17315): Terminated: ok {rc=0} 03:17:07.100762 bus /sierra_3: Setting Powered False 03:17:08.200238 bus /sierra_3: Setting Powered False 03:17:09.318451 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 03:17:10.406608 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:17:10.417842 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:10.466142 tst emergency_preemptive_call.py: using LAC 18695 03:17:10.582123 tst emergency_preemptive_call.py: using RAC 80 03:17:10.696018 tst emergency_preemptive_call.py: using CellId 18695 03:17:10.810331 tst emergency_preemptive_call.py: using BVCI 18696 03:17:10.915244 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:17:10.925963 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:17:10.936341 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:17:10.947006 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:17:10.957895 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:17:10.968487 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:11.080897 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:11.194387 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:11.312636 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:11.428649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:11.914881 run create_hlr_db(pid=17318): Launched 03:17:12.041819 bus /sierra_2: Setting Powered False 03:17:13.104267 run create_hlr_db(pid=17318): Terminated: ok {rc=0} 03:17:13.521146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17320): Launched 03:17:13.812364 run osmo-hlr_10.42.42.2(pid=17321): Launched 03:17:13.923174 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:14.421573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17323): Launched 03:17:14.710474 run osmo-stp_10.42.42.5(pid=17324): Launched 03:17:14.829921 tst emergency_preemptive_call.py: using MSISDN 6994 03:17:14.977997 run osmo-msc_10.42.42.6: Starting osmo-msc 03:17:15.499321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17326): Launched 03:17:15.788662 run osmo-msc_10.42.42.6(pid=17327): Launched 03:17:16.084199 run osmo-stp_10.42.42.5(pid=17324): ERR: Terminated: ERROR {rc=1} [trial-2353↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17324)] 03:17:16.508759 run osmo-stp_10.42.42.5(pid=17324): stdout: | (launched: 2022-12-09_03:17:14.657349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:16.669524 run osmo-stp_10.42.42.5(pid=17324): stderr: | 20221209031714826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031714826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031714826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031714827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031714827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031714827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031714827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:16.812530 run osmo-stp_10.42.42.5(pid=17324): stdout: | (launched: 2022-12-09_03:17:14.657349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:16.940665 run osmo-stp_10.42.42.5(pid=17324): stderr: | 20221209031714826 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031714826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031714826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031714827 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031714827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031714827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031714827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:17.094717 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=17324): Process ended prematurely: osmo-stp_10.42.42.5(pid=17324) [trial-2353↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17324)] [trial-2353↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 03:17:17.104554 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 03:17:17.134782 run osmo-hlr_10.42.42.2(pid=17321): ERR: Terminated: ERROR {rc=237} [trial-2353↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17321)] 03:17:17.188273 run osmo-hlr_10.42.42.2(pid=17321): stdout: | (launched: 2022-12-09_03:17:13.758874) 03:17:17.238422 run osmo-hlr_10.42.42.2(pid=17321): stderr: | 20221209031713933 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031713933 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031713933 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031713933 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031713933 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031713933 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031713946 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031713954 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031713955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031713955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:17.308183 run osmo-msc_10.42.42.6(pid=17327): ERR: Terminated: ERROR {rc=2} [trial-2353↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17327)] 03:17:17.355422 run osmo-msc_10.42.42.6(pid=17327): stdout: | (launched: 2022-12-09_03:17:15.735177) 03:17:17.404022 run osmo-msc_10.42.42.6(pid=17327): stderr: | 20221209031716191 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209031716192 DLGLOBAL DEBUG validating counter group 0x7ff8012d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209031716192 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209031716192 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209031716193 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209031716193 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209031716198 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209031716199 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209031716200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209031716200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:17:17.453156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17320): Terminating (SIGTERM) 03:17:17.492679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17323): Terminating (SIGTERM) 03:17:17.532430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17326): Terminating (SIGTERM) 03:17:17.572176 --- ParallelTerminationStrategy: PID 17320 died... 03:17:17.591114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17320): Terminated: ok {rc=0} 03:17:17.635205 --- ParallelTerminationStrategy: PID 17323 died... 03:17:17.653720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17323): Terminated: ok {rc=0} 03:17:17.698321 --- ParallelTerminationStrategy: PID 17326 died... 03:17:17.716845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17326): Terminated: ok {rc=0} 03:17:17.800457 bus /sierra_9: Setting Powered False 03:17:18.897316 bus /sierra_9: Setting Powered False 03:17:20.013457 bus /sierra_8: Setting Powered False 03:17:21.110232 bus /sierra_8: Setting Powered False 03:17:22.222150 bus /sierra_3: Setting Powered False 03:17:23.319604 bus /sierra_3: Setting Powered False 03:17:24.433533 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-900 --------------------------------------------------------------------- 03:17:25.701721 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:17:25.706775 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:17:25.738972 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 03:17:25.777053 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 03:17:25.861862 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:17:25.893635 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 03:17:25.932006 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 03:17:26.521244 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 03:17:26.570080 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:26.580661 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:26.631696 tst cs_paging_gprs_active.py: using LAC 18696 03:17:26.750275 tst cs_paging_gprs_active.py: using RAC 81 03:17:26.867390 tst cs_paging_gprs_active.py: using CellId 18696 03:17:26.990747 tst cs_paging_gprs_active.py: using BVCI 18697 03:17:27.107852 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:27.119260 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:27.130346 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:27.141450 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:27.152299 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:27.163358 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:27.174424 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:27.185177 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:27.196410 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:27.309347 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:27.425075 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:17:27.623764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:27.920449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17332): Launched 03:17:28.177139 run iperf3-srv_10.42.42.10(pid=17333): Launched 03:17:28.287254 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:17:28.484538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:28.780264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17334): Launched 03:17:29.037474 run iperf3-srv_10.42.42.10(pid=17335): Launched 03:17:29.148509 tst cs_paging_gprs_active.py:38: start network... 03:17:29.345834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:29.801771 run create_hlr_db(pid=17336): Launched 03:17:29.914889 bus /sierra_2: Setting Powered False 03:17:30.979537 run create_hlr_db(pid=17336): Terminated: ok {rc=0} 03:17:31.473671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17338): Launched 03:17:31.800391 run osmo-hlr_10.42.42.2(pid=17339): Launched 03:17:32.047124 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:32.671201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17341): Launched 03:17:32.987801 run osmo-stp_10.42.42.5(pid=17342): Launched 03:17:33.108804 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:33.655233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17344): Launched 03:17:33.776518 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:34.043946 run patchelf(pid=17345): Launched 03:17:34.218963 run osmo-stp_10.42.42.5(pid=17342): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17342)] 03:17:34.352527 run osmo-stp_10.42.42.5(pid=17342): stdout: | (launched: 2022-12-09_03:17:32.930501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:34.487633 run osmo-stp_10.42.42.5(pid=17342): stderr: | 20221209031733119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031733119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031733119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031733120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031733120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031733120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031733120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:34.622952 run osmo-stp_10.42.42.5(pid=17342): stdout: | (launched: 2022-12-09_03:17:32.930501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:34.752435 run osmo-stp_10.42.42.5(pid=17342): stderr: | 20221209031733119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031733119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031733119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031733120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031733120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031733120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031733120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:34.906748 run patchelf(pid=17345): Terminating (SIGINT) 03:17:35.083670 run patchelf(pid=17345): Terminated: ok {rc=0} 03:17:35.211632 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17342): Process ended prematurely: osmo-stp_10.42.42.5(pid=17342) [trial-2353↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17342)] [trial-2353↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 03:17:35.221544 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 03:17:35.249303 run osmo-hlr_10.42.42.2(pid=17339): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17339)] 03:17:35.298163 run osmo-hlr_10.42.42.2(pid=17339): stdout: | (launched: 2022-12-09_03:17:31.727642) 03:17:35.349042 run osmo-hlr_10.42.42.2(pid=17339): stderr: | 20221209031731974 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031731974 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031731974 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031731974 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031731974 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031731974 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031731990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031732013 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031732014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031732014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:35.400037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17332): Terminating (SIGTERM) 03:17:35.440845 run iperf3-srv_10.42.42.10(pid=17333): Terminating (SIGTERM) 03:17:35.481672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17334): Terminating (SIGTERM) 03:17:35.522533 run iperf3-srv_10.42.42.10(pid=17335): Terminating (SIGTERM) 03:17:35.563274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17338): Terminating (SIGTERM) 03:17:35.604033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17341): Terminating (SIGTERM) 03:17:35.644791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17344): Terminating (SIGTERM) 03:17:35.686560 --- ParallelTerminationStrategy: PID 17332 died... 03:17:35.706254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17332): Terminated: ok {rc=0} 03:17:35.751767 --- ParallelTerminationStrategy: PID 17333 died... 03:17:35.771453 run iperf3-srv_10.42.42.10(pid=17333): Terminated {rc=256} 03:17:35.817024 --- ParallelTerminationStrategy: PID 17334 died... 03:17:35.836584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17334): Terminated: ok {rc=0} 03:17:35.881793 --- ParallelTerminationStrategy: PID 17335 died... 03:17:35.900926 run iperf3-srv_10.42.42.10(pid=17335): Terminated {rc=256} 03:17:35.946321 --- ParallelTerminationStrategy: PID 17338 died... 03:17:35.965595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17338): Terminated: ok {rc=0} 03:17:36.010600 --- ParallelTerminationStrategy: PID 17341 died... 03:17:36.029871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17341): Terminated: ok {rc=0} 03:17:36.074957 --- ParallelTerminationStrategy: PID 17344 died... 03:17:36.094133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17344): Terminated: ok {rc=0} 03:17:36.179499 bus /gobi_0: Setting Powered False 03:17:37.275740 bus /gobi_0: Setting Powered False 03:17:38.390908 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 03:17:39.534196 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:39.545239 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:39.594804 tst iperf3.py: using LAC 18697 03:17:39.710919 tst iperf3.py: using RAC 82 03:17:39.829366 tst iperf3.py: using CellId 18697 03:17:39.949869 tst iperf3.py: using BVCI 18698 03:17:40.058360 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:40.069010 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:40.079453 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:40.090160 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:40.100644 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:40.111288 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:40.122108 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:40.132711 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:40.143506 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:40.256436 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:17:40.471164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:40.790063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17350): Launched 03:17:41.065094 run iperf3-srv_10.42.42.10(pid=17351): Launched 03:17:41.183357 tst iperf3.py:8: start network... 03:17:41.396883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:41.887743 run create_hlr_db(pid=17352): Launched 03:17:42.015949 bus /gobi_6: Setting Powered False 03:17:43.076066 run create_hlr_db(pid=17352): Terminated: ok {rc=0} 03:17:43.515828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17354): Launched 03:17:43.832345 run osmo-hlr_10.42.42.2(pid=17355): Launched 03:17:43.953453 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:44.503157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17358): Launched 03:17:44.818808 run osmo-stp_10.42.42.5(pid=17360): Launched 03:17:44.940789 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:45.490843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17363): Launched 03:17:45.611249 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:45.908004 run patchelf(pid=17364): Launched 03:17:46.100931 run osmo-stp_10.42.42.5(pid=17360): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17360)] 03:17:46.239216 run osmo-stp_10.42.42.5(pid=17360): stdout: | (launched: 2022-12-09_03:17:44.761059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:46.379279 run osmo-stp_10.42.42.5(pid=17360): stderr: | 20221209031744953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031744953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031744953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031744954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031744954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031744954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031744954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:46.517582 run osmo-stp_10.42.42.5(pid=17360): stdout: | (launched: 2022-12-09_03:17:44.761059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:46.654017 run osmo-stp_10.42.42.5(pid=17360): stderr: | 20221209031744953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031744953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031744953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031744954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031744954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031744954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031744954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:46.812471 run patchelf(pid=17364): Terminating (SIGINT) 03:17:46.995508 run patchelf(pid=17364): Terminated: ok {rc=0} 03:17:47.125975 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17360): Process ended prematurely: osmo-stp_10.42.42.5(pid=17360) [trial-2353↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17360)] [trial-2353↪gprs:nanobts+band-900↪iperf3.py:8] 03:17:47.136586 tst iperf3.py:8: Test FAILED (7.6 sec) 03:17:47.166744 run osmo-hlr_10.42.42.2(pid=17355): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17355)] 03:17:47.216690 run osmo-hlr_10.42.42.2(pid=17355): stdout: | (launched: 2022-12-09_03:17:43.774403) 03:17:47.268366 run osmo-hlr_10.42.42.2(pid=17355): stderr: | 20221209031743971 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031743971 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031743971 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031743972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031743972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031743972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031743985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031743993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031743993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031743993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:47.320118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17350): Terminating (SIGTERM) 03:17:47.361663 run iperf3-srv_10.42.42.10(pid=17351): Terminating (SIGTERM) 03:17:47.405401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17354): Terminating (SIGTERM) 03:17:47.445523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17358): Terminating (SIGTERM) 03:17:47.485434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17363): Terminating (SIGTERM) 03:17:47.525769 --- ParallelTerminationStrategy: PID 17350 died... 03:17:47.544328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17350): Terminated: ok {rc=0} 03:17:47.589492 --- ParallelTerminationStrategy: PID 17351 died... 03:17:47.607855 run iperf3-srv_10.42.42.10(pid=17351): Terminated {rc=256} 03:17:47.655566 --- ParallelTerminationStrategy: PID 17354 died... 03:17:47.673822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17354): Terminated: ok {rc=0} 03:17:47.718781 --- ParallelTerminationStrategy: PID 17358 died... 03:17:47.737040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17358): Terminated: ok {rc=0} 03:17:47.781642 --- ParallelTerminationStrategy: PID 17363 died... 03:17:47.799711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17363): Terminated: ok {rc=0} 03:17:47.885186 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 03:17:49.032713 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:49.044697 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:49.094490 tst iperf3m4.py: using LAC 18698 03:17:49.212548 tst iperf3m4.py: using RAC 83 03:17:49.332603 tst iperf3m4.py: using CellId 18698 03:17:49.451311 tst iperf3m4.py: using BVCI 18699 03:17:49.560303 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:49.571148 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:49.581770 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:49.592556 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:49.603354 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:49.618064 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:49.630095 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:49.640824 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:49.652303 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:49.772017 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:49.894315 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:50.010992 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:50.130549 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:17:50.336631 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:50.654761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17368): Launched 03:17:50.934546 run iperf3-srv_10.42.42.10(pid=17369): Launched 03:17:51.054832 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:17:51.269096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:51.588203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17370): Launched 03:17:51.865337 run iperf3-srv_10.42.42.10(pid=17371): Launched 03:17:51.976729 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:17:52.178979 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:52.486115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17372): Launched 03:17:52.758108 run iperf3-srv_10.42.42.10(pid=17373): Launched 03:17:52.869280 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:17:53.081130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:53.400432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17374): Launched 03:17:53.676251 run iperf3-srv_10.42.42.10(pid=17376): Launched 03:17:53.794869 tst iperf3m4.py:8: start network... 03:17:54.008735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:54.504894 run create_hlr_db(pid=17378): Launched 03:17:54.634713 bus /gobi_6: Setting Powered False 03:17:55.698515 run create_hlr_db(pid=17378): Terminated: ok {rc=0} 03:17:56.124819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17380): Launched 03:17:56.425306 run osmo-hlr_10.42.42.2(pid=17381): Launched 03:17:56.543361 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:57.076198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17383): Launched 03:17:57.394130 run osmo-stp_10.42.42.5(pid=17384): Launched 03:17:57.507928 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:58.020277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17386): Launched 03:17:58.133665 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:58.383868 run patchelf(pid=17387): Launched 03:17:58.548577 run osmo-stp_10.42.42.5(pid=17384): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17384)] 03:17:58.673852 run osmo-stp_10.42.42.5(pid=17384): stdout: | (launched: 2022-12-09_03:17:57.339000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:58.801798 run osmo-stp_10.42.42.5(pid=17384): stderr: | 20221209031757506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031757506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031757506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031757506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031757507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031757507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031757507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:58.929288 run osmo-stp_10.42.42.5(pid=17384): stdout: | (launched: 2022-12-09_03:17:57.339000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:59.051236 run osmo-stp_10.42.42.5(pid=17384): stderr: | 20221209031757506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031757506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031757506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031757506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031757507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031757507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031757507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:59.195349 run patchelf(pid=17387): Terminating (SIGINT) 03:17:59.362492 run patchelf(pid=17387): Terminated: ok {rc=0} 03:17:59.482145 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17384): Process ended prematurely: osmo-stp_10.42.42.5(pid=17384) [trial-2353↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17384)] [trial-2353↪gprs:nanobts+band-900↪iperf3m4.py:8] 03:17:59.491382 tst iperf3m4.py:8: Test FAILED (10.5 sec) 03:17:59.518789 run osmo-hlr_10.42.42.2(pid=17381): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17381)] 03:17:59.565747 run osmo-hlr_10.42.42.2(pid=17381): stdout: | (launched: 2022-12-09_03:17:56.370368) 03:17:59.615227 run osmo-hlr_10.42.42.2(pid=17381): stderr: | 20221209031756545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031756545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031756545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031756545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031756545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031756545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031756557 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031756566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031756566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031756566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:59.664249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17368): Terminating (SIGTERM) 03:17:59.703859 run iperf3-srv_10.42.42.10(pid=17369): Terminating (SIGTERM) 03:17:59.744593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17370): Terminating (SIGTERM) 03:17:59.784472 run iperf3-srv_10.42.42.10(pid=17371): Terminating (SIGTERM) 03:17:59.823373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17372): Terminating (SIGTERM) 03:17:59.862845 run iperf3-srv_10.42.42.10(pid=17373): Terminating (SIGTERM) 03:17:59.901826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17374): Terminating (SIGTERM) 03:17:59.940686 run iperf3-srv_10.42.42.10(pid=17376): Terminating (SIGTERM) 03:17:59.979513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17380): Terminating (SIGTERM) 03:18:00.018493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17383): Terminating (SIGTERM) 03:18:00.057342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17386): Terminating (SIGTERM) 03:18:00.096592 --- ParallelTerminationStrategy: PID 17368 died... 03:18:00.116101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17368): Terminated: ok {rc=0} 03:18:00.159900 --- ParallelTerminationStrategy: PID 17369 died... 03:18:00.178049 run iperf3-srv_10.42.42.10(pid=17369): Terminated {rc=256} 03:18:00.221408 --- ParallelTerminationStrategy: PID 17370 died... 03:18:00.239538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17370): Terminated: ok {rc=0} 03:18:00.282696 --- ParallelTerminationStrategy: PID 17371 died... 03:18:00.300708 run iperf3-srv_10.42.42.10(pid=17371): Terminated {rc=256} 03:18:00.343884 --- ParallelTerminationStrategy: PID 17372 died... 03:18:00.362400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17372): Terminated: ok {rc=0} 03:18:00.406559 --- ParallelTerminationStrategy: PID 17373 died... 03:18:00.424777 run iperf3-srv_10.42.42.10(pid=17373): Terminated {rc=256} 03:18:00.467879 --- ParallelTerminationStrategy: PID 17374 died... 03:18:00.486144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17374): Terminated: ok {rc=0} 03:18:00.529310 --- ParallelTerminationStrategy: PID 17376 died... 03:18:00.547272 run iperf3-srv_10.42.42.10(pid=17376): Terminated {rc=256} 03:18:00.590562 --- ParallelTerminationStrategy: PID 17380 died... 03:18:00.608751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17380): Terminated: ok {rc=0} 03:18:00.652768 --- ParallelTerminationStrategy: PID 17383 died... 03:18:00.671020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17383): Terminated: ok {rc=0} 03:18:00.714240 --- ParallelTerminationStrategy: PID 17386 died... 03:18:00.732578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17386): Terminated: ok {rc=0} 03:18:00.815450 bus /gobi_4: Setting Powered False 03:18:01.943688 bus /gobi_4: Setting Powered False 03:18:03.071319 bus /gobi_1: Setting Powered False 03:18:04.167516 bus /gobi_1: Setting Powered False 03:18:05.283952 bus /gobi_0: Setting Powered False 03:18:06.381830 bus /gobi_0: Setting Powered False 03:18:07.494455 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900 ping.py ---------------------------------------------- 03:18:08.595428 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:08.606644 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:18:08.654199 tst ping.py: using LAC 18699 03:18:08.771358 tst ping.py: using RAC 84 03:18:08.887281 tst ping.py: using CellId 18699 03:18:09.001565 tst ping.py: using BVCI 18700 03:18:09.116066 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:09.127235 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:09.138337 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:09.149754 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:09.161180 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:09.172465 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:09.183970 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:09.195356 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:18:09.311485 tst ping.py:19: start network... 03:18:09.511763 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:09.996634 run create_hlr_db(pid=17388): Launched 03:18:10.126839 bus /gobi_6: Setting Powered False 03:18:11.189412 run create_hlr_db(pid=17388): Terminated: ok {rc=0} 03:18:11.622352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17390): Launched 03:18:11.919951 run osmo-hlr_10.42.42.2(pid=17391): Launched 03:18:12.036271 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:12.558536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17393): Launched 03:18:12.857381 run osmo-stp_10.42.42.5(pid=17394): Launched 03:18:12.977081 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:13.501633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17396): Launched 03:18:13.621318 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:13.884340 run patchelf(pid=17397): Launched 03:18:14.057219 run osmo-stp_10.42.42.5(pid=17394): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17394)] 03:18:14.188610 run osmo-stp_10.42.42.5(pid=17394): stdout: | (launched: 2022-12-09_03:18:12.800100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:14.322001 run osmo-stp_10.42.42.5(pid=17394): stderr: | 20221209031812991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031812991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031812991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031812992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031812992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031812992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031812992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:14.455212 run osmo-stp_10.42.42.5(pid=17394): stdout: | (launched: 2022-12-09_03:18:12.800100) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:14.582940 run osmo-stp_10.42.42.5(pid=17394): stderr: | 20221209031812991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031812991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031812991 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031812992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031812992 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031812992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031812992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:14.734176 run patchelf(pid=17397): Terminating (SIGINT) 03:18:14.908563 run patchelf(pid=17397): Terminated: ok {rc=0} 03:18:15.033611 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17394): Process ended prematurely: osmo-stp_10.42.42.5(pid=17394) [trial-2353↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17394)] [trial-2353↪gprs:nanobts+band-900↪ping.py:22] 03:18:15.042926 tst ping.py:22: Test FAILED (6.4 sec) 03:18:15.070783 run osmo-hlr_10.42.42.2(pid=17391): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17391)] 03:18:15.120105 run osmo-hlr_10.42.42.2(pid=17391): stdout: | (launched: 2022-12-09_03:18:11.866342) 03:18:15.170961 run osmo-hlr_10.42.42.2(pid=17391): stderr: | 20221209031812041 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031812041 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031812041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031812041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031812041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031812041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031812053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031812062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031812062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031812062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:15.222660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17390): Terminating (SIGTERM) 03:18:15.263618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17393): Terminating (SIGTERM) 03:18:15.304644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17396): Terminating (SIGTERM) 03:18:15.346122 --- ParallelTerminationStrategy: PID 17390 died... 03:18:15.366027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17390): Terminated: ok {rc=0} 03:18:15.411536 --- ParallelTerminationStrategy: PID 17393 died... 03:18:15.430981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17393): Terminated: ok {rc=0} 03:18:15.476863 --- ParallelTerminationStrategy: PID 17396 died... 03:18:15.496465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17396): Terminated: ok {rc=0} 03:18:15.585568 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 03:18:16.675650 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:16.690594 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:18:16.746531 tst ping_idle_ping.py: using LAC 18700 03:18:16.874082 tst ping_idle_ping.py: using RAC 85 03:18:17.009390 tst ping_idle_ping.py: using CellId 18700 03:18:17.135455 tst ping_idle_ping.py: using BVCI 18701 03:18:17.271189 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:17.283178 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:17.295016 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:17.307912 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:17.318998 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:17.330596 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:17.342187 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:18:17.353804 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:18:17.469922 tst ping_idle_ping.py:24: start network... 03:18:17.683915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:18.175631 run create_hlr_db(pid=17398): Launched 03:18:18.305255 bus /gobi_6: Setting Powered False 03:18:19.369857 run create_hlr_db(pid=17398): Terminated: ok {rc=0} 03:18:19.786236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17400): Launched 03:18:20.076584 run osmo-hlr_10.42.42.2(pid=17401): Launched 03:18:20.190542 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:20.705648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17403): Launched 03:18:20.995738 run osmo-stp_10.42.42.5(pid=17404): Launched 03:18:21.106340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:21.624298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17406): Launched 03:18:21.744184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:22.010361 run patchelf(pid=17407): Launched 03:18:22.185572 run osmo-stp_10.42.42.5(pid=17404): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17404)] 03:18:22.319204 run osmo-stp_10.42.42.5(pid=17404): stdout: | (launched: 2022-12-09_03:18:20.942459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:22.453485 run osmo-stp_10.42.42.5(pid=17404): stderr: | 20221209031821111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031821111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031821111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031821112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031821112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031821112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031821112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:22.586699 run osmo-stp_10.42.42.5(pid=17404): stdout: | (launched: 2022-12-09_03:18:20.942459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:22.714875 run osmo-stp_10.42.42.5(pid=17404): stderr: | 20221209031821111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031821111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031821111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031821112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031821112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031821112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031821112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:22.866628 run patchelf(pid=17407): Terminating (SIGINT) 03:18:23.041593 run patchelf(pid=17407): Terminated: ok {rc=0} 03:18:23.167008 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17404): Process ended prematurely: osmo-stp_10.42.42.5(pid=17404) [trial-2353↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17404)] [trial-2353↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 03:18:23.176180 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:18:23.203961 run osmo-hlr_10.42.42.2(pid=17401): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17401)] 03:18:23.253091 run osmo-hlr_10.42.42.2(pid=17401): stdout: | (launched: 2022-12-09_03:18:20.023364) 03:18:23.303494 run osmo-hlr_10.42.42.2(pid=17401): stderr: | 20221209031820202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031820202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031820202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031820202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031820202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031820202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031820215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031820223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031820223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031820223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:23.354473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17400): Terminating (SIGTERM) 03:18:23.395497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17403): Terminating (SIGTERM) 03:18:23.436471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17406): Terminating (SIGTERM) 03:18:23.477760 --- ParallelTerminationStrategy: PID 17400 died... 03:18:23.497500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17400): Terminated: ok {rc=0} 03:18:23.542920 --- ParallelTerminationStrategy: PID 17403 died... 03:18:23.562439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17403): Terminated: ok {rc=0} 03:18:23.607624 --- ParallelTerminationStrategy: PID 17406 died... 03:18:23.626785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17406): Terminated: ok {rc=0} 03:18:23.713227 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 03:18:25.016038 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:18:25.023042 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:18:25.055831 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:18:25.093911 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:18:25.179242 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:18:25.214730 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:18:25.253928 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:18:25.848250 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:18:25.896351 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:25.907157 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:18:25.955330 tst cs_paging_gprs_active.py: using LAC 18701 03:18:26.083434 tst cs_paging_gprs_active.py: using RAC 86 03:18:26.200024 tst cs_paging_gprs_active.py: using CellId 18701 03:18:26.316079 tst cs_paging_gprs_active.py: using BVCI 18702 03:18:26.431961 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:26.443652 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:26.454921 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:26.466064 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:26.477084 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:26.488130 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:26.499270 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:26.510727 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:26.521952 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:26.636045 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:26.758222 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:18:26.968933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:27.269799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17412): Launched 03:18:27.530371 run iperf3-srv_10.42.42.10(pid=17413): Launched 03:18:27.643021 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:18:27.841188 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:28.137872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17414): Launched 03:18:28.416481 run iperf3-srv_10.42.42.10(pid=17415): Launched 03:18:28.534999 tst cs_paging_gprs_active.py:38: start network... 03:18:28.733750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:29.195031 run create_hlr_db(pid=17417): Launched 03:18:29.307464 bus /gobi_6: Setting Powered False 03:18:30.366268 run create_hlr_db(pid=17417): Terminated: ok {rc=0} 03:18:30.802547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17419): Launched 03:18:31.130132 run osmo-hlr_10.42.42.2(pid=17420): Launched 03:18:31.397901 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:32.014170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17422): Launched 03:18:32.344856 run osmo-stp_10.42.42.5(pid=17423): Launched 03:18:32.466452 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:33.002146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17425): Launched 03:18:33.115190 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:33.365112 run patchelf(pid=17426): Launched 03:18:33.530306 run osmo-stp_10.42.42.5(pid=17423): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17423)] 03:18:33.656015 run osmo-stp_10.42.42.5(pid=17423): stdout: | (launched: 2022-12-09_03:18:32.287271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:33.783460 run osmo-stp_10.42.42.5(pid=17423): stderr: | 20221209031832478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031832478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031832478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031832479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031832479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031832479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031832479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:33.910070 run osmo-stp_10.42.42.5(pid=17423): stdout: | (launched: 2022-12-09_03:18:32.287271) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:34.031939 run osmo-stp_10.42.42.5(pid=17423): stderr: | 20221209031832478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031832478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031832478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031832479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031832479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031832479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031832479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:34.176226 run patchelf(pid=17426): Terminating (SIGINT) 03:18:34.342743 run patchelf(pid=17426): Terminated: ok {rc=0} 03:18:34.462331 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17423): Process ended prematurely: osmo-stp_10.42.42.5(pid=17423) [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17423)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:18:34.471522 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:18:34.498721 run osmo-hlr_10.42.42.2(pid=17420): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17420)] 03:18:34.545746 run osmo-hlr_10.42.42.2(pid=17420): stdout: | (launched: 2022-12-09_03:18:31.069232) 03:18:34.594925 run osmo-hlr_10.42.42.2(pid=17420): stderr: | 20221209031831323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031831323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031831323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031831323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031831323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031831323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031831347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031831355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031831355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031831355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:34.644212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17412): Terminating (SIGTERM) 03:18:34.683748 run iperf3-srv_10.42.42.10(pid=17413): Terminating (SIGTERM) 03:18:34.722874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17414): Terminating (SIGTERM) 03:18:34.762184 run iperf3-srv_10.42.42.10(pid=17415): Terminating (SIGTERM) 03:18:34.801286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17419): Terminating (SIGTERM) 03:18:34.840586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17422): Terminating (SIGTERM) 03:18:34.880030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17425): Terminating (SIGTERM) 03:18:34.919749 --- ParallelTerminationStrategy: PID 17412 died... 03:18:34.938633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17412): Terminated: ok {rc=0} 03:18:34.982324 --- ParallelTerminationStrategy: PID 17413 died... 03:18:35.000403 run iperf3-srv_10.42.42.10(pid=17413): Terminated {rc=256} 03:18:35.043952 --- ParallelTerminationStrategy: PID 17414 died... 03:18:35.062534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17414): Terminated: ok {rc=0} 03:18:35.106044 --- ParallelTerminationStrategy: PID 17415 died... 03:18:35.124217 run iperf3-srv_10.42.42.10(pid=17415): Terminated {rc=256} 03:18:35.167684 --- ParallelTerminationStrategy: PID 17419 died... 03:18:35.186038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17419): Terminated: ok {rc=0} 03:18:35.229602 --- ParallelTerminationStrategy: PID 17422 died... 03:18:35.247703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17422): Terminated: ok {rc=0} 03:18:35.291429 --- ParallelTerminationStrategy: PID 17425 died... 03:18:35.309723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17425): Terminated: ok {rc=0} 03:18:35.393040 bus /gobi_0: Setting Powered False 03:18:36.490320 bus /gobi_0: Setting Powered False 03:18:37.604802 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:18:38.753590 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:38.765755 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:18:38.818600 tst iperf3.py: using LAC 18702 03:18:38.946652 tst iperf3.py: using RAC 87 03:18:39.072875 tst iperf3.py: using CellId 18702 03:18:39.200440 tst iperf3.py: using BVCI 18703 03:18:39.314798 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:39.325717 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:39.336295 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:39.347194 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:39.358316 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:39.369150 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:39.380172 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:39.391023 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:39.402124 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:39.518044 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:18:39.717509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:40.015235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17428): Launched 03:18:40.271301 run iperf3-srv_10.42.42.10(pid=17429): Launched 03:18:40.384781 tst iperf3.py:8: start network... 03:18:40.583374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:41.043273 run create_hlr_db(pid=17430): Launched 03:18:41.157432 bus /gobi_6: Setting Powered False 03:18:42.217269 run create_hlr_db(pid=17430): Terminated: ok {rc=0} 03:18:42.631994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17432): Launched 03:18:42.928140 run osmo-hlr_10.42.42.2(pid=17433): Launched 03:18:43.041368 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:43.595036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17435): Launched 03:18:43.917373 run osmo-stp_10.42.42.5(pid=17436): Launched 03:18:44.039216 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:44.583354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17438): Launched 03:18:44.697721 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:44.950794 run patchelf(pid=17439): Launched 03:18:45.115971 run osmo-stp_10.42.42.5(pid=17436): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17436)] 03:18:45.241553 run osmo-stp_10.42.42.5(pid=17436): stdout: | (launched: 2022-12-09_03:18:43.857761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:45.369305 run osmo-stp_10.42.42.5(pid=17436): stderr: | 20221209031844050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031844050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031844050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031844050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031844051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031844051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031844051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:45.498008 run osmo-stp_10.42.42.5(pid=17436): stdout: | (launched: 2022-12-09_03:18:43.857761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:45.620159 run osmo-stp_10.42.42.5(pid=17436): stderr: | 20221209031844050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031844050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031844050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031844050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031844051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031844051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031844051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:45.770063 run patchelf(pid=17439): Terminating (SIGINT) 03:18:45.973224 run patchelf(pid=17439): Terminated: ok {rc=0} 03:18:46.100793 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17436): Process ended prematurely: osmo-stp_10.42.42.5(pid=17436) [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17436)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 03:18:46.110279 tst iperf3.py:8: Test FAILED (7.4 sec) 03:18:46.139794 run osmo-hlr_10.42.42.2(pid=17433): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17433)] 03:18:46.189593 run osmo-hlr_10.42.42.2(pid=17433): stdout: | (launched: 2022-12-09_03:18:42.874231) 03:18:46.243582 run osmo-hlr_10.42.42.2(pid=17433): stderr: | 20221209031843049 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031843050 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031843050 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031843050 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031843050 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031843050 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031843063 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031843072 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031843072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031843072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:46.298464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17428): Terminating (SIGTERM) 03:18:46.343297 run iperf3-srv_10.42.42.10(pid=17429): Terminating (SIGTERM) 03:18:46.384831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17432): Terminating (SIGTERM) 03:18:46.427094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17435): Terminating (SIGTERM) 03:18:46.470513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17438): Terminating (SIGTERM) 03:18:46.514014 --- ParallelTerminationStrategy: PID 17428 died... 03:18:46.533676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17428): Terminated: ok {rc=0} 03:18:46.584396 --- ParallelTerminationStrategy: PID 17429 died... 03:18:46.607552 run iperf3-srv_10.42.42.10(pid=17429): Terminated {rc=256} 03:18:46.654328 --- ParallelTerminationStrategy: PID 17432 died... 03:18:46.673857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17432): Terminated: ok {rc=0} 03:18:46.720649 --- ParallelTerminationStrategy: PID 17435 died... 03:18:46.740216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17435): Terminated: ok {rc=0} 03:18:46.787137 --- ParallelTerminationStrategy: PID 17438 died... 03:18:46.806702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17438): Terminated: ok {rc=0} 03:18:46.901797 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:18:48.062845 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:48.074981 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:18:48.125092 tst iperf3m4.py: using LAC 18703 03:18:48.249659 tst iperf3m4.py: using RAC 88 03:18:48.373718 tst iperf3m4.py: using CellId 18703 03:18:48.494575 tst iperf3m4.py: using BVCI 18704 03:18:48.604521 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:48.615474 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:48.626246 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:48.637673 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:48.650727 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:48.662061 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:48.673831 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:48.685128 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:48.696477 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:48.812277 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:48.935717 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:49.050447 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:49.165124 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:18:49.379607 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:49.698282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17440): Launched 03:18:49.974335 run iperf3-srv_10.42.42.10(pid=17441): Launched 03:18:50.093785 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:18:50.308349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:50.627264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17442): Launched 03:18:50.904942 run iperf3-srv_10.42.42.10(pid=17443): Launched 03:18:51.024153 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:18:51.237564 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:51.557895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17444): Launched 03:18:51.834852 run iperf3-srv_10.42.42.10(pid=17445): Launched 03:18:51.954125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:18:52.168314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:52.489000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17446): Launched 03:18:52.765400 run iperf3-srv_10.42.42.10(pid=17447): Launched 03:18:52.884887 tst iperf3m4.py:8: start network... 03:18:53.098993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:53.592078 run create_hlr_db(pid=17448): Launched 03:18:53.720392 bus /gobi_6: Setting Powered False 03:18:54.784146 run create_hlr_db(pid=17448): Terminated: ok {rc=0} 03:18:55.210718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17450): Launched 03:18:55.506376 run osmo-hlr_10.42.42.2(pid=17451): Launched 03:18:55.619699 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:56.133590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17453): Launched 03:18:56.430797 run osmo-stp_10.42.42.5(pid=17454): Launched 03:18:56.544439 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:57.065632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17456): Launched 03:18:57.187437 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:57.458376 run patchelf(pid=17457): Launched 03:18:57.637655 run osmo-stp_10.42.42.5(pid=17454): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17454)] 03:18:57.772234 run osmo-stp_10.42.42.5(pid=17454): stdout: | (launched: 2022-12-09_03:18:56.376231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:57.913313 run osmo-stp_10.42.42.5(pid=17454): stderr: | 20221209031856546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031856546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031856546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031856546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031856547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031856547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031856547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:58.050062 run osmo-stp_10.42.42.5(pid=17454): stdout: | (launched: 2022-12-09_03:18:56.376231) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:58.183118 run osmo-stp_10.42.42.5(pid=17454): stderr: | 20221209031856546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031856546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031856546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031856546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031856547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031856547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031856547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:58.338128 run patchelf(pid=17457): Terminating (SIGINT) 03:18:58.518027 run patchelf(pid=17457): Terminated: ok {rc=0} 03:18:58.648072 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17454): Process ended prematurely: osmo-stp_10.42.42.5(pid=17454) [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17454)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 03:18:58.658116 tst iperf3m4.py:8: Test FAILED (10.6 sec) 03:18:58.687468 run osmo-hlr_10.42.42.2(pid=17451): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17451)] 03:18:58.736855 run osmo-hlr_10.42.42.2(pid=17451): stdout: | (launched: 2022-12-09_03:18:55.452136) 03:18:58.788044 run osmo-hlr_10.42.42.2(pid=17451): stderr: | 20221209031855625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031855625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031855625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031855626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031855626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031855626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031855640 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031855649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031855649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031855649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:58.839691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17440): Terminating (SIGTERM) 03:18:58.885173 run iperf3-srv_10.42.42.10(pid=17441): Terminating (SIGTERM) 03:18:58.925795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17442): Terminating (SIGTERM) 03:18:58.965377 run iperf3-srv_10.42.42.10(pid=17443): Terminating (SIGTERM) 03:18:59.004877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17444): Terminating (SIGTERM) 03:18:59.044353 run iperf3-srv_10.42.42.10(pid=17445): Terminating (SIGTERM) 03:18:59.083729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17446): Terminating (SIGTERM) 03:18:59.124091 run iperf3-srv_10.42.42.10(pid=17447): Terminating (SIGTERM) 03:18:59.168999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17450): Terminating (SIGTERM) 03:18:59.210522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17453): Terminating (SIGTERM) 03:18:59.251685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17456): Terminating (SIGTERM) 03:18:59.293403 --- ParallelTerminationStrategy: PID 17440 died... 03:18:59.313457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17440): Terminated: ok {rc=0} 03:18:59.359152 --- ParallelTerminationStrategy: PID 17441 died... 03:18:59.378569 run iperf3-srv_10.42.42.10(pid=17441): Terminated {rc=256} 03:18:59.425803 --- ParallelTerminationStrategy: PID 17442 died... 03:18:59.445027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17442): Terminated: ok {rc=0} 03:18:59.489283 --- ParallelTerminationStrategy: PID 17443 died... 03:18:59.507493 run iperf3-srv_10.42.42.10(pid=17443): Terminated {rc=256} 03:18:59.551683 --- ParallelTerminationStrategy: PID 17444 died... 03:18:59.570298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17444): Terminated: ok {rc=0} 03:18:59.614662 --- ParallelTerminationStrategy: PID 17445 died... 03:18:59.632941 run iperf3-srv_10.42.42.10(pid=17445): Terminated {rc=256} 03:18:59.677270 --- ParallelTerminationStrategy: PID 17446 died... 03:18:59.695548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17446): Terminated: ok {rc=0} 03:18:59.740782 --- ParallelTerminationStrategy: PID 17447 died... 03:18:59.759778 run iperf3-srv_10.42.42.10(pid=17447): Terminated {rc=256} 03:18:59.803705 --- ParallelTerminationStrategy: PID 17450 died... 03:18:59.822381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17450): Terminated: ok {rc=0} 03:18:59.866438 --- ParallelTerminationStrategy: PID 17453 died... 03:18:59.884912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17453): Terminated: ok {rc=0} 03:18:59.928826 --- ParallelTerminationStrategy: PID 17456 died... 03:18:59.947772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17456): Terminated: ok {rc=0} 03:19:00.033172 bus /gobi_4: Setting Powered False 03:19:01.132726 bus /gobi_4: Setting Powered False 03:19:02.250787 bus /gobi_1: Setting Powered False 03:19:03.348459 bus /gobi_1: Setting Powered False 03:19:04.465739 bus /gobi_0: Setting Powered False 03:19:05.563294 bus /gobi_0: Setting Powered False 03:19:06.678889 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 03:19:07.782013 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:07.794080 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:19:07.844442 tst ping.py: using LAC 18704 03:19:07.968686 tst ping.py: using RAC 89 03:19:08.094965 tst ping.py: using CellId 18704 03:19:08.218155 tst ping.py: using BVCI 18705 03:19:08.333369 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:08.344697 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:08.355905 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:08.367055 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:08.378135 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:08.389126 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:08.400339 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:08.411597 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:19:08.526544 tst ping.py:19: start network... 03:19:08.728153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:09.212387 run create_hlr_db(pid=17458): Launched 03:19:09.338833 bus /gobi_6: Setting Powered False 03:19:10.401117 run create_hlr_db(pid=17458): Terminated: ok {rc=0} 03:19:10.834887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17463): Launched 03:19:11.145513 run osmo-hlr_10.42.42.2(pid=17464): Launched 03:19:11.263815 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:11.788854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17466): Launched 03:19:12.082564 run osmo-stp_10.42.42.5(pid=17467): Launched 03:19:12.192871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:12.700088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17469): Launched 03:19:12.811115 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:13.059597 run patchelf(pid=17470): Launched 03:19:13.224394 run osmo-stp_10.42.42.5(pid=17467): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17467)] 03:19:13.347777 run osmo-stp_10.42.42.5(pid=17467): stdout: | (launched: 2022-12-09_03:19:12.029368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:13.483723 run osmo-stp_10.42.42.5(pid=17467): stderr: | 20221209031912195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031912195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031912195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031912196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031912198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031912198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031912198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:13.618499 run osmo-stp_10.42.42.5(pid=17467): stdout: | (launched: 2022-12-09_03:19:12.029368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:13.745317 run osmo-stp_10.42.42.5(pid=17467): stderr: | 20221209031912195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031912195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031912195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031912196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031912198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031912198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031912198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:13.888019 run patchelf(pid=17470): Terminating (SIGINT) 03:19:14.055533 run patchelf(pid=17470): Terminated: ok {rc=0} 03:19:14.173763 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17467): Process ended prematurely: osmo-stp_10.42.42.5(pid=17467) [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17467)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 03:19:14.182653 tst ping.py:22: Test FAILED (6.4 sec) 03:19:14.210671 run osmo-hlr_10.42.42.2(pid=17464): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17464)] 03:19:14.261093 run osmo-hlr_10.42.42.2(pid=17464): stdout: | (launched: 2022-12-09_03:19:11.088755) 03:19:14.310428 run osmo-hlr_10.42.42.2(pid=17464): stderr: | 20221209031911290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031911290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031911290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031911290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031911290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031911290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031911302 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031911312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031911312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031911312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:14.360034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17463): Terminating (SIGTERM) 03:19:14.399451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17466): Terminating (SIGTERM) 03:19:14.440253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17469): Terminating (SIGTERM) 03:19:14.481047 --- ParallelTerminationStrategy: PID 17463 died... 03:19:14.500130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17463): Terminated: ok {rc=0} 03:19:14.545603 --- ParallelTerminationStrategy: PID 17466 died... 03:19:14.564457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17466): Terminated: ok {rc=0} 03:19:14.611597 --- ParallelTerminationStrategy: PID 17469 died... 03:19:14.630250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17469): Terminated: ok {rc=0} 03:19:14.717368 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:19:15.806679 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:15.818685 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:19:15.893052 tst ping_idle_ping.py: using LAC 18705 03:19:16.044284 tst ping_idle_ping.py: using RAC 90 03:19:16.202639 tst ping_idle_ping.py: using CellId 18705 03:19:16.350034 tst ping_idle_ping.py: using BVCI 18706 03:19:16.493563 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:16.508195 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:16.524504 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:16.540887 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:16.557171 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:16.571565 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:16.586839 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:19:16.605821 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:19:16.752692 tst ping_idle_ping.py:24: start network... 03:19:16.988325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:17.487096 run create_hlr_db(pid=17471): Launched 03:19:17.615525 bus /gobi_6: Setting Powered False 03:19:18.679008 run create_hlr_db(pid=17471): Terminated: ok {rc=0} 03:19:19.106522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17473): Launched 03:19:19.416732 run osmo-hlr_10.42.42.2(pid=17474): Launched 03:19:19.530668 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:20.046708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17476): Launched 03:19:20.338165 run osmo-stp_10.42.42.5(pid=17477): Launched 03:19:20.451182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:20.981440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17479): Launched 03:19:21.093018 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:21.353430 run patchelf(pid=17480): Launched 03:19:21.530077 run osmo-stp_10.42.42.5(pid=17477): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17477)] 03:19:21.663080 run osmo-stp_10.42.42.5(pid=17477): stdout: | (launched: 2022-12-09_03:19:20.284512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:21.797455 run osmo-stp_10.42.42.5(pid=17477): stderr: | 20221209031920455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031920455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031920455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031920456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031920456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031920456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031920456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:21.934644 run osmo-stp_10.42.42.5(pid=17477): stdout: | (launched: 2022-12-09_03:19:20.284512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:22.063544 run osmo-stp_10.42.42.5(pid=17477): stderr: | 20221209031920455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031920455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031920455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031920456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031920456 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031920456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031920456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:22.215805 run patchelf(pid=17480): Terminating (SIGINT) 03:19:22.391466 run patchelf(pid=17480): Terminated: ok {rc=0} 03:19:22.517497 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17477): Process ended prematurely: osmo-stp_10.42.42.5(pid=17477) [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17477)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 03:19:22.526868 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 03:19:22.554405 run osmo-hlr_10.42.42.2(pid=17474): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17474)] 03:19:22.603335 run osmo-hlr_10.42.42.2(pid=17474): stdout: | (launched: 2022-12-09_03:19:19.363484) 03:19:22.654178 run osmo-hlr_10.42.42.2(pid=17474): stderr: | 20221209031919538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031919538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031919538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031919538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031919538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031919538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031919551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031919562 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031919562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031919562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:22.705363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17473): Terminating (SIGTERM) 03:19:22.746166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17476): Terminating (SIGTERM) 03:19:22.787132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17479): Terminating (SIGTERM) 03:19:22.828444 --- ParallelTerminationStrategy: PID 17473 died... 03:19:22.848223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17473): Terminated: ok {rc=0} 03:19:22.894012 --- ParallelTerminationStrategy: PID 17476 died... 03:19:22.913506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17476): Terminated: ok {rc=0} 03:19:22.959041 --- ParallelTerminationStrategy: PID 17479 died... 03:19:22.978471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17479): Terminated: ok {rc=0} 03:19:23.066020 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:19:24.373513 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:19:24.380584 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:19:24.413323 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:19:24.453175 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:19:24.542860 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:19:24.576334 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:19:24.615440 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:19:25.211247 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:19:25.261984 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:25.273318 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:19:25.340617 tst cs_paging_gprs_active.py: using LAC 18706 03:19:25.464935 tst cs_paging_gprs_active.py: using RAC 91 03:19:25.590163 tst cs_paging_gprs_active.py: using CellId 18706 03:19:25.714202 tst cs_paging_gprs_active.py: using BVCI 18707 03:19:25.831099 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:25.842534 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:25.853728 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:25.865323 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:25.876522 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:25.887791 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:25.899485 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:25.910733 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:25.922039 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:26.040533 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:26.159899 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:19:26.374359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:26.694604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17484): Launched 03:19:26.970474 run iperf3-srv_10.42.42.10(pid=17485): Launched 03:19:27.089300 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:19:27.303568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:27.621947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17486): Launched 03:19:27.896384 run iperf3-srv_10.42.42.10(pid=17487): Launched 03:19:28.014641 tst cs_paging_gprs_active.py:38: start network... 03:19:28.228713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:28.719573 run create_hlr_db(pid=17488): Launched 03:19:28.848221 bus /gobi_6: Setting Powered False 03:19:29.912274 run create_hlr_db(pid=17488): Terminated: ok {rc=0} 03:19:30.336445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17490): Launched 03:19:30.633683 run osmo-hlr_10.42.42.2(pid=17491): Launched 03:19:30.748455 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:31.373680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17493): Launched 03:19:31.711016 run osmo-stp_10.42.42.5(pid=17494): Launched 03:19:31.892370 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:32.554077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17496): Launched 03:19:32.675883 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:32.945315 run patchelf(pid=17497): Launched 03:19:33.122834 run osmo-stp_10.42.42.5(pid=17494): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17494)] 03:19:33.258107 run osmo-stp_10.42.42.5(pid=17494): stdout: | (launched: 2022-12-09_03:19:31.649047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:33.394976 run osmo-stp_10.42.42.5(pid=17494): stderr: | 20221209031932005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031932006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031932006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031932007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031932007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031932007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031932007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:33.531728 run osmo-stp_10.42.42.5(pid=17494): stdout: | (launched: 2022-12-09_03:19:31.649047) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:33.663575 run osmo-stp_10.42.42.5(pid=17494): stderr: | 20221209031932005 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031932006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031932006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031932007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031932007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031932007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031932007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:33.819085 run patchelf(pid=17497): Terminating (SIGINT) 03:19:33.997668 run patchelf(pid=17497): Terminated: ok {rc=0} 03:19:34.126655 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17494): Process ended prematurely: osmo-stp_10.42.42.5(pid=17494) [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17494)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:19:34.136534 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 03:19:34.164574 run osmo-hlr_10.42.42.2(pid=17491): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17491)] 03:19:34.213691 run osmo-hlr_10.42.42.2(pid=17491): stdout: | (launched: 2022-12-09_03:19:30.579988) 03:19:34.264641 run osmo-hlr_10.42.42.2(pid=17491): stderr: | 20221209031930754 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031930755 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031930755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031930755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031930755 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031930755 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031930767 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031930775 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031930776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031930776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:34.315978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17484): Terminating (SIGTERM) 03:19:34.357201 run iperf3-srv_10.42.42.10(pid=17485): Terminating (SIGTERM) 03:19:34.398288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17486): Terminating (SIGTERM) 03:19:34.439414 run iperf3-srv_10.42.42.10(pid=17487): Terminating (SIGTERM) 03:19:34.480266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17490): Terminating (SIGTERM) 03:19:34.521482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17493): Terminating (SIGTERM) 03:19:34.562725 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17496): Terminating (SIGTERM) 03:19:34.604135 --- ParallelTerminationStrategy: PID 17484 died... 03:19:34.623724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17484): Terminated: ok {rc=0} 03:19:34.669441 --- ParallelTerminationStrategy: PID 17485 died... 03:19:34.688686 run iperf3-srv_10.42.42.10(pid=17485): Terminated {rc=256} 03:19:34.734745 --- ParallelTerminationStrategy: PID 17486 died... 03:19:34.754022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17486): Terminated: ok {rc=0} 03:19:34.799561 --- ParallelTerminationStrategy: PID 17487 died... 03:19:34.818703 run iperf3-srv_10.42.42.10(pid=17487): Terminated {rc=256} 03:19:34.864069 --- ParallelTerminationStrategy: PID 17490 died... 03:19:34.883390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17490): Terminated: ok {rc=0} 03:19:34.929089 --- ParallelTerminationStrategy: PID 17493 died... 03:19:34.948364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17493): Terminated: ok {rc=0} 03:19:34.993587 --- ParallelTerminationStrategy: PID 17496 died... 03:19:35.012591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17496): Terminated: ok {rc=0} 03:19:35.099191 bus /gobi_0: Setting Powered False 03:19:36.198145 bus /gobi_0: Setting Powered False 03:19:37.312782 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:19:38.459300 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:38.471130 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:19:38.541449 tst iperf3.py: using LAC 18707 03:19:38.666347 tst iperf3.py: using RAC 92 03:19:38.792183 tst iperf3.py: using CellId 18707 03:19:38.916635 tst iperf3.py: using BVCI 18708 03:19:39.031888 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:39.043171 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:39.054288 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:39.065425 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:39.076471 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:39.087672 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:39.099228 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:39.110300 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:39.121526 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:39.238651 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:19:39.453108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:39.771980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17498): Launched 03:19:40.049499 run iperf3-srv_10.42.42.10(pid=17499): Launched 03:19:40.168570 tst iperf3.py:8: start network... 03:19:40.382334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:40.874287 run create_hlr_db(pid=17500): Launched 03:19:41.002968 bus /gobi_6: Setting Powered False 03:19:42.065614 run create_hlr_db(pid=17500): Terminated: ok {rc=0} 03:19:42.506349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17502): Launched 03:19:42.823012 run osmo-hlr_10.42.42.2(pid=17503): Launched 03:19:42.944849 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:43.497430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17505): Launched 03:19:43.813535 run osmo-stp_10.42.42.5(pid=17506): Launched 03:19:43.935310 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:44.484328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17508): Launched 03:19:44.605444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:44.874163 run patchelf(pid=17509): Launched 03:19:45.050648 run osmo-stp_10.42.42.5(pid=17506): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17506)] 03:19:45.184275 run osmo-stp_10.42.42.5(pid=17506): stdout: | (launched: 2022-12-09_03:19:43.756054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:45.319911 run osmo-stp_10.42.42.5(pid=17506): stderr: | 20221209031943946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031943946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031943947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031943947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031943950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031943950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031943950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:45.455560 run osmo-stp_10.42.42.5(pid=17506): stdout: | (launched: 2022-12-09_03:19:43.756054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:45.585682 run osmo-stp_10.42.42.5(pid=17506): stderr: | 20221209031943946 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031943946 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031943947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031943947 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031943950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031943950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031943950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:45.739520 run patchelf(pid=17509): Terminating (SIGINT) 03:19:45.936405 run patchelf(pid=17509): Terminated: ok {rc=0} 03:19:46.075508 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17506): Process ended prematurely: osmo-stp_10.42.42.5(pid=17506) [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17506)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 03:19:46.086594 tst iperf3.py:8: Test FAILED (7.7 sec) 03:19:46.115949 run osmo-hlr_10.42.42.2(pid=17503): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17503)] 03:19:46.166231 run osmo-hlr_10.42.42.2(pid=17503): stdout: | (launched: 2022-12-09_03:19:42.764887) 03:19:46.219456 run osmo-hlr_10.42.42.2(pid=17503): stderr: | 20221209031942961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031942961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031942961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031942961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031942962 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031942962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031942974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031942982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031942982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031942982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:46.273073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17498): Terminating (SIGTERM) 03:19:46.315983 run iperf3-srv_10.42.42.10(pid=17499): Terminating (SIGTERM) 03:19:46.358519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17502): Terminating (SIGTERM) 03:19:46.401220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17505): Terminating (SIGTERM) 03:19:46.443896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17508): Terminating (SIGTERM) 03:19:46.486941 --- ParallelTerminationStrategy: PID 17498 died... 03:19:46.507112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17498): Terminated: ok {rc=0} 03:19:46.554741 --- ParallelTerminationStrategy: PID 17499 died... 03:19:46.574857 run iperf3-srv_10.42.42.10(pid=17499): Terminated {rc=256} 03:19:46.622247 --- ParallelTerminationStrategy: PID 17502 died... 03:19:46.642504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17502): Terminated: ok {rc=0} 03:19:46.690201 --- ParallelTerminationStrategy: PID 17505 died... 03:19:46.710603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17505): Terminated: ok {rc=0} 03:19:46.758251 --- ParallelTerminationStrategy: PID 17508 died... 03:19:46.778459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17508): Terminated: ok {rc=0} 03:19:46.868712 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:19:48.011988 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:48.023493 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:19:48.089379 tst iperf3m4.py: using LAC 18708 03:19:48.204851 tst iperf3m4.py: using RAC 93 03:19:48.320800 tst iperf3m4.py: using CellId 18708 03:19:48.436591 tst iperf3m4.py: using BVCI 18709 03:19:48.544388 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:48.555450 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:48.566256 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:48.577256 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:48.588148 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:48.599025 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:48.610273 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:48.621332 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:48.632606 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:48.752013 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:48.869546 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:48.983448 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:49.101394 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:19:49.316769 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:49.636492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17510): Launched 03:19:49.912876 run iperf3-srv_10.42.42.10(pid=17511): Launched 03:19:50.031443 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:19:50.246727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:50.565186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17512): Launched 03:19:50.840090 run iperf3-srv_10.42.42.10(pid=17513): Launched 03:19:50.959008 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:19:51.172746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:51.492220 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17514): Launched 03:19:51.767817 run iperf3-srv_10.42.42.10(pid=17515): Launched 03:19:51.886883 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:19:52.100916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:52.421243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17516): Launched 03:19:52.697220 run iperf3-srv_10.42.42.10(pid=17517): Launched 03:19:52.815624 tst iperf3m4.py:8: start network... 03:19:53.030333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:53.524283 run create_hlr_db(pid=17518): Launched 03:19:53.653218 bus /gobi_6: Setting Powered False 03:19:54.716008 run create_hlr_db(pid=17518): Terminated: ok {rc=0} 03:19:55.140812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17520): Launched 03:19:55.437612 run osmo-hlr_10.42.42.2(pid=17521): Launched 03:19:55.550970 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:56.068383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17523): Launched 03:19:56.365130 run osmo-stp_10.42.42.5(pid=17524): Launched 03:19:56.478497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:56.989415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17526): Launched 03:19:57.102166 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:57.352172 run patchelf(pid=17527): Launched 03:19:57.516544 run osmo-stp_10.42.42.5(pid=17524): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17524)] 03:19:57.641355 run osmo-stp_10.42.42.5(pid=17524): stdout: | (launched: 2022-12-09_03:19:56.310747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:57.768046 run osmo-stp_10.42.42.5(pid=17524): stderr: | 20221209031956477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031956477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031956478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031956478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031956479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031956479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031956479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:57.894642 run osmo-stp_10.42.42.5(pid=17524): stdout: | (launched: 2022-12-09_03:19:56.310747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:58.015923 run osmo-stp_10.42.42.5(pid=17524): stderr: | 20221209031956477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209031956477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209031956478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209031956478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209031956479 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209031956479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209031956479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:58.159396 run patchelf(pid=17527): Terminating (SIGINT) 03:19:58.326443 run patchelf(pid=17527): Terminated: ok {rc=0} 03:19:58.446341 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17524): Process ended prematurely: osmo-stp_10.42.42.5(pid=17524) [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17524)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:19:58.455632 tst iperf3m4.py:8: Test FAILED (10.5 sec) 03:19:58.483052 run osmo-hlr_10.42.42.2(pid=17521): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17521)] 03:19:58.530902 run osmo-hlr_10.42.42.2(pid=17521): stdout: | (launched: 2022-12-09_03:19:55.382992) 03:19:58.579801 run osmo-hlr_10.42.42.2(pid=17521): stderr: | 20221209031955556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209031955556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209031955556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209031955556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209031955556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209031955556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209031955571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209031955582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209031955582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209031955582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:58.629333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17510): Terminating (SIGTERM) 03:19:58.669052 run iperf3-srv_10.42.42.10(pid=17511): Terminating (SIGTERM) 03:19:58.708434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17512): Terminating (SIGTERM) 03:19:58.747830 run iperf3-srv_10.42.42.10(pid=17513): Terminating (SIGTERM) 03:19:58.787087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17514): Terminating (SIGTERM) 03:19:58.826578 run iperf3-srv_10.42.42.10(pid=17515): Terminating (SIGTERM) 03:19:58.866001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17516): Terminating (SIGTERM) 03:19:58.905495 run iperf3-srv_10.42.42.10(pid=17517): Terminating (SIGTERM) 03:19:58.945012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17520): Terminating (SIGTERM) 03:19:58.984388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17523): Terminating (SIGTERM) 03:19:59.023664 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17526): Terminating (SIGTERM) 03:19:59.063629 --- ParallelTerminationStrategy: PID 17510 died... 03:19:59.082747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17510): Terminated: ok {rc=0} 03:19:59.126832 --- ParallelTerminationStrategy: PID 17511 died... 03:19:59.145411 run iperf3-srv_10.42.42.10(pid=17511): Terminated {rc=256} 03:19:59.189765 --- ParallelTerminationStrategy: PID 17512 died... 03:19:59.208297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17512): Terminated: ok {rc=0} 03:19:59.252714 --- ParallelTerminationStrategy: PID 17513 died... 03:19:59.271309 run iperf3-srv_10.42.42.10(pid=17513): Terminated {rc=256} 03:19:59.314942 --- ParallelTerminationStrategy: PID 17514 died... 03:19:59.333303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17514): Terminated: ok {rc=0} 03:19:59.377415 --- ParallelTerminationStrategy: PID 17515 died... 03:19:59.395824 run iperf3-srv_10.42.42.10(pid=17515): Terminated {rc=256} 03:19:59.439134 --- ParallelTerminationStrategy: PID 17516 died... 03:19:59.457619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17516): Terminated: ok {rc=0} 03:19:59.502052 --- ParallelTerminationStrategy: PID 17517 died... 03:19:59.520556 run iperf3-srv_10.42.42.10(pid=17517): Terminated {rc=256} 03:19:59.564851 --- ParallelTerminationStrategy: PID 17520 died... 03:19:59.583742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17520): Terminated: ok {rc=0} 03:19:59.627759 --- ParallelTerminationStrategy: PID 17523 died... 03:19:59.646427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17523): Terminated: ok {rc=0} 03:19:59.690180 --- ParallelTerminationStrategy: PID 17526 died... 03:19:59.708821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17526): Terminated: ok {rc=0} 03:19:59.792155 bus /gobi_4: Setting Powered False 03:20:00.899534 bus /gobi_4: Setting Powered False 03:20:02.050980 bus /gobi_1: Setting Powered False 03:20:03.157624 bus /gobi_1: Setting Powered False 03:20:04.273167 bus /gobi_0: Setting Powered False 03:20:05.370120 bus /gobi_0: Setting Powered False 03:20:06.485894 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:20:07.589732 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:07.601505 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:20:07.681577 tst ping.py: using LAC 18709 03:20:07.806825 tst ping.py: using RAC 94 03:20:07.931323 tst ping.py: using CellId 18709 03:20:08.056113 tst ping.py: using BVCI 18710 03:20:08.169805 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:08.181307 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:08.192441 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:08.203645 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:08.214830 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:08.226051 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:08.237327 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:08.248410 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:20:08.365559 tst ping.py:19: start network... 03:20:08.577022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:09.061356 run create_hlr_db(pid=17531): Launched 03:20:09.187358 bus /gobi_6: Setting Powered False 03:20:10.249995 run create_hlr_db(pid=17531): Terminated: ok {rc=0} 03:20:10.686942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17533): Launched 03:20:10.999744 run osmo-hlr_10.42.42.2(pid=17534): Launched 03:20:11.118737 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:11.660350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17536): Launched 03:20:11.972722 run osmo-stp_10.42.42.5(pid=17537): Launched 03:20:12.091715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:12.633454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17539): Launched 03:20:12.752654 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:13.017957 run patchelf(pid=17540): Launched 03:20:13.191641 run osmo-stp_10.42.42.5(pid=17537): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17537)] 03:20:13.324022 run osmo-stp_10.42.42.5(pid=17537): stdout: | (launched: 2022-12-09_03:20:11.915608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:13.457880 run osmo-stp_10.42.42.5(pid=17537): stderr: | 20221209032012109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032012109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032012109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032012110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032012110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032012110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032012110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:13.591814 run osmo-stp_10.42.42.5(pid=17537): stdout: | (launched: 2022-12-09_03:20:11.915608) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:13.720372 run osmo-stp_10.42.42.5(pid=17537): stderr: | 20221209032012109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032012109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032012109 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032012110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032012110 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032012110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032012110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:13.872599 run patchelf(pid=17540): Terminating (SIGINT) 03:20:14.048927 run patchelf(pid=17540): Terminated: ok {rc=0} 03:20:14.175372 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17537): Process ended prematurely: osmo-stp_10.42.42.5(pid=17537) [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17537)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 03:20:14.184556 tst ping.py:22: Test FAILED (6.6 sec) 03:20:14.212344 run osmo-hlr_10.42.42.2(pid=17534): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17534)] 03:20:14.261608 run osmo-hlr_10.42.42.2(pid=17534): stdout: | (launched: 2022-12-09_03:20:10.942629) 03:20:14.312681 run osmo-hlr_10.42.42.2(pid=17534): stderr: | 20221209032011141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032011141 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032011141 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032011141 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032011141 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032011141 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032011157 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032011166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032011166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032011166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:14.363864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17533): Terminating (SIGTERM) 03:20:14.404855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17536): Terminating (SIGTERM) 03:20:14.446399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17539): Terminating (SIGTERM) 03:20:14.488078 --- ParallelTerminationStrategy: PID 17533 died... 03:20:14.508042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17533): Terminated: ok {rc=0} 03:20:14.554467 --- ParallelTerminationStrategy: PID 17536 died... 03:20:14.574005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17536): Terminated: ok {rc=0} 03:20:14.619621 --- ParallelTerminationStrategy: PID 17539 died... 03:20:14.639169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17539): Terminated: ok {rc=0} 03:20:14.726255 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:20:15.812800 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:15.824465 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:20:15.911245 tst ping_idle_ping.py: using LAC 18710 03:20:16.038869 tst ping_idle_ping.py: using RAC 95 03:20:16.196647 tst ping_idle_ping.py: using CellId 18710 03:20:16.315468 tst ping_idle_ping.py: using BVCI 18711 03:20:16.426419 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:16.438273 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:16.450765 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:16.463000 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:16.475001 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:16.487269 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:16.499613 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:20:16.512665 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:20:16.631381 tst ping_idle_ping.py:24: start network... 03:20:16.903351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:17.404570 run create_hlr_db(pid=17541): Launched 03:20:17.532018 bus /gobi_6: Setting Powered False 03:20:18.595519 run create_hlr_db(pid=17541): Terminated: ok {rc=0} 03:20:19.033297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17543): Launched 03:20:19.345221 run osmo-hlr_10.42.42.2(pid=17544): Launched 03:20:19.464595 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:20.002501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17546): Launched 03:20:20.314032 run osmo-stp_10.42.42.5(pid=17547): Launched 03:20:20.433199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:20.974080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17549): Launched 03:20:21.093082 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:21.357408 run patchelf(pid=17550): Launched 03:20:21.531107 run osmo-stp_10.42.42.5(pid=17547): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17547)] 03:20:21.663481 run osmo-stp_10.42.42.5(pid=17547): stdout: | (launched: 2022-12-09_03:20:20.257321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:21.797925 run osmo-stp_10.42.42.5(pid=17547): stderr: | 20221209032020447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032020447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032020447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032020448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032020450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032020450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032020450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:21.932494 run osmo-stp_10.42.42.5(pid=17547): stdout: | (launched: 2022-12-09_03:20:20.257321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:22.061777 run osmo-stp_10.42.42.5(pid=17547): stderr: | 20221209032020447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032020447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032020447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032020448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032020450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032020450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032020450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:22.214125 run patchelf(pid=17550): Terminating (SIGINT) 03:20:22.390153 run patchelf(pid=17550): Terminated: ok {rc=0} 03:20:22.517131 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17547): Process ended prematurely: osmo-stp_10.42.42.5(pid=17547) [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17547)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:20:22.526397 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 03:20:22.553913 run osmo-hlr_10.42.42.2(pid=17544): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17544)] 03:20:22.602800 run osmo-hlr_10.42.42.2(pid=17544): stdout: | (launched: 2022-12-09_03:20:19.288134) 03:20:22.653462 run osmo-hlr_10.42.42.2(pid=17544): stderr: | 20221209032019488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032019488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032019488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032019488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032019488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032019488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032019500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032019508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032019509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032019509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:22.704423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17543): Terminating (SIGTERM) 03:20:22.745353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17546): Terminating (SIGTERM) 03:20:22.786661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17549): Terminating (SIGTERM) 03:20:22.828015 --- ParallelTerminationStrategy: PID 17543 died... 03:20:22.847825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17543): Terminated: ok {rc=0} 03:20:22.893896 --- ParallelTerminationStrategy: PID 17546 died... 03:20:22.913468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17546): Terminated: ok {rc=0} 03:20:22.959139 --- ParallelTerminationStrategy: PID 17549 died... 03:20:22.978612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17549): Terminated: ok {rc=0} 03:20:23.064816 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 03:20:24.366651 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:20:24.373787 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 03:20:24.406094 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 03:20:24.444162 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 03:20:24.529468 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 03:20:24.560893 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 03:20:24.598792 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 03:20:25.199090 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 03:20:25.247024 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:25.258282 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:20:25.309503 tst cs_paging_gprs_active.py: using LAC 18711 03:20:25.425080 tst cs_paging_gprs_active.py: using RAC 96 03:20:25.539672 tst cs_paging_gprs_active.py: using CellId 18711 03:20:25.653872 tst cs_paging_gprs_active.py: using BVCI 18712 03:20:25.769656 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:25.781724 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:25.793644 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:25.805685 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:25.817775 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:25.829753 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:25.841946 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:25.853944 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:25.866151 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:25.984726 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:26.098360 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:20:26.312114 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:26.629225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17554): Launched 03:20:26.902243 run iperf3-srv_10.42.42.10(pid=17555): Launched 03:20:27.020345 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:20:27.233181 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:27.549381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17556): Launched 03:20:27.821794 run iperf3-srv_10.42.42.10(pid=17557): Launched 03:20:27.940318 tst cs_paging_gprs_active.py:38: start network... 03:20:28.151692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:28.640364 run create_hlr_db(pid=17558): Launched 03:20:28.767528 bus /gobi_6: Setting Powered False 03:20:29.829807 run create_hlr_db(pid=17558): Terminated: ok {rc=0} 03:20:30.269559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17560): Launched 03:20:30.585699 run osmo-hlr_10.42.42.2(pid=17561): Launched 03:20:30.702166 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:31.284901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17563): Launched 03:20:31.622867 run osmo-stp_10.42.42.5(pid=17564): Launched 03:20:31.864073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:32.483992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17566): Launched 03:20:32.605091 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:32.870554 run patchelf(pid=17567): Launched 03:20:33.045467 run osmo-stp_10.42.42.5(pid=17564): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17564)] 03:20:33.178935 run osmo-stp_10.42.42.5(pid=17564): stdout: | (launched: 2022-12-09_03:20:31.550134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:33.314063 run osmo-stp_10.42.42.5(pid=17564): stderr: | 20221209032031837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032031837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032031837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032031838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032031838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032031838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032031838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:33.448722 run osmo-stp_10.42.42.5(pid=17564): stdout: | (launched: 2022-12-09_03:20:31.550134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:33.578394 run osmo-stp_10.42.42.5(pid=17564): stderr: | 20221209032031837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032031837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032031837 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032031838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032031838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032031838 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032031838 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:33.731846 run patchelf(pid=17567): Terminating (SIGINT) 03:20:33.908399 run patchelf(pid=17567): Terminated: ok {rc=0} 03:20:34.035978 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=17564): Process ended prematurely: osmo-stp_10.42.42.5(pid=17564) [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17564)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 03:20:34.046026 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 03:20:34.073695 run osmo-hlr_10.42.42.2(pid=17561): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17561)] 03:20:34.123172 run osmo-hlr_10.42.42.2(pid=17561): stdout: | (launched: 2022-12-09_03:20:30.528063) 03:20:34.174237 run osmo-hlr_10.42.42.2(pid=17561): stderr: | 20221209032030701 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032030701 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032030701 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032030701 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032030701 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032030702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032030713 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032030722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032030722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032030722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:34.225681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17554): Terminating (SIGTERM) 03:20:34.266954 run iperf3-srv_10.42.42.10(pid=17555): Terminating (SIGTERM) 03:20:34.308213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17556): Terminating (SIGTERM) 03:20:34.349784 run iperf3-srv_10.42.42.10(pid=17557): Terminating (SIGTERM) 03:20:34.390924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17560): Terminating (SIGTERM) 03:20:34.432366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17563): Terminating (SIGTERM) 03:20:34.473818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17566): Terminating (SIGTERM) 03:20:34.515273 --- ParallelTerminationStrategy: PID 17554 died... 03:20:34.534967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17554): Terminated: ok {rc=0} 03:20:34.580580 --- ParallelTerminationStrategy: PID 17555 died... 03:20:34.599916 run iperf3-srv_10.42.42.10(pid=17555): Terminated {rc=256} 03:20:34.644895 --- ParallelTerminationStrategy: PID 17556 died... 03:20:34.664091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17556): Terminated: ok {rc=0} 03:20:34.709940 --- ParallelTerminationStrategy: PID 17557 died... 03:20:34.728866 run iperf3-srv_10.42.42.10(pid=17557): Terminated {rc=256} 03:20:34.774102 --- ParallelTerminationStrategy: PID 17560 died... 03:20:34.793276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17560): Terminated: ok {rc=0} 03:20:34.838344 --- ParallelTerminationStrategy: PID 17563 died... 03:20:34.857480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17563): Terminated: ok {rc=0} 03:20:34.902944 --- ParallelTerminationStrategy: PID 17566 died... 03:20:34.922273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17566): Terminated: ok {rc=0} 03:20:35.009208 bus /gobi_0: Setting Powered False 03:20:36.108422 bus /gobi_0: Setting Powered False 03:20:37.224212 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 03:20:38.371665 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:38.384047 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:20:38.434609 tst iperf3.py: using LAC 18712 03:20:38.560495 tst iperf3.py: using RAC 97 03:20:38.687091 tst iperf3.py: using CellId 18712 03:20:38.813065 tst iperf3.py: using BVCI 18713 03:20:38.922447 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:38.934043 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:38.945387 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:38.956772 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:38.968577 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:38.980207 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:38.992060 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:39.003722 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:39.015663 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:39.135355 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:20:39.347475 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:39.663658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17568): Launched 03:20:39.937214 run iperf3-srv_10.42.42.10(pid=17569): Launched 03:20:40.055134 tst iperf3.py:8: start network... 03:20:40.267190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:40.755819 run create_hlr_db(pid=17570): Launched 03:20:40.883261 bus /gobi_6: Setting Powered False 03:20:41.945777 run create_hlr_db(pid=17570): Terminated: ok {rc=0} 03:20:42.365108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17572): Launched 03:20:42.659451 run osmo-hlr_10.42.42.2(pid=17573): Launched 03:20:42.771894 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:43.281870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17575): Launched 03:20:43.575086 run osmo-stp_10.42.42.5(pid=17576): Launched 03:20:43.688744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:44.196666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17578): Launched 03:20:44.308544 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:44.557088 run patchelf(pid=17579): Launched 03:20:44.720286 run osmo-stp_10.42.42.5(pid=17576): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17576)] 03:20:44.844655 run osmo-stp_10.42.42.5(pid=17576): stdout: | (launched: 2022-12-09_03:20:43.521628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:44.970997 run osmo-stp_10.42.42.5(pid=17576): stderr: | 20221209032043692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032043692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032043692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032043693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032043693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032043693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032043693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:45.097597 run osmo-stp_10.42.42.5(pid=17576): stdout: | (launched: 2022-12-09_03:20:43.521628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:45.218511 run osmo-stp_10.42.42.5(pid=17576): stderr: | 20221209032043692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032043692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032043692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032043693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032043693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032043693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032043693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:45.361946 run patchelf(pid=17579): Terminating (SIGINT) 03:20:45.527117 run patchelf(pid=17579): Terminated: ok {rc=0} 03:20:45.646573 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17576): Process ended prematurely: osmo-stp_10.42.42.5(pid=17576) [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17576)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 03:20:45.655840 tst iperf3.py:8: Test FAILED (7.3 sec) 03:20:45.683135 run osmo-hlr_10.42.42.2(pid=17573): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17573)] 03:20:45.730628 run osmo-hlr_10.42.42.2(pid=17573): stdout: | (launched: 2022-12-09_03:20:42.605932) 03:20:45.779592 run osmo-hlr_10.42.42.2(pid=17573): stderr: | 20221209032042778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032042778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032042778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032042778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032042778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032042778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032042790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032042798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032042799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032042799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:45.831695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17568): Terminating (SIGTERM) 03:20:45.906030 run iperf3-srv_10.42.42.10(pid=17569): Terminating (SIGTERM) 03:20:45.949392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17572): Terminating (SIGTERM) 03:20:45.989911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17575): Terminating (SIGTERM) 03:20:46.034427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17578): Terminating (SIGTERM) 03:20:46.081586 --- ParallelTerminationStrategy: PID 17568 died... 03:20:46.101959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17568): Terminated: ok {rc=0} 03:20:46.152272 --- ParallelTerminationStrategy: PID 17569 died... 03:20:46.172497 run iperf3-srv_10.42.42.10(pid=17569): Terminated {rc=256} 03:20:46.221787 --- ParallelTerminationStrategy: PID 17572 died... 03:20:46.242151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17572): Terminated: ok {rc=0} 03:20:46.292050 --- ParallelTerminationStrategy: PID 17575 died... 03:20:46.312650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17575): Terminated: ok {rc=0} 03:20:46.362182 --- ParallelTerminationStrategy: PID 17578 died... 03:20:46.383403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17578): Terminated: ok {rc=0} 03:20:46.479077 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 03:20:47.634688 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:47.646531 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:20:47.697845 tst iperf3m4.py: using LAC 18713 03:20:47.814328 tst iperf3m4.py: using RAC 98 03:20:47.931669 tst iperf3m4.py: using CellId 18713 03:20:48.051083 tst iperf3m4.py: using BVCI 18714 03:20:48.158842 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:48.170175 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:48.181418 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:48.192808 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:48.204127 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:48.215490 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:48.227006 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:48.238326 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:48.249936 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:48.368267 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:48.489751 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:48.609614 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:48.727810 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:20:48.942812 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:49.259898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17580): Launched 03:20:49.534434 run iperf3-srv_10.42.42.10(pid=17581): Launched 03:20:49.652934 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:20:49.866293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:50.183410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17582): Launched 03:20:50.457058 run iperf3-srv_10.42.42.10(pid=17583): Launched 03:20:50.575216 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:20:50.788642 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:51.106658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17584): Launched 03:20:51.381052 run iperf3-srv_10.42.42.10(pid=17585): Launched 03:20:51.499074 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:20:51.712519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:52.030253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17586): Launched 03:20:52.303407 run iperf3-srv_10.42.42.10(pid=17587): Launched 03:20:52.421465 tst iperf3m4.py:8: start network... 03:20:52.633943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:53.124772 run create_hlr_db(pid=17588): Launched 03:20:53.252919 bus /gobi_6: Setting Powered False 03:20:54.315952 run create_hlr_db(pid=17588): Terminated: ok {rc=0} 03:20:54.738152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17590): Launched 03:20:55.033927 run osmo-hlr_10.42.42.2(pid=17591): Launched 03:20:55.147946 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:55.660164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17593): Launched 03:20:55.955315 run osmo-stp_10.42.42.5(pid=17594): Launched 03:20:56.067572 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:56.577127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17596): Launched 03:20:56.699690 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:56.968039 run patchelf(pid=17597): Launched 03:20:57.143186 run osmo-stp_10.42.42.5(pid=17594): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17594)] 03:20:57.276553 run osmo-stp_10.42.42.5(pid=17594): stdout: | (launched: 2022-12-09_03:20:55.901845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:57.411808 run osmo-stp_10.42.42.5(pid=17594): stderr: | 20221209032056067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032056067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032056068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032056068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032056069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032056069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032056069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:57.547165 run osmo-stp_10.42.42.5(pid=17594): stdout: | (launched: 2022-12-09_03:20:55.901845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:57.676800 run osmo-stp_10.42.42.5(pid=17594): stderr: | 20221209032056067 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032056067 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032056068 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032056068 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032056069 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032056069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032056069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:57.830330 run patchelf(pid=17597): Terminating (SIGINT) 03:20:58.007479 run patchelf(pid=17597): Terminated: ok {rc=0} 03:20:58.134986 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17594): Process ended prematurely: osmo-stp_10.42.42.5(pid=17594) [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17594)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 03:20:58.144814 tst iperf3m4.py:8: Test FAILED (10.5 sec) 03:20:58.173100 run osmo-hlr_10.42.42.2(pid=17591): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17591)] 03:20:58.222141 run osmo-hlr_10.42.42.2(pid=17591): stdout: | (launched: 2022-12-09_03:20:54.980134) 03:20:58.273128 run osmo-hlr_10.42.42.2(pid=17591): stderr: | 20221209032055153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032055153 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032055153 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032055153 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032055153 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032055153 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032055164 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032055174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032055174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032055174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:58.324505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17580): Terminating (SIGTERM) 03:20:58.365559 run iperf3-srv_10.42.42.10(pid=17581): Terminating (SIGTERM) 03:20:58.406441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17582): Terminating (SIGTERM) 03:20:58.447425 run iperf3-srv_10.42.42.10(pid=17583): Terminating (SIGTERM) 03:20:58.488126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17584): Terminating (SIGTERM) 03:20:58.529229 run iperf3-srv_10.42.42.10(pid=17585): Terminating (SIGTERM) 03:20:58.569818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17586): Terminating (SIGTERM) 03:20:58.610779 run iperf3-srv_10.42.42.10(pid=17587): Terminating (SIGTERM) 03:20:58.651611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17590): Terminating (SIGTERM) 03:20:58.692505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17593): Terminating (SIGTERM) 03:20:58.733449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17596): Terminating (SIGTERM) 03:20:58.774867 --- ParallelTerminationStrategy: PID 17580 died... 03:20:58.794767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17580): Terminated: ok {rc=0} 03:20:58.840202 --- ParallelTerminationStrategy: PID 17581 died... 03:20:58.859148 run iperf3-srv_10.42.42.10(pid=17581): Terminated {rc=256} 03:20:58.904668 --- ParallelTerminationStrategy: PID 17582 died... 03:20:58.924122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17582): Terminated: ok {rc=0} 03:20:58.969539 --- ParallelTerminationStrategy: PID 17583 died... 03:20:58.988932 run iperf3-srv_10.42.42.10(pid=17583): Terminated {rc=256} 03:20:59.034273 --- ParallelTerminationStrategy: PID 17584 died... 03:20:59.053623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17584): Terminated: ok {rc=0} 03:20:59.098987 --- ParallelTerminationStrategy: PID 17585 died... 03:20:59.118330 run iperf3-srv_10.42.42.10(pid=17585): Terminated {rc=256} 03:20:59.163674 --- ParallelTerminationStrategy: PID 17586 died... 03:20:59.183011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17586): Terminated: ok {rc=0} 03:20:59.228197 --- ParallelTerminationStrategy: PID 17587 died... 03:20:59.247547 run iperf3-srv_10.42.42.10(pid=17587): Terminated {rc=256} 03:20:59.293027 --- ParallelTerminationStrategy: PID 17590 died... 03:20:59.312409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17590): Terminated: ok {rc=0} 03:20:59.357661 --- ParallelTerminationStrategy: PID 17593 died... 03:20:59.377151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17593): Terminated: ok {rc=0} 03:20:59.422508 --- ParallelTerminationStrategy: PID 17596 died... 03:20:59.441851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17596): Terminated: ok {rc=0} 03:20:59.528710 bus /gobi_4: Setting Powered False 03:21:00.628118 bus /gobi_4: Setting Powered False 03:21:01.756445 bus /gobi_1: Setting Powered False 03:21:02.866586 bus /gobi_1: Setting Powered False 03:21:03.979023 bus /gobi_0: Setting Powered False 03:21:05.073800 bus /gobi_0: Setting Powered False 03:21:06.188686 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 03:21:07.289858 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:07.301917 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:21:07.355486 tst ping.py: using LAC 18714 03:21:07.478475 tst ping.py: using RAC 99 03:21:07.599443 tst ping.py: using CellId 18714 03:21:07.721648 tst ping.py: using BVCI 18715 03:21:07.834298 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:07.846459 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:07.858316 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:07.870379 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:07.882285 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:07.894246 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:07.906565 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:07.918404 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:21:08.037227 tst ping.py:19: start network... 03:21:08.246190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:08.728473 run create_hlr_db(pid=17598): Launched 03:21:08.855037 bus /gobi_6: Setting Powered False 03:21:09.916793 run create_hlr_db(pid=17598): Terminated: ok {rc=0} 03:21:10.333714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17600): Launched 03:21:10.624406 run osmo-hlr_10.42.42.2(pid=17601): Launched 03:21:10.736374 run osmo-stp_10.42.42.5: Starting osmo-stp 03:21:11.253134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17603): Launched 03:21:11.563923 run osmo-stp_10.42.42.5(pid=17604): Launched 03:21:11.682506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:21:12.220324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17606): Launched 03:21:12.338881 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:21:12.600781 run patchelf(pid=17607): Launched 03:21:12.773141 run osmo-stp_10.42.42.5(pid=17604): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17604)] 03:21:12.904930 run osmo-stp_10.42.42.5(pid=17604): stdout: | (launched: 2022-12-09_03:21:11.507471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:13.038877 run osmo-stp_10.42.42.5(pid=17604): stderr: | 20221209032111700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032111700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032111701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032111701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032111701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032111702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032111702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:13.172163 run osmo-stp_10.42.42.5(pid=17604): stdout: | (launched: 2022-12-09_03:21:11.507471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:13.299882 run osmo-stp_10.42.42.5(pid=17604): stderr: | 20221209032111700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032111700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032111701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032111701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032111701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032111702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032111702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:13.451148 run patchelf(pid=17607): Terminating (SIGINT) 03:21:13.624530 run patchelf(pid=17607): Terminated: ok {rc=0} 03:21:13.750026 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=17604): Process ended prematurely: osmo-stp_10.42.42.5(pid=17604) [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17604)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 03:21:13.759521 tst ping.py:22: Test FAILED (6.5 sec) 03:21:13.787283 run osmo-hlr_10.42.42.2(pid=17601): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17601)] 03:21:13.837284 run osmo-hlr_10.42.42.2(pid=17601): stdout: | (launched: 2022-12-09_03:21:10.571388) 03:21:13.888300 run osmo-hlr_10.42.42.2(pid=17601): stderr: | 20221209032110744 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032110744 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032110744 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032110744 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032110744 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032110744 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032110757 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032110767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032110767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032110767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:13.940200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17600): Terminating (SIGTERM) 03:21:13.981702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17603): Terminating (SIGTERM) 03:21:14.022971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17606): Terminating (SIGTERM) 03:21:14.064398 --- ParallelTerminationStrategy: PID 17600 died... 03:21:14.083812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17600): Terminated: ok {rc=0} 03:21:14.129351 --- ParallelTerminationStrategy: PID 17603 died... 03:21:14.148526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17603): Terminated: ok {rc=0} 03:21:14.194010 --- ParallelTerminationStrategy: PID 17606 died... 03:21:14.213433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17606): Terminated: ok {rc=0} 03:21:14.300688 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 03:21:15.388391 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:15.401447 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:21:15.458788 tst ping_idle_ping.py: using LAC 18715 03:21:15.582011 tst ping_idle_ping.py: using RAC 100 03:21:15.702651 tst ping_idle_ping.py: using CellId 18715 03:21:15.823703 tst ping_idle_ping.py: using BVCI 18716 03:21:15.945593 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:15.958679 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:15.971484 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:15.984243 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:15.996792 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:16.009714 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:16.022659 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:21:16.035132 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:21:16.175184 tst ping_idle_ping.py:24: start network... 03:21:16.399747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:16.905663 run create_hlr_db(pid=17608): Launched 03:21:17.062340 bus /gobi_6: Setting Powered False 03:21:18.125090 run create_hlr_db(pid=17608): Terminated: ok {rc=0} 03:21:18.541851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17610): Launched 03:21:18.832786 run osmo-hlr_10.42.42.2(pid=17611): Launched 03:21:18.945614 run osmo-stp_10.42.42.5: Starting osmo-stp 03:21:19.450189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17613): Launched 03:21:19.740723 run osmo-stp_10.42.42.5(pid=17614): Launched 03:21:19.851739 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:21:20.353802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17616): Launched 03:21:20.465398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:21:20.711903 run patchelf(pid=17617): Launched 03:21:20.873852 run osmo-stp_10.42.42.5(pid=17614): ERR: Terminated: ERROR {rc=1} [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17614)] 03:21:20.997701 run osmo-stp_10.42.42.5(pid=17614): stdout: | (launched: 2022-12-09_03:21:19.687109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:21.123463 run osmo-stp_10.42.42.5(pid=17614): stderr: | 20221209032119856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032119856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032119856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032119857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032119857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032119857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032119857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:21.248527 run osmo-stp_10.42.42.5(pid=17614): stdout: | (launched: 2022-12-09_03:21:19.687109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:21.368371 run osmo-stp_10.42.42.5(pid=17614): stderr: | 20221209032119856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032119856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032119856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032119857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032119857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032119857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032119857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:21.510450 run patchelf(pid=17617): Terminating (SIGINT) 03:21:21.674560 run patchelf(pid=17617): Terminated: ok {rc=0} 03:21:21.792348 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=17614): Process ended prematurely: osmo-stp_10.42.42.5(pid=17614) [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17614)] [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 03:21:21.801570 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 03:21:21.828345 run osmo-hlr_10.42.42.2(pid=17611): ERR: Terminated: ERROR {rc=237} [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17611)] 03:21:21.875946 run osmo-hlr_10.42.42.2(pid=17611): stdout: | (launched: 2022-12-09_03:21:18.779665) 03:21:21.929474 run osmo-hlr_10.42.42.2(pid=17611): stderr: | 20221209032118953 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032118953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032118953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032118953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032118953 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032118953 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032118967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032118975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032118975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032118976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:21.980422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17610): Terminating (SIGTERM) 03:21:22.020046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17613): Terminating (SIGTERM) 03:21:22.059799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17616): Terminating (SIGTERM) 03:21:22.099825 --- ParallelTerminationStrategy: PID 17610 died... 03:21:22.118725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17610): Terminated: ok {rc=0} 03:21:22.162737 --- ParallelTerminationStrategy: PID 17613 died... 03:21:22.181175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17613): Terminated: ok {rc=0} 03:21:22.225303 --- ParallelTerminationStrategy: PID 17616 died... 03:21:22.243851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17616): Terminated: ok {rc=0} 03:21:22.330230 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 03:21:23.642326 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:21:23.649644 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:21:23.682983 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:21:23.717212 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:21:23.769864 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:21:23.801521 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:21:23.835470 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:21:24.396582 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2353 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:21:24.401897 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:24.413674 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:21:24.479435 tst switch_tch_pdch.py: using LAC 18716 03:21:24.598927 tst switch_tch_pdch.py: using RAC 101 03:21:24.712606 tst switch_tch_pdch.py: using CellId 18716 03:21:24.825228 tst switch_tch_pdch.py: using BVCI 18717 03:21:24.930237 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:24.941925 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:24.953472 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:24.965357 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:24.977352 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:24.989115 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:25.001546 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:25.013578 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:21:25.125210 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:21:25.239129 tst switch_tch_pdch.py:51: start network... 03:21:25.432000 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:25.879118 run create_hlr_db(pid=17623): Launched 03:21:25.988478 bus /gobi_6: Setting Powered False 03:21:27.045520 run create_hlr_db(pid=17623): Terminated: ok {rc=0} 03:21:27.468209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17625): Launched 03:21:27.777649 run osmo-hlr_10.42.42.2(pid=17626): Launched 03:21:27.895347 run osmo-stp_10.42.42.5: Starting osmo-stp 03:21:28.428023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17628): Launched 03:21:28.737798 run osmo-stp_10.42.42.5(pid=17629): Launched 03:21:28.856581 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:21:29.394649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17631): Launched 03:21:29.513297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:21:29.775443 run patchelf(pid=17632): Launched 03:21:29.947944 run osmo-stp_10.42.42.5(pid=17629): ERR: Terminated: ERROR {rc=1} [trial-2353↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17629)] 03:21:30.079616 run osmo-stp_10.42.42.5(pid=17629): stdout: | (launched: 2022-12-09_03:21:28.681523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:30.213782 run osmo-stp_10.42.42.5(pid=17629): stderr: | 20221209032128870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032128870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032128871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032128871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032128871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032128872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032128872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:30.347449 run osmo-stp_10.42.42.5(pid=17629): stdout: | (launched: 2022-12-09_03:21:28.681523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:30.475350 run osmo-stp_10.42.42.5(pid=17629): stderr: | 20221209032128870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032128870 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032128871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032128871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032128871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032128872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032128872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:30.627232 run patchelf(pid=17632): Terminating (SIGINT) 03:21:30.801344 run patchelf(pid=17632): Terminated: ok {rc=0} 03:21:30.934703 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=17629): Process ended prematurely: osmo-stp_10.42.42.5(pid=17629) [trial-2353↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17629)] [trial-2353↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:21:30.944665 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 03:21:30.973094 run osmo-hlr_10.42.42.2(pid=17626): ERR: Terminated: ERROR {rc=237} [trial-2353↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17626)] 03:21:31.024108 run osmo-hlr_10.42.42.2(pid=17626): stdout: | (launched: 2022-12-09_03:21:27.721976) 03:21:31.076485 run osmo-hlr_10.42.42.2(pid=17626): stderr: | 20221209032127916 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032127916 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032127916 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032127916 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032127916 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032127916 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032127929 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032127937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032127937 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032127937 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:31.129796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17625): Terminating (SIGTERM) 03:21:31.172338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17628): Terminating (SIGTERM) 03:21:31.215539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17631): Terminating (SIGTERM) 03:21:31.260210 --- ParallelTerminationStrategy: PID 17625 died... 03:21:31.280526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17625): Terminated: ok {rc=0} 03:21:31.328886 --- ParallelTerminationStrategy: PID 17628 died... 03:21:31.348730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17628): Terminated: ok {rc=0} 03:21:31.395390 --- ParallelTerminationStrategy: PID 17631 died... 03:21:31.415125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=17631): Terminated: ok {rc=0} 03:21:31.509063 bus /gobi_0: Setting Powered False 03:21:32.619381 bus /gobi_0: Setting Powered False 03:21:33.734751 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2353 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 nitb_smpp --------------------------------------------------------------------- 03:21:34.993738 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:21:34.996430 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 03:21:35.017447 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 03:21:35.024906 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 03:21:35.059575 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 03:21:35.079968 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 03:21:35.086899 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 03:21:35.608706 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2353 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 03:21:35.614118 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 03:21:35.633986 tst esme_connect_policy_acceptall.py: using MSISDN 6995 03:21:35.773426 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:21:36.365678 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17636): Launched 03:21:36.682363 run osmo-nitb_10.42.42.2(pid=17637): Launched 03:21:36.857767 run osmo-nitb_10.42.42.2(pid=17637): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17637)] 03:21:37.000177 run osmo-nitb_10.42.42.2(pid=17637): stdout: | (launched: 2022-12-09_03:21:36.624575) 03:21:37.144437 run osmo-nitb_10.42.42.2(pid=17637): stderr: | (launched: 2022-12-09_03:21:36.671971) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:37.287607 run osmo-nitb_10.42.42.2(pid=17637): stdout: | (launched: 2022-12-09_03:21:36.624575) 03:21:37.425840 run osmo-nitb_10.42.42.2(pid=17637): stderr: | (launched: 2022-12-09_03:21:36.671971) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17637): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17637) [trial-2353↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17637)] 03:21:37.802330 tst osmo-nitb_10.42.42.2(pid=17637): stdout: | (launched: 2022-12-09_03:21:36.624575) 03:21:37.930916 tst osmo-nitb_10.42.42.2(pid=17637): stderr: | (launched: 2022-12-09_03:21:36.671971) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:38.082076 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=17637): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17637) [trial-2353↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17637)] [trial-2353↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 03:21:38.091116 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 03:21:38.098196 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17636): Terminating (SIGTERM) 03:21:38.308315 --- ParallelTerminationStrategy: PID 17636 died... 03:21:38.329705 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17636): Terminated: ok {rc=0} ---------------------------------------------- trial-2353 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 03:21:38.380400 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 03:21:38.401744 tst esme_connect_policy_closed.py: using MSISDN 6996 03:21:38.529182 tst esme_connect_policy_closed.py: using MSISDN 6997 03:21:38.638442 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:21:39.193700 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17638): Launched 03:21:39.490409 run osmo-nitb_10.42.42.2(pid=17639): Launched 03:21:39.651122 run osmo-nitb_10.42.42.2(pid=17639): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17639)] 03:21:39.774089 run osmo-nitb_10.42.42.2(pid=17639): stdout: | (launched: 2022-12-09_03:21:39.436503) 03:21:39.898413 run osmo-nitb_10.42.42.2(pid=17639): stderr: | (launched: 2022-12-09_03:21:39.480859) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:40.023817 run osmo-nitb_10.42.42.2(pid=17639): stdout: | (launched: 2022-12-09_03:21:39.436503) 03:21:40.142902 run osmo-nitb_10.42.42.2(pid=17639): stderr: | (launched: 2022-12-09_03:21:39.480859) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:40.284580 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=17639): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17639) [trial-2353↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17639)] [trial-2353↪nitb_smpp↪esme_connect_policy_closed.py:24] 03:21:40.292682 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 03:21:40.299026 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17638): Terminating (SIGTERM) 03:21:40.507643 --- ParallelTerminationStrategy: PID 17638 died... 03:21:40.527918 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17638): Terminated: ok {rc=0} ---------------------------------------------- trial-2353 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 03:21:40.576006 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 03:21:40.586925 tst nitb_smpp: Using 1 x bts (candidates: 1) 03:21:40.621418 tst esme_ms_sms_storeforward.py: using LAC 18717 03:21:40.750299 tst esme_ms_sms_storeforward.py: using RAC 102 03:21:40.880443 tst esme_ms_sms_storeforward.py: using CellId 18717 03:21:41.006745 tst esme_ms_sms_storeforward.py: using BVCI 18718 03:21:41.123707 tst nitb_smpp: Using 1 x modem (candidates: 1) 03:21:41.247647 tst esme_ms_sms_storeforward.py: using MSISDN 6998 03:21:41.356868 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 03:21:41.556903 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:21:42.164351 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17640): Launched 03:21:42.461648 run osmo-nitb_10.42.42.2(pid=17641): Launched 03:21:42.621945 run osmo-nitb_10.42.42.2(pid=17641): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17641)] 03:21:42.745209 run osmo-nitb_10.42.42.2(pid=17641): stdout: | (launched: 2022-12-09_03:21:42.407716) 03:21:42.869633 run osmo-nitb_10.42.42.2(pid=17641): stderr: | (launched: 2022-12-09_03:21:42.452121) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:42.993791 run osmo-nitb_10.42.42.2(pid=17641): stdout: | (launched: 2022-12-09_03:21:42.407716) 03:21:43.112360 run osmo-nitb_10.42.42.2(pid=17641): stderr: | (launched: 2022-12-09_03:21:42.452121) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:43.255113 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=17641): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17641) [trial-2353↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17641)] [trial-2353↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 03:21:43.263338 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.7 sec) 03:21:43.269611 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17640): Terminating (SIGTERM) 03:21:43.477963 --- ParallelTerminationStrategy: PID 17640 died... 03:21:43.498532 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17640): Terminated: ok {rc=0} 03:21:43.580397 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 03:21:44.666356 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 03:21:44.678348 tst nitb_smpp: Using 1 x bts (candidates: 1) 03:21:44.717229 tst esme_ms_sms_transaction.py: using LAC 18718 03:21:44.844610 tst esme_ms_sms_transaction.py: using RAC 103 03:21:44.971863 tst esme_ms_sms_transaction.py: using CellId 18718 03:21:45.098373 tst esme_ms_sms_transaction.py: using BVCI 18719 03:21:45.215387 tst nitb_smpp: Using 1 x modem (candidates: 1) 03:21:45.342992 tst esme_ms_sms_transaction.py: using MSISDN 6999 03:21:45.453044 tst esme_ms_sms_transaction.py:18: start nitb and bts... 03:21:45.653205 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:21:46.298814 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17642): Launched 03:21:46.658906 run osmo-nitb_10.42.42.2(pid=17643): Launched 03:21:46.842379 run osmo-nitb_10.42.42.2(pid=17643): ERR: Terminated: ERROR {rc=2} [trial-2353↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17643)] 03:21:46.979786 run osmo-nitb_10.42.42.2(pid=17643): stdout: | (launched: 2022-12-09_03:21:46.597204) 03:21:47.118816 run osmo-nitb_10.42.42.2(pid=17643): stderr: | (launched: 2022-12-09_03:21:46.643501) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:47.256787 run osmo-nitb_10.42.42.2(pid=17643): stdout: | (launched: 2022-12-09_03:21:46.597204) 03:21:47.386666 run osmo-nitb_10.42.42.2(pid=17643): stderr: | (launched: 2022-12-09_03:21:46.643501) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f1c354a6268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=17643): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17643) [trial-2353↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17643)] 03:21:47.789503 tst osmo-nitb_10.42.42.2(pid=17643): stdout: | (launched: 2022-12-09_03:21:46.597204) 03:21:47.910098 tst osmo-nitb_10.42.42.2(pid=17643): stderr: | (launched: 2022-12-09_03:21:46.643501) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:48.051724 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=17643): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17643) [trial-2353↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17643)] [trial-2353↪nitb_smpp↪esme_ms_sms_transaction.py:21] 03:21:48.060192 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 03:21:48.066559 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17642): Terminating (SIGTERM) 03:21:48.275078 --- ParallelTerminationStrategy: PID 17642 died... 03:21:48.295536 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=17642): Terminated: ok {rc=0} 03:21:48.379946 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 smpp --------------------------------------------------------------------- 03:21:49.545063 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:21:49.548308 tst smpp: Verifying 1 x bts (candidates: 11) 03:21:49.570421 tst smpp: Verifying 6 x ip_address (candidates: 9) 03:21:49.597595 tst smpp: Verifying 1 x modem (candidates: 12) 03:21:49.633098 tst smpp: Reserving 1 x bts (candidates: 11) 03:21:49.653903 tst smpp: Reserving 6 x ip_address (candidates: 9) 03:21:49.680924 tst smpp: Reserving 1 x modem (candidates: 12) 03:21:50.208837 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2353 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 03:21:50.213984 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:50.224595 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:50.235550 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:50.246156 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:50.265102 tst esme_connect_policy_acceptall.py: using MSISDN 7000 03:21:50.375154 run osmo-stp_10.42.42.4: Starting osmo-stp 03:21:50.881647 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=17647): Launched 03:21:51.178284 run osmo-stp_10.42.42.4(pid=17648): Launched 03:21:51.291904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:51.752556 run create_hlr_db(pid=17649): Launched 03:21:51.866902 bus /sierra_2: Setting Powered False 03:21:52.927053 run create_hlr_db(pid=17649): Terminated: ok {rc=0} 03:21:53.362817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17651): Launched 03:21:53.680259 run osmo-hlr_10.42.42.2(pid=17652): Launched 03:21:53.802057 run osmo-msc_10.42.42.5: Starting osmo-msc 03:21:54.379526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17654): Launched 03:21:54.697388 run osmo-msc_10.42.42.5(pid=17655): Launched 03:21:54.874832 run osmo-hlr_10.42.42.2(pid=17652): ERR: Terminated: ERROR {rc=237} [trial-2353↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17652)] 03:21:55.011642 run osmo-hlr_10.42.42.2(pid=17652): stdout: | (launched: 2022-12-09_03:21:53.622605) 03:21:55.148121 run osmo-hlr_10.42.42.2(pid=17652): stderr: | 20221209032153813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032153813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032153813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032153813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032153813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032153813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032153828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032153836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032153836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032153836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:55.284307 run osmo-hlr_10.42.42.2(pid=17652): stdout: | (launched: 2022-12-09_03:21:53.622605) 03:21:55.411381 run osmo-hlr_10.42.42.2(pid=17652): stderr: | 20221209032153813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032153813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032153813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032153813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032153813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032153813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032153828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032153836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032153836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032153836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:55.563468 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=17652): Process ended prematurely: osmo-hlr_10.42.42.2(pid=17652) [trial-2353↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17652)] [trial-2353↪smpp↪esme_connect_policy_acceptall.py:23] 03:21:55.572026 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.4 sec) 03:21:55.598979 run osmo-msc_10.42.42.5(pid=17655): ERR: Terminated: ERROR {rc=9} [trial-2353↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=17655)] 03:21:55.648106 run osmo-msc_10.42.42.5(pid=17655): stdout: | (launched: 2022-12-09_03:21:54.639891) 03:21:55.699116 run osmo-msc_10.42.42.5(pid=17655): stderr: | 20221209032155046 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209032155046 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209032155046 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032155046 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209032155046 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209032155046 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209032155046 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209032155046 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209032155047 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 03:21:55.750289 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=17647): Terminating (SIGTERM) 03:21:55.791174 run osmo-stp_10.42.42.4(pid=17648): Terminating (SIGTERM) 03:21:55.832065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17651): Terminating (SIGTERM) 03:21:55.874611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17654): Terminating (SIGTERM) 03:21:55.918851 --- ParallelTerminationStrategy: PID 17647 died... 03:21:55.939249 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=17647): Terminated: ok {rc=0} 03:21:55.987112 --- ParallelTerminationStrategy: PID 17648 died... 03:21:56.006230 run osmo-stp_10.42.42.4(pid=17648): Terminated: ok {rc=0} 03:21:56.051160 --- ParallelTerminationStrategy: PID 17651 died... 03:21:56.070293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17651): Terminated: ok {rc=0} 03:21:56.115485 --- ParallelTerminationStrategy: PID 17654 died... 03:21:56.134675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17654): Terminated: ok {rc=0} ---------------------------------------------- trial-2353 smpp esme_connect_policy_closed.py ---------------------------------------------- 03:21:56.184796 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:56.196106 tst smpp: Using 1 x bts (candidates: 1) 03:21:56.231360 tst esme_connect_policy_closed.py: using LAC 18719 03:21:56.352729 tst esme_connect_policy_closed.py: using RAC 104 03:21:56.470292 tst esme_connect_policy_closed.py: using CellId 18719 03:21:56.590525 tst esme_connect_policy_closed.py: using BVCI 18720 03:21:56.701329 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:56.711627 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:56.722080 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:56.742593 tst esme_connect_policy_closed.py: using MSISDN 7001 03:21:56.862738 tst esme_connect_policy_closed.py: using MSISDN 7002 03:21:56.971960 run osmo-stp_10.42.42.4: Starting osmo-stp 03:21:57.480371 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=17658): Launched 03:21:57.777805 run osmo-stp_10.42.42.4(pid=17659): Launched 03:21:57.891956 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:58.355321 run create_hlr_db(pid=17660): Launched 03:21:59.523025 run create_hlr_db(pid=17660): Terminated: ok {rc=0} 03:21:59.838078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17662): Launched 03:22:00.135940 run osmo-hlr_10.42.42.2(pid=17663): Launched 03:22:00.250122 run osmo-msc_10.42.42.5: Starting osmo-msc 03:22:00.795741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17665): Launched 03:22:01.121594 run osmo-msc_10.42.42.5(pid=17666): Launched 03:22:01.530371 run osmo-hlr_10.42.42.2(pid=17663): ERR: Terminated: ERROR {rc=237} [trial-2353↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17663)] 03:22:01.784561 run osmo-hlr_10.42.42.2(pid=17663): stdout: | (launched: 2022-12-09_03:22:00.081601) 03:22:02.047876 run osmo-hlr_10.42.42.2(pid=17663): stderr: | 20221209032200253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032200253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032200253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032200253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032200253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032200253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032200265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032200274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032200274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032200274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:02.180114 run osmo-hlr_10.42.42.2(pid=17663): stdout: | (launched: 2022-12-09_03:22:00.081601) 03:22:02.304903 run osmo-hlr_10.42.42.2(pid=17663): stderr: | 20221209032200253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032200253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032200253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032200253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032200253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032200253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032200265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032200274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032200274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032200274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:02.452468 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=17663): Process ended prematurely: osmo-hlr_10.42.42.2(pid=17663) [trial-2353↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17663)] [trial-2353↪smpp↪esme_connect_policy_closed.py:31] 03:22:02.460867 tst esme_connect_policy_closed.py:31: Test FAILED (6.3 sec) 03:22:02.487519 run osmo-msc_10.42.42.5(pid=17666): ERR: Terminated: ERROR {rc=9} [trial-2353↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=17666)] 03:22:02.536386 run osmo-msc_10.42.42.5(pid=17666): stdout: | (launched: 2022-12-09_03:22:01.051637) 03:22:02.586294 run osmo-msc_10.42.42.5(pid=17666): stderr: | 20221209032201606 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209032201606 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209032201606 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032201606 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209032201606 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209032201606 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209032201606 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209032201606 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209032201607 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 03:22:02.636717 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=17658): Terminating (SIGTERM) 03:22:02.677078 run osmo-stp_10.42.42.4(pid=17659): Terminating (SIGTERM) 03:22:02.717224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17662): Terminating (SIGTERM) 03:22:02.758993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17665): Terminating (SIGTERM) 03:22:02.800441 --- ParallelTerminationStrategy: PID 17658 died... 03:22:02.819665 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=17658): Terminated: ok {rc=0} 03:22:02.864788 --- ParallelTerminationStrategy: PID 17659 died... 03:22:02.883479 run osmo-stp_10.42.42.4(pid=17659): Terminated: ok {rc=0} 03:22:02.928033 --- ParallelTerminationStrategy: PID 17662 died... 03:22:02.946816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17662): Terminated: ok {rc=0} 03:22:02.991327 --- ParallelTerminationStrategy: PID 17665 died... 03:22:03.009956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17665): Terminated: ok {rc=0} ---------------------------------------------- trial-2353 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 03:22:03.058979 tst smpp: Using 1 x ip_address (candidates: 6) 03:22:03.070029 tst smpp: Using 1 x bts (candidates: 1) 03:22:03.106251 tst esme_ms_sms_storeforward.py: using LAC 18720 03:22:03.236170 tst esme_ms_sms_storeforward.py: using RAC 105 03:22:03.367674 tst esme_ms_sms_storeforward.py: using CellId 18720 03:22:03.490488 tst esme_ms_sms_storeforward.py: using BVCI 18721 03:22:03.604028 tst smpp: Using 1 x ip_address (candidates: 6) 03:22:03.614692 tst smpp: Using 1 x ip_address (candidates: 6) 03:22:03.625216 tst smpp: Using 1 x ip_address (candidates: 6) 03:22:03.635813 tst smpp: Using 1 x ip_address (candidates: 6) 03:22:03.646511 tst smpp: Using 1 x ip_address (candidates: 6) 03:22:03.656851 tst smpp: Using 1 x modem (candidates: 1) 03:22:03.785771 tst esme_ms_sms_storeforward.py: using MSISDN 7003 03:22:03.905481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:22:04.413136 run create_hlr_db(pid=17669): Launched 03:22:05.603585 run create_hlr_db(pid=17669): Terminated: ok {rc=0} 03:22:05.947671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17671): Launched 03:22:06.274022 run osmo-hlr_10.42.42.2(pid=17672): Launched 03:22:06.398697 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:06.967745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17674): Launched 03:22:07.295126 run osmo-stp_10.42.42.5(pid=17675): Launched 03:22:07.420335 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:08.012618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17677): Launched 03:22:08.338953 run osmo-msc_10.42.42.6(pid=17678): Launched 03:22:08.521276 run osmo-stp_10.42.42.5(pid=17675): ERR: Terminated: ERROR {rc=1} [trial-2353↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17675)] 03:22:08.659505 run osmo-stp_10.42.42.5(pid=17675): stdout: | (launched: 2022-12-09_03:22:07.235693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:08.797979 run osmo-stp_10.42.42.5(pid=17675): stderr: | 20221209032207429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032207429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032207429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032207430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032207430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032207430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032207430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:08.935267 run osmo-stp_10.42.42.5(pid=17675): stdout: | (launched: 2022-12-09_03:22:07.235693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:09.065449 run osmo-stp_10.42.42.5(pid=17675): stderr: | 20221209032207429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032207429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032207429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032207430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032207430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032207430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032207430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:09.220721 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=17675): Process ended prematurely: osmo-stp_10.42.42.5(pid=17675) [trial-2353↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17675)] [trial-2353↪smpp↪esme_ms_sms_storeforward.py:30] 03:22:09.230036 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.2 sec) 03:22:09.257318 run osmo-hlr_10.42.42.2(pid=17672): ERR: Terminated: ERROR {rc=237} [trial-2353↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17672)] 03:22:09.307155 run osmo-hlr_10.42.42.2(pid=17672): stdout: | (launched: 2022-12-09_03:22:06.214542) 03:22:09.358956 run osmo-hlr_10.42.42.2(pid=17672): stderr: | 20221209032206412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032206412 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032206412 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032206412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032206412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032206412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032206424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032206433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032206433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032206433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:09.431208 run osmo-msc_10.42.42.6(pid=17678): ERR: Terminated: ERROR {rc=2} [trial-2353↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17678)] 03:22:09.481175 run osmo-msc_10.42.42.6(pid=17678): stdout: | (launched: 2022-12-09_03:22:08.279509) 03:22:09.532392 run osmo-msc_10.42.42.6(pid=17678): stderr: | 20221209032208602 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032208602 DLGLOBAL DEBUG validating counter group 0x7f9c0c3f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032208602 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032208602 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032208602 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032208602 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032208604 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032208605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032208605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032208605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:09.584262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17671): Terminating (SIGTERM) 03:22:09.625978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17674): Terminating (SIGTERM) 03:22:09.667538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17677): Terminating (SIGTERM) 03:22:09.709552 --- ParallelTerminationStrategy: PID 17671 died... 03:22:09.729129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17671): Terminated: ok {rc=0} 03:22:09.775007 --- ParallelTerminationStrategy: PID 17674 died... 03:22:09.794525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17674): Terminated: ok {rc=0} 03:22:09.840464 --- ParallelTerminationStrategy: PID 17677 died... 03:22:09.859998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17677): Terminated: ok {rc=0} 03:22:09.947822 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 smpp esme_ms_sms_transaction.py ---------------------------------------------- 03:22:11.036314 tst smpp: Using 1 x ip_address (candidates: 6) 03:22:11.048530 tst smpp: Using 1 x bts (candidates: 1) 03:22:11.090902 tst esme_ms_sms_transaction.py: using LAC 18721 03:22:11.219908 tst esme_ms_sms_transaction.py: using RAC 106 03:22:11.346061 tst esme_ms_sms_transaction.py: using CellId 18721 03:22:11.473999 tst esme_ms_sms_transaction.py: using BVCI 18722 03:22:11.593604 tst smpp: Using 1 x ip_address (candidates: 6) 03:22:11.604365 tst smpp: Using 1 x ip_address (candidates: 6) 03:22:11.615170 tst smpp: Using 1 x ip_address (candidates: 6) 03:22:11.626558 tst smpp: Using 1 x ip_address (candidates: 6) 03:22:11.637892 tst smpp: Using 1 x ip_address (candidates: 6) 03:22:11.649078 tst smpp: Using 1 x modem (candidates: 1) 03:22:11.776841 tst esme_ms_sms_transaction.py: using MSISDN 7004 03:22:11.896134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:22:12.401285 run create_hlr_db(pid=17680): Launched 03:22:12.533535 bus /sierra_2: Setting Powered False 03:22:13.597567 run create_hlr_db(pid=17680): Terminated: ok {rc=0} 03:22:14.050994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17682): Launched 03:22:14.377323 run osmo-hlr_10.42.42.2(pid=17683): Launched 03:22:14.502163 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:15.068416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17685): Launched 03:22:15.393634 run osmo-stp_10.42.42.5(pid=17686): Launched 03:22:15.518341 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:16.121988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17688): Launched 03:22:16.449970 run osmo-msc_10.42.42.6(pid=17689): Launched 03:22:16.881249 run osmo-stp_10.42.42.5(pid=17686): ERR: Terminated: ERROR {rc=1} [trial-2353↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17686)] 03:22:17.281378 run osmo-stp_10.42.42.5(pid=17686): stdout: | (launched: 2022-12-09_03:22:15.333863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:17.466868 run osmo-stp_10.42.42.5(pid=17686): stderr: | 20221209032215529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032215529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032215529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032215530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032215530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032215530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032215530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:17.595729 run osmo-stp_10.42.42.5(pid=17686): stdout: | (launched: 2022-12-09_03:22:15.333863) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:17.718474 run osmo-stp_10.42.42.5(pid=17686): stderr: | 20221209032215529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032215529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032215529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032215530 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032215530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032215530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032215530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:17.865802 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=17686): Process ended prematurely: osmo-stp_10.42.42.5(pid=17686) [trial-2353↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17686)] [trial-2353↪smpp↪esme_ms_sms_transaction.py:28] 03:22:17.874149 tst esme_ms_sms_transaction.py:28: Test FAILED (6.8 sec) 03:22:17.901478 run osmo-hlr_10.42.42.2(pid=17683): ERR: Terminated: ERROR {rc=237} [trial-2353↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17683)] 03:22:17.950537 run osmo-hlr_10.42.42.2(pid=17683): stdout: | (launched: 2022-12-09_03:22:14.317876) 03:22:18.001061 run osmo-hlr_10.42.42.2(pid=17683): stderr: | 20221209032214518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032214518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032214518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032214518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032214518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032214518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032214530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032214539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032214539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032214539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:18.071128 run osmo-msc_10.42.42.6(pid=17689): ERR: Terminated: ERROR {rc=2} [trial-2353↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17689)] 03:22:18.119939 run osmo-msc_10.42.42.6(pid=17689): stdout: | (launched: 2022-12-09_03:22:16.390562) 03:22:18.170467 run osmo-msc_10.42.42.6(pid=17689): stderr: | 20221209032216930 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032216930 DLGLOBAL DEBUG validating counter group 0x7f560a016c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032216931 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032216932 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032216933 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032216933 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032216939 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032216940 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032216940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032216940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:18.221273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17682): Terminating (SIGTERM) 03:22:18.262399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17685): Terminating (SIGTERM) 03:22:18.303458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17688): Terminating (SIGTERM) 03:22:18.344680 --- ParallelTerminationStrategy: PID 17682 died... 03:22:18.363999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17682): Terminated: ok {rc=0} 03:22:18.410021 --- ParallelTerminationStrategy: PID 17685 died... 03:22:18.428673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17685): Terminated: ok {rc=0} 03:22:18.474546 --- ParallelTerminationStrategy: PID 17688 died... 03:22:18.493340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17688): Terminated: ok {rc=0} 03:22:18.581030 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 encryption --------------------------------------------------------------------- 03:22:19.774235 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:22:19.777924 tst encryption: Verifying 1 x bts (candidates: 11) 03:22:19.799935 tst encryption: Verifying 6 x ip_address (candidates: 9) 03:22:19.827714 tst encryption: Verifying 1 x modem (candidates: 12) 03:22:19.863387 tst encryption: Reserving 1 x bts (candidates: 11) 03:22:19.885070 tst encryption: Reserving 6 x ip_address (candidates: 9) 03:22:19.912645 tst encryption: Reserving 1 x modem (candidates: 12) 03:22:20.442627 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2353 encryption register_a5_0_authopt.py ---------------------------------------------- 03:22:20.498125 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:20.509227 tst encryption: Using 1 x bts (candidates: 1) 03:22:20.545754 tst register_a5_0_authopt.py: using LAC 18722 03:22:20.676572 tst register_a5_0_authopt.py: using RAC 107 03:22:20.806241 tst register_a5_0_authopt.py: using CellId 18722 03:22:20.939559 tst register_a5_0_authopt.py: using BVCI 18723 03:22:21.061733 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:21.072934 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:21.084000 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:21.094942 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:21.105956 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:21.116761 tst encryption: Using 1 x modem (candidates: 1) 03:22:21.231826 tst register_a5_0_authopt.py:8: start network... 03:22:21.441155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:22:21.920473 run create_hlr_db(pid=17694): Launched 03:22:22.039609 bus /sierra_2: Setting Powered False 03:22:23.100367 run create_hlr_db(pid=17694): Terminated: ok {rc=0} 03:22:23.550038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17696): Launched 03:22:23.879843 run osmo-hlr_10.42.42.2(pid=17697): Launched 03:22:24.005800 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:24.572146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17699): Launched 03:22:24.899334 run osmo-stp_10.42.42.5(pid=17700): Launched 03:22:25.025560 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:25.616941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17702): Launched 03:22:25.944330 run osmo-msc_10.42.42.6(pid=17703): Launched 03:22:26.128010 run osmo-stp_10.42.42.5(pid=17700): ERR: Terminated: ERROR {rc=1} [trial-2353↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17700)] 03:22:26.266685 run osmo-stp_10.42.42.5(pid=17700): stdout: | (launched: 2022-12-09_03:22:24.839681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:26.406089 run osmo-stp_10.42.42.5(pid=17700): stderr: | 20221209032225033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032225033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032225033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032225034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032225034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032225034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032225034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:26.543618 run osmo-stp_10.42.42.5(pid=17700): stdout: | (launched: 2022-12-09_03:22:24.839681) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:26.674814 run osmo-stp_10.42.42.5(pid=17700): stderr: | 20221209032225033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032225033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032225033 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032225034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032225034 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032225034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032225034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:26.831391 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17700): Process ended prematurely: osmo-stp_10.42.42.5(pid=17700) [trial-2353↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17700)] [trial-2353↪encryption↪register_a5_0_authopt.py:8] 03:22:26.840639 tst register_a5_0_authopt.py:8: Test FAILED (6.4 sec) 03:22:26.868030 run osmo-hlr_10.42.42.2(pid=17697): ERR: Terminated: ERROR {rc=237} [trial-2353↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17697)] 03:22:26.917677 run osmo-hlr_10.42.42.2(pid=17697): stdout: | (launched: 2022-12-09_03:22:23.820147) 03:22:26.969474 run osmo-hlr_10.42.42.2(pid=17697): stderr: | 20221209032224022 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032224022 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032224022 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032224022 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032224022 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032224022 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032224038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032224048 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032224048 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032224048 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:27.040921 run osmo-msc_10.42.42.6(pid=17703): ERR: Terminated: ERROR {rc=2} [trial-2353↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17703)] 03:22:27.090424 run osmo-msc_10.42.42.6(pid=17703): stdout: | (launched: 2022-12-09_03:22:25.884899) 03:22:27.141598 run osmo-msc_10.42.42.6(pid=17703): stderr: | 20221209032226205 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032226206 DLGLOBAL DEBUG validating counter group 0x7f51b93b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032226206 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032226206 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032226206 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032226206 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032226208 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032226208 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032226208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032226208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:27.193100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17696): Terminating (SIGTERM) 03:22:27.234982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17699): Terminating (SIGTERM) 03:22:27.276200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17702): Terminating (SIGTERM) 03:22:27.317871 --- ParallelTerminationStrategy: PID 17696 died... 03:22:27.337142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17696): Terminated: ok {rc=0} 03:22:27.382770 --- ParallelTerminationStrategy: PID 17699 died... 03:22:27.401961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17699): Terminated: ok {rc=0} 03:22:27.447461 --- ParallelTerminationStrategy: PID 17702 died... 03:22:27.467048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17702): Terminated: ok {rc=0} 03:22:27.554916 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 encryption register_a5_0_authreq.py ---------------------------------------------- 03:22:28.706999 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:28.718952 tst encryption: Using 1 x bts (candidates: 1) 03:22:28.756081 tst register_a5_0_authreq.py: using LAC 18723 03:22:28.887199 tst register_a5_0_authreq.py: using RAC 108 03:22:29.017197 tst register_a5_0_authreq.py: using CellId 18723 03:22:29.146447 tst register_a5_0_authreq.py: using BVCI 18724 03:22:29.267463 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:29.278628 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:29.289764 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:29.300546 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:29.311429 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:29.322427 tst encryption: Using 1 x modem (candidates: 1) 03:22:29.440366 tst register_a5_0_authreq.py:8: start network... 03:22:29.648940 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:22:30.126148 run create_hlr_db(pid=17706): Launched 03:22:30.243709 bus /sierra_2: Setting Powered False 03:22:31.322711 run create_hlr_db(pid=17706): Terminated: ok {rc=0} 03:22:31.822256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17708): Launched 03:22:32.149778 run osmo-hlr_10.42.42.2(pid=17709): Launched 03:22:32.299479 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:32.866956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17711): Launched 03:22:33.197188 run osmo-stp_10.42.42.5(pid=17712): Launched 03:22:33.322096 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:33.914945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17714): Launched 03:22:34.244592 run osmo-msc_10.42.42.6(pid=17715): Launched 03:22:34.427434 run osmo-stp_10.42.42.5(pid=17712): ERR: Terminated: ERROR {rc=1} [trial-2353↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17712)] 03:22:34.565348 run osmo-stp_10.42.42.5(pid=17712): stdout: | (launched: 2022-12-09_03:22:33.137733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:34.703829 run osmo-stp_10.42.42.5(pid=17712): stderr: | 20221209032233330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032233331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032233331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032233331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032233332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032233332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032233332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:34.841677 run osmo-stp_10.42.42.5(pid=17712): stdout: | (launched: 2022-12-09_03:22:33.137733) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:34.972880 run osmo-stp_10.42.42.5(pid=17712): stderr: | 20221209032233330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032233331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032233331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032233331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032233332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032233332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032233332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:35.129415 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17712): Process ended prematurely: osmo-stp_10.42.42.5(pid=17712) [trial-2353↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17712)] [trial-2353↪encryption↪register_a5_0_authreq.py:8] 03:22:35.138978 tst register_a5_0_authreq.py:8: Test FAILED (6.5 sec) 03:22:35.166371 run osmo-hlr_10.42.42.2(pid=17709): ERR: Terminated: ERROR {rc=237} [trial-2353↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17709)] 03:22:35.215840 run osmo-hlr_10.42.42.2(pid=17709): stdout: | (launched: 2022-12-09_03:22:32.090982) 03:22:35.267065 run osmo-hlr_10.42.42.2(pid=17709): stderr: | 20221209032232298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032232298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032232298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032232298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032232298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032232298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032232310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032232320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032232321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032232321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:35.338765 run osmo-msc_10.42.42.6(pid=17715): ERR: Terminated: ERROR {rc=2} [trial-2353↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17715)] 03:22:35.388147 run osmo-msc_10.42.42.6(pid=17715): stdout: | (launched: 2022-12-09_03:22:34.184810) 03:22:35.439307 run osmo-msc_10.42.42.6(pid=17715): stderr: | 20221209032234508 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032234508 DLGLOBAL DEBUG validating counter group 0x7f6bf715dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032234508 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032234508 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032234508 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032234509 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032234510 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032234511 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032234511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032234511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:35.490697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17708): Terminating (SIGTERM) 03:22:35.532164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17711): Terminating (SIGTERM) 03:22:35.573924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17714): Terminating (SIGTERM) 03:22:35.615598 --- ParallelTerminationStrategy: PID 17708 died... 03:22:35.635065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17708): Terminated: ok {rc=0} 03:22:35.680463 --- ParallelTerminationStrategy: PID 17711 died... 03:22:35.699887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17711): Terminated: ok {rc=0} 03:22:35.745801 --- ParallelTerminationStrategy: PID 17714 died... 03:22:35.765155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17714): Terminated: ok {rc=0} 03:22:35.853942 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 encryption register_a5_1_authreq.py ---------------------------------------------- 03:22:37.006860 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:37.018483 tst encryption: Using 1 x bts (candidates: 1) 03:22:37.056814 tst register_a5_1_authreq.py: using LAC 18724 03:22:37.188254 tst register_a5_1_authreq.py: using RAC 109 03:22:37.317461 tst register_a5_1_authreq.py: using CellId 18724 03:22:37.449369 tst register_a5_1_authreq.py: using BVCI 18725 03:22:37.570458 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:37.581616 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:37.592509 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:37.603952 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:37.615285 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:37.626693 tst encryption: Using 1 x modem (candidates: 1) 03:22:37.746630 tst register_a5_1_authreq.py:8: start network... 03:22:37.955783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:22:38.435264 run create_hlr_db(pid=17717): Launched 03:22:38.553452 bus /sierra_2: Setting Powered False 03:22:39.614926 run create_hlr_db(pid=17717): Terminated: ok {rc=0} 03:22:40.065589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17719): Launched 03:22:40.394326 run osmo-hlr_10.42.42.2(pid=17720): Launched 03:22:40.520199 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:41.090849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17722): Launched 03:22:41.419945 run osmo-stp_10.42.42.5(pid=17723): Launched 03:22:41.545555 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:42.139183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17725): Launched 03:22:42.468638 run osmo-msc_10.42.42.6(pid=17726): Launched 03:22:42.652871 run osmo-stp_10.42.42.5(pid=17723): ERR: Terminated: ERROR {rc=1} [trial-2353↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17723)] 03:22:42.791870 run osmo-stp_10.42.42.5(pid=17723): stdout: | (launched: 2022-12-09_03:22:41.359943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:42.930982 run osmo-stp_10.42.42.5(pid=17723): stderr: | 20221209032241554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032241554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032241554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032241554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032241557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032241557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032241557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:43.069684 run osmo-stp_10.42.42.5(pid=17723): stdout: | (launched: 2022-12-09_03:22:41.359943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:43.201319 run osmo-stp_10.42.42.5(pid=17723): stderr: | 20221209032241554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032241554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032241554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032241554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032241557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032241557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032241557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:43.358786 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17723): Process ended prematurely: osmo-stp_10.42.42.5(pid=17723) [trial-2353↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17723)] [trial-2353↪encryption↪register_a5_1_authreq.py:8] 03:22:43.368171 tst register_a5_1_authreq.py:8: Test FAILED (6.4 sec) 03:22:43.395484 run osmo-hlr_10.42.42.2(pid=17720): ERR: Terminated: ERROR {rc=237} [trial-2353↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17720)] 03:22:43.445072 run osmo-hlr_10.42.42.2(pid=17720): stdout: | (launched: 2022-12-09_03:22:40.334647) 03:22:43.496371 run osmo-hlr_10.42.42.2(pid=17720): stderr: | 20221209032240534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032240534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032240534 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032240534 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032240534 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032240534 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032240547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032240555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032240556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032240556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:43.568094 run osmo-msc_10.42.42.6(pid=17726): ERR: Terminated: ERROR {rc=2} [trial-2353↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17726)] 03:22:43.618089 run osmo-msc_10.42.42.6(pid=17726): stdout: | (launched: 2022-12-09_03:22:42.407521) 03:22:43.669234 run osmo-msc_10.42.42.6(pid=17726): stderr: | 20221209032242735 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032242736 DLGLOBAL DEBUG validating counter group 0x7f1dbeb60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032242736 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032242736 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032242736 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032242736 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032242738 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032242738 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032242738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032242738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:43.720674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17719): Terminating (SIGTERM) 03:22:43.762014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17722): Terminating (SIGTERM) 03:22:43.803411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17725): Terminating (SIGTERM) 03:22:43.845000 --- ParallelTerminationStrategy: PID 17719 died... 03:22:43.864836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17719): Terminated: ok {rc=0} 03:22:43.910847 --- ParallelTerminationStrategy: PID 17722 died... 03:22:43.930315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17722): Terminated: ok {rc=0} 03:22:43.976270 --- ParallelTerminationStrategy: PID 17725 died... 03:22:43.995740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17725): Terminated: ok {rc=0} 03:22:44.081774 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2353 encryption register_a5_3_authreq.py ---------------------------------------------- 03:22:45.230266 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:45.242007 tst encryption: Using 1 x bts (candidates: 1) 03:22:45.279400 tst register_a5_3_authreq.py: using LAC 18725 03:22:45.414540 tst register_a5_3_authreq.py: using RAC 110 03:22:45.544410 tst register_a5_3_authreq.py: using CellId 18725 03:22:45.674131 tst register_a5_3_authreq.py: using BVCI 18726 03:22:45.795906 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:45.806882 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:45.817790 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:45.838490 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:45.854929 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:45.868602 tst encryption: Using 1 x modem (candidates: 1) 03:22:46.006012 tst register_a5_3_authreq.py:8: start network... 03:22:46.239263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:22:46.768155 run create_hlr_db(pid=17728): Launched 03:22:46.934436 bus /sierra_2: Setting Powered False 03:22:47.999682 run create_hlr_db(pid=17728): Terminated: ok {rc=0} 03:22:48.455266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17730): Launched 03:22:48.783308 run osmo-hlr_10.42.42.2(pid=17731): Launched 03:22:48.908832 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:49.475583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17733): Launched 03:22:49.804586 run osmo-stp_10.42.42.5(pid=17734): Launched 03:22:49.930398 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:50.523320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17736): Launched 03:22:50.850429 run osmo-msc_10.42.42.6(pid=17737): Launched 03:22:51.033667 run osmo-stp_10.42.42.5(pid=17734): ERR: Terminated: ERROR {rc=1} [trial-2353↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17734)] 03:22:51.172287 run osmo-stp_10.42.42.5(pid=17734): stdout: | (launched: 2022-12-09_03:22:49.744938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:51.311745 run osmo-stp_10.42.42.5(pid=17734): stderr: | 20221209032249940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032249940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032249940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032249941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032249941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032249941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032249941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:51.449755 run osmo-stp_10.42.42.5(pid=17734): stdout: | (launched: 2022-12-09_03:22:49.744938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:51.581450 run osmo-stp_10.42.42.5(pid=17734): stderr: | 20221209032249940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032249940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032249940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032249941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032249941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032249941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032249941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:51.739371 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=17734): Process ended prematurely: osmo-stp_10.42.42.5(pid=17734) [trial-2353↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17734)] [trial-2353↪encryption↪register_a5_3_authreq.py:8] 03:22:51.748763 tst register_a5_3_authreq.py:8: Test FAILED (6.6 sec) 03:22:51.775968 run osmo-hlr_10.42.42.2(pid=17731): ERR: Terminated: ERROR {rc=237} [trial-2353↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17731)] 03:22:51.825555 run osmo-hlr_10.42.42.2(pid=17731): stdout: | (launched: 2022-12-09_03:22:48.723742) 03:22:51.876714 run osmo-hlr_10.42.42.2(pid=17731): stderr: | 20221209032248926 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032248926 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032248926 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032248926 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032248926 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032248926 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032248965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032248974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032248974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032248975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:51.948001 run osmo-msc_10.42.42.6(pid=17737): ERR: Terminated: ERROR {rc=2} [trial-2353↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=17737)] 03:22:51.997872 run osmo-msc_10.42.42.6(pid=17737): stdout: | (launched: 2022-12-09_03:22:50.790944) 03:22:52.049166 run osmo-msc_10.42.42.6(pid=17737): stderr: | 20221209032251115 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032251116 DLGLOBAL DEBUG validating counter group 0x7fe6909bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032251116 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032251116 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032251116 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032251116 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032251118 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032251118 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032251118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032251118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:52.100477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17730): Terminating (SIGTERM) 03:22:52.141782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17733): Terminating (SIGTERM) 03:22:52.183222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17736): Terminating (SIGTERM) 03:22:52.224727 --- ParallelTerminationStrategy: PID 17730 died... 03:22:52.244477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17730): Terminated: ok {rc=0} 03:22:52.290126 --- ParallelTerminationStrategy: PID 17733 died... 03:22:52.309368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17733): Terminated: ok {rc=0} 03:22:52.354854 --- ParallelTerminationStrategy: PID 17736 died... 03:22:52.374264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17736): Terminated: ok {rc=0} 03:22:52.460355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 03:22:53.670962 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:22:53.676667 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 03:22:53.695653 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 03:22:53.722899 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 03:22:53.751504 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 03:22:53.770531 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 03:22:53.797908 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 03:22:54.308787 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2353 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 03:22:54.313760 tst handover.py:11: TEST_CONFIG: {} 03:22:54.535174 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:22:54.551578 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:22:54.575868 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:22:54.626937 tst handover.py: using MSISDN 7005 03:22:54.749012 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7005', subscriber_id=0} 03:22:54.864313 run srsepc_10.42.42.118: Starting srsepc 03:22:56.783159 run rm-remote-dir(pid=17742): Launched 03:22:56.914610 bus /sierra_2: Setting Powered False 03:22:57.983347 run rm-remote-dir(pid=17742): Terminated: ok {rc=0} 03:22:58.454672 run mk-remote-dir(pid=17743): Launched 03:22:59.646722 run mk-remote-dir(pid=17743): Terminated: ok {rc=0} 03:22:59.953096 run scp-inst-to-remote(pid=17744): Launched 03:23:02.176222 run scp-inst-to-remote(pid=17744): Terminated: ok {rc=0} 03:23:02.681629 run rm-remote-dir(pid=17797): Launched 03:23:04.054820 run rm-remote-dir(pid=17797): Terminated: ok {rc=0} 03:23:04.426652 run mk-remote-dir(pid=18017): Launched 03:23:05.687851 run mk-remote-dir(pid=18017): Terminated: ok {rc=0} 03:23:06.014099 run scp-cfg-to-remote(pid=18019): Launched 03:23:07.238568 run scp-cfg-to-remote(pid=18019): Terminated: ok {rc=0} 03:23:07.555369 run scp-db-to-remote(pid=18022): Launched 03:23:08.810086 run scp-db-to-remote(pid=18022): Terminated: ok {rc=0} 03:23:08.956229 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:23:09.301048 run patchelf(pid=18024): Launched 03:23:10.560924 run patchelf(pid=18024): Terminated: ok {rc=0} 03:23:10.708829 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:23:11.053924 run setcap-netadm(pid=18025): Launched 03:23:12.314863 run setcap-netadm(pid=18025): Terminated: ok {rc=0} 03:23:12.676803 run srsepc(pid=18026): Launched 03:23:12.859222 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:23:14.160785 run rm-remote-dir(pid=18027): Launched 03:23:14.474159 run srsepc(pid=18026): ERR: Terminated: ERROR {rc=127} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18026)] 03:23:14.628814 run srsepc(pid=18026): stdout: | (launched: 2022-12-09_03:23:12.614447) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:14.782911 run srsepc(pid=18026): stderr: | (launched: 2022-12-09_03:23:12.666549) | Connection to 10.42.42.116 closed. 03:23:14.934645 run srsepc(pid=18026): stdout: | (launched: 2022-12-09_03:23:12.614447) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:15.081349 run srsepc(pid=18026): stderr: | (launched: 2022-12-09_03:23:12.666549) | Connection to 10.42.42.116 closed. 03:23:15.252272 run rm-remote-dir(pid=18027): Terminating (SIGINT) 03:23:15.450972 run rm-remote-dir(pid=18027): Terminated: ok {rc=0} 03:23:15.595711 tst handover.py:37: ERR: Error: srsepc(pid=18026): Process ended prematurely: srsepc(pid=18026) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18026)] [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 03:23:15.607461 tst handover.py:37: Test FAILED (21.3 sec) 03:23:15.692209 run scp-back-log(pid=18028): Launched 03:23:16.827395 run scp-back-log(pid=18028): ERR: Terminated: ERROR {rc=1} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18028)] 03:23:16.903416 run scp-back-log(pid=18028): stdout: | (launched: 2022-12-09_03:23:15.658613) 03:23:16.980457 run scp-back-log(pid=18028): stderr: | (launched: 2022-12-09_03:23:15.681146) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:23:17.070883 tst srsepc_10.42.42.118: Error('scp-back-log(pid=18028): launch_sync(): local process exited with status 1 [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18028)]') ---------------------------------------------- trial-2353 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 03:23:17.129141 tst iperf3_bidir.py:13: Number of physical ue: 1 03:23:17.405118 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:23:17.456069 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 03:23:17.728813 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:23:17.746735 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:23:17.783276 tst iperf3_bidir.py: using MSISDN 7006 03:23:17.930282 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7006', subscriber_id=0} 03:23:18.051138 run srsepc_10.42.42.118: Starting srsepc 03:23:18.757501 run rm-remote-dir(pid=18030): Launched 03:23:20.011249 run rm-remote-dir(pid=18030): Terminated: ok {rc=0} 03:23:20.385977 run mk-remote-dir(pid=18031): Launched 03:23:21.651134 run mk-remote-dir(pid=18031): Terminated: ok {rc=0} 03:23:21.973721 run scp-inst-to-remote(pid=18032): Launched 03:23:24.229882 run scp-inst-to-remote(pid=18032): Terminated: ok {rc=0} 03:23:24.603973 run rm-remote-dir(pid=18034): Launched 03:23:25.871637 run rm-remote-dir(pid=18034): Terminated: ok {rc=0} 03:23:26.236611 run mk-remote-dir(pid=18035): Launched 03:23:27.431055 run mk-remote-dir(pid=18035): Terminated: ok {rc=0} 03:23:27.741093 run scp-cfg-to-remote(pid=18036): Launched 03:23:28.928108 run scp-cfg-to-remote(pid=18036): Terminated: ok {rc=0} 03:23:29.218831 run scp-db-to-remote(pid=18039): Launched 03:23:30.398923 run scp-db-to-remote(pid=18039): Terminated: ok {rc=0} 03:23:30.532822 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:23:30.867086 run patchelf(pid=18041): Launched 03:23:32.112835 run patchelf(pid=18041): Terminated: ok {rc=0} 03:23:32.252346 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:23:32.570166 run setcap-netadm(pid=18042): Launched 03:23:33.751073 run setcap-netadm(pid=18042): Terminated: ok {rc=0} 03:23:34.080127 run srsepc(pid=18043): Launched 03:23:34.196227 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:23:35.320873 run rm-remote-dir(pid=18044): Launched 03:23:35.500241 run srsepc(pid=18043): ERR: Terminated: ERROR {rc=127} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18043)] 03:23:35.635978 run srsepc(pid=18043): stdout: | (launched: 2022-12-09_03:23:34.022870) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:35.773170 run srsepc(pid=18043): stderr: | (launched: 2022-12-09_03:23:34.069584) | Connection to 10.42.42.116 closed. 03:23:35.910220 run srsepc(pid=18043): stdout: | (launched: 2022-12-09_03:23:34.022870) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:36.041929 run srsepc(pid=18043): stderr: | (launched: 2022-12-09_03:23:34.069584) | Connection to 10.42.42.116 closed. 03:23:36.197815 run rm-remote-dir(pid=18044): Terminating (SIGINT) 03:23:36.377768 run rm-remote-dir(pid=18044): Terminated: ok {rc=0} 03:23:36.507599 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=18043): Process ended prematurely: srsepc(pid=18043) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18043)] [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 03:23:36.517620 tst iperf3_bidir.py:42: Test FAILED (19.4 sec) 03:23:36.595591 run scp-back-log(pid=18045): Launched 03:23:37.673318 run scp-back-log(pid=18045): ERR: Terminated: ERROR {rc=1} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18045)] 03:23:37.734833 run scp-back-log(pid=18045): stdout: | (launched: 2022-12-09_03:23:36.564802) 03:23:37.797869 run scp-back-log(pid=18045): stderr: | (launched: 2022-12-09_03:23:36.584766) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:23:37.868651 tst srsepc_10.42.42.118: Error('scp-back-log(pid=18045): launch_sync(): local process exited with status 1 [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18045)]') ---------------------------------------------- trial-2353 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 03:23:37.914094 tst iperf3_dl.py:13: Number of physical ue: 1 03:23:38.125435 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:23:38.169722 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 03:23:38.378358 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:23:38.394278 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:23:38.426913 tst iperf3_dl.py: using MSISDN 7007 03:23:38.550707 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7007', subscriber_id=0} 03:23:38.668467 run srsepc_10.42.42.118: Starting srsepc 03:23:39.351061 run rm-remote-dir(pid=18047): Launched 03:23:40.545892 run rm-remote-dir(pid=18047): Terminated: ok {rc=0} 03:23:40.909753 run mk-remote-dir(pid=18048): Launched 03:23:42.104129 run mk-remote-dir(pid=18048): Terminated: ok {rc=0} 03:23:42.414511 run scp-inst-to-remote(pid=18049): Launched 03:23:44.604462 run scp-inst-to-remote(pid=18049): Terminated: ok {rc=0} 03:23:44.943732 run rm-remote-dir(pid=18051): Launched 03:23:46.124841 run rm-remote-dir(pid=18051): Terminated: ok {rc=0} 03:23:46.476649 run mk-remote-dir(pid=18053): Launched 03:23:47.725200 run mk-remote-dir(pid=18053): Terminated: ok {rc=0} 03:23:48.035310 run scp-cfg-to-remote(pid=18054): Launched 03:23:49.227494 run scp-cfg-to-remote(pid=18054): Terminated: ok {rc=0} 03:23:49.534763 run scp-db-to-remote(pid=18056): Launched 03:23:50.726712 run scp-db-to-remote(pid=18056): Terminated: ok {rc=0} 03:23:50.869360 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:23:51.205252 run patchelf(pid=18058): Launched 03:23:52.397944 run patchelf(pid=18058): Terminated: ok {rc=0} 03:23:52.540678 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:23:52.875565 run setcap-netadm(pid=18059): Launched 03:23:54.067500 run setcap-netadm(pid=18059): Terminated: ok {rc=0} 03:23:54.418247 run srsepc(pid=18060): Launched 03:23:54.544106 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:23:55.742858 run rm-remote-dir(pid=18061): Launched 03:23:55.934506 run srsepc(pid=18060): ERR: Terminated: ERROR {rc=127} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18060)] 03:23:56.081664 run srsepc(pid=18060): stdout: | (launched: 2022-12-09_03:23:54.357354) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:56.227964 run srsepc(pid=18060): stderr: | (launched: 2022-12-09_03:23:54.407031) | Connection to 10.42.42.116 closed. 03:23:56.373939 run srsepc(pid=18060): stdout: | (launched: 2022-12-09_03:23:54.357354) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:56.513871 run srsepc(pid=18060): stderr: | (launched: 2022-12-09_03:23:54.407031) | Connection to 10.42.42.116 closed. 03:23:56.679674 run rm-remote-dir(pid=18061): Terminating (SIGINT) 03:23:56.871161 run rm-remote-dir(pid=18061): Terminated: ok {rc=0} 03:23:57.009899 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=18060): Process ended prematurely: srsepc(pid=18060) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18060)] [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 03:23:57.020664 tst iperf3_dl.py:42: Test FAILED (19.1 sec) 03:23:57.101976 run scp-back-log(pid=18062): Launched 03:23:58.182401 run scp-back-log(pid=18062): ERR: Terminated: ERROR {rc=1} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18062)] 03:23:58.246239 run scp-back-log(pid=18062): stdout: | (launched: 2022-12-09_03:23:57.069459) 03:23:58.311501 run scp-back-log(pid=18062): stderr: | (launched: 2022-12-09_03:23:57.090110) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:23:58.384826 tst srsepc_10.42.42.118: Error('scp-back-log(pid=18062): launch_sync(): local process exited with status 1 [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18062)]') ---------------------------------------------- trial-2353 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 03:23:58.431615 tst iperf3_ul.py:13: Number of physical ue: 1 03:23:58.655687 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:23:58.699772 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 03:23:58.923820 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:23:58.940370 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:23:58.973418 tst iperf3_ul.py: using MSISDN 7008 03:23:59.087540 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7008', subscriber_id=0} 03:23:59.196887 run srsepc_10.42.42.118: Starting srsepc 03:23:59.837858 run rm-remote-dir(pid=18064): Launched 03:24:01.019103 run rm-remote-dir(pid=18064): Terminated: ok {rc=0} 03:24:01.366729 run mk-remote-dir(pid=18065): Launched 03:24:02.606710 run mk-remote-dir(pid=18065): Terminated: ok {rc=0} 03:24:02.915908 run scp-inst-to-remote(pid=18066): Launched 03:24:05.110409 run scp-inst-to-remote(pid=18066): Terminated: ok {rc=0} 03:24:05.471216 run rm-remote-dir(pid=18068): Launched 03:24:06.667590 run rm-remote-dir(pid=18068): Terminated: ok {rc=0} 03:24:07.030896 run mk-remote-dir(pid=18069): Launched 03:24:08.226210 run mk-remote-dir(pid=18069): Terminated: ok {rc=0} 03:24:08.535679 run scp-cfg-to-remote(pid=18070): Launched 03:24:09.727497 run scp-cfg-to-remote(pid=18070): Terminated: ok {rc=0} 03:24:10.035304 run scp-db-to-remote(pid=18072): Launched 03:24:11.228432 run scp-db-to-remote(pid=18072): Terminated: ok {rc=0} 03:24:11.370680 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:24:11.706096 run patchelf(pid=18074): Launched 03:24:12.887007 run patchelf(pid=18074): Terminated: ok {rc=0} 03:24:13.021426 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:24:13.335447 run setcap-netadm(pid=18075): Launched 03:24:14.513833 run setcap-netadm(pid=18075): Terminated: ok {rc=0} 03:24:14.842870 run srsepc(pid=18076): Launched 03:24:14.958384 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:24:16.095237 run rm-remote-dir(pid=18077): Launched 03:24:16.388673 run srsepc(pid=18076): ERR: Terminated: ERROR {rc=127} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18076)] 03:24:16.539180 run srsepc(pid=18076): stdout: | (launched: 2022-12-09_03:24:14.785627) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:16.679963 run srsepc(pid=18076): stderr: | (launched: 2022-12-09_03:24:14.832237) | Connection to 10.42.42.116 closed. 03:24:16.820128 run srsepc(pid=18076): stdout: | (launched: 2022-12-09_03:24:14.785627) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:16.954414 run srsepc(pid=18076): stderr: | (launched: 2022-12-09_03:24:14.832237) | Connection to 10.42.42.116 closed. 03:24:17.113529 run rm-remote-dir(pid=18077): Terminating (SIGINT) 03:24:17.295969 run rm-remote-dir(pid=18077): Terminated: ok {rc=0} 03:24:17.426433 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=18076): Process ended prematurely: srsepc(pid=18076) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18076)] [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 03:24:17.436563 tst iperf3_ul.py:42: Test FAILED (19.0 sec) 03:24:17.514386 run scp-back-log(pid=18078): Launched 03:24:18.591089 run scp-back-log(pid=18078): ERR: Terminated: ERROR {rc=1} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18078)] 03:24:18.652385 run scp-back-log(pid=18078): stdout: | (launched: 2022-12-09_03:24:17.483487) 03:24:18.715144 run scp-back-log(pid=18078): stderr: | (launched: 2022-12-09_03:24:17.503459) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:24:18.785656 tst srsepc_10.42.42.118: Error('scp-back-log(pid=18078): launch_sync(): local process exited with status 1 [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18078)]') ---------------------------------------------- trial-2353 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 03:24:18.831728 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:24:18.848736 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:24:18.871646 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:24:18.921204 tst ping.py: using MSISDN 7009 03:24:19.037679 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7009', subscriber_id=0} 03:24:19.147151 run srsepc_10.42.42.118: Starting srsepc 03:24:19.787470 run rm-remote-dir(pid=18080): Launched 03:24:20.968493 run rm-remote-dir(pid=18080): Terminated: ok {rc=0} 03:24:21.309164 run mk-remote-dir(pid=18081): Launched 03:24:22.489109 run mk-remote-dir(pid=18081): Terminated: ok {rc=0} 03:24:22.778379 run scp-inst-to-remote(pid=18082): Launched 03:24:24.962756 run scp-inst-to-remote(pid=18082): Terminated: ok {rc=0} 03:24:25.324023 run rm-remote-dir(pid=18084): Launched 03:24:26.519458 run rm-remote-dir(pid=18084): Terminated: ok {rc=0} 03:24:26.882066 run mk-remote-dir(pid=18085): Launched 03:24:28.075782 run mk-remote-dir(pid=18085): Terminated: ok {rc=0} 03:24:28.384793 run scp-cfg-to-remote(pid=18086): Launched 03:24:29.575768 run scp-cfg-to-remote(pid=18086): Terminated: ok {rc=0} 03:24:29.882942 run scp-db-to-remote(pid=18088): Launched 03:24:31.070758 run scp-db-to-remote(pid=18088): Terminated: ok {rc=0} 03:24:31.207564 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:24:31.570973 run patchelf(pid=18090): Launched 03:24:32.810970 run patchelf(pid=18090): Terminated: ok {rc=0} 03:24:32.944274 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:24:33.257736 run setcap-netadm(pid=18091): Launched 03:24:34.435398 run setcap-netadm(pid=18091): Terminated: ok {rc=0} 03:24:34.764138 run srsepc(pid=18092): Launched 03:24:34.879497 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:24:36.015145 run rm-remote-dir(pid=18093): Launched 03:24:36.193429 run srsepc(pid=18092): ERR: Terminated: ERROR {rc=127} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18092)] 03:24:36.329555 run srsepc(pid=18092): stdout: | (launched: 2022-12-09_03:24:34.706552) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:36.466916 run srsepc(pid=18092): stderr: | (launched: 2022-12-09_03:24:34.752793) | Connection to 10.42.42.116 closed. 03:24:36.605337 run srsepc(pid=18092): stdout: | (launched: 2022-12-09_03:24:34.706552) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:36.736892 run srsepc(pid=18092): stderr: | (launched: 2022-12-09_03:24:34.752793) | Connection to 10.42.42.116 closed. 03:24:36.892785 run rm-remote-dir(pid=18093): Terminating (SIGINT) 03:24:37.072607 run rm-remote-dir(pid=18093): Terminated: ok {rc=0} 03:24:37.202881 tst ping.py:16: ERR: Error: srsepc(pid=18092): Process ended prematurely: srsepc(pid=18092) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18092)] [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 03:24:37.213074 tst ping.py:16: Test FAILED (18.4 sec) 03:24:37.291066 run scp-back-log(pid=18094): Launched 03:24:38.368649 run scp-back-log(pid=18094): ERR: Terminated: ERROR {rc=1} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18094)] 03:24:38.430009 run scp-back-log(pid=18094): stdout: | (launched: 2022-12-09_03:24:37.260132) 03:24:38.492460 run scp-back-log(pid=18094): stderr: | (launched: 2022-12-09_03:24:37.279791) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:24:38.563089 tst srsepc_10.42.42.118: Error('scp-back-log(pid=18094): launch_sync(): local process exited with status 1 [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18094)]') ---------------------------------------------- trial-2353 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 03:24:38.609540 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:24:38.626276 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:24:38.649809 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:24:38.701259 tst rrc_idle_mo_ping.py: using MSISDN 7010 03:24:38.818202 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7010', subscriber_id=0} 03:24:38.927392 run srsepc_10.42.42.118: Starting srsepc 03:24:39.563886 run rm-remote-dir(pid=18096): Launched 03:24:40.745315 run rm-remote-dir(pid=18096): Terminated: ok {rc=0} 03:24:41.085458 run mk-remote-dir(pid=18097): Launched 03:24:42.266019 run mk-remote-dir(pid=18097): Terminated: ok {rc=0} 03:24:42.555783 run scp-inst-to-remote(pid=18098): Launched 03:24:44.735890 run scp-inst-to-remote(pid=18098): Terminated: ok {rc=0} 03:24:45.074748 run rm-remote-dir(pid=18100): Launched 03:24:46.255318 run rm-remote-dir(pid=18100): Terminated: ok {rc=0} 03:24:46.606659 run mk-remote-dir(pid=18101): Launched 03:24:47.844188 run mk-remote-dir(pid=18101): Terminated: ok {rc=0} 03:24:48.134660 run scp-cfg-to-remote(pid=18102): Launched 03:24:49.313356 run scp-cfg-to-remote(pid=18102): Terminated: ok {rc=0} 03:24:49.600451 run scp-db-to-remote(pid=18104): Launched 03:24:50.779016 run scp-db-to-remote(pid=18104): Terminated: ok {rc=0} 03:24:50.912035 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:24:51.224534 run patchelf(pid=18106): Launched 03:24:52.402771 run patchelf(pid=18106): Terminated: ok {rc=0} 03:24:52.535765 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:24:52.849478 run setcap-netadm(pid=18107): Launched 03:24:54.026723 run setcap-netadm(pid=18107): Terminated: ok {rc=0} 03:24:54.355584 run srsepc(pid=18108): Launched 03:24:54.470860 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:24:55.663027 run rm-remote-dir(pid=18109): Launched 03:24:55.855126 run srsepc(pid=18108): ERR: Terminated: ERROR {rc=127} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18108)] 03:24:56.001378 run srsepc(pid=18108): stdout: | (launched: 2022-12-09_03:24:54.298736) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:56.147829 run srsepc(pid=18108): stderr: | (launched: 2022-12-09_03:24:54.344844) | Connection to 10.42.42.116 closed. 03:24:56.293596 run srsepc(pid=18108): stdout: | (launched: 2022-12-09_03:24:54.298736) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:56.433558 run srsepc(pid=18108): stderr: | (launched: 2022-12-09_03:24:54.344844) | Connection to 10.42.42.116 closed. 03:24:56.599338 run rm-remote-dir(pid=18109): Terminating (SIGINT) 03:24:56.791036 run rm-remote-dir(pid=18109): Terminated: ok {rc=0} 03:24:56.929683 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=18108): Process ended prematurely: srsepc(pid=18108) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18108)] [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 03:24:56.940267 tst rrc_idle_mo_ping.py:16: Test FAILED (18.3 sec) 03:24:57.021297 run scp-back-log(pid=18110): Launched 03:24:58.102631 run scp-back-log(pid=18110): ERR: Terminated: ERROR {rc=1} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18110)] 03:24:58.166530 run scp-back-log(pid=18110): stdout: | (launched: 2022-12-09_03:24:56.988898) 03:24:58.231865 run scp-back-log(pid=18110): stderr: | (launched: 2022-12-09_03:24:57.009603) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:24:58.305375 tst srsepc_10.42.42.118: Error('scp-back-log(pid=18110): launch_sync(): local process exited with status 1 [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18110)]') ---------------------------------------------- trial-2353 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 03:24:58.353730 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:24:58.371244 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:24:58.395160 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:24:58.445587 tst rrc_idle_mt_ping.py: using MSISDN 7011 03:24:58.570363 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7011', subscriber_id=0} 03:24:58.687798 run srsepc_10.42.42.118: Starting srsepc 03:24:59.372276 run rm-remote-dir(pid=18112): Launched 03:25:00.566973 run rm-remote-dir(pid=18112): Terminated: ok {rc=0} 03:25:00.961660 run mk-remote-dir(pid=18113): Launched 03:25:02.190575 run mk-remote-dir(pid=18113): Terminated: ok {rc=0} 03:25:02.511840 run scp-inst-to-remote(pid=18117): Launched 03:25:04.703168 run scp-inst-to-remote(pid=18117): Terminated: ok {rc=0} 03:25:05.042217 run rm-remote-dir(pid=18119): Launched 03:25:06.223428 run rm-remote-dir(pid=18119): Terminated: ok {rc=0} 03:25:06.563887 run mk-remote-dir(pid=18120): Launched 03:25:07.745564 run mk-remote-dir(pid=18120): Terminated: ok {rc=0} 03:25:08.036120 run scp-cfg-to-remote(pid=18121): Launched 03:25:09.215291 run scp-cfg-to-remote(pid=18121): Terminated: ok {rc=0} 03:25:09.503927 run scp-db-to-remote(pid=18123): Launched 03:25:10.683473 run scp-db-to-remote(pid=18123): Terminated: ok {rc=0} 03:25:10.817515 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:25:11.131800 run patchelf(pid=18125): Launched 03:25:12.311263 run patchelf(pid=18125): Terminated: ok {rc=0} 03:25:12.444658 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:25:12.758257 run setcap-netadm(pid=18126): Launched 03:25:13.938064 run setcap-netadm(pid=18126): Terminated: ok {rc=0} 03:25:14.267363 run srsepc(pid=18127): Launched 03:25:14.383109 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:25:15.512465 run rm-remote-dir(pid=18128): Launched 03:25:15.690470 run srsepc(pid=18127): ERR: Terminated: ERROR {rc=127} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18127)] 03:25:15.826842 run srsepc(pid=18127): stdout: | (launched: 2022-12-09_03:25:14.210180) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:25:15.989547 run srsepc(pid=18127): stderr: | (launched: 2022-12-09_03:25:14.256546) | Connection to 10.42.42.116 closed. 03:25:16.169282 run srsepc(pid=18127): stdout: | (launched: 2022-12-09_03:25:14.210180) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:25:16.329642 run srsepc(pid=18127): stderr: | (launched: 2022-12-09_03:25:14.256546) | Connection to 10.42.42.116 closed. 03:25:16.490068 run rm-remote-dir(pid=18128): Terminating (SIGINT) 03:25:16.675230 run rm-remote-dir(pid=18128): Terminated: ok {rc=0} 03:25:16.810595 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=18127): Process ended prematurely: srsepc(pid=18127) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18127)] [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 03:25:16.821872 tst rrc_idle_mt_ping.py:16: Test FAILED (18.5 sec) 03:25:16.904167 run scp-back-log(pid=18129): Launched 03:25:18.043281 run scp-back-log(pid=18129): ERR: Terminated: ERROR {rc=1} [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18129)] 03:25:18.105429 run scp-back-log(pid=18129): stdout: | (launched: 2022-12-09_03:25:16.873082) 03:25:18.168818 run scp-back-log(pid=18129): stderr: | (launched: 2022-12-09_03:25:16.893495) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:25:18.239513 tst srsepc_10.42.42.118: Error('scp-back-log(pid=18129): launch_sync(): local process exited with status 1 [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=18129)]') --------------------------------------------------------------------- trial-2353 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 03:25:18.371522 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:18.376651 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 03:25:18.419051 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 03:25:18.446219 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 03:25:18.499395 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 03:25:18.543351 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 03:25:18.570652 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 03:25:19.117623 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 03:25:19.125170 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:25:19.136847 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 03:25:19.176030 tst handover.py: using LAC 18726 03:25:19.306798 tst handover.py: using RAC 111 03:25:19.441375 tst handover.py: using CellId 18726 03:25:19.573276 tst handover.py: using BVCI 18727 03:25:19.695187 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 03:25:19.729466 tst handover.py: using LAC 18727 03:25:19.858818 tst handover.py: using RAC 112 03:25:19.986179 tst handover.py: using CellId 18727 03:25:20.113624 tst handover.py: using BVCI 18728 03:25:20.226400 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:25:20.237582 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:25:20.248585 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:25:20.260038 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:25:20.271599 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:25:20.283009 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 03:25:20.406089 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 03:25:20.527377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:21.038700 run create_hlr_db(pid=18134): Launched 03:25:22.224361 run create_hlr_db(pid=18134): Terminated: ok {rc=0} 03:25:22.570787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18136): Launched 03:25:22.900842 run osmo-hlr_10.42.42.2(pid=18137): Launched 03:25:23.027224 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:23.594356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18139): Launched 03:25:23.922650 run osmo-stp_10.42.42.5(pid=18140): Launched 03:25:24.048435 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:24.643336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18142): Launched 03:25:24.971889 run osmo-msc_10.42.42.6(pid=18143): Launched 03:25:25.156124 run osmo-stp_10.42.42.5(pid=18140): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18140)] 03:25:25.315287 run osmo-stp_10.42.42.5(pid=18140): stdout: | (launched: 2022-12-09_03:25:23.862585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:25.454185 run osmo-stp_10.42.42.5(pid=18140): stderr: | 20221209032524054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032524054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032524055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032524055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032524055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032524055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032524056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:25.591071 run osmo-stp_10.42.42.5(pid=18140): stdout: | (launched: 2022-12-09_03:25:23.862585) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:25.721295 run osmo-stp_10.42.42.5(pid=18140): stderr: | 20221209032524054 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032524054 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032524055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032524055 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032524055 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032524055 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032524056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:25.877259 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18140): Process ended prematurely: osmo-stp_10.42.42.5(pid=18140) [trial-2353↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18140)] [trial-2353↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 03:25:25.886218 tst handover.py:18: Test FAILED (6.8 sec) 03:25:25.913628 run osmo-hlr_10.42.42.2(pid=18137): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18137)] 03:25:25.963965 run osmo-hlr_10.42.42.2(pid=18137): stdout: | (launched: 2022-12-09_03:25:22.840674) 03:25:26.015927 run osmo-hlr_10.42.42.2(pid=18137): stderr: | 20221209032523041 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032523041 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032523041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032523041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032523041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032523041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032523054 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032523062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032523062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032523062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:26.089221 run osmo-msc_10.42.42.6(pid=18143): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18143)] 03:25:26.139218 run osmo-msc_10.42.42.6(pid=18143): stdout: | (launched: 2022-12-09_03:25:24.911959) 03:25:26.190903 run osmo-msc_10.42.42.6(pid=18143): stderr: | 20221209032525235 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032525235 DLGLOBAL DEBUG validating counter group 0x7f53f96bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032525235 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032525235 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032525235 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032525235 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032525237 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032525237 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032525238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032525238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:26.242678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18136): Terminating (SIGTERM) 03:25:26.284243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18139): Terminating (SIGTERM) 03:25:26.326012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18142): Terminating (SIGTERM) 03:25:26.367850 --- ParallelTerminationStrategy: PID 18136 died... 03:25:26.387303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18136): Terminated: ok {rc=0} 03:25:26.433350 --- ParallelTerminationStrategy: PID 18139 died... 03:25:26.452654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18139): Terminated: ok {rc=0} 03:25:26.498541 --- ParallelTerminationStrategy: PID 18142 died... 03:25:26.518014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18142): Terminated: ok {rc=0} 03:25:26.605295 bus /sierra_3: Setting Powered False 03:25:27.706038 bus /sierra_3: Setting Powered False 03:25:28.823318 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 03:25:30.071561 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:30.077324 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 03:25:30.119523 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 03:25:30.147473 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 03:25:30.203788 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 03:25:30.244884 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 03:25:30.272531 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 03:25:30.825635 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 03:25:30.831576 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:25:30.844718 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 03:25:30.895547 tst handover.py: using LAC 18728 03:25:31.039844 tst handover.py: using RAC 113 03:25:31.200665 tst handover.py: using CellId 18728 03:25:31.327733 tst handover.py: using BVCI 18729 03:25:31.445252 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 03:25:31.481424 tst handover.py: using LAC 18729 03:25:31.614016 tst handover.py: using RAC 114 03:25:31.781287 tst handover.py: using CellId 18729 03:25:31.905152 tst handover.py: using BVCI 18730 03:25:32.068051 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:25:32.084579 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:25:32.102399 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:25:32.119867 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:25:32.137962 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:25:32.155276 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 03:25:32.290981 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 03:25:32.418695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:32.901722 run create_hlr_db(pid=18150): Launched 03:25:33.027518 bus /sierra_2: Setting Powered False 03:25:34.092621 run create_hlr_db(pid=18150): Terminated: ok {rc=0} 03:25:34.507093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18152): Launched 03:25:34.817619 run osmo-hlr_10.42.42.2(pid=18153): Launched 03:25:34.935403 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:35.442748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18155): Launched 03:25:35.751669 run osmo-stp_10.42.42.5(pid=18156): Launched 03:25:35.870052 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:36.402887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18158): Launched 03:25:36.734930 run osmo-msc_10.42.42.6(pid=18159): Launched 03:25:36.920368 run osmo-stp_10.42.42.5(pid=18156): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18156)] 03:25:37.061473 run osmo-stp_10.42.42.5(pid=18156): stdout: | (launched: 2022-12-09_03:25:35.694478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:37.202064 run osmo-stp_10.42.42.5(pid=18156): stderr: | 20221209032535868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032535868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032535868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032535869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032535869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032535869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032535870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:37.340252 run osmo-stp_10.42.42.5(pid=18156): stdout: | (launched: 2022-12-09_03:25:35.694478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:37.471661 run osmo-stp_10.42.42.5(pid=18156): stderr: | 20221209032535868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032535868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032535868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032535869 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032535869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032535869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032535870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:37.629219 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18156): Process ended prematurely: osmo-stp_10.42.42.5(pid=18156) [trial-2353↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18156)] [trial-2353↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 03:25:37.638260 tst handover.py:18: Test FAILED (6.8 sec) 03:25:37.666365 run osmo-hlr_10.42.42.2(pid=18153): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18153)] 03:25:37.716727 run osmo-hlr_10.42.42.2(pid=18153): stdout: | (launched: 2022-12-09_03:25:34.759540) 03:25:37.768402 run osmo-hlr_10.42.42.2(pid=18153): stderr: | 20221209032534938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032534938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032534938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032534938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032534938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032534938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032534951 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032534962 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032534962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032534962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:37.841107 run osmo-msc_10.42.42.6(pid=18159): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18159)] 03:25:37.891334 run osmo-msc_10.42.42.6(pid=18159): stdout: | (launched: 2022-12-09_03:25:36.674983) 03:25:37.943200 run osmo-msc_10.42.42.6(pid=18159): stderr: | 20221209032536997 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032536997 DLGLOBAL DEBUG validating counter group 0x7f308b2fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032536998 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032536998 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032536998 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032536998 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032537000 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032537000 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032537000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032537000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:37.995313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18152): Terminating (SIGTERM) 03:25:38.037609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18155): Terminating (SIGTERM) 03:25:38.079682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18158): Terminating (SIGTERM) 03:25:38.122148 --- ParallelTerminationStrategy: PID 18152 died... 03:25:38.142042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18152): Terminated: ok {rc=0} 03:25:38.188667 --- ParallelTerminationStrategy: PID 18155 died... 03:25:38.208213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18155): Terminated: ok {rc=0} 03:25:38.255224 --- ParallelTerminationStrategy: PID 18158 died... 03:25:38.274722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18158): Terminated: ok {rc=0} 03:25:38.362275 bus /sierra_3: Setting Powered False 03:25:39.461975 bus /sierra_3: Setting Powered False 03:25:40.580480 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 03:25:41.830513 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:41.836045 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 03:25:41.908809 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 03:25:41.945963 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 03:25:41.998564 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 03:25:42.051841 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 03:25:42.078533 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 03:25:42.630212 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 03:25:42.635848 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:42.646983 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:25:42.685184 tst handover.py: using LAC 18730 03:25:42.807294 tst handover.py: using RAC 115 03:25:42.930727 tst handover.py: using CellId 18730 03:25:43.053856 tst handover.py: using BVCI 18731 03:25:43.168296 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:25:43.217398 tst handover.py: using LAC 18731 03:25:43.338989 tst handover.py: using RAC 116 03:25:43.465372 tst handover.py: using CellId 18731 03:25:43.586469 tst handover.py: using BVCI 18732 03:25:43.700260 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:43.711482 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:43.722506 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:43.733729 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:43.744920 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:43.756148 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:25:43.875378 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:25:43.997967 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:44.480463 run create_hlr_db(pid=18164): Launched 03:25:44.606241 bus /sierra_2: Setting Powered False 03:25:45.671258 run create_hlr_db(pid=18164): Terminated: ok {rc=0} 03:25:46.104901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18166): Launched 03:25:46.441672 run osmo-hlr_10.42.42.2(pid=18167): Launched 03:25:46.683586 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:47.354072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18169): Launched 03:25:47.683249 run osmo-stp_10.42.42.5(pid=18170): Launched 03:25:47.808855 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:48.376658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18172): Launched 03:25:48.706631 run osmo-msc_10.42.42.6(pid=18173): Launched 03:25:48.891382 run osmo-stp_10.42.42.5(pid=18170): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18170)] 03:25:49.030237 run osmo-stp_10.42.42.5(pid=18170): stdout: | (launched: 2022-12-09_03:25:47.622967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:49.171228 run osmo-stp_10.42.42.5(pid=18170): stderr: | 20221209032547816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032547816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032547816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032547816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032547817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032547817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032547817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:49.308573 run osmo-stp_10.42.42.5(pid=18170): stdout: | (launched: 2022-12-09_03:25:47.622967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:49.439457 run osmo-stp_10.42.42.5(pid=18170): stderr: | 20221209032547816 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032547816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032547816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032547816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032547817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032547817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032547817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:49.596365 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18170): Process ended prematurely: osmo-stp_10.42.42.5(pid=18170) [trial-2353↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18170)] [trial-2353↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 03:25:49.605160 tst handover.py:18: Test FAILED (7.0 sec) 03:25:49.632576 run osmo-hlr_10.42.42.2(pid=18167): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18167)] 03:25:49.682933 run osmo-hlr_10.42.42.2(pid=18167): stdout: | (launched: 2022-12-09_03:25:46.378494) 03:25:49.734776 run osmo-hlr_10.42.42.2(pid=18167): stderr: | 20221209032546723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032546723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032546723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032546723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032546723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032546723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032546746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032546754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032546754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032546754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:49.806765 run osmo-msc_10.42.42.6(pid=18173): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18173)] 03:25:49.856810 run osmo-msc_10.42.42.6(pid=18173): stdout: | (launched: 2022-12-09_03:25:48.646817) 03:25:49.908416 run osmo-msc_10.42.42.6(pid=18173): stderr: | 20221209032548968 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032548968 DLGLOBAL DEBUG validating counter group 0x7f843058ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032548969 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032548969 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032548969 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032548969 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032548971 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032548971 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032548971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032548971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:49.960352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18166): Terminating (SIGTERM) 03:25:50.002122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18169): Terminating (SIGTERM) 03:25:50.043916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18172): Terminating (SIGTERM) 03:25:50.086299 --- ParallelTerminationStrategy: PID 18166 died... 03:25:50.106190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18166): Terminated: ok {rc=0} 03:25:50.152441 --- ParallelTerminationStrategy: PID 18169 died... 03:25:50.171862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18169): Terminated: ok {rc=0} 03:25:50.217952 --- ParallelTerminationStrategy: PID 18172 died... 03:25:50.237249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18172): Terminated: ok {rc=0} 03:25:50.325404 bus /sierra_3: Setting Powered False 03:25:51.424763 bus /sierra_3: Setting Powered False 03:25:52.541104 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 03:25:53.799229 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:53.804278 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 03:25:53.854287 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:25:53.881097 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:25:53.933657 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 03:25:53.984257 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:25:54.010916 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:25:54.563182 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 03:25:54.568634 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:54.579899 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:25:54.617680 tst handover.py: using LAC 18732 03:25:54.739016 tst handover.py: using RAC 117 03:25:54.861751 tst handover.py: using CellId 18732 03:25:54.984494 tst handover.py: using BVCI 18733 03:25:55.097814 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:25:55.145280 tst handover.py: using LAC 18733 03:25:55.266355 tst handover.py: using RAC 118 03:25:55.386467 tst handover.py: using CellId 18733 03:25:55.513089 tst handover.py: using BVCI 18734 03:25:55.625543 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:55.636622 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:55.647646 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:55.658639 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:55.669654 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:55.680596 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:25:55.797857 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:25:55.915879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:56.365626 run create_hlr_db(pid=18178): Launched 03:25:56.490836 bus /sierra_2: Setting Powered False 03:25:57.551743 run create_hlr_db(pid=18178): Terminated: ok {rc=0} 03:25:57.971494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18180): Launched 03:25:58.301345 run osmo-hlr_10.42.42.2(pid=18181): Launched 03:25:58.429580 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:58.969263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18183): Launched 03:25:59.299769 run osmo-stp_10.42.42.5(pid=18184): Launched 03:25:59.425215 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:59.996548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18186): Launched 03:26:00.326895 run osmo-msc_10.42.42.6(pid=18187): Launched 03:26:00.511465 run osmo-stp_10.42.42.5(pid=18184): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18184)] 03:26:00.651757 run osmo-stp_10.42.42.5(pid=18184): stdout: | (launched: 2022-12-09_03:25:59.239828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:00.791437 run osmo-stp_10.42.42.5(pid=18184): stderr: | 20221209032559432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032559432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032559432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032559433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032559435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032559435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032559435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:00.938823 run osmo-stp_10.42.42.5(pid=18184): stdout: | (launched: 2022-12-09_03:25:59.239828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:01.072897 run osmo-stp_10.42.42.5(pid=18184): stderr: | 20221209032559432 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032559432 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032559432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032559433 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032559435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032559435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032559435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:01.235270 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18184): Process ended prematurely: osmo-stp_10.42.42.5(pid=18184) [trial-2353↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18184)] [trial-2353↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 03:26:01.245097 tst handover.py:18: Test FAILED (6.7 sec) 03:26:01.275466 run osmo-hlr_10.42.42.2(pid=18181): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18181)] 03:26:01.327978 run osmo-hlr_10.42.42.2(pid=18181): stdout: | (launched: 2022-12-09_03:25:58.241408) 03:26:01.382393 run osmo-hlr_10.42.42.2(pid=18181): stderr: | 20221209032558440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032558440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032558440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032558440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032558440 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032558440 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032558452 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032558460 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032558461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032558461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:01.456808 run osmo-msc_10.42.42.6(pid=18187): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18187)] 03:26:01.509196 run osmo-msc_10.42.42.6(pid=18187): stdout: | (launched: 2022-12-09_03:26:00.267032) 03:26:01.563471 run osmo-msc_10.42.42.6(pid=18187): stderr: | 20221209032600592 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032600592 DLGLOBAL DEBUG validating counter group 0x7f5c00ca1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032600592 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032600592 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032600592 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032600593 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032600594 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032600595 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032600595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032600595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:01.617780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18180): Terminating (SIGTERM) 03:26:01.661993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18183): Terminating (SIGTERM) 03:26:01.706479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18186): Terminating (SIGTERM) 03:26:01.752262 --- ParallelTerminationStrategy: PID 18180 died... 03:26:01.772863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18180): Terminated: ok {rc=0} 03:26:01.822349 --- ParallelTerminationStrategy: PID 18183 died... 03:26:01.843215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18183): Terminated: ok {rc=0} 03:26:01.892870 --- ParallelTerminationStrategy: PID 18186 died... 03:26:01.913405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18186): Terminated: ok {rc=0} 03:26:02.004298 bus /sierra_3: Setting Powered False 03:26:03.104916 bus /sierra_3: Setting Powered False 03:26:04.222639 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:26:05.479485 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:05.484729 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:26:05.538735 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:26:05.565888 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:26:05.619172 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:26:05.673542 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:26:05.700271 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:26:06.251433 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:26:06.256604 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:26:06.267768 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:26:06.305784 tst handover.py: using LAC 18734 03:26:06.430344 tst handover.py: using RAC 119 03:26:06.551084 tst handover.py: using CellId 18734 03:26:06.672354 tst handover.py: using BVCI 18735 03:26:06.795142 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:26:06.844332 tst handover.py: using LAC 18735 03:26:06.972324 tst handover.py: using RAC 120 03:26:07.101090 tst handover.py: using CellId 18735 03:26:07.229402 tst handover.py: using BVCI 18736 03:26:07.350501 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:26:07.362436 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:26:07.373961 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:26:07.385766 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:26:07.397534 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:26:07.409219 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:26:07.531232 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:26:07.653122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:08.136281 run create_hlr_db(pid=18192): Launched 03:26:08.261813 bus /sierra_2: Setting Powered False 03:26:09.326553 run create_hlr_db(pid=18192): Terminated: ok {rc=0} 03:26:09.739652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18194): Launched 03:26:10.047421 run osmo-hlr_10.42.42.2(pid=18195): Launched 03:26:10.166145 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:10.670389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18197): Launched 03:26:10.978070 run osmo-stp_10.42.42.5(pid=18198): Launched 03:26:11.095591 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:11.626136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18200): Launched 03:26:11.933646 run osmo-msc_10.42.42.6(pid=18201): Launched 03:26:12.105296 run osmo-stp_10.42.42.5(pid=18198): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18198)] 03:26:12.234928 run osmo-stp_10.42.42.5(pid=18198): stdout: | (launched: 2022-12-09_03:26:10.921422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:12.363506 run osmo-stp_10.42.42.5(pid=18198): stderr: | 20221209032611093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032611093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032611093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032611094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032611096 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032611096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032611096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:12.490664 run osmo-stp_10.42.42.5(pid=18198): stdout: | (launched: 2022-12-09_03:26:10.921422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:12.612117 run osmo-stp_10.42.42.5(pid=18198): stderr: | 20221209032611093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032611093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032611093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032611094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032611096 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032611096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032611096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:12.757807 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18198): Process ended prematurely: osmo-stp_10.42.42.5(pid=18198) [trial-2353↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18198)] [trial-2353↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 03:26:12.766104 tst handover.py:18: Test FAILED (6.5 sec) 03:26:12.792130 run osmo-hlr_10.42.42.2(pid=18195): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18195)] 03:26:12.839825 run osmo-hlr_10.42.42.2(pid=18195): stdout: | (launched: 2022-12-09_03:26:09.991328) 03:26:12.889341 run osmo-hlr_10.42.42.2(pid=18195): stderr: | 20221209032610170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032610170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032610170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032610170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032610171 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032610171 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032610213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032610224 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032610224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032610224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:12.958246 run osmo-msc_10.42.42.6(pid=18201): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18201)] 03:26:13.006007 run osmo-msc_10.42.42.6(pid=18201): stdout: | (launched: 2022-12-09_03:26:11.877180) 03:26:13.055263 run osmo-msc_10.42.42.6(pid=18201): stderr: | 20221209032612149 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032612149 DLGLOBAL DEBUG validating counter group 0x7f1673468c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032612149 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032612149 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032612150 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032612150 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032612153 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032612154 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032612154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032612154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:13.105061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18194): Terminating (SIGTERM) 03:26:13.144355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18197): Terminating (SIGTERM) 03:26:13.183734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18200): Terminating (SIGTERM) 03:26:13.223495 --- ParallelTerminationStrategy: PID 18194 died... 03:26:13.242600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18194): Terminated: ok {rc=0} 03:26:13.287533 --- ParallelTerminationStrategy: PID 18197 died... 03:26:13.306139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18197): Terminated: ok {rc=0} 03:26:13.350417 --- ParallelTerminationStrategy: PID 18200 died... 03:26:13.369036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18200): Terminated: ok {rc=0} 03:26:13.452043 bus /sierra_3: Setting Powered False 03:26:14.547150 bus /sierra_3: Setting Powered False 03:26:15.663228 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 03:26:16.929288 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:16.940120 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:26:16.996649 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:26:17.024801 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:26:17.081175 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:26:17.145536 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:26:17.172919 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:26:17.700629 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 03:26:17.706557 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:26:17.718140 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 03:26:17.759096 tst handover.py: using LAC 18736 03:26:17.888644 tst handover.py: using RAC 121 03:26:18.018417 tst handover.py: using CellId 18736 03:26:18.148750 tst handover.py: using BVCI 18737 03:26:18.269400 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 03:26:18.305291 tst handover.py: using LAC 18737 03:26:18.435376 tst handover.py: using RAC 122 03:26:18.566946 tst handover.py: using CellId 18737 03:26:18.696203 tst handover.py: using BVCI 18738 03:26:18.809448 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:26:18.820348 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:26:18.831198 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:26:18.842028 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:26:18.853296 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:26:18.864007 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 03:26:18.983321 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 03:26:19.103681 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:19.556130 run create_hlr_db(pid=18207): Launched 03:26:19.681636 bus /sierra_2: Setting Powered False 03:26:20.743006 run create_hlr_db(pid=18207): Terminated: ok {rc=0} 03:26:21.164177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18209): Launched 03:26:21.493218 run osmo-hlr_10.42.42.2(pid=18210): Launched 03:26:21.621754 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:22.164115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18212): Launched 03:26:22.493271 run osmo-stp_10.42.42.5(pid=18213): Launched 03:26:22.619512 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:23.185449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18215): Launched 03:26:23.516097 run osmo-msc_10.42.42.6(pid=18216): Launched 03:26:23.701355 run osmo-stp_10.42.42.5(pid=18213): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18213)] 03:26:23.840140 run osmo-stp_10.42.42.5(pid=18213): stdout: | (launched: 2022-12-09_03:26:22.433254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:23.979724 run osmo-stp_10.42.42.5(pid=18213): stderr: | 20221209032622628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032622628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032622628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032622628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032622629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032622629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032622629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:24.118305 run osmo-stp_10.42.42.5(pid=18213): stdout: | (launched: 2022-12-09_03:26:22.433254) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:24.249796 run osmo-stp_10.42.42.5(pid=18213): stderr: | 20221209032622628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032622628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032622628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032622628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032622629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032622629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032622629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:24.407009 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18213): Process ended prematurely: osmo-stp_10.42.42.5(pid=18213) [trial-2353↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18213)] [trial-2353↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 03:26:24.416119 tst handover.py:18: Test FAILED (6.7 sec) 03:26:24.444110 run osmo-hlr_10.42.42.2(pid=18210): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18210)] 03:26:24.494367 run osmo-hlr_10.42.42.2(pid=18210): stdout: | (launched: 2022-12-09_03:26:21.433642) 03:26:24.546428 run osmo-hlr_10.42.42.2(pid=18210): stderr: | 20221209032621631 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032621631 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032621631 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032621631 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032621631 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032621631 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032621649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032621659 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032621659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032621659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:24.619164 run osmo-msc_10.42.42.6(pid=18216): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18216)] 03:26:24.669339 run osmo-msc_10.42.42.6(pid=18216): stdout: | (launched: 2022-12-09_03:26:23.455990) 03:26:24.721204 run osmo-msc_10.42.42.6(pid=18216): stderr: | 20221209032623778 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032623778 DLGLOBAL DEBUG validating counter group 0x7fa4b25eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032623778 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032623778 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032623778 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032623779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032623780 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032623781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032623781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032623781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:24.773596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18209): Terminating (SIGTERM) 03:26:24.815548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18212): Terminating (SIGTERM) 03:26:24.857460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18215): Terminating (SIGTERM) 03:26:24.899528 --- ParallelTerminationStrategy: PID 18209 died... 03:26:24.919461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18209): Terminated: ok {rc=0} 03:26:24.966160 --- ParallelTerminationStrategy: PID 18212 died... 03:26:24.985744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18212): Terminated: ok {rc=0} 03:26:25.032069 --- ParallelTerminationStrategy: PID 18215 died... 03:26:25.051635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18215): Terminated: ok {rc=0} 03:26:25.141168 bus /sierra_3: Setting Powered False 03:26:26.240333 bus /sierra_3: Setting Powered False 03:26:27.356475 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 03:26:28.603119 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:28.608188 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:26:28.661711 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:26:28.688725 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:26:28.740034 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:26:28.792899 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:26:28.819473 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:26:29.372684 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 03:26:29.378167 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:26:29.389533 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:26:29.428406 tst handover.py: using LAC 18738 03:26:29.564078 tst handover.py: using RAC 123 03:26:29.686603 tst handover.py: using CellId 18738 03:26:29.808604 tst handover.py: using BVCI 18739 03:26:29.920858 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:26:29.971066 tst handover.py: using LAC 18739 03:26:30.090747 tst handover.py: using RAC 124 03:26:30.211824 tst handover.py: using CellId 18739 03:26:30.331791 tst handover.py: using BVCI 18740 03:26:30.443674 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:26:30.454653 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:26:30.465580 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:26:30.476330 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:26:30.487220 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:26:30.498217 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:26:30.615206 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:26:30.731373 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:31.203456 run create_hlr_db(pid=18221): Launched 03:26:31.366218 bus /sierra_2: Setting Powered False 03:26:32.427375 run create_hlr_db(pid=18221): Terminated: ok {rc=0} 03:26:32.848435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18223): Launched 03:26:33.179308 run osmo-hlr_10.42.42.2(pid=18224): Launched 03:26:33.307931 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:33.851127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18226): Launched 03:26:34.180659 run osmo-stp_10.42.42.5(pid=18227): Launched 03:26:34.307171 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:34.875329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18229): Launched 03:26:35.205879 run osmo-msc_10.42.42.6(pid=18230): Launched 03:26:35.390746 run osmo-stp_10.42.42.5(pid=18227): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18227)] 03:26:35.530033 run osmo-stp_10.42.42.5(pid=18227): stdout: | (launched: 2022-12-09_03:26:34.120292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:35.669638 run osmo-stp_10.42.42.5(pid=18227): stderr: | 20221209032634315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032634315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032634315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032634315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032634316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032634316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032634316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:35.807837 run osmo-stp_10.42.42.5(pid=18227): stdout: | (launched: 2022-12-09_03:26:34.120292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:35.939073 run osmo-stp_10.42.42.5(pid=18227): stderr: | 20221209032634315 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032634315 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032634315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032634315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032634316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032634316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032634316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:36.096684 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18227): Process ended prematurely: osmo-stp_10.42.42.5(pid=18227) [trial-2353↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18227)] [trial-2353↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 03:26:36.105687 tst handover.py:18: Test FAILED (6.7 sec) 03:26:36.133605 run osmo-hlr_10.42.42.2(pid=18224): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18224)] 03:26:36.183698 run osmo-hlr_10.42.42.2(pid=18224): stdout: | (launched: 2022-12-09_03:26:33.119360) 03:26:36.235484 run osmo-hlr_10.42.42.2(pid=18224): stderr: | 20221209032633320 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032633320 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032633320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032633320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032633320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032633320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032633335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032633343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032633343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032633344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:36.307517 run osmo-msc_10.42.42.6(pid=18230): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18230)] 03:26:36.357554 run osmo-msc_10.42.42.6(pid=18230): stdout: | (launched: 2022-12-09_03:26:35.145270) 03:26:36.409300 run osmo-msc_10.42.42.6(pid=18230): stderr: | 20221209032635468 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032635468 DLGLOBAL DEBUG validating counter group 0x7fe0ebc52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032635468 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032635469 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032635469 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032635469 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032635471 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032635471 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032635471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032635471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:36.461357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18223): Terminating (SIGTERM) 03:26:36.503091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18226): Terminating (SIGTERM) 03:26:36.545021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18229): Terminating (SIGTERM) 03:26:36.586950 --- ParallelTerminationStrategy: PID 18223 died... 03:26:36.606741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18223): Terminated: ok {rc=0} 03:26:36.653228 --- ParallelTerminationStrategy: PID 18226 died... 03:26:36.672527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18226): Terminated: ok {rc=0} 03:26:36.718590 --- ParallelTerminationStrategy: PID 18229 died... 03:26:36.737991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18229): Terminated: ok {rc=0} 03:26:36.826317 bus /sierra_3: Setting Powered False 03:26:37.925705 bus /sierra_3: Setting Powered False 03:26:39.043997 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 03:26:40.312326 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:40.318520 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:26:40.373659 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:26:40.401111 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:26:40.455737 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:26:40.511147 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:26:40.539022 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:26:41.089784 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 03:26:41.096415 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:41.108444 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:26:41.146144 tst handover.py: using LAC 18740 03:26:41.269141 tst handover.py: using RAC 125 03:26:41.390549 tst handover.py: using CellId 18740 03:26:41.514281 tst handover.py: using BVCI 18741 03:26:41.628891 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:26:41.682338 tst handover.py: using LAC 18741 03:26:41.804893 tst handover.py: using RAC 126 03:26:41.924925 tst handover.py: using CellId 18741 03:26:42.049497 tst handover.py: using BVCI 18742 03:26:42.163339 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:42.174420 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:42.185272 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:42.196217 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:42.207268 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:42.218270 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:26:42.337974 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:26:42.456714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:42.907779 run create_hlr_db(pid=18235): Launched 03:26:43.033737 bus /sierra_2: Setting Powered False 03:26:44.095255 run create_hlr_db(pid=18235): Terminated: ok {rc=0} 03:26:44.516381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18237): Launched 03:26:44.846800 run osmo-hlr_10.42.42.2(pid=18238): Launched 03:26:44.972539 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:45.515394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18240): Launched 03:26:45.861681 run osmo-stp_10.42.42.5(pid=18241): Launched 03:26:46.138058 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:46.813474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18243): Launched 03:26:47.212852 run osmo-msc_10.42.42.6(pid=18244): Launched 03:26:47.431433 run osmo-stp_10.42.42.5(pid=18241): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18241)] 03:26:47.565700 run osmo-stp_10.42.42.5(pid=18241): stdout: | (launched: 2022-12-09_03:26:45.786868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:47.698149 run osmo-stp_10.42.42.5(pid=18241): stderr: | 20221209032646083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032646083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032646084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032646085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032646087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032646087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032646087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:47.826792 run osmo-stp_10.42.42.5(pid=18241): stdout: | (launched: 2022-12-09_03:26:45.786868) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:47.950326 run osmo-stp_10.42.42.5(pid=18241): stderr: | 20221209032646083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032646083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032646084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032646085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032646087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032646087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032646087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:48.097448 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18241): Process ended prematurely: osmo-stp_10.42.42.5(pid=18241) [trial-2353↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18241)] [trial-2353↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 03:26:48.106022 tst handover.py:18: Test FAILED (7.0 sec) 03:26:48.132352 run osmo-hlr_10.42.42.2(pid=18238): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18238)] 03:26:48.180252 run osmo-hlr_10.42.42.2(pid=18238): stdout: | (launched: 2022-12-09_03:26:44.786527) 03:26:48.230219 run osmo-hlr_10.42.42.2(pid=18238): stderr: | 20221209032644986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032644986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032644987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032644987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032644987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032644987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032644999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032645007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032645007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032645008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:48.299210 run osmo-msc_10.42.42.6(pid=18244): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18244)] 03:26:48.347280 run osmo-msc_10.42.42.6(pid=18244): stdout: | (launched: 2022-12-09_03:26:47.155067) 03:26:48.397279 run osmo-msc_10.42.42.6(pid=18244): stderr: | 20221209032647495 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032647496 DLGLOBAL DEBUG validating counter group 0x7fb930685c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032647496 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032647496 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032647496 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032647496 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032647500 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032647500 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032647500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032647500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:48.447471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18237): Terminating (SIGTERM) 03:26:48.487165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18240): Terminating (SIGTERM) 03:26:48.527114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18243): Terminating (SIGTERM) 03:26:48.567253 --- ParallelTerminationStrategy: PID 18237 died... 03:26:48.586601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18237): Terminated: ok {rc=0} 03:26:48.630870 --- ParallelTerminationStrategy: PID 18240 died... 03:26:48.649570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18240): Terminated: ok {rc=0} 03:26:48.693765 --- ParallelTerminationStrategy: PID 18243 died... 03:26:48.712645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18243): Terminated: ok {rc=0} 03:26:48.799082 bus /sierra_3: Setting Powered False 03:26:49.899944 bus /sierra_3: Setting Powered False 03:26:51.016767 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 03:26:52.279052 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:52.284177 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 03:26:52.321104 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 03:26:52.347785 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 03:26:52.400273 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 03:26:52.437283 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 03:26:52.464205 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 03:26:53.019085 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 03:26:53.024517 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:53.036058 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 03:26:53.071055 tst handover.py: using LAC 18742 03:26:53.200398 tst handover.py: using RAC 127 03:26:53.329794 tst handover.py: using CellId 18742 03:26:53.460644 tst handover.py: using BVCI 18743 03:26:53.581223 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 03:26:53.619235 tst handover.py: using LAC 18743 03:26:53.746762 tst handover.py: using RAC 128 03:26:53.874524 tst handover.py: using CellId 18743 03:26:54.002254 tst handover.py: using BVCI 18744 03:26:54.123308 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:54.134718 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:54.146042 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:54.158316 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:54.169951 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:54.181718 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 03:26:54.302623 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 03:26:54.422800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:54.877567 run create_hlr_db(pid=18250): Launched 03:26:55.004227 bus /sierra_2: Setting Powered False 03:26:56.070175 run create_hlr_db(pid=18250): Terminated: ok {rc=0} 03:26:56.501311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18252): Launched 03:26:56.832548 run osmo-hlr_10.42.42.2(pid=18253): Launched 03:26:56.959681 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:57.500332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18255): Launched 03:26:57.831256 run osmo-stp_10.42.42.5(pid=18256): Launched 03:26:57.958282 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:58.527059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18258): Launched 03:26:58.858691 run osmo-msc_10.42.42.6(pid=18259): Launched 03:26:59.044903 run osmo-stp_10.42.42.5(pid=18256): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18256)] 03:26:59.188401 run osmo-stp_10.42.42.5(pid=18256): stdout: | (launched: 2022-12-09_03:26:57.770862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:59.324137 run osmo-stp_10.42.42.5(pid=18256): stderr: | 20221209032657966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032657967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032657967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032657967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032657968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032657968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032657968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:59.461894 run osmo-stp_10.42.42.5(pid=18256): stdout: | (launched: 2022-12-09_03:26:57.770862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:59.593668 run osmo-stp_10.42.42.5(pid=18256): stderr: | 20221209032657966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032657967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032657967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032657967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032657968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032657968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032657968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:59.751525 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18256): Process ended prematurely: osmo-stp_10.42.42.5(pid=18256) [trial-2353↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18256)] [trial-2353↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 03:26:59.760672 tst handover.py:18: Test FAILED (6.7 sec) 03:26:59.788654 run osmo-hlr_10.42.42.2(pid=18253): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18253)] 03:26:59.839254 run osmo-hlr_10.42.42.2(pid=18253): stdout: | (launched: 2022-12-09_03:26:56.772207) 03:26:59.891687 run osmo-hlr_10.42.42.2(pid=18253): stderr: | 20221209032656972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032656972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032656972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032656972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032656972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032656972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032656995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032657005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032657005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032657005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:59.964060 run osmo-msc_10.42.42.6(pid=18259): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18259)] 03:27:00.014436 run osmo-msc_10.42.42.6(pid=18259): stdout: | (launched: 2022-12-09_03:26:58.798545) 03:27:00.066209 run osmo-msc_10.42.42.6(pid=18259): stderr: | 20221209032659123 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032659123 DLGLOBAL DEBUG validating counter group 0x7f3f82109c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032659123 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032659123 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032659123 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032659123 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032659125 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032659125 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032659126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032659126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:00.118784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18252): Terminating (SIGTERM) 03:27:00.160763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18255): Terminating (SIGTERM) 03:27:00.202753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18258): Terminating (SIGTERM) 03:27:00.244936 --- ParallelTerminationStrategy: PID 18252 died... 03:27:00.265058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18252): Terminated: ok {rc=0} 03:27:00.311810 --- ParallelTerminationStrategy: PID 18255 died... 03:27:00.331393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18255): Terminated: ok {rc=0} 03:27:00.377862 --- ParallelTerminationStrategy: PID 18258 died... 03:27:00.397444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18258): Terminated: ok {rc=0} 03:27:00.486162 bus /sierra_3: Setting Powered False 03:27:01.586482 bus /sierra_3: Setting Powered False 03:27:02.704905 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 03:27:03.950843 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:03.956038 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 03:27:04.006588 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 03:27:04.033298 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 03:27:04.083728 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 03:27:04.134146 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 03:27:04.160757 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 03:27:04.719143 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 03:27:04.724144 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:04.735010 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:27:04.769375 tst handover.py: using LAC 18744 03:27:04.889128 tst handover.py: using RAC 129 03:27:05.009048 tst handover.py: using CellId 18744 03:27:05.129383 tst handover.py: using BVCI 18745 03:27:05.243452 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:27:05.290850 tst handover.py: using LAC 18745 03:27:05.412942 tst handover.py: using RAC 130 03:27:05.533341 tst handover.py: using CellId 18745 03:27:05.656118 tst handover.py: using BVCI 18746 03:27:05.770939 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:05.782077 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:05.792722 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:05.803404 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:05.814201 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:05.824866 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:27:05.943869 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:27:06.063424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:06.518133 run create_hlr_db(pid=18264): Launched 03:27:06.647035 bus /sierra_2: Setting Powered False 03:27:07.710111 run create_hlr_db(pid=18264): Terminated: ok {rc=0} 03:27:08.133399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18266): Launched 03:27:08.464537 run osmo-hlr_10.42.42.2(pid=18267): Launched 03:27:08.592346 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:09.132680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18269): Launched 03:27:09.462170 run osmo-stp_10.42.42.5(pid=18270): Launched 03:27:09.591220 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:10.159642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18272): Launched 03:27:10.490756 run osmo-msc_10.42.42.6(pid=18273): Launched 03:27:10.678494 run osmo-stp_10.42.42.5(pid=18270): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18270)] 03:27:10.818668 run osmo-stp_10.42.42.5(pid=18270): stdout: | (launched: 2022-12-09_03:27:09.402278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:10.959341 run osmo-stp_10.42.42.5(pid=18270): stderr: | 20221209032709596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032709596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032709596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032709597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032709597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032709597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032709597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:11.098489 run osmo-stp_10.42.42.5(pid=18270): stdout: | (launched: 2022-12-09_03:27:09.402278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:11.230317 run osmo-stp_10.42.42.5(pid=18270): stderr: | 20221209032709596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032709596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032709596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032709597 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032709597 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032709597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032709597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:11.387810 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18270): Process ended prematurely: osmo-stp_10.42.42.5(pid=18270) [trial-2353↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18270)] [trial-2353↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 03:27:11.396933 tst handover.py:18: Test FAILED (6.7 sec) 03:27:11.425060 run osmo-hlr_10.42.42.2(pid=18267): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18267)] 03:27:11.475404 run osmo-hlr_10.42.42.2(pid=18267): stdout: | (launched: 2022-12-09_03:27:08.404481) 03:27:11.527297 run osmo-hlr_10.42.42.2(pid=18267): stderr: | 20221209032708606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032708606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032708606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032708606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032708606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032708606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032708648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032708657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032708657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032708657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:11.599720 run osmo-msc_10.42.42.6(pid=18273): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18273)] 03:27:11.649840 run osmo-msc_10.42.42.6(pid=18273): stdout: | (launched: 2022-12-09_03:27:10.430413) 03:27:11.701490 run osmo-msc_10.42.42.6(pid=18273): stderr: | 20221209032710753 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032710753 DLGLOBAL DEBUG validating counter group 0x7f076a1f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032710753 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032710753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032710754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032710754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032710755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032710756 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032710756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032710756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:11.753766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18266): Terminating (SIGTERM) 03:27:11.795471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18269): Terminating (SIGTERM) 03:27:11.837368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18272): Terminating (SIGTERM) 03:27:11.879537 --- ParallelTerminationStrategy: PID 18266 died... 03:27:11.899668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18266): Terminated: ok {rc=0} 03:27:11.946541 --- ParallelTerminationStrategy: PID 18269 died... 03:27:11.966155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18269): Terminated: ok {rc=0} 03:27:12.012742 --- ParallelTerminationStrategy: PID 18272 died... 03:27:12.032500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18272): Terminated: ok {rc=0} 03:27:12.120593 bus /sierra_3: Setting Powered False 03:27:13.218970 bus /sierra_3: Setting Powered False 03:27:14.337271 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 03:27:15.596056 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:15.601590 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 03:27:15.649400 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:27:15.676691 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:27:15.729136 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 03:27:15.776750 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:27:15.804143 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:27:16.360843 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 03:27:16.367964 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:27:16.380601 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:27:16.419941 tst handover.py: using LAC 18746 03:27:16.545172 tst handover.py: using RAC 131 03:27:16.670628 tst handover.py: using CellId 18746 03:27:16.805363 tst handover.py: using BVCI 18747 03:27:16.933969 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:27:16.980901 tst handover.py: using LAC 18747 03:27:17.117618 tst handover.py: using RAC 132 03:27:17.256084 tst handover.py: using CellId 18747 03:27:17.386537 tst handover.py: using BVCI 18748 03:27:17.509397 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:27:17.521123 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:27:17.532789 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:27:17.544620 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:27:17.556574 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:27:17.568625 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:27:17.687441 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:27:17.805538 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:18.260794 run create_hlr_db(pid=18278): Launched 03:27:18.388446 bus /sierra_2: Setting Powered False 03:27:19.450007 run create_hlr_db(pid=18278): Terminated: ok {rc=0} 03:27:19.874105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18280): Launched 03:27:20.206159 run osmo-hlr_10.42.42.2(pid=18281): Launched 03:27:20.334036 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:20.877400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18283): Launched 03:27:21.208217 run osmo-stp_10.42.42.5(pid=18284): Launched 03:27:21.334979 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:21.905115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18286): Launched 03:27:22.236276 run osmo-msc_10.42.42.6(pid=18287): Launched 03:27:22.421148 run osmo-stp_10.42.42.5(pid=18284): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18284)] 03:27:22.561156 run osmo-stp_10.42.42.5(pid=18284): stdout: | (launched: 2022-12-09_03:27:21.147853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:22.702490 run osmo-stp_10.42.42.5(pid=18284): stderr: | 20221209032721343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032721343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032721343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032721343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032721344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032721344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032721344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:22.841756 run osmo-stp_10.42.42.5(pid=18284): stdout: | (launched: 2022-12-09_03:27:21.147853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:22.973700 run osmo-stp_10.42.42.5(pid=18284): stderr: | 20221209032721343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032721343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032721343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032721343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032721344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032721344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032721344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:23.131771 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18284): Process ended prematurely: osmo-stp_10.42.42.5(pid=18284) [trial-2353↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18284)] [trial-2353↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 03:27:23.140704 tst handover.py:18: Test FAILED (6.8 sec) 03:27:23.168727 run osmo-hlr_10.42.42.2(pid=18281): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18281)] 03:27:23.219484 run osmo-hlr_10.42.42.2(pid=18281): stdout: | (launched: 2022-12-09_03:27:20.146080) 03:27:23.271686 run osmo-hlr_10.42.42.2(pid=18281): stderr: | 20221209032720348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032720348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032720348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032720348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032720348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032720348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032720361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032720370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032720370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032720370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:23.344325 run osmo-msc_10.42.42.6(pid=18287): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18287)] 03:27:23.394975 run osmo-msc_10.42.42.6(pid=18287): stdout: | (launched: 2022-12-09_03:27:22.175741) 03:27:23.447050 run osmo-msc_10.42.42.6(pid=18287): stderr: | 20221209032722501 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032722501 DLGLOBAL DEBUG validating counter group 0x7f061d468c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032722501 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032722501 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032722502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032722502 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032722503 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032722504 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032722504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032722504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:23.499791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18280): Terminating (SIGTERM) 03:27:23.541710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18283): Terminating (SIGTERM) 03:27:23.583560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18286): Terminating (SIGTERM) 03:27:23.625853 --- ParallelTerminationStrategy: PID 18280 died... 03:27:23.645914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18280): Terminated: ok {rc=0} 03:27:23.692681 --- ParallelTerminationStrategy: PID 18283 died... 03:27:23.712274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18283): Terminated: ok {rc=0} 03:27:23.758965 --- ParallelTerminationStrategy: PID 18286 died... 03:27:23.778621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18286): Terminated: ok {rc=0} 03:27:23.866716 bus /sierra_3: Setting Powered False 03:27:24.967585 bus /sierra_3: Setting Powered False 03:27:26.082590 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:27:27.342383 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:27.348942 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:27:27.400429 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:27:27.427412 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:27:27.479729 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:27:27.531066 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:27:27.557846 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:27:28.113631 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:27:28.119561 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:27:28.130813 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:27:28.165550 tst handover.py: using LAC 18748 03:27:28.296384 tst handover.py: using RAC 133 03:27:28.425790 tst handover.py: using CellId 18748 03:27:28.557777 tst handover.py: using BVCI 18749 03:27:28.680133 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:27:28.731047 tst handover.py: using LAC 18749 03:27:28.863024 tst handover.py: using RAC 134 03:27:28.995901 tst handover.py: using CellId 18749 03:27:29.125762 tst handover.py: using BVCI 18750 03:27:29.241546 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:27:29.252680 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:27:29.263769 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:27:29.275031 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:27:29.286422 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:27:29.297661 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:27:29.417671 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:27:29.539186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:29.992328 run create_hlr_db(pid=18292): Launched 03:27:30.118056 bus /sierra_2: Setting Powered False 03:27:31.182021 run create_hlr_db(pid=18292): Terminated: ok {rc=0} 03:27:31.622734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18294): Launched 03:27:31.977796 run osmo-hlr_10.42.42.2(pid=18295): Launched 03:27:32.181663 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:32.698244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18297): Launched 03:27:33.006560 run osmo-stp_10.42.42.5(pid=18298): Launched 03:27:33.125914 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:33.656736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18300): Launched 03:27:33.965560 run osmo-msc_10.42.42.6(pid=18301): Launched 03:27:34.138242 run osmo-stp_10.42.42.5(pid=18298): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18298)] 03:27:34.268065 run osmo-stp_10.42.42.5(pid=18298): stdout: | (launched: 2022-12-09_03:27:32.950168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:34.397444 run osmo-stp_10.42.42.5(pid=18298): stderr: | 20221209032733123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032733123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032733124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032733124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032733124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032733124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032733125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:34.525023 run osmo-stp_10.42.42.5(pid=18298): stdout: | (launched: 2022-12-09_03:27:32.950168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:34.647109 run osmo-stp_10.42.42.5(pid=18298): stderr: | 20221209032733123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032733123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032733124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032733124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032733124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032733124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032733125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:34.793233 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18298): Process ended prematurely: osmo-stp_10.42.42.5(pid=18298) [trial-2353↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18298)] [trial-2353↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 03:27:34.801600 tst handover.py:18: Test FAILED (6.7 sec) 03:27:34.828019 run osmo-hlr_10.42.42.2(pid=18295): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18295)] 03:27:34.875831 run osmo-hlr_10.42.42.2(pid=18295): stdout: | (launched: 2022-12-09_03:27:31.913898) 03:27:34.925439 run osmo-hlr_10.42.42.2(pid=18295): stderr: | 20221209032732193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032732193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032732193 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032732193 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032732193 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032732193 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032732209 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032732217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032732217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032732217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:34.993954 run osmo-msc_10.42.42.6(pid=18301): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18301)] 03:27:35.041330 run osmo-msc_10.42.42.6(pid=18301): stdout: | (launched: 2022-12-09_03:27:33.908738) 03:27:35.090111 run osmo-msc_10.42.42.6(pid=18301): stderr: | 20221209032734181 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032734182 DLGLOBAL DEBUG validating counter group 0x7f4b50bb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032734182 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032734182 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032734182 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032734182 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032734184 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032734184 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032734184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032734184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:35.139540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18294): Terminating (SIGTERM) 03:27:35.179090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18297): Terminating (SIGTERM) 03:27:35.218879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18300): Terminating (SIGTERM) 03:27:35.258770 --- ParallelTerminationStrategy: PID 18294 died... 03:27:35.277882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18294): Terminated: ok {rc=0} 03:27:35.322187 --- ParallelTerminationStrategy: PID 18297 died... 03:27:35.340795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18297): Terminated: ok {rc=0} 03:27:35.384656 --- ParallelTerminationStrategy: PID 18300 died... 03:27:35.403356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18300): Terminated: ok {rc=0} 03:27:35.487485 bus /sierra_3: Setting Powered False 03:27:36.586130 bus /sierra_3: Setting Powered False 03:27:37.705638 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 03:27:38.963908 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:38.968873 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:27:39.007527 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:27:39.034460 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:27:39.090606 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:27:39.129470 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:27:39.156207 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:27:39.701660 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 03:27:39.707049 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:39.717974 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 03:27:39.752383 tst handover.py: using LAC 18750 03:27:39.872241 tst handover.py: using RAC 135 03:27:39.993288 tst handover.py: using CellId 18750 03:27:40.115521 tst handover.py: using BVCI 18751 03:27:40.229664 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 03:27:40.263262 tst handover.py: using LAC 18751 03:27:40.383605 tst handover.py: using RAC 136 03:27:40.513274 tst handover.py: using CellId 18751 03:27:40.641659 tst handover.py: using BVCI 18752 03:27:40.754610 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:40.765676 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:40.776536 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:40.787630 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:40.798680 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:40.809714 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 03:27:40.930845 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 03:27:41.049619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:41.505292 run create_hlr_db(pid=18306): Launched 03:27:41.630891 bus /sierra_2: Setting Powered False 03:27:42.692313 run create_hlr_db(pid=18306): Terminated: ok {rc=0} 03:27:43.114513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18308): Launched 03:27:43.445034 run osmo-hlr_10.42.42.2(pid=18309): Launched 03:27:43.571548 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:44.116550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18311): Launched 03:27:44.446534 run osmo-stp_10.42.42.5(pid=18312): Launched 03:27:44.574979 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:45.144193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18314): Launched 03:27:45.476107 run osmo-msc_10.42.42.6(pid=18315): Launched 03:27:45.659976 run osmo-stp_10.42.42.5(pid=18312): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18312)] 03:27:45.801494 run osmo-stp_10.42.42.5(pid=18312): stdout: | (launched: 2022-12-09_03:27:44.386458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:46.035750 run osmo-stp_10.42.42.5(pid=18312): stderr: | 20221209032744579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032744580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032744580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032744580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032744582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032744583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032744583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:46.223968 run osmo-stp_10.42.42.5(pid=18312): stdout: | (launched: 2022-12-09_03:27:44.386458) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:46.359620 run osmo-stp_10.42.42.5(pid=18312): stderr: | 20221209032744579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032744580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032744580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032744580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032744582 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032744583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032744583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:46.521689 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18312): Process ended prematurely: osmo-stp_10.42.42.5(pid=18312) [trial-2353↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18312)] [trial-2353↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 03:27:46.532007 tst handover.py:18: Test FAILED (6.8 sec) 03:27:46.561992 run osmo-hlr_10.42.42.2(pid=18309): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18309)] 03:27:46.615683 run osmo-hlr_10.42.42.2(pid=18309): stdout: | (launched: 2022-12-09_03:27:43.384489) 03:27:46.670345 run osmo-hlr_10.42.42.2(pid=18309): stderr: | 20221209032743583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032743583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032743584 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032743584 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032743584 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032743584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032743596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032743605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032743605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032743605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:46.747643 run osmo-msc_10.42.42.6(pid=18315): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18315)] 03:27:46.800093 run osmo-msc_10.42.42.6(pid=18315): stdout: | (launched: 2022-12-09_03:27:45.415804) 03:27:46.854542 run osmo-msc_10.42.42.6(pid=18315): stderr: | 20221209032745739 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032745739 DLGLOBAL DEBUG validating counter group 0x7f2c6dae8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032745739 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032745739 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032745739 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032745739 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032745741 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032745741 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032745742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032745742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:46.910185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18308): Terminating (SIGTERM) 03:27:46.956021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18311): Terminating (SIGTERM) 03:27:47.000609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18314): Terminating (SIGTERM) 03:27:47.044938 --- ParallelTerminationStrategy: PID 18308 died... 03:27:47.065697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18308): Terminated: ok {rc=0} 03:27:47.116845 --- ParallelTerminationStrategy: PID 18311 died... 03:27:47.137577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18311): Terminated: ok {rc=0} 03:27:47.187243 --- ParallelTerminationStrategy: PID 18314 died... 03:27:47.207978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18314): Terminated: ok {rc=0} 03:27:47.299861 bus /sierra_3: Setting Powered False 03:27:48.400835 bus /sierra_3: Setting Powered False 03:27:49.519619 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 03:27:50.762152 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:50.769076 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:27:50.822812 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:27:50.850882 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:27:50.905878 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:27:50.959691 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:27:50.987412 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:27:51.540213 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 03:27:51.546015 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:51.557420 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:27:51.597594 tst handover.py: using LAC 18752 03:27:51.727097 tst handover.py: using RAC 137 03:27:51.855055 tst handover.py: using CellId 18752 03:27:51.986262 tst handover.py: using BVCI 18753 03:27:52.108827 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:27:52.157778 tst handover.py: using LAC 18753 03:27:52.287418 tst handover.py: using RAC 138 03:27:52.414671 tst handover.py: using CellId 18753 03:27:52.545924 tst handover.py: using BVCI 18754 03:27:52.660662 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:52.671840 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:52.682805 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:52.694402 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:52.706022 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:52.717304 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:27:52.836252 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:27:52.955327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:53.408311 run create_hlr_db(pid=18320): Launched 03:27:53.534307 bus /sierra_2: Setting Powered False 03:27:54.596026 run create_hlr_db(pid=18320): Terminated: ok {rc=0} 03:27:55.017938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18322): Launched 03:27:55.350274 run osmo-hlr_10.42.42.2(pid=18323): Launched 03:27:55.478412 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:56.021277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18325): Launched 03:27:56.351615 run osmo-stp_10.42.42.5(pid=18326): Launched 03:27:56.478803 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:57.046658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18328): Launched 03:27:57.378099 run osmo-msc_10.42.42.6(pid=18329): Launched 03:27:57.564723 run osmo-stp_10.42.42.5(pid=18326): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18326)] 03:27:57.705427 run osmo-stp_10.42.42.5(pid=18326): stdout: | (launched: 2022-12-09_03:27:56.291601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:57.844891 run osmo-stp_10.42.42.5(pid=18326): stderr: | 20221209032756486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032756486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032756487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032756487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032756487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032756487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032756488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:57.982635 run osmo-stp_10.42.42.5(pid=18326): stdout: | (launched: 2022-12-09_03:27:56.291601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:58.115224 run osmo-stp_10.42.42.5(pid=18326): stderr: | 20221209032756486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032756486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032756487 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032756487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032756487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032756487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032756488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:58.272899 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18326): Process ended prematurely: osmo-stp_10.42.42.5(pid=18326) [trial-2353↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18326)] [trial-2353↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 03:27:58.282141 tst handover.py:18: Test FAILED (6.7 sec) 03:27:58.310395 run osmo-hlr_10.42.42.2(pid=18323): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18323)] 03:27:58.360820 run osmo-hlr_10.42.42.2(pid=18323): stdout: | (launched: 2022-12-09_03:27:55.290133) 03:27:58.413219 run osmo-hlr_10.42.42.2(pid=18323): stderr: | 20221209032755492 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032755492 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032755492 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032755492 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032755492 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032755492 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032755504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032755513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032755513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032755513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:58.485739 run osmo-msc_10.42.42.6(pid=18329): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18329)] 03:27:58.535696 run osmo-msc_10.42.42.6(pid=18329): stdout: | (launched: 2022-12-09_03:27:57.318066) 03:27:58.587644 run osmo-msc_10.42.42.6(pid=18329): stderr: | 20221209032757639 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032757640 DLGLOBAL DEBUG validating counter group 0x7fda3d771c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032757640 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032757640 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032757640 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032757640 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032757642 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032757642 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032757643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032757643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:58.640019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18322): Terminating (SIGTERM) 03:27:58.682403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18325): Terminating (SIGTERM) 03:27:58.724439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18328): Terminating (SIGTERM) 03:27:58.766952 --- ParallelTerminationStrategy: PID 18322 died... 03:27:58.786964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18322): Terminated: ok {rc=0} 03:27:58.834025 --- ParallelTerminationStrategy: PID 18325 died... 03:27:58.853664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18325): Terminated: ok {rc=0} 03:27:58.900028 --- ParallelTerminationStrategy: PID 18328 died... 03:27:58.919565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18328): Terminated: ok {rc=0} 03:27:59.007642 bus /sierra_3: Setting Powered False 03:28:00.106616 bus /sierra_3: Setting Powered False 03:28:01.230000 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 03:28:02.494505 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:02.499997 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:28:02.552563 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:28:02.580451 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:28:02.632405 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:28:02.682703 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:28:02.709447 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:28:03.261902 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 03:28:03.267422 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:03.278565 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:28:03.313129 tst handover.py: using LAC 18754 03:28:03.434575 tst handover.py: using RAC 139 03:28:03.556415 tst handover.py: using CellId 18754 03:28:03.677225 tst handover.py: using BVCI 18755 03:28:03.789589 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:28:03.836814 tst handover.py: using LAC 18755 03:28:03.961561 tst handover.py: using RAC 140 03:28:04.082712 tst handover.py: using CellId 18755 03:28:04.203080 tst handover.py: using BVCI 18756 03:28:04.316732 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:04.327848 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:04.338896 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:04.350085 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:04.361304 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:04.372241 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:28:04.493380 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:28:04.614355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:05.099136 run create_hlr_db(pid=18334): Launched 03:28:05.226531 bus /sierra_2: Setting Powered False 03:28:06.291410 run create_hlr_db(pid=18334): Terminated: ok {rc=0} 03:28:06.722781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18336): Launched 03:28:07.054272 run osmo-hlr_10.42.42.2(pid=18337): Launched 03:28:07.183811 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:07.727931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18339): Launched 03:28:08.058649 run osmo-stp_10.42.42.5(pid=18340): Launched 03:28:08.188258 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:08.757354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18342): Launched 03:28:09.088057 run osmo-msc_10.42.42.6(pid=18343): Launched 03:28:09.274023 run osmo-stp_10.42.42.5(pid=18340): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18340)] 03:28:09.414280 run osmo-stp_10.42.42.5(pid=18340): stdout: | (launched: 2022-12-09_03:28:07.998425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:09.554407 run osmo-stp_10.42.42.5(pid=18340): stderr: | 20221209032808194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032808194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032808194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032808195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032808195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032808196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032808196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:09.692328 run osmo-stp_10.42.42.5(pid=18340): stdout: | (launched: 2022-12-09_03:28:07.998425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:09.823875 run osmo-stp_10.42.42.5(pid=18340): stderr: | 20221209032808194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032808194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032808194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032808195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032808195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032808196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032808196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:09.981361 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18340): Process ended prematurely: osmo-stp_10.42.42.5(pid=18340) [trial-2353↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18340)] [trial-2353↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 03:28:09.990411 tst handover.py:18: Test FAILED (6.7 sec) 03:28:10.018278 run osmo-hlr_10.42.42.2(pid=18337): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18337)] 03:28:10.068526 run osmo-hlr_10.42.42.2(pid=18337): stdout: | (launched: 2022-12-09_03:28:06.994064) 03:28:10.121101 run osmo-hlr_10.42.42.2(pid=18337): stderr: | 20221209032807195 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032807195 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032807195 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032807195 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032807195 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032807195 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032807208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032807216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032807216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032807217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:10.193123 run osmo-msc_10.42.42.6(pid=18343): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18343)] 03:28:10.243495 run osmo-msc_10.42.42.6(pid=18343): stdout: | (launched: 2022-12-09_03:28:09.028014) 03:28:10.295107 run osmo-msc_10.42.42.6(pid=18343): stderr: | 20221209032809348 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032809348 DLGLOBAL DEBUG validating counter group 0x7f9f19617c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032809348 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032809348 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032809348 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032809349 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032809350 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032809351 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032809351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032809351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:10.347260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18336): Terminating (SIGTERM) 03:28:10.389027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18339): Terminating (SIGTERM) 03:28:10.430942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18342): Terminating (SIGTERM) 03:28:10.472926 --- ParallelTerminationStrategy: PID 18336 died... 03:28:10.492828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18336): Terminated: ok {rc=0} 03:28:10.539279 --- ParallelTerminationStrategy: PID 18339 died... 03:28:10.558540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18339): Terminated: ok {rc=0} 03:28:10.604828 --- ParallelTerminationStrategy: PID 18342 died... 03:28:10.624632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18342): Terminated: ok {rc=0} 03:28:10.713612 bus /sierra_3: Setting Powered False 03:28:11.810961 bus /sierra_3: Setting Powered False 03:28:12.927285 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 03:28:14.188324 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:14.194480 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 03:28:14.244243 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 03:28:14.271364 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 03:28:14.323115 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 03:28:14.372404 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 03:28:14.399384 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 03:28:14.949924 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 03:28:14.955248 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:28:14.966408 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:28:15.000614 tst handover.py: using LAC 18756 03:28:15.123118 tst handover.py: using RAC 141 03:28:15.246731 tst handover.py: using CellId 18756 03:28:15.370575 tst handover.py: using BVCI 18757 03:28:15.484164 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:28:15.533054 tst handover.py: using LAC 18757 03:28:15.658860 tst handover.py: using RAC 142 03:28:15.779783 tst handover.py: using CellId 18757 03:28:15.914551 tst handover.py: using BVCI 18758 03:28:16.052186 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:28:16.064586 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:28:16.079316 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:28:16.092702 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:28:16.105180 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:28:16.118690 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:28:16.236717 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:28:16.355293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:16.914907 run create_hlr_db(pid=18348): Launched 03:28:17.080456 bus /sierra_2: Setting Powered False 03:28:18.145264 run create_hlr_db(pid=18348): Terminated: ok {rc=0} 03:28:18.559502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18350): Launched 03:28:18.868564 run osmo-hlr_10.42.42.2(pid=18351): Launched 03:28:18.986694 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:19.510669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18353): Launched 03:28:19.818039 run osmo-stp_10.42.42.5(pid=18354): Launched 03:28:19.937214 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:20.472737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18356): Launched 03:28:20.781471 run osmo-msc_10.42.42.6(pid=18357): Launched 03:28:20.953863 run osmo-stp_10.42.42.5(pid=18354): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18354)] 03:28:21.084165 run osmo-stp_10.42.42.5(pid=18354): stdout: | (launched: 2022-12-09_03:28:19.761371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:21.214731 run osmo-stp_10.42.42.5(pid=18354): stderr: | 20221209032819934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032819935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032819935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032819935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032819936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032819936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032819936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:21.342879 run osmo-stp_10.42.42.5(pid=18354): stdout: | (launched: 2022-12-09_03:28:19.761371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:21.465473 run osmo-stp_10.42.42.5(pid=18354): stderr: | 20221209032819934 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032819935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032819935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032819935 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032819936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032819936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032819936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:21.611638 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18354): Process ended prematurely: osmo-stp_10.42.42.5(pid=18354) [trial-2353↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18354)] [trial-2353↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 03:28:21.620156 tst handover.py:18: Test FAILED (6.7 sec) 03:28:21.646396 run osmo-hlr_10.42.42.2(pid=18351): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18351)] 03:28:21.694234 run osmo-hlr_10.42.42.2(pid=18351): stdout: | (launched: 2022-12-09_03:28:18.811969) 03:28:21.744239 run osmo-hlr_10.42.42.2(pid=18351): stderr: | 20221209032818991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032818992 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032818992 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032818992 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032818992 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032818992 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032819004 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032819014 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032819015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032819015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:21.813642 run osmo-msc_10.42.42.6(pid=18357): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18357)] 03:28:21.861528 run osmo-msc_10.42.42.6(pid=18357): stdout: | (launched: 2022-12-09_03:28:20.724864) 03:28:21.910805 run osmo-msc_10.42.42.6(pid=18357): stderr: | 20221209032820996 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032820996 DLGLOBAL DEBUG validating counter group 0x7fb56495cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032820996 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032820996 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032820996 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032820997 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032820998 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032820999 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032820999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032820999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:21.960253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18350): Terminating (SIGTERM) 03:28:21.999990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18353): Terminating (SIGTERM) 03:28:22.039872 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18356): Terminating (SIGTERM) 03:28:22.080146 --- ParallelTerminationStrategy: PID 18350 died... 03:28:22.099348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18350): Terminated: ok {rc=0} 03:28:22.143789 --- ParallelTerminationStrategy: PID 18353 died... 03:28:22.162555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18353): Terminated: ok {rc=0} 03:28:22.206576 --- ParallelTerminationStrategy: PID 18356 died... 03:28:22.225563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18356): Terminated: ok {rc=0} 03:28:22.311074 bus /sierra_3: Setting Powered False 03:28:23.412341 bus /sierra_3: Setting Powered False 03:28:24.528796 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 03:28:25.784628 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:25.790382 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 03:28:25.835666 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:28:25.862417 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:28:25.914985 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 03:28:25.960192 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:28:25.986916 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:28:26.539302 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 03:28:26.544787 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:26.556158 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:28:26.590719 tst handover.py: using LAC 18758 03:28:26.714817 tst handover.py: using RAC 143 03:28:26.838569 tst handover.py: using CellId 18758 03:28:26.962125 tst handover.py: using BVCI 18759 03:28:27.074648 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:28:27.124522 tst handover.py: using LAC 18759 03:28:27.246455 tst handover.py: using RAC 144 03:28:27.368113 tst handover.py: using CellId 18759 03:28:27.488403 tst handover.py: using BVCI 18760 03:28:27.601165 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:27.612264 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:27.623236 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:27.634435 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:27.645814 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:27.657139 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:28:27.780124 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:28:27.900274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:28.386319 run create_hlr_db(pid=18362): Launched 03:28:28.512544 bus /sierra_2: Setting Powered False 03:28:29.577771 run create_hlr_db(pid=18362): Terminated: ok {rc=0} 03:28:29.992868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18364): Launched 03:28:30.303047 run osmo-hlr_10.42.42.2(pid=18365): Launched 03:28:30.423103 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:30.947857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18367): Launched 03:28:31.317166 run osmo-stp_10.42.42.5(pid=18368): Launched 03:28:31.569497 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:32.187211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18370): Launched 03:28:32.532523 run osmo-msc_10.42.42.6(pid=18371): Launched 03:28:32.719572 run osmo-stp_10.42.42.5(pid=18368): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18368)] 03:28:32.860267 run osmo-stp_10.42.42.5(pid=18368): stdout: | (launched: 2022-12-09_03:28:31.254874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:33.001350 run osmo-stp_10.42.42.5(pid=18368): stderr: | 20221209032831555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032831555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032831556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032831556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032831556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032831557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032831557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:33.140098 run osmo-stp_10.42.42.5(pid=18368): stdout: | (launched: 2022-12-09_03:28:31.254874) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:33.271550 run osmo-stp_10.42.42.5(pid=18368): stderr: | 20221209032831555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032831555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032831556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032831556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032831556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032831557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032831557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:33.429036 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18368): Process ended prematurely: osmo-stp_10.42.42.5(pid=18368) [trial-2353↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18368)] [trial-2353↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 03:28:33.437993 tst handover.py:18: Test FAILED (6.9 sec) 03:28:33.465916 run osmo-hlr_10.42.42.2(pid=18365): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18365)] 03:28:33.516314 run osmo-hlr_10.42.42.2(pid=18365): stdout: | (launched: 2022-12-09_03:28:30.246459) 03:28:33.568479 run osmo-hlr_10.42.42.2(pid=18365): stderr: | 20221209032830424 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032830424 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032830424 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032830424 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032830424 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032830424 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032830437 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032830445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032830445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032830445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:33.640902 run osmo-msc_10.42.42.6(pid=18371): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18371)] 03:28:33.691217 run osmo-msc_10.42.42.6(pid=18371): stdout: | (launched: 2022-12-09_03:28:32.472009) 03:28:33.743129 run osmo-msc_10.42.42.6(pid=18371): stderr: | 20221209032832793 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032832794 DLGLOBAL DEBUG validating counter group 0x7fbae894fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032832794 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032832794 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032832794 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032832794 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032832796 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032832796 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032832796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032832796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:33.795537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18364): Terminating (SIGTERM) 03:28:33.837476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18367): Terminating (SIGTERM) 03:28:33.879586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18370): Terminating (SIGTERM) 03:28:33.922166 --- ParallelTerminationStrategy: PID 18364 died... 03:28:33.942455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18364): Terminated: ok {rc=0} 03:28:33.988897 --- ParallelTerminationStrategy: PID 18367 died... 03:28:34.008515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18367): Terminated: ok {rc=0} 03:28:34.055010 --- ParallelTerminationStrategy: PID 18370 died... 03:28:34.074484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18370): Terminated: ok {rc=0} 03:28:34.163406 bus /sierra_3: Setting Powered False 03:28:35.262128 bus /sierra_3: Setting Powered False 03:28:36.380469 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:28:37.632507 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:37.637792 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:28:37.687437 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:28:37.714393 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:28:37.767663 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:28:37.817863 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:28:37.844735 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:28:38.396578 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:28:38.402023 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:38.413690 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:28:38.448154 tst handover.py: using LAC 18760 03:28:38.570980 tst handover.py: using RAC 145 03:28:38.694922 tst handover.py: using CellId 18760 03:28:38.818432 tst handover.py: using BVCI 18761 03:28:38.932380 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:28:38.982444 tst handover.py: using LAC 18761 03:28:39.106539 tst handover.py: using RAC 146 03:28:39.231022 tst handover.py: using CellId 18761 03:28:39.354896 tst handover.py: using BVCI 18762 03:28:39.469251 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:39.480451 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:39.491636 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:39.502774 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:39.513901 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:39.525027 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:28:39.645260 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:28:39.765137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:40.218369 run create_hlr_db(pid=18376): Launched 03:28:40.346148 bus /sierra_2: Setting Powered False 03:28:41.410529 run create_hlr_db(pid=18376): Terminated: ok {rc=0} 03:28:41.825310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18378): Launched 03:28:42.133424 run osmo-hlr_10.42.42.2(pid=18379): Launched 03:28:42.251193 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:42.755376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18381): Launched 03:28:43.062750 run osmo-stp_10.42.42.5(pid=18382): Launched 03:28:43.180715 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:43.711184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18384): Launched 03:28:44.020271 run osmo-msc_10.42.42.6(pid=18385): Launched 03:28:44.193225 run osmo-stp_10.42.42.5(pid=18382): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18382)] 03:28:44.323321 run osmo-stp_10.42.42.5(pid=18382): stdout: | (launched: 2022-12-09_03:28:43.006551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:44.453788 run osmo-stp_10.42.42.5(pid=18382): stderr: | 20221209032843180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032843180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032843180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032843181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032843181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032843181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032843182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:44.582468 run osmo-stp_10.42.42.5(pid=18382): stdout: | (launched: 2022-12-09_03:28:43.006551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:44.704718 run osmo-stp_10.42.42.5(pid=18382): stderr: | 20221209032843180 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032843180 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032843180 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032843181 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032843181 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032843181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032843182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:44.851269 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18382): Process ended prematurely: osmo-stp_10.42.42.5(pid=18382) [trial-2353↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18382)] [trial-2353↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 03:28:44.859518 tst handover.py:18: Test FAILED (6.5 sec) 03:28:44.885320 run osmo-hlr_10.42.42.2(pid=18379): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18379)] 03:28:44.932641 run osmo-hlr_10.42.42.2(pid=18379): stdout: | (launched: 2022-12-09_03:28:42.076616) 03:28:44.981707 run osmo-hlr_10.42.42.2(pid=18379): stderr: | 20221209032842253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032842253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032842253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032842253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032842253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032842253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032842266 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032842274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032842274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032842274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:45.050182 run osmo-msc_10.42.42.6(pid=18385): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18385)] 03:28:45.097526 run osmo-msc_10.42.42.6(pid=18385): stdout: | (launched: 2022-12-09_03:28:43.963625) 03:28:45.146452 run osmo-msc_10.42.42.6(pid=18385): stderr: | 20221209032844237 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032844237 DLGLOBAL DEBUG validating counter group 0x7f78d4b80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032844237 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032844237 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032844237 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032844238 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032844239 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032844240 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032844240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032844240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:45.195823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18378): Terminating (SIGTERM) 03:28:45.235059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18381): Terminating (SIGTERM) 03:28:45.274349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18384): Terminating (SIGTERM) 03:28:45.313849 --- ParallelTerminationStrategy: PID 18378 died... 03:28:45.332583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18378): Terminated: ok {rc=0} 03:28:45.376330 --- ParallelTerminationStrategy: PID 18381 died... 03:28:45.394793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18381): Terminated: ok {rc=0} 03:28:45.438352 --- ParallelTerminationStrategy: PID 18384 died... 03:28:45.456727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18384): Terminated: ok {rc=0} 03:28:45.541596 bus /sierra_3: Setting Powered False 03:28:46.643832 bus /sierra_3: Setting Powered False 03:28:47.771147 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 03:28:49.035133 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:49.040340 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:28:49.078339 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:28:49.105479 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:28:49.158736 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:28:49.196253 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:28:49.223119 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:28:49.771207 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 03:28:49.776181 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:49.787084 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 03:28:49.821097 tst handover.py: using LAC 18762 03:28:49.943574 tst handover.py: using RAC 147 03:28:50.067748 tst handover.py: using CellId 18762 03:28:50.200711 tst handover.py: using BVCI 18763 03:28:50.323840 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 03:28:50.360122 tst handover.py: using LAC 18763 03:28:50.491424 tst handover.py: using RAC 148 03:28:50.616900 tst handover.py: using CellId 18763 03:28:50.741047 tst handover.py: using BVCI 18764 03:28:50.855774 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:50.866722 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:50.877478 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:50.889192 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:50.900422 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:50.911623 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 03:28:51.033668 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 03:28:51.155932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:51.640286 run create_hlr_db(pid=18390): Launched 03:28:51.767216 bus /sierra_2: Setting Powered False 03:28:52.832285 run create_hlr_db(pid=18390): Terminated: ok {rc=0} 03:28:53.263807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18393): Launched 03:28:53.594693 run osmo-hlr_10.42.42.2(pid=18394): Launched 03:28:53.721804 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:54.265428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18396): Launched 03:28:54.594622 run osmo-stp_10.42.42.5(pid=18397): Launched 03:28:54.721350 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:55.289636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18399): Launched 03:28:55.621251 run osmo-msc_10.42.42.6(pid=18400): Launched 03:28:55.806407 run osmo-stp_10.42.42.5(pid=18397): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18397)] 03:28:55.945970 run osmo-stp_10.42.42.5(pid=18397): stdout: | (launched: 2022-12-09_03:28:54.534589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:56.086154 run osmo-stp_10.42.42.5(pid=18397): stderr: | 20221209032854728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032854728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032854728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032854729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032854730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032854730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032854730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:56.225333 run osmo-stp_10.42.42.5(pid=18397): stdout: | (launched: 2022-12-09_03:28:54.534589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:56.356890 run osmo-stp_10.42.42.5(pid=18397): stderr: | 20221209032854728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032854728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032854728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032854729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032854730 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032854730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032854730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:56.513774 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18397): Process ended prematurely: osmo-stp_10.42.42.5(pid=18397) [trial-2353↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18397)] [trial-2353↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 03:28:56.522661 tst handover.py:18: Test FAILED (6.7 sec) 03:28:56.550439 run osmo-hlr_10.42.42.2(pid=18394): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18394)] 03:28:56.601178 run osmo-hlr_10.42.42.2(pid=18394): stdout: | (launched: 2022-12-09_03:28:53.534674) 03:28:56.653405 run osmo-hlr_10.42.42.2(pid=18394): stderr: | 20221209032853734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032853735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032853735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032853735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032853735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032853735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032853746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032853754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032853755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032853755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:56.726070 run osmo-msc_10.42.42.6(pid=18400): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18400)] 03:28:56.776412 run osmo-msc_10.42.42.6(pid=18400): stdout: | (launched: 2022-12-09_03:28:55.560860) 03:28:56.828334 run osmo-msc_10.42.42.6(pid=18400): stderr: | 20221209032855883 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032855884 DLGLOBAL DEBUG validating counter group 0x7f1ed7c02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032855884 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032855884 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032855884 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032855884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032855886 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032855886 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032855886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032855887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:56.880550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18393): Terminating (SIGTERM) 03:28:56.922662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18396): Terminating (SIGTERM) 03:28:56.964556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18399): Terminating (SIGTERM) 03:28:57.006809 --- ParallelTerminationStrategy: PID 18393 died... 03:28:57.026772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18393): Terminated: ok {rc=0} 03:28:57.073354 --- ParallelTerminationStrategy: PID 18396 died... 03:28:57.092827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18396): Terminated: ok {rc=0} 03:28:57.139585 --- ParallelTerminationStrategy: PID 18399 died... 03:28:57.159082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18399): Terminated: ok {rc=0} 03:28:57.247210 bus /sierra_3: Setting Powered False 03:28:58.346356 bus /sierra_3: Setting Powered False 03:28:59.463030 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 03:29:00.708299 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:00.713994 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:29:00.765169 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:29:00.793065 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:29:00.880474 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:29:00.940600 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:29:00.970029 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:29:01.517070 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 03:29:01.523146 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:01.534848 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:29:01.574235 tst handover.py: using LAC 18764 03:29:01.700630 tst handover.py: using RAC 149 03:29:01.825489 tst handover.py: using CellId 18764 03:29:01.954303 tst handover.py: using BVCI 18765 03:29:02.109272 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:29:02.172496 tst handover.py: using LAC 18765 03:29:02.311817 tst handover.py: using RAC 150 03:29:02.441802 tst handover.py: using CellId 18765 03:29:02.571550 tst handover.py: using BVCI 18766 03:29:02.692560 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:02.703978 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:02.715178 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:02.726613 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:02.738214 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:02.749729 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:29:02.866480 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:29:02.983737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:03.468337 run create_hlr_db(pid=18405): Launched 03:29:03.594211 bus /sierra_2: Setting Powered False 03:29:04.659652 run create_hlr_db(pid=18405): Terminated: ok {rc=0} 03:29:05.073728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18407): Launched 03:29:05.383230 run osmo-hlr_10.42.42.2(pid=18408): Launched 03:29:05.501767 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:06.019501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18410): Launched 03:29:06.328218 run osmo-stp_10.42.42.5(pid=18411): Launched 03:29:06.447403 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:06.978289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18413): Launched 03:29:07.286589 run osmo-msc_10.42.42.6(pid=18414): Launched 03:29:07.461287 run osmo-stp_10.42.42.5(pid=18411): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18411)] 03:29:07.593185 run osmo-stp_10.42.42.5(pid=18411): stdout: | (launched: 2022-12-09_03:29:06.271429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:07.723110 run osmo-stp_10.42.42.5(pid=18411): stderr: | 20221209032906442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032906442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032906442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032906443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032906443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032906443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032906443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:07.850928 run osmo-stp_10.42.42.5(pid=18411): stdout: | (launched: 2022-12-09_03:29:06.271429) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:07.973242 run osmo-stp_10.42.42.5(pid=18411): stderr: | 20221209032906442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032906442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032906442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032906443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032906443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032906443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032906443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:08.119636 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18411): Process ended prematurely: osmo-stp_10.42.42.5(pid=18411) [trial-2353↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18411)] [trial-2353↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 03:29:08.128141 tst handover.py:18: Test FAILED (6.6 sec) 03:29:08.154799 run osmo-hlr_10.42.42.2(pid=18408): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18408)] 03:29:08.202746 run osmo-hlr_10.42.42.2(pid=18408): stdout: | (launched: 2022-12-09_03:29:05.326166) 03:29:08.251970 run osmo-hlr_10.42.42.2(pid=18408): stderr: | 20221209032905506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032905506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032905506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032905506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032905506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032905506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032905518 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032905528 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032905528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032905528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:08.320596 run osmo-msc_10.42.42.6(pid=18414): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18414)] 03:29:08.368150 run osmo-msc_10.42.42.6(pid=18414): stdout: | (launched: 2022-12-09_03:29:07.229961) 03:29:08.417221 run osmo-msc_10.42.42.6(pid=18414): stderr: | 20221209032907503 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032907503 DLGLOBAL DEBUG validating counter group 0x7f59222e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032907503 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032907503 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032907503 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032907504 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032907505 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032907506 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032907506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032907506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:08.466545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18407): Terminating (SIGTERM) 03:29:08.506032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18410): Terminating (SIGTERM) 03:29:08.545875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18413): Terminating (SIGTERM) 03:29:08.585750 --- ParallelTerminationStrategy: PID 18407 died... 03:29:08.604631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18407): Terminated: ok {rc=0} 03:29:08.648634 --- ParallelTerminationStrategy: PID 18410 died... 03:29:08.667610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18410): Terminated: ok {rc=0} 03:29:08.711432 --- ParallelTerminationStrategy: PID 18413 died... 03:29:08.730012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18413): Terminated: ok {rc=0} 03:29:08.815574 bus /sierra_3: Setting Powered False 03:29:09.915613 bus /sierra_3: Setting Powered False 03:29:11.032882 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 03:29:12.293751 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:12.299357 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:29:12.349809 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:29:12.377799 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:29:12.430703 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:29:12.480860 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:29:12.508777 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:29:13.061625 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 03:29:13.067088 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:13.078542 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:29:13.113115 tst handover.py: using LAC 18766 03:29:13.245362 tst handover.py: using RAC 151 03:29:13.370313 tst handover.py: using CellId 18766 03:29:13.494498 tst handover.py: using BVCI 18767 03:29:13.608911 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:29:13.656925 tst handover.py: using LAC 18767 03:29:13.780486 tst handover.py: using RAC 152 03:29:13.904654 tst handover.py: using CellId 18767 03:29:14.032665 tst handover.py: using BVCI 18768 03:29:14.156361 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:14.167877 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:14.179270 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:14.190992 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:14.202684 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:14.214274 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:29:14.332104 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:29:14.450604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:14.907747 run create_hlr_db(pid=18419): Launched 03:29:15.034310 bus /sierra_2: Setting Powered False 03:29:16.101104 run create_hlr_db(pid=18419): Terminated: ok {rc=0} 03:29:16.546860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18421): Launched 03:29:16.899480 run osmo-hlr_10.42.42.2(pid=18422): Launched 03:29:17.099696 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:17.625170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18424): Launched 03:29:17.933985 run osmo-stp_10.42.42.5(pid=18425): Launched 03:29:18.052923 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:18.585409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18427): Launched 03:29:18.895610 run osmo-msc_10.42.42.6(pid=18428): Launched 03:29:19.068370 run osmo-stp_10.42.42.5(pid=18425): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18425)] 03:29:19.198681 run osmo-stp_10.42.42.5(pid=18425): stdout: | (launched: 2022-12-09_03:29:17.877461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:19.328407 run osmo-stp_10.42.42.5(pid=18425): stderr: | 20221209032918048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032918048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032918048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032918049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032918051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032918051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032918051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:19.456702 run osmo-stp_10.42.42.5(pid=18425): stdout: | (launched: 2022-12-09_03:29:17.877461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:19.579514 run osmo-stp_10.42.42.5(pid=18425): stderr: | 20221209032918048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032918048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032918048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032918049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032918051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032918051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032918051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:19.726061 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18425): Process ended prematurely: osmo-stp_10.42.42.5(pid=18425) [trial-2353↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18425)] [trial-2353↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 03:29:19.734557 tst handover.py:18: Test FAILED (6.7 sec) 03:29:19.760486 run osmo-hlr_10.42.42.2(pid=18422): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18422)] 03:29:19.808090 run osmo-hlr_10.42.42.2(pid=18422): stdout: | (launched: 2022-12-09_03:29:16.838083) 03:29:19.857218 run osmo-hlr_10.42.42.2(pid=18422): stderr: | 20221209032917098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032917098 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032917098 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032917098 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032917098 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032917098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032917120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032917147 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032917147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032917147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:19.925518 run osmo-msc_10.42.42.6(pid=18428): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18428)] 03:29:19.972588 run osmo-msc_10.42.42.6(pid=18428): stdout: | (launched: 2022-12-09_03:29:18.838928) 03:29:20.021457 run osmo-msc_10.42.42.6(pid=18428): stderr: | 20221209032919114 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032919114 DLGLOBAL DEBUG validating counter group 0x7feaca2cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032919114 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032919114 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032919115 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032919115 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032919117 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032919117 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032919117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032919118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:20.070399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18421): Terminating (SIGTERM) 03:29:20.109682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18424): Terminating (SIGTERM) 03:29:20.148920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18427): Terminating (SIGTERM) 03:29:20.188475 --- ParallelTerminationStrategy: PID 18421 died... 03:29:20.207504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18421): Terminated: ok {rc=0} 03:29:20.251398 --- ParallelTerminationStrategy: PID 18424 died... 03:29:20.269893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18424): Terminated: ok {rc=0} 03:29:20.313250 --- ParallelTerminationStrategy: PID 18427 died... 03:29:20.331810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18427): Terminated: ok {rc=0} 03:29:20.414950 bus /sierra_3: Setting Powered False 03:29:21.512632 bus /sierra_3: Setting Powered False 03:29:22.629681 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 03:29:23.891963 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:23.898404 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 03:29:23.957727 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:29:23.984455 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:29:24.038945 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 03:29:24.102420 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:29:24.130538 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:29:24.674277 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 03:29:24.680345 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:29:24.692464 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:29:24.743922 tst handover.py: using LAC 18768 03:29:24.874863 tst handover.py: using RAC 153 03:29:25.002616 tst handover.py: using CellId 18768 03:29:25.130552 tst handover.py: using BVCI 18769 03:29:25.251677 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:29:25.301012 tst handover.py: using LAC 18769 03:29:25.430413 tst handover.py: using RAC 154 03:29:25.558081 tst handover.py: using CellId 18769 03:29:25.687651 tst handover.py: using BVCI 18770 03:29:25.800651 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:29:25.812050 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:29:25.823059 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:29:25.834190 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:29:25.845216 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:29:25.856115 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:29:25.976847 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:29:26.099313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:26.583470 run create_hlr_db(pid=18433): Launched 03:29:26.709609 bus /sierra_2: Setting Powered False 03:29:27.774471 run create_hlr_db(pid=18433): Terminated: ok {rc=0} 03:29:28.188920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18435): Launched 03:29:28.498386 run osmo-hlr_10.42.42.2(pid=18436): Launched 03:29:28.618745 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:29.124485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18438): Launched 03:29:29.432747 run osmo-stp_10.42.42.5(pid=18439): Launched 03:29:29.551652 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:30.084101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18441): Launched 03:29:30.394396 run osmo-msc_10.42.42.6(pid=18442): Launched 03:29:30.569327 run osmo-stp_10.42.42.5(pid=18439): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18439)] 03:29:30.699314 run osmo-stp_10.42.42.5(pid=18439): stdout: | (launched: 2022-12-09_03:29:29.376196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:30.837904 run osmo-stp_10.42.42.5(pid=18439): stderr: | 20221209032929547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032929548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032929548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032929548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032929549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032929549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032929549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:31.000787 run osmo-stp_10.42.42.5(pid=18439): stdout: | (launched: 2022-12-09_03:29:29.376196) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:31.127277 run osmo-stp_10.42.42.5(pid=18439): stderr: | 20221209032929547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032929548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032929548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032929548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032929549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032929549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032929549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:31.278283 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18439): Process ended prematurely: osmo-stp_10.42.42.5(pid=18439) [trial-2353↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18439)] [trial-2353↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 03:29:31.287097 tst handover.py:18: Test FAILED (6.6 sec) 03:29:31.313899 run osmo-hlr_10.42.42.2(pid=18436): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18436)] 03:29:31.362908 run osmo-hlr_10.42.42.2(pid=18436): stdout: | (launched: 2022-12-09_03:29:28.441592) 03:29:31.413837 run osmo-hlr_10.42.42.2(pid=18436): stderr: | 20221209032928618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032928618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032928618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032928618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032928618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032928618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032928633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032928643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032928644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032928644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:31.483663 run osmo-msc_10.42.42.6(pid=18442): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18442)] 03:29:31.532488 run osmo-msc_10.42.42.6(pid=18442): stdout: | (launched: 2022-12-09_03:29:30.337594) 03:29:31.582939 run osmo-msc_10.42.42.6(pid=18442): stderr: | 20221209032930608 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032930608 DLGLOBAL DEBUG validating counter group 0x7f32e0989c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032930609 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032930609 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032930609 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032930609 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032930611 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032930611 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032930611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032930611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:31.637099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18435): Terminating (SIGTERM) 03:29:31.683914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18438): Terminating (SIGTERM) 03:29:31.730976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18441): Terminating (SIGTERM) 03:29:31.778078 --- ParallelTerminationStrategy: PID 18435 died... 03:29:31.799268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18435): Terminated: ok {rc=0} 03:29:31.850987 --- ParallelTerminationStrategy: PID 18438 died... 03:29:31.871633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18438): Terminated: ok {rc=0} 03:29:31.922773 --- ParallelTerminationStrategy: PID 18441 died... 03:29:31.943546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18441): Terminated: ok {rc=0} 03:29:32.042387 bus /sierra_3: Setting Powered False 03:29:33.143329 bus /sierra_3: Setting Powered False 03:29:34.255524 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:29:35.520433 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:35.525749 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:29:35.590137 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:29:35.617240 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:29:35.670666 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:29:35.738490 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:29:35.766524 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:29:36.314006 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:29:36.320254 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:36.332818 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:29:36.383981 tst handover.py: using LAC 18770 03:29:36.514743 tst handover.py: using RAC 155 03:29:36.645399 tst handover.py: using CellId 18770 03:29:36.774475 tst handover.py: using BVCI 18771 03:29:36.897065 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:29:36.947369 tst handover.py: using LAC 18771 03:29:37.078713 tst handover.py: using RAC 156 03:29:37.210589 tst handover.py: using CellId 18771 03:29:37.341194 tst handover.py: using BVCI 18772 03:29:37.463284 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:37.474857 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:37.487381 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:37.499192 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:37.510953 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:37.522733 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:29:37.645822 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:29:37.764937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:38.220505 run create_hlr_db(pid=18447): Launched 03:29:38.346881 bus /sierra_2: Setting Powered False 03:29:39.407812 run create_hlr_db(pid=18447): Terminated: ok {rc=0} 03:29:39.829402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18449): Launched 03:29:40.160022 run osmo-hlr_10.42.42.2(pid=18450): Launched 03:29:40.287986 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:40.830415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18452): Launched 03:29:41.160259 run osmo-stp_10.42.42.5(pid=18453): Launched 03:29:41.288028 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:41.857514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18455): Launched 03:29:42.188753 run osmo-msc_10.42.42.6(pid=18456): Launched 03:29:42.375193 run osmo-stp_10.42.42.5(pid=18453): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18453)] 03:29:42.515370 run osmo-stp_10.42.42.5(pid=18453): stdout: | (launched: 2022-12-09_03:29:41.100358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:42.655700 run osmo-stp_10.42.42.5(pid=18453): stderr: | 20221209032941295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032941295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032941295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032941296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032941296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032941296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032941296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:42.794032 run osmo-stp_10.42.42.5(pid=18453): stdout: | (launched: 2022-12-09_03:29:41.100358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:42.925775 run osmo-stp_10.42.42.5(pid=18453): stderr: | 20221209032941295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032941295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032941295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032941296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032941296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032941296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032941296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:43.083818 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18453): Process ended prematurely: osmo-stp_10.42.42.5(pid=18453) [trial-2353↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18453)] [trial-2353↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 03:29:43.092883 tst handover.py:18: Test FAILED (6.8 sec) 03:29:43.121352 run osmo-hlr_10.42.42.2(pid=18450): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18450)] 03:29:43.172234 run osmo-hlr_10.42.42.2(pid=18450): stdout: | (launched: 2022-12-09_03:29:40.100034) 03:29:43.224369 run osmo-hlr_10.42.42.2(pid=18450): stderr: | 20221209032940299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032940299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032940299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032940299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032940299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032940299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032940312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032940322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032940322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032940322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:43.296823 run osmo-msc_10.42.42.6(pid=18456): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18456)] 03:29:43.347436 run osmo-msc_10.42.42.6(pid=18456): stdout: | (launched: 2022-12-09_03:29:42.127809) 03:29:43.399481 run osmo-msc_10.42.42.6(pid=18456): stderr: | 20221209032942449 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032942449 DLGLOBAL DEBUG validating counter group 0x7f7271f81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032942449 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032942449 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032942449 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032942450 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032942451 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032942452 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032942452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032942452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:43.451809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18449): Terminating (SIGTERM) 03:29:43.493855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18452): Terminating (SIGTERM) 03:29:43.535838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18455): Terminating (SIGTERM) 03:29:43.578065 --- ParallelTerminationStrategy: PID 18449 died... 03:29:43.598123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18449): Terminated: ok {rc=0} 03:29:43.644816 --- ParallelTerminationStrategy: PID 18452 died... 03:29:43.664328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18452): Terminated: ok {rc=0} 03:29:43.711094 --- ParallelTerminationStrategy: PID 18455 died... 03:29:43.730548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18455): Terminated: ok {rc=0} 03:29:43.817931 bus /sierra_3: Setting Powered False 03:29:44.916363 bus /sierra_3: Setting Powered False 03:29:46.038298 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 03:29:47.338615 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:47.344253 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:29:47.396557 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:29:47.424520 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:29:47.477960 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:29:47.531761 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:29:47.559861 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:29:48.110138 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 03:29:48.115574 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:48.126984 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 03:29:48.176303 tst handover.py: using LAC 18772 03:29:48.305623 tst handover.py: using RAC 157 03:29:48.428873 tst handover.py: using CellId 18772 03:29:48.550344 tst handover.py: using BVCI 18773 03:29:48.664741 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 03:29:48.700110 tst handover.py: using LAC 18773 03:29:48.821348 tst handover.py: using RAC 158 03:29:48.942744 tst handover.py: using CellId 18773 03:29:49.067237 tst handover.py: using BVCI 18774 03:29:49.180149 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:49.191067 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:49.201936 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:49.212582 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:49.223390 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:49.234073 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 03:29:49.355232 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 03:29:49.476705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:49.962260 run create_hlr_db(pid=18461): Launched 03:29:50.090996 bus /sierra_2: Setting Powered False 03:29:51.155989 run create_hlr_db(pid=18461): Terminated: ok {rc=0} 03:29:51.587004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18463): Launched 03:29:51.918846 run osmo-hlr_10.42.42.2(pid=18464): Launched 03:29:52.045897 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:52.586184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18466): Launched 03:29:52.915684 run osmo-stp_10.42.42.5(pid=18467): Launched 03:29:53.044836 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:53.614750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18469): Launched 03:29:53.945558 run osmo-msc_10.42.42.6(pid=18470): Launched 03:29:54.130231 run osmo-stp_10.42.42.5(pid=18467): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18467)] 03:29:54.272435 run osmo-stp_10.42.42.5(pid=18467): stdout: | (launched: 2022-12-09_03:29:52.855600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:54.412787 run osmo-stp_10.42.42.5(pid=18467): stderr: | 20221209032953051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032953052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032953052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032953052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032953053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032953053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032953053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:54.551032 run osmo-stp_10.42.42.5(pid=18467): stdout: | (launched: 2022-12-09_03:29:52.855600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:54.682757 run osmo-stp_10.42.42.5(pid=18467): stderr: | 20221209032953051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209032953052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209032953052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209032953052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209032953053 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209032953053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209032953053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:54.839652 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18467): Process ended prematurely: osmo-stp_10.42.42.5(pid=18467) [trial-2353↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18467)] [trial-2353↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 03:29:54.848695 tst handover.py:18: Test FAILED (6.7 sec) 03:29:54.876224 run osmo-hlr_10.42.42.2(pid=18464): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18464)] 03:29:54.927003 run osmo-hlr_10.42.42.2(pid=18464): stdout: | (launched: 2022-12-09_03:29:51.858207) 03:29:54.979178 run osmo-hlr_10.42.42.2(pid=18464): stderr: | 20221209032952059 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209032952059 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209032952059 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209032952059 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209032952059 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209032952059 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209032952074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209032952083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209032952083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209032952083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:55.052168 run osmo-msc_10.42.42.6(pid=18470): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18470)] 03:29:55.103236 run osmo-msc_10.42.42.6(pid=18470): stdout: | (launched: 2022-12-09_03:29:53.885189) 03:29:55.155534 run osmo-msc_10.42.42.6(pid=18470): stderr: | 20221209032954208 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209032954208 DLGLOBAL DEBUG validating counter group 0x7fce1fe50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209032954208 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209032954208 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209032954209 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209032954209 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209032954211 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209032954211 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209032954211 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209032954211 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:55.208172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18463): Terminating (SIGTERM) 03:29:55.250226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18466): Terminating (SIGTERM) 03:29:55.292377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18469): Terminating (SIGTERM) 03:29:55.334607 --- ParallelTerminationStrategy: PID 18463 died... 03:29:55.354741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18463): Terminated: ok {rc=0} 03:29:55.401429 --- ParallelTerminationStrategy: PID 18466 died... 03:29:55.421012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18466): Terminated: ok {rc=0} 03:29:55.467874 --- ParallelTerminationStrategy: PID 18469 died... 03:29:55.487733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18469): Terminated: ok {rc=0} 03:29:55.575598 bus /sierra_3: Setting Powered False 03:29:56.674365 bus /sierra_3: Setting Powered False 03:29:57.788374 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 03:29:59.047843 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:59.053992 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:29:59.120005 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:29:59.148264 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:29:59.202403 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:29:59.268001 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:29:59.295933 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:29:59.846927 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 03:29:59.852308 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:59.863630 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:29:59.913273 tst handover.py: using LAC 18774 03:30:00.042656 tst handover.py: using RAC 159 03:30:00.173361 tst handover.py: using CellId 18774 03:30:00.303072 tst handover.py: using BVCI 18775 03:30:00.425749 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:30:00.476019 tst handover.py: using LAC 18775 03:30:00.606991 tst handover.py: using RAC 160 03:30:00.738599 tst handover.py: using CellId 18775 03:30:00.885517 tst handover.py: using BVCI 18776 03:30:01.011559 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:01.023508 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:01.035742 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:01.048004 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:01.059976 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:01.072470 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:30:01.194387 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:30:01.312400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:01.869687 run create_hlr_db(pid=18478): Launched 03:30:02.031778 bus /sierra_2: Setting Powered False 03:30:03.097135 run create_hlr_db(pid=18478): Terminated: ok {rc=0} 03:30:03.512871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18487): Launched 03:30:03.822515 run osmo-hlr_10.42.42.2(pid=18488): Launched 03:30:03.942125 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:04.449245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18490): Launched 03:30:04.783287 run osmo-stp_10.42.42.5(pid=18491): Launched 03:30:04.909674 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:05.485634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18493): Launched 03:30:05.818664 run osmo-msc_10.42.42.6(pid=18494): Launched 03:30:06.006272 run osmo-stp_10.42.42.5(pid=18491): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18491)] 03:30:06.147185 run osmo-stp_10.42.42.5(pid=18491): stdout: | (launched: 2022-12-09_03:30:04.722939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:06.289336 run osmo-stp_10.42.42.5(pid=18491): stderr: | 20221209033004917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033004917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033004917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033004918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033004918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033004918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033004918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:06.428668 run osmo-stp_10.42.42.5(pid=18491): stdout: | (launched: 2022-12-09_03:30:04.722939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:06.561479 run osmo-stp_10.42.42.5(pid=18491): stderr: | 20221209033004917 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033004917 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033004917 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033004918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033004918 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033004918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033004918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:06.719752 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18491): Process ended prematurely: osmo-stp_10.42.42.5(pid=18491) [trial-2353↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18491)] [trial-2353↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 03:30:06.728736 tst handover.py:18: Test FAILED (6.9 sec) 03:30:06.756817 run osmo-hlr_10.42.42.2(pid=18488): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18488)] 03:30:06.807814 run osmo-hlr_10.42.42.2(pid=18488): stdout: | (launched: 2022-12-09_03:30:03.766148) 03:30:06.860169 run osmo-hlr_10.42.42.2(pid=18488): stderr: | 20221209033003944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033003944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033003944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033003944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033003944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033003944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033003957 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033003965 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033003966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033003966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:06.933239 run osmo-msc_10.42.42.6(pid=18494): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18494)] 03:30:06.983826 run osmo-msc_10.42.42.6(pid=18494): stdout: | (launched: 2022-12-09_03:30:05.758133) 03:30:07.035920 run osmo-msc_10.42.42.6(pid=18494): stderr: | 20221209033006079 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033006079 DLGLOBAL DEBUG validating counter group 0x7f5b6809ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033006080 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033006080 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033006080 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033006081 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033006084 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033006085 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033006085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033006085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:07.088567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18487): Terminating (SIGTERM) 03:30:07.130902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18490): Terminating (SIGTERM) 03:30:07.173628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18493): Terminating (SIGTERM) 03:30:07.216291 --- ParallelTerminationStrategy: PID 18487 died... 03:30:07.236466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18487): Terminated: ok {rc=0} 03:30:07.283752 --- ParallelTerminationStrategy: PID 18490 died... 03:30:07.303487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18490): Terminated: ok {rc=0} 03:30:07.350321 --- ParallelTerminationStrategy: PID 18493 died... 03:30:07.370059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18493): Terminated: ok {rc=0} 03:30:07.458305 bus /sierra_3: Setting Powered False 03:30:08.557976 bus /sierra_3: Setting Powered False 03:30:09.674668 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 03:30:10.955694 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:10.961520 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:30:11.026195 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:30:11.054065 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:30:11.107355 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:30:11.172876 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:30:11.200765 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:30:11.751869 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 03:30:11.757356 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:11.768625 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:30:11.818353 tst handover.py: using LAC 18776 03:30:11.950354 tst handover.py: using RAC 161 03:30:12.082460 tst handover.py: using CellId 18776 03:30:12.214589 tst handover.py: using BVCI 18777 03:30:12.337893 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:30:12.387140 tst handover.py: using LAC 18777 03:30:12.518813 tst handover.py: using RAC 162 03:30:12.650812 tst handover.py: using CellId 18777 03:30:12.792194 tst handover.py: using BVCI 18778 03:30:12.938408 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:12.950426 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:12.962213 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:12.974403 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:12.986508 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:12.998543 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:30:13.123914 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:30:13.248084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:13.726866 run create_hlr_db(pid=18647): Launched 03:30:13.884301 bus /sierra_2: Setting Powered False 03:30:14.948379 run create_hlr_db(pid=18647): Terminated: ok {rc=0} 03:30:15.365426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18852): Launched 03:30:15.673635 run osmo-hlr_10.42.42.2(pid=18853): Launched 03:30:15.791824 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:16.517243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18855): Launched 03:30:16.867251 run osmo-stp_10.42.42.5(pid=18856): Launched 03:30:17.109143 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:17.699511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18858): Launched 03:30:18.007703 run osmo-msc_10.42.42.6(pid=18859): Launched 03:30:18.180382 run osmo-stp_10.42.42.5(pid=18856): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18856)] 03:30:18.374969 run osmo-stp_10.42.42.5(pid=18856): stdout: | (launched: 2022-12-09_03:30:16.806264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:18.515771 run osmo-stp_10.42.42.5(pid=18856): stderr: | 20221209033017006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033017006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033017006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033017007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033017021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033017021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033017021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:18.654351 run osmo-stp_10.42.42.5(pid=18856): stdout: | (launched: 2022-12-09_03:30:16.806264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:18.786006 run osmo-stp_10.42.42.5(pid=18856): stderr: | 20221209033017006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033017006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033017006 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033017007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033017021 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033017021 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033017021 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:18.943520 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=18856): Process ended prematurely: osmo-stp_10.42.42.5(pid=18856) [trial-2353↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18856)] [trial-2353↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 03:30:18.952442 tst handover.py:18: Test FAILED (7.2 sec) 03:30:18.980517 run osmo-hlr_10.42.42.2(pid=18853): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=18853)] 03:30:19.031279 run osmo-hlr_10.42.42.2(pid=18853): stdout: | (launched: 2022-12-09_03:30:15.617245) 03:30:19.083753 run osmo-hlr_10.42.42.2(pid=18853): stderr: | 20221209033015795 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033015795 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033015795 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033015796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033015796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033015796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033015809 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033015818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033015818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033015818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:19.156440 run osmo-msc_10.42.42.6(pid=18859): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=18859)] 03:30:19.207466 run osmo-msc_10.42.42.6(pid=18859): stdout: | (launched: 2022-12-09_03:30:17.950841) 03:30:19.259729 run osmo-msc_10.42.42.6(pid=18859): stderr: | 20221209033018224 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033018224 DLGLOBAL DEBUG validating counter group 0x7f2ec1148c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033018224 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033018224 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033018224 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033018224 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033018226 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033018227 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033018227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033018227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:19.312068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18852): Terminating (SIGTERM) 03:30:19.354081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18855): Terminating (SIGTERM) 03:30:19.396256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18858): Terminating (SIGTERM) 03:30:19.438689 --- ParallelTerminationStrategy: PID 18852 died... 03:30:19.458898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18852): Terminated: ok {rc=0} 03:30:19.505992 --- ParallelTerminationStrategy: PID 18855 died... 03:30:19.525778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18855): Terminated: ok {rc=0} 03:30:19.572672 --- ParallelTerminationStrategy: PID 18858 died... 03:30:19.592418 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18858): Terminated: ok {rc=0} 03:30:19.681879 bus /sierra_3: Setting Powered False 03:30:20.780477 bus /sierra_3: Setting Powered False 03:30:21.898016 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:30:23.169521 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:23.177272 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:30:23.240202 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:30:23.268924 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:30:23.329789 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:30:23.398750 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:30:23.428686 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:30:23.973152 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:30:23.981164 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:30:23.993547 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:30:24.041402 tst handover.py: using LAC 18778 03:30:24.181587 tst handover.py: using RAC 163 03:30:24.314949 tst handover.py: using CellId 18778 03:30:24.443988 tst handover.py: using BVCI 18779 03:30:24.559863 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:30:24.608790 tst handover.py: using LAC 18779 03:30:24.730897 tst handover.py: using RAC 164 03:30:24.852176 tst handover.py: using CellId 18779 03:30:24.975922 tst handover.py: using BVCI 18780 03:30:25.090175 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:30:25.103188 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:30:25.115388 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:30:25.127788 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:30:25.140216 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:30:25.152793 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:30:25.274526 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:30:25.393898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:25.855320 run create_hlr_db(pid=19041): Launched 03:30:26.017928 bus /sierra_2: Setting Powered False 03:30:27.080110 run create_hlr_db(pid=19041): Terminated: ok {rc=0} 03:30:27.495575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19043): Launched 03:30:27.822796 run osmo-hlr_10.42.42.2(pid=19044): Launched 03:30:28.069382 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:28.762969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19046): Launched 03:30:29.096601 run osmo-stp_10.42.42.5(pid=19048): Launched 03:30:29.282802 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:29.821094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19050): Launched 03:30:30.133185 run osmo-msc_10.42.42.6(pid=19051): Launched 03:30:30.306923 run osmo-stp_10.42.42.5(pid=19048): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19048)] 03:30:30.438086 run osmo-stp_10.42.42.5(pid=19048): stdout: | (launched: 2022-12-09_03:30:29.036500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:30.567386 run osmo-stp_10.42.42.5(pid=19048): stderr: | 20221209033029273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033029274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033029274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033029274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033029275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033029275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033029275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:30.695427 run osmo-stp_10.42.42.5(pid=19048): stdout: | (launched: 2022-12-09_03:30:29.036500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:30.818306 run osmo-stp_10.42.42.5(pid=19048): stderr: | 20221209033029273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033029274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033029274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033029274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033029275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033029275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033029275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:31.003071 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19048): Process ended prematurely: osmo-stp_10.42.42.5(pid=19048) [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19048)] [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 03:30:31.011487 tst handover.py:18: Test FAILED (7.0 sec) 03:30:31.038118 run osmo-hlr_10.42.42.2(pid=19044): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19044)] 03:30:31.086469 run osmo-hlr_10.42.42.2(pid=19044): stdout: | (launched: 2022-12-09_03:30:27.765329) 03:30:31.137491 run osmo-hlr_10.42.42.2(pid=19044): stderr: | 20221209033028097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033028097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033028097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033028097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033028097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033028098 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033028117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033028134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033028134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033028134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:31.207943 run osmo-msc_10.42.42.6(pid=19051): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19051)] 03:30:31.256855 run osmo-msc_10.42.42.6(pid=19051): stdout: | (launched: 2022-12-09_03:30:30.076372) 03:30:31.307445 run osmo-msc_10.42.42.6(pid=19051): stderr: | 20221209033030350 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033030350 DLGLOBAL DEBUG validating counter group 0x7f7e782cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033030351 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033030351 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033030351 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033030351 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033030353 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033030353 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033030353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033030353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:31.358752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19043): Terminating (SIGTERM) 03:30:31.399323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19046): Terminating (SIGTERM) 03:30:31.441009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19050): Terminating (SIGTERM) 03:30:31.484389 --- ParallelTerminationStrategy: PID 19043 died... 03:30:31.504491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19043): Terminated: ok {rc=0} 03:30:31.552247 --- ParallelTerminationStrategy: PID 19046 died... 03:30:31.571949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19046): Terminated: ok {rc=0} 03:30:31.617990 --- ParallelTerminationStrategy: PID 19050 died... 03:30:31.637118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19050): Terminated: ok {rc=0} 03:30:31.723052 bus /sierra_3: Setting Powered False 03:30:32.820787 bus /sierra_3: Setting Powered False 03:30:33.933391 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 03:30:35.204355 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:35.210077 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:30:35.258797 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:30:35.286277 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:30:35.339154 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:30:35.387312 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:30:35.415062 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:30:35.968579 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 03:30:35.973946 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:35.985428 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 03:30:36.033808 tst handover.py: using LAC 18780 03:30:36.161384 tst handover.py: using RAC 165 03:30:36.293759 tst handover.py: using CellId 18780 03:30:36.420670 tst handover.py: using BVCI 18781 03:30:36.539017 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 03:30:36.573998 tst handover.py: using LAC 18781 03:30:36.702722 tst handover.py: using RAC 166 03:30:36.829611 tst handover.py: using CellId 18781 03:30:36.956613 tst handover.py: using BVCI 18782 03:30:37.074944 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:37.086525 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:37.097910 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:37.109719 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:37.121263 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:37.132654 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 03:30:37.249778 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 03:30:37.370790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:37.845486 run create_hlr_db(pid=19056): Launched 03:30:37.969117 bus /sierra_2: Setting Powered False 03:30:39.033434 run create_hlr_db(pid=19056): Terminated: ok {rc=0} 03:30:39.456339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19058): Launched 03:30:39.780294 run osmo-hlr_10.42.42.2(pid=19059): Launched 03:30:39.904718 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:40.438922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19061): Launched 03:30:40.762488 run osmo-stp_10.42.42.5(pid=19062): Launched 03:30:40.886705 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:41.446220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19064): Launched 03:30:41.769661 run osmo-msc_10.42.42.6(pid=19065): Launched 03:30:41.951051 run osmo-stp_10.42.42.5(pid=19062): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19062)] 03:30:42.088252 run osmo-stp_10.42.42.5(pid=19062): stdout: | (launched: 2022-12-09_03:30:40.703385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:42.226214 run osmo-stp_10.42.42.5(pid=19062): stderr: | 20221209033040896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033040896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033040896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033040897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033040897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033040897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033040897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:42.373339 run osmo-stp_10.42.42.5(pid=19062): stdout: | (launched: 2022-12-09_03:30:40.703385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:42.499886 run osmo-stp_10.42.42.5(pid=19062): stderr: | 20221209033040896 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033040896 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033040896 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033040897 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033040897 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033040897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033040897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:42.651491 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19062): Process ended prematurely: osmo-stp_10.42.42.5(pid=19062) [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19062)] [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 03:30:42.660230 tst handover.py:18: Test FAILED (6.7 sec) 03:30:42.687744 run osmo-hlr_10.42.42.2(pid=19059): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19059)] 03:30:42.737264 run osmo-hlr_10.42.42.2(pid=19059): stdout: | (launched: 2022-12-09_03:30:39.721185) 03:30:42.788562 run osmo-hlr_10.42.42.2(pid=19059): stderr: | 20221209033039923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033039923 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033039923 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033039923 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033039923 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033039923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033039935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033039943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033039943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033039943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:42.859965 run osmo-msc_10.42.42.6(pid=19065): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19065)] 03:30:42.909427 run osmo-msc_10.42.42.6(pid=19065): stdout: | (launched: 2022-12-09_03:30:41.710615) 03:30:42.960420 run osmo-msc_10.42.42.6(pid=19065): stderr: | 20221209033042032 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033042032 DLGLOBAL DEBUG validating counter group 0x7f3889fedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033042033 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033042033 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033042033 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033042033 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033042035 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033042035 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033042035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033042035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:43.011678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19058): Terminating (SIGTERM) 03:30:43.052806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19061): Terminating (SIGTERM) 03:30:43.094210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19064): Terminating (SIGTERM) 03:30:43.135734 --- ParallelTerminationStrategy: PID 19058 died... 03:30:43.155469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19058): Terminated: ok {rc=0} 03:30:43.201864 --- ParallelTerminationStrategy: PID 19061 died... 03:30:43.221192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19061): Terminated: ok {rc=0} 03:30:43.267274 --- ParallelTerminationStrategy: PID 19064 died... 03:30:43.286593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19064): Terminated: ok {rc=0} 03:30:43.374060 bus /sierra_3: Setting Powered False 03:30:44.472058 bus /sierra_3: Setting Powered False 03:30:45.586379 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 03:30:46.862376 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:46.868072 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:30:46.941720 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:30:46.975227 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:30:47.034335 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:30:47.130330 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:30:47.164926 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:30:47.670688 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 03:30:47.676645 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:47.688199 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:30:47.736719 tst handover.py: using LAC 18782 03:30:47.866928 tst handover.py: using RAC 167 03:30:47.991009 tst handover.py: using CellId 18782 03:30:48.107302 tst handover.py: using BVCI 18783 03:30:48.216314 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:30:48.263692 tst handover.py: using LAC 18783 03:30:48.378574 tst handover.py: using RAC 168 03:30:48.493445 tst handover.py: using CellId 18783 03:30:48.609010 tst handover.py: using BVCI 18784 03:30:48.716352 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:48.727406 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:48.738273 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:48.749224 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:48.760015 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:48.770779 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:30:48.888879 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:30:49.004110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:49.439150 run create_hlr_db(pid=19070): Launched 03:30:49.561283 bus /sierra_2: Setting Powered False 03:30:50.621170 run create_hlr_db(pid=19070): Terminated: ok {rc=0} 03:30:51.010682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19072): Launched 03:30:51.308703 run osmo-hlr_10.42.42.2(pid=19073): Launched 03:30:51.421911 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:51.913254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19075): Launched 03:30:52.210206 run osmo-stp_10.42.42.5(pid=19076): Launched 03:30:52.323751 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:52.835662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19078): Launched 03:30:53.131984 run osmo-msc_10.42.42.6(pid=19079): Launched 03:30:53.298133 run osmo-stp_10.42.42.5(pid=19076): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19076)] 03:30:53.423742 run osmo-stp_10.42.42.5(pid=19076): stdout: | (launched: 2022-12-09_03:30:52.155941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:53.550131 run osmo-stp_10.42.42.5(pid=19076): stderr: | 20221209033052323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033052323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033052324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033052324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033052325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033052325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033052325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:53.673934 run osmo-stp_10.42.42.5(pid=19076): stdout: | (launched: 2022-12-09_03:30:52.155941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:53.791916 run osmo-stp_10.42.42.5(pid=19076): stderr: | 20221209033052323 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033052323 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033052324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033052324 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033052325 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033052325 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033052325 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:53.933367 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19076): Process ended prematurely: osmo-stp_10.42.42.5(pid=19076) [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19076)] [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 03:30:53.941618 tst handover.py:18: Test FAILED (6.3 sec) 03:30:53.967343 run osmo-hlr_10.42.42.2(pid=19073): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19073)] 03:30:54.013912 run osmo-hlr_10.42.42.2(pid=19073): stdout: | (launched: 2022-12-09_03:30:51.254185) 03:30:54.062239 run osmo-hlr_10.42.42.2(pid=19073): stderr: | 20221209033051427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033051427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033051427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033051427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033051427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033051427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033051438 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033051447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033051448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033051448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:54.129915 run osmo-msc_10.42.42.6(pid=19079): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19079)] 03:30:54.176490 run osmo-msc_10.42.42.6(pid=19079): stdout: | (launched: 2022-12-09_03:30:53.077831) 03:30:54.225164 run osmo-msc_10.42.42.6(pid=19079): stderr: | 20221209033053351 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033053351 DLGLOBAL DEBUG validating counter group 0x7fb89169bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033053351 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033053351 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033053352 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033053352 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033053354 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033053354 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033053354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033053354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:54.273551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19072): Terminating (SIGTERM) 03:30:54.312486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19075): Terminating (SIGTERM) 03:30:54.351532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19078): Terminating (SIGTERM) 03:30:54.390698 --- ParallelTerminationStrategy: PID 19072 died... 03:30:54.409479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19072): Terminated: ok {rc=0} 03:30:54.452834 --- ParallelTerminationStrategy: PID 19075 died... 03:30:54.471288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19075): Terminated: ok {rc=0} 03:30:54.514354 --- ParallelTerminationStrategy: PID 19078 died... 03:30:54.532687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19078): Terminated: ok {rc=0} 03:30:54.615069 bus /sierra_3: Setting Powered False 03:30:55.710844 bus /sierra_3: Setting Powered False 03:30:56.825445 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 03:30:58.097333 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:58.102835 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:30:58.162695 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:30:58.190371 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:30:58.243894 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:30:58.303623 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:30:58.331273 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:30:58.882903 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 03:30:58.888110 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:58.899505 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:30:58.944152 tst handover.py: using LAC 18784 03:30:59.070796 tst handover.py: using RAC 169 03:30:59.197933 tst handover.py: using CellId 18784 03:30:59.325032 tst handover.py: using BVCI 18785 03:30:59.443014 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:30:59.492608 tst handover.py: using LAC 18785 03:30:59.613228 tst handover.py: using RAC 170 03:30:59.731849 tst handover.py: using CellId 18785 03:30:59.850187 tst handover.py: using BVCI 18786 03:30:59.961099 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:59.972293 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:59.983386 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:59.994999 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:00.006509 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:00.018054 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:00.136679 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:00.255508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:00.724071 run create_hlr_db(pid=19084): Launched 03:31:00.909194 bus /sierra_2: Setting Powered False 03:31:01.972071 run create_hlr_db(pid=19084): Terminated: ok {rc=0} 03:31:02.398569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19086): Launched 03:31:02.718096 run osmo-hlr_10.42.42.2(pid=19087): Launched 03:31:02.845982 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:03.398463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19089): Launched 03:31:03.717459 run osmo-stp_10.42.42.5(pid=19090): Launched 03:31:03.840467 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:04.390275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19092): Launched 03:31:04.709652 run osmo-msc_10.42.42.6(pid=19093): Launched 03:31:04.889291 run osmo-stp_10.42.42.5(pid=19090): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)] 03:31:05.025120 run osmo-stp_10.42.42.5(pid=19090): stdout: | (launched: 2022-12-09_03:31:03.659126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:05.161669 run osmo-stp_10.42.42.5(pid=19090): stderr: | 20221209033103849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033103849 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033103850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033103850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033103850 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033103850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033103851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:05.297217 run osmo-stp_10.42.42.5(pid=19090): stdout: | (launched: 2022-12-09_03:31:03.659126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:05.424367 run osmo-stp_10.42.42.5(pid=19090): stderr: | 20221209033103849 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033103849 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033103850 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033103850 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033103850 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033103850 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033103851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:05.576579 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19090): Process ended prematurely: osmo-stp_10.42.42.5(pid=19090) [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)] [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 03:31:05.585347 tst handover.py:18: Test FAILED (6.7 sec) 03:31:05.613102 run osmo-hlr_10.42.42.2(pid=19087): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19087)] 03:31:05.662974 run osmo-hlr_10.42.42.2(pid=19087): stdout: | (launched: 2022-12-09_03:31:02.659850) 03:31:05.714884 run osmo-hlr_10.42.42.2(pid=19087): stderr: | 20221209033102855 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033102855 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033102855 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033102855 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033102855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033102855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033102868 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033102879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033102880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033102880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:05.786489 run osmo-msc_10.42.42.6(pid=19093): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19093)] 03:31:05.836207 run osmo-msc_10.42.42.6(pid=19093): stdout: | (launched: 2022-12-09_03:31:04.651643) 03:31:05.887404 run osmo-msc_10.42.42.6(pid=19093): stderr: | 20221209033104971 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033104971 DLGLOBAL DEBUG validating counter group 0x7f5429a2fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033104971 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033104971 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033104972 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033104972 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033104974 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033104974 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033104974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033104974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:05.939047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19086): Terminating (SIGTERM) 03:31:05.980278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19089): Terminating (SIGTERM) 03:31:06.021625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19092): Terminating (SIGTERM) 03:31:06.063355 --- ParallelTerminationStrategy: PID 19086 died... 03:31:06.083235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19086): Terminated: ok {rc=0} 03:31:06.129432 --- ParallelTerminationStrategy: PID 19089 died... 03:31:06.148509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19089): Terminated: ok {rc=0} 03:31:06.195241 --- ParallelTerminationStrategy: PID 19092 died... 03:31:06.214606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19092): Terminated: ok {rc=0} 03:31:06.302023 bus /sierra_3: Setting Powered False 03:31:07.400240 bus /sierra_3: Setting Powered False 03:31:08.513665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 03:31:09.787400 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:09.793367 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:31:09.843818 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:31:09.870284 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:31:09.920158 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:31:09.972916 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:31:10.000692 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:31:10.549818 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 03:31:10.556490 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:31:10.569055 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 03:31:10.620121 tst handover.py: using LAC 18786 03:31:10.746235 tst handover.py: using RAC 171 03:31:10.873205 tst handover.py: using CellId 18786 03:31:10.998804 tst handover.py: using BVCI 18787 03:31:11.115374 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 03:31:11.149747 tst handover.py: using LAC 18787 03:31:11.275747 tst handover.py: using RAC 172 03:31:11.400136 tst handover.py: using CellId 18787 03:31:11.523326 tst handover.py: using BVCI 18788 03:31:11.639940 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:31:11.651388 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:31:11.662592 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:31:11.674792 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:31:11.686642 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:31:11.698586 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 03:31:11.813287 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 03:31:11.926562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:12.362364 run create_hlr_db(pid=19098): Launched 03:31:12.483868 bus /sierra_2: Setting Powered False 03:31:13.543148 run create_hlr_db(pid=19098): Terminated: ok {rc=0} 03:31:13.950714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19100): Launched 03:31:14.270910 run osmo-hlr_10.42.42.2(pid=19101): Launched 03:31:14.393578 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:14.918819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19103): Launched 03:31:15.237948 run osmo-stp_10.42.42.5(pid=19104): Launched 03:31:15.360736 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:15.929601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19106): Launched 03:31:16.280049 run osmo-msc_10.42.42.6(pid=19107): Launched 03:31:16.638455 run osmo-stp_10.42.42.5(pid=19104): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19104)] 03:31:16.920703 run osmo-stp_10.42.42.5(pid=19104): stdout: | (launched: 2022-12-09_03:31:15.179799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:17.058422 run osmo-stp_10.42.42.5(pid=19104): stderr: | 20221209033115371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033115372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033115372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033115372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033115373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033115373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033115373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:17.196083 run osmo-stp_10.42.42.5(pid=19104): stdout: | (launched: 2022-12-09_03:31:15.179799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:17.324479 run osmo-stp_10.42.42.5(pid=19104): stderr: | 20221209033115371 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033115372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033115372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033115372 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033115373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033115373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033115373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:17.477670 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19104): Process ended prematurely: osmo-stp_10.42.42.5(pid=19104) [trial-2353↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19104)] [trial-2353↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 03:31:17.486790 tst handover.py:18: Test FAILED (6.9 sec) 03:31:17.514614 run osmo-hlr_10.42.42.2(pid=19101): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19101)] 03:31:17.565327 run osmo-hlr_10.42.42.2(pid=19101): stdout: | (launched: 2022-12-09_03:31:14.212814) 03:31:17.617172 run osmo-hlr_10.42.42.2(pid=19101): stderr: | 20221209033114409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033114409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033114409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033114409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033114410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033114410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033114422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033114431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033114431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033114431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:17.689460 run osmo-msc_10.42.42.6(pid=19107): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19107)] 03:31:17.740003 run osmo-msc_10.42.42.6(pid=19107): stdout: | (launched: 2022-12-09_03:31:16.209506) 03:31:17.791802 run osmo-msc_10.42.42.6(pid=19107): stderr: | 20221209033116678 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033116678 DLGLOBAL DEBUG validating counter group 0x7f841c1b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033116678 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033116679 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033116679 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033116679 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033116681 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033116681 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033116681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033116681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:17.844155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19100): Terminating (SIGTERM) 03:31:17.886150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19103): Terminating (SIGTERM) 03:31:17.928154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19106): Terminating (SIGTERM) 03:31:17.970508 --- ParallelTerminationStrategy: PID 19100 died... 03:31:17.990583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19100): Terminated: ok {rc=0} 03:31:18.037624 --- ParallelTerminationStrategy: PID 19103 died... 03:31:18.057224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19103): Terminated: ok {rc=0} 03:31:18.103867 --- ParallelTerminationStrategy: PID 19106 died... 03:31:18.123578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19106): Terminated: ok {rc=0} 03:31:18.211136 bus /sierra_3: Setting Powered False 03:31:19.308114 bus /sierra_3: Setting Powered False 03:31:20.423232 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 03:31:21.681694 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:21.687318 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:31:21.749687 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:31:21.775861 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:31:21.826858 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:31:21.892193 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:31:21.918756 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:31:22.467275 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 03:31:22.472262 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:22.483217 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:31:22.530836 tst handover.py: using LAC 18788 03:31:22.650137 tst handover.py: using RAC 173 03:31:22.769140 tst handover.py: using CellId 18788 03:31:22.887807 tst handover.py: using BVCI 18789 03:31:22.997379 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:31:23.044780 tst handover.py: using LAC 18789 03:31:23.161940 tst handover.py: using RAC 174 03:31:23.279582 tst handover.py: using CellId 18789 03:31:23.396674 tst handover.py: using BVCI 18790 03:31:23.505008 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:23.515945 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:23.526650 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:23.537448 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:23.548157 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:23.558906 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:31:23.679187 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:31:23.795850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:24.233857 run create_hlr_db(pid=19112): Launched 03:31:24.355692 bus /sierra_2: Setting Powered False 03:31:25.415850 run create_hlr_db(pid=19112): Terminated: ok {rc=0} 03:31:25.824820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19114): Launched 03:31:26.144136 run osmo-hlr_10.42.42.2(pid=19115): Launched 03:31:26.267235 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:26.794483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19117): Launched 03:31:27.113361 run osmo-stp_10.42.42.5(pid=19118): Launched 03:31:27.236300 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:27.787159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19120): Launched 03:31:28.107169 run osmo-msc_10.42.42.6(pid=19121): Launched 03:31:28.286666 run osmo-stp_10.42.42.5(pid=19118): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19118)] 03:31:28.422932 run osmo-stp_10.42.42.5(pid=19118): stdout: | (launched: 2022-12-09_03:31:27.055554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:28.558959 run osmo-stp_10.42.42.5(pid=19118): stderr: | 20221209033127247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033127247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033127247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033127247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033127248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033127248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033127248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:28.693656 run osmo-stp_10.42.42.5(pid=19118): stdout: | (launched: 2022-12-09_03:31:27.055554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:28.821275 run osmo-stp_10.42.42.5(pid=19118): stderr: | 20221209033127247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033127247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033127247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033127247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033127248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033127248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033127248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:28.973699 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19118): Process ended prematurely: osmo-stp_10.42.42.5(pid=19118) [trial-2353↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19118)] [trial-2353↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 03:31:28.982573 tst handover.py:18: Test FAILED (6.5 sec) 03:31:29.010487 run osmo-hlr_10.42.42.2(pid=19115): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19115)] 03:31:29.060405 run osmo-hlr_10.42.42.2(pid=19115): stdout: | (launched: 2022-12-09_03:31:26.086383) 03:31:29.111898 run osmo-hlr_10.42.42.2(pid=19115): stderr: | 20221209033126283 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033126283 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033126283 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033126283 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033126283 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033126283 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033126296 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033126304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033126304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033126304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:29.183393 run osmo-msc_10.42.42.6(pid=19121): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19121)] 03:31:29.234067 run osmo-msc_10.42.42.6(pid=19121): stdout: | (launched: 2022-12-09_03:31:28.049252) 03:31:29.285805 run osmo-msc_10.42.42.6(pid=19121): stderr: | 20221209033128367 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033128368 DLGLOBAL DEBUG validating counter group 0x7f7871f1fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033128368 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033128368 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033128368 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033128368 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033128370 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033128371 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033128371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033128371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:29.337739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19114): Terminating (SIGTERM) 03:31:29.379168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19117): Terminating (SIGTERM) 03:31:29.420678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19120): Terminating (SIGTERM) 03:31:29.462578 --- ParallelTerminationStrategy: PID 19114 died... 03:31:29.482250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19114): Terminated: ok {rc=0} 03:31:29.528805 --- ParallelTerminationStrategy: PID 19117 died... 03:31:29.548307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19117): Terminated: ok {rc=0} 03:31:29.594377 --- ParallelTerminationStrategy: PID 19120 died... 03:31:29.613806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19120): Terminated: ok {rc=0} 03:31:29.700385 bus /sierra_3: Setting Powered False 03:31:30.797313 bus /sierra_3: Setting Powered False 03:31:31.925538 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 03:31:33.215039 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:33.220723 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:31:33.285181 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:31:33.313009 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:31:33.366773 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:31:33.429618 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:31:33.456059 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:31:34.012246 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 03:31:34.017879 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:34.029471 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:34.079728 tst handover.py: using LAC 18790 03:31:34.206418 tst handover.py: using RAC 175 03:31:34.337846 tst handover.py: using CellId 18790 03:31:34.463992 tst handover.py: using BVCI 18791 03:31:34.583108 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:34.630250 tst handover.py: using LAC 18791 03:31:34.756679 tst handover.py: using RAC 176 03:31:34.881581 tst handover.py: using CellId 18791 03:31:35.008040 tst handover.py: using BVCI 18792 03:31:35.125143 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:35.136670 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:35.148166 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:35.160025 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:35.171812 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:35.183479 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:35.303945 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:35.423399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:35.894830 run create_hlr_db(pid=19126): Launched 03:31:36.017186 bus /sierra_2: Setting Powered False 03:31:37.076616 run create_hlr_db(pid=19126): Terminated: ok {rc=0} 03:31:37.466256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19128): Launched 03:31:37.763190 run osmo-hlr_10.42.42.2(pid=19129): Launched 03:31:37.878034 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:38.363458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19131): Launched 03:31:38.660532 run osmo-stp_10.42.42.5(pid=19132): Launched 03:31:38.773947 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:39.286705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19134): Launched 03:31:39.583826 run osmo-msc_10.42.42.6(pid=19135): Launched 03:31:39.751499 run osmo-stp_10.42.42.5(pid=19132): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19132)] 03:31:39.878507 run osmo-stp_10.42.42.5(pid=19132): stdout: | (launched: 2022-12-09_03:31:38.605938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:40.004736 run osmo-stp_10.42.42.5(pid=19132): stderr: | 20221209033138777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033138777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033138778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033138778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033138778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033138779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033138779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:40.128236 run osmo-stp_10.42.42.5(pid=19132): stdout: | (launched: 2022-12-09_03:31:38.605938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:40.246359 run osmo-stp_10.42.42.5(pid=19132): stderr: | 20221209033138777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033138777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033138778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033138778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033138778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033138779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033138779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:40.387589 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19132): Process ended prematurely: osmo-stp_10.42.42.5(pid=19132) [trial-2353↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19132)] [trial-2353↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 03:31:40.395696 tst handover.py:18: Test FAILED (6.4 sec) 03:31:40.421166 run osmo-hlr_10.42.42.2(pid=19129): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19129)] 03:31:40.468069 run osmo-hlr_10.42.42.2(pid=19129): stdout: | (launched: 2022-12-09_03:31:37.708859) 03:31:40.516350 run osmo-hlr_10.42.42.2(pid=19129): stderr: | 20221209033137884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033137884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033137884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033137884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033137884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033137884 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033137895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033137904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033137904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033137904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:40.583920 run osmo-msc_10.42.42.6(pid=19135): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19135)] 03:31:40.630801 run osmo-msc_10.42.42.6(pid=19135): stdout: | (launched: 2022-12-09_03:31:39.529390) 03:31:40.679021 run osmo-msc_10.42.42.6(pid=19135): stderr: | 20221209033139799 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033139799 DLGLOBAL DEBUG validating counter group 0x7efce7fefc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033139799 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033139799 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033139799 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033139799 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033139802 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033139803 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033139803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033139803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:40.727699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19128): Terminating (SIGTERM) 03:31:40.766553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19131): Terminating (SIGTERM) 03:31:40.805402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19134): Terminating (SIGTERM) 03:31:40.844671 --- ParallelTerminationStrategy: PID 19128 died... 03:31:40.863490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19128): Terminated: ok {rc=0} 03:31:40.907269 --- ParallelTerminationStrategy: PID 19131 died... 03:31:40.925665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19131): Terminated: ok {rc=0} 03:31:40.968657 --- ParallelTerminationStrategy: PID 19134 died... 03:31:40.987066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19134): Terminated: ok {rc=0} 03:31:41.068724 bus /sierra_3: Setting Powered False 03:31:42.162958 bus /sierra_3: Setting Powered False 03:31:43.277562 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 03:31:44.554061 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:44.559887 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:31:44.611942 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:31:44.639321 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:31:44.691553 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:31:44.743527 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:31:44.771079 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:31:45.325497 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 03:31:45.331027 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:45.342458 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:31:45.382529 tst handover.py: using LAC 18792 03:31:45.507484 tst handover.py: using RAC 177 03:31:45.633702 tst handover.py: using CellId 18792 03:31:45.750927 tst handover.py: using BVCI 18793 03:31:45.871015 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:31:45.943636 tst handover.py: using LAC 18793 03:31:46.070139 tst handover.py: using RAC 178 03:31:46.230266 tst handover.py: using CellId 18793 03:31:46.363301 tst handover.py: using BVCI 18794 03:31:46.487609 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:46.500908 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:46.514246 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:46.526564 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:46.539311 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:46.553238 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:31:46.677756 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:31:46.814054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:47.328611 run create_hlr_db(pid=19140): Launched 03:31:47.451616 bus /sierra_2: Setting Powered False 03:31:48.515916 run create_hlr_db(pid=19140): Terminated: ok {rc=0} 03:31:48.917465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19142): Launched 03:31:49.214496 run osmo-hlr_10.42.42.2(pid=19143): Launched 03:31:49.328055 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:49.813384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19145): Launched 03:31:50.111443 run osmo-stp_10.42.42.5(pid=19146): Launched 03:31:50.225154 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:50.738408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19148): Launched 03:31:51.035344 run osmo-msc_10.42.42.6(pid=19149): Launched 03:31:51.201867 run osmo-stp_10.42.42.5(pid=19146): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19146)] 03:31:51.328525 run osmo-stp_10.42.42.5(pid=19146): stdout: | (launched: 2022-12-09_03:31:50.056767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:51.454209 run osmo-stp_10.42.42.5(pid=19146): stderr: | 20221209033150228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033150228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033150228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033150229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033150229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033150229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033150229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:51.577894 run osmo-stp_10.42.42.5(pid=19146): stdout: | (launched: 2022-12-09_03:31:50.056767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:51.695759 run osmo-stp_10.42.42.5(pid=19146): stderr: | 20221209033150228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033150228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033150228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033150229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033150229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033150229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033150229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:51.837483 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19146): Process ended prematurely: osmo-stp_10.42.42.5(pid=19146) [trial-2353↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19146)] [trial-2353↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 03:31:51.845564 tst handover.py:18: Test FAILED (6.5 sec) 03:31:51.871301 run osmo-hlr_10.42.42.2(pid=19143): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19143)] 03:31:51.918553 run osmo-hlr_10.42.42.2(pid=19143): stdout: | (launched: 2022-12-09_03:31:49.159957) 03:31:51.967692 run osmo-hlr_10.42.42.2(pid=19143): stderr: | 20221209033149334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033149334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033149334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033149334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033149334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033149334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033149345 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033149354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033149354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033149355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:52.035763 run osmo-msc_10.42.42.6(pid=19149): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19149)] 03:31:52.083028 run osmo-msc_10.42.42.6(pid=19149): stdout: | (launched: 2022-12-09_03:31:50.980860) 03:31:52.131891 run osmo-msc_10.42.42.6(pid=19149): stderr: | 20221209033151254 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033151254 DLGLOBAL DEBUG validating counter group 0x7f3d8b720c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033151254 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033151254 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033151254 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033151255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033151256 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033151257 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033151257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033151257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:52.180833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19142): Terminating (SIGTERM) 03:31:52.219861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19145): Terminating (SIGTERM) 03:31:52.259436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19148): Terminating (SIGTERM) 03:31:52.298962 --- ParallelTerminationStrategy: PID 19142 died... 03:31:52.317792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19142): Terminated: ok {rc=0} 03:31:52.361037 --- ParallelTerminationStrategy: PID 19145 died... 03:31:52.379565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19145): Terminated: ok {rc=0} 03:31:52.422687 --- ParallelTerminationStrategy: PID 19148 died... 03:31:52.441020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19148): Terminated: ok {rc=0} 03:31:52.524721 bus /sierra_3: Setting Powered False 03:31:53.622716 bus /sierra_3: Setting Powered False 03:31:54.737336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 03:31:55.992554 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:55.998211 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:31:56.049881 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:31:56.077336 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:31:56.130971 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:31:56.183348 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:31:56.210942 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:31:56.759020 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 03:31:56.764634 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:56.776061 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:56.812279 tst handover.py: using LAC 18794 03:31:56.939720 tst handover.py: using RAC 179 03:31:57.065260 tst handover.py: using CellId 18794 03:31:57.192645 tst handover.py: using BVCI 18795 03:31:57.309569 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:57.359473 tst handover.py: using LAC 18795 03:31:57.479615 tst handover.py: using RAC 180 03:31:57.599543 tst handover.py: using CellId 18795 03:31:57.717096 tst handover.py: using BVCI 18796 03:31:57.825207 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:57.835866 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:57.846445 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:57.857045 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:57.867811 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:57.878419 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:57.995521 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:58.113685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:58.584601 run create_hlr_db(pid=19154): Launched 03:31:58.707380 bus /sierra_2: Setting Powered False 03:31:59.770314 run create_hlr_db(pid=19154): Terminated: ok {rc=0} 03:32:00.188200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19156): Launched 03:32:00.509173 run osmo-hlr_10.42.42.2(pid=19157): Launched 03:32:00.632757 run osmo-stp_10.42.42.5: Starting osmo-stp 03:32:01.192210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19159): Launched 03:32:01.541635 run osmo-stp_10.42.42.5(pid=19160): Launched 03:32:01.786840 run osmo-msc_10.42.42.6: Starting osmo-msc 03:32:02.414303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19162): Launched 03:32:02.735347 run osmo-msc_10.42.42.6(pid=19163): Launched 03:32:02.914438 run osmo-stp_10.42.42.5(pid=19160): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19160)] 03:32:03.050583 run osmo-stp_10.42.42.5(pid=19160): stdout: | (launched: 2022-12-09_03:32:01.469512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:32:03.186859 run osmo-stp_10.42.42.5(pid=19160): stderr: | 20221209033201760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033201760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033201761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033201761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033201762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033201762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033201762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:32:03.322779 run osmo-stp_10.42.42.5(pid=19160): stdout: | (launched: 2022-12-09_03:32:01.469512) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:32:03.450687 run osmo-stp_10.42.42.5(pid=19160): stderr: | 20221209033201760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033201760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033201761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033201761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033201762 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033201762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033201762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:32:03.603635 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19160): Process ended prematurely: osmo-stp_10.42.42.5(pid=19160) [trial-2353↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19160)] [trial-2353↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 03:32:03.612640 tst handover.py:18: Test FAILED (6.8 sec) 03:32:03.640553 run osmo-hlr_10.42.42.2(pid=19157): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19157)] 03:32:03.691214 run osmo-hlr_10.42.42.2(pid=19157): stdout: | (launched: 2022-12-09_03:32:00.450958) 03:32:03.743041 run osmo-hlr_10.42.42.2(pid=19157): stderr: | 20221209033200648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033200648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033200648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033200648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033200648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033200648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033200660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033200669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033200669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033200669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:32:03.815284 run osmo-msc_10.42.42.6(pid=19163): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19163)] 03:32:03.865293 run osmo-msc_10.42.42.6(pid=19163): stdout: | (launched: 2022-12-09_03:32:02.677058) 03:32:03.916891 run osmo-msc_10.42.42.6(pid=19163): stderr: | 20221209033202997 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033202997 DLGLOBAL DEBUG validating counter group 0x7f6df7b42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033202997 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033202997 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033202997 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033202998 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033202999 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033203000 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033203000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033203000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:32:03.969203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19156): Terminating (SIGTERM) 03:32:04.010938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19159): Terminating (SIGTERM) 03:32:04.052777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19162): Terminating (SIGTERM) 03:32:04.095227 --- ParallelTerminationStrategy: PID 19156 died... 03:32:04.115412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19156): Terminated: ok {rc=0} 03:32:04.162342 --- ParallelTerminationStrategy: PID 19159 died... 03:32:04.182072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19159): Terminated: ok {rc=0} 03:32:04.229340 --- ParallelTerminationStrategy: PID 19162 died... 03:32:04.249090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19162): Terminated: ok {rc=0} 03:32:04.337102 bus /sierra_3: Setting Powered False 03:32:05.435938 bus /sierra_3: Setting Powered False 03:32:06.549655 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2353 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 03:32:07.801099 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:32:07.806407 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:32:07.867890 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:32:07.894541 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:32:07.947110 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:32:08.009307 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:32:08.035668 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:32:08.584587 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2353 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 03:32:08.589689 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:32:08.600439 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:32:08.650166 tst handover.py: using LAC 18796 03:32:08.766931 tst handover.py: using RAC 181 03:32:08.882209 tst handover.py: using CellId 18796 03:32:08.997676 tst handover.py: using BVCI 18797 03:32:09.105717 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:32:09.152145 tst handover.py: using LAC 18797 03:32:09.271586 tst handover.py: using RAC 182 03:32:09.389114 tst handover.py: using CellId 18797 03:32:09.504376 tst handover.py: using BVCI 18798 03:32:09.611973 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:32:09.622821 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:32:09.633594 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:32:09.644170 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:32:09.654830 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:32:09.665478 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:32:09.779133 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:32:09.896400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:32:10.335045 run create_hlr_db(pid=19168): Launched 03:32:10.457074 bus /sierra_2: Setting Powered False 03:32:11.516499 run create_hlr_db(pid=19168): Terminated: ok {rc=0} 03:32:11.907143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19170): Launched 03:32:12.205373 run osmo-hlr_10.42.42.2(pid=19171): Launched 03:32:12.318347 run osmo-stp_10.42.42.5: Starting osmo-stp 03:32:12.819364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19173): Launched 03:32:13.115928 run osmo-stp_10.42.42.5(pid=19174): Launched 03:32:13.228738 run osmo-msc_10.42.42.6: Starting osmo-msc 03:32:13.740740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19176): Launched 03:32:14.041685 run osmo-msc_10.42.42.6(pid=19177): Launched 03:32:14.223472 run osmo-stp_10.42.42.5(pid=19174): ERR: Terminated: ERROR {rc=1} [trial-2353↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19174)] 03:32:14.362478 run osmo-stp_10.42.42.5(pid=19174): stdout: | (launched: 2022-12-09_03:32:13.061536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:32:14.500249 run osmo-stp_10.42.42.5(pid=19174): stderr: | 20221209033213232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033213232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033213232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033213233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033213233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033213234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033213234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:32:14.636183 run osmo-stp_10.42.42.5(pid=19174): stdout: | (launched: 2022-12-09_03:32:13.061536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:32:14.764517 run osmo-stp_10.42.42.5(pid=19174): stderr: | 20221209033213232 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209033213232 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209033213232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209033213233 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209033213233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209033213234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209033213234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:32:14.917785 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=19174): Process ended prematurely: osmo-stp_10.42.42.5(pid=19174) [trial-2353↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19174)] [trial-2353↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 03:32:14.926768 tst handover.py:18: Test FAILED (6.3 sec) 03:32:14.954760 run osmo-hlr_10.42.42.2(pid=19171): ERR: Terminated: ERROR {rc=237} [trial-2353↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19171)] 03:32:15.005395 run osmo-hlr_10.42.42.2(pid=19171): stdout: | (launched: 2022-12-09_03:32:12.150731) 03:32:15.057288 run osmo-hlr_10.42.42.2(pid=19171): stderr: | 20221209033212326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209033212326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209033212326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209033212326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209033212326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209033212326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209033212338 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209033212348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209033212348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209033212348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:32:15.129341 run osmo-msc_10.42.42.6(pid=19177): ERR: Terminated: ERROR {rc=2} [trial-2353↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19177)] 03:32:15.179850 run osmo-msc_10.42.42.6(pid=19177): stdout: | (launched: 2022-12-09_03:32:13.983408) 03:32:15.232287 run osmo-msc_10.42.42.6(pid=19177): stderr: | 20221209033214303 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209033214303 DLGLOBAL DEBUG validating counter group 0x7ff7ed8b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209033214303 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209033214303 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209033214303 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209033214303 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209033214305 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209033214306 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209033214306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209033214306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:32:15.284915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19170): Terminating (SIGTERM) 03:32:15.327277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19173): Terminating (SIGTERM) 03:32:15.369270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19176): Terminating (SIGTERM) 03:32:15.411515 --- ParallelTerminationStrategy: PID 19170 died... 03:32:15.431533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19170): Terminated: ok {rc=0} 03:32:15.478594 --- ParallelTerminationStrategy: PID 19173 died... 03:32:15.498224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19173): Terminated: ok {rc=0} 03:32:15.545089 --- ParallelTerminationStrategy: PID 19176 died... 03:32:15.564776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19176): Terminated: ok {rc=0} 03:32:15.651702 bus /sierra_3: Setting Powered False 03:32:16.750190 bus /sierra_3: Setting Powered False 03:32:17.868439 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2353 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 03:32:19.140298 tst trial-2353: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353/run.2022-12-09_02-07-59/trial-2353.xml -------------------------------------------------------------------------------------------- trial-2353 FAIL -------------------------------------------------------------------------------------------- 03:32:21.067930 tst trial-2353: trial-2353: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=10408): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10408) [trial-2353↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10408)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.5 sec) Error: osmo-stp_10.42.42.5(pid=10419): Process ended prematurely: osmo-stp_10.42.42.5(pid=10419) [trial-2353↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10419)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=10428): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10428) [trial-2353↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10428)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10438): Process ended prematurely: osmo-stp_10.42.42.5(pid=10438) [trial-2353↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10438)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10452): Process ended prematurely: osmo-stp_10.42.42.5(pid=10452) [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10452)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10464): Process ended prematurely: osmo-stp_10.42.42.5(pid=10464) [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10464)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10479): Process ended prematurely: osmo-stp_10.42.42.5(pid=10479) [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10479)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10490): Process ended prematurely: osmo-stp_10.42.42.5(pid=10490) [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10490)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10505): Process ended prematurely: osmo-stp_10.42.42.5(pid=10505) [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10505)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10516): Process ended prematurely: osmo-stp_10.42.42.5(pid=10516) [trial-2353↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10516)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10530): Process ended prematurely: osmo-stp_10.42.42.5(pid=10530) [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10530)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10541): Process ended prematurely: osmo-stp_10.42.42.5(pid=10541) [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10541)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10555): Process ended prematurely: osmo-stp_10.42.42.5(pid=10555) [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10555)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10566): Process ended prematurely: osmo-stp_10.42.42.5(pid=10566) [trial-2353↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10566)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10582): Process ended prematurely: osmo-stp_10.42.42.5(pid=10582) [trial-2353↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10582)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10593): Process ended prematurely: osmo-stp_10.42.42.5(pid=10593) [trial-2353↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10593)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10607): Process ended prematurely: osmo-stp_10.42.42.5(pid=10607) [trial-2353↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10607)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10623): Process ended prematurely: osmo-stp_10.42.42.5(pid=10623) [trial-2353↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10623)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10637): Process ended prematurely: osmo-stp_10.42.42.5(pid=10637) [trial-2353↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10637)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10648): Process ended prematurely: osmo-stp_10.42.42.5(pid=10648) [trial-2353↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10648)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.5 sec) Error: osmo-stp_10.42.42.5(pid=10666): Process ended prematurely: osmo-stp_10.42.42.5(pid=10666) [trial-2353↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10666)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10678): Process ended prematurely: osmo-stp_10.42.42.5(pid=10678) [trial-2353↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10678)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=10696): Process ended prematurely: osmo-stp_10.42.42.5(pid=10696) [trial-2353↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10696)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10706): Process ended prematurely: osmo-stp_10.42.42.5(pid=10706) [trial-2353↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10706)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=10718): Process ended prematurely: osmo-stp_10.42.42.5(pid=10718) [trial-2353↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10718)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10735): Process ended prematurely: osmo-stp_10.42.42.5(pid=10735) [trial-2353↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10735)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=10750): Process ended prematurely: osmo-stp_10.42.42.5(pid=10750) [trial-2353↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10750)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=10768): Process ended prematurely: osmo-stp_10.42.42.5(pid=10768) [trial-2353↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10768)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10778): Process ended prematurely: osmo-stp_10.42.42.5(pid=10778) [trial-2353↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10778)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=10788): Process ended prematurely: osmo-stp_10.42.42.5(pid=10788) [trial-2353↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10788)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=10805): Process ended prematurely: osmo-stp_10.42.42.5(pid=10805) [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10805)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=10817): Process ended prematurely: osmo-stp_10.42.42.5(pid=10817) [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10817)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=10836): Process ended prematurely: osmo-stp_10.42.42.5(pid=10836) [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10836)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10846): Process ended prematurely: osmo-stp_10.42.42.5(pid=10846) [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10846)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10856): Process ended prematurely: osmo-stp_10.42.42.5(pid=10856) [trial-2353↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10856)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=10874): Process ended prematurely: osmo-stp_10.42.42.5(pid=10874) [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10874)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=10889): Process ended prematurely: osmo-stp_10.42.42.5(pid=10889) [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10889)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=10919): Process ended prematurely: osmo-stp_10.42.42.5(pid=10919) [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10919)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10932): Process ended prematurely: osmo-stp_10.42.42.5(pid=10932) [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10932)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10942): Process ended prematurely: osmo-stp_10.42.42.5(pid=10942) [trial-2353↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10942)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10955): Process ended prematurely: osmo-stp_10.42.42.5(pid=10955) [trial-2353↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10955)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10968): Process ended prematurely: osmo-stp_10.42.42.5(pid=10968) [trial-2353↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10968)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=10976): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10976) [trial-2353↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10976)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=10986): Process ended prematurely: osmo-stp_10.42.42.5(pid=10986) [trial-2353↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10986)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=10996): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10996) [trial-2353↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10996)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11007): Process ended prematurely: osmo-stp_10.42.42.5(pid=11007) [trial-2353↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11007)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11041): Process ended prematurely: osmo-stp_10.42.42.5(pid=11041) [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11041)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11053): Process ended prematurely: osmo-stp_10.42.42.5(pid=11053) [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11053)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11068): Process ended prematurely: osmo-stp_10.42.42.5(pid=11068) [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11068)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11079): Process ended prematurely: osmo-stp_10.42.42.5(pid=11079) [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11079)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11093): Process ended prematurely: osmo-stp_10.42.42.5(pid=11093) [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11093)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11104): Process ended prematurely: osmo-stp_10.42.42.5(pid=11104) [trial-2353↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11104)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11118): Process ended prematurely: osmo-stp_10.42.42.5(pid=11118) [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11118)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11132): Process ended prematurely: osmo-stp_10.42.42.5(pid=11132) [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11132)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11147): Process ended prematurely: osmo-stp_10.42.42.5(pid=11147) [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11147)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11158): Process ended prematurely: osmo-stp_10.42.42.5(pid=11158) [trial-2353↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11158)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11173): Process ended prematurely: osmo-stp_10.42.42.5(pid=11173) [trial-2353↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11173)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11184): Process ended prematurely: osmo-stp_10.42.42.5(pid=11184) [trial-2353↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11184)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11198): Process ended prematurely: osmo-stp_10.42.42.5(pid=11198) [trial-2353↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11198)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11209): Process ended prematurely: osmo-stp_10.42.42.5(pid=11209) [trial-2353↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11209)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11223): Process ended prematurely: osmo-stp_10.42.42.5(pid=11223) [trial-2353↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11223)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11235): Process ended prematurely: osmo-stp_10.42.42.5(pid=11235) [trial-2353↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11235)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11254): Process ended prematurely: osmo-stp_10.42.42.5(pid=11254) [trial-2353↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11254)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=11266): Process ended prematurely: osmo-stp_10.42.42.5(pid=11266) [trial-2353↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11266)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=11284): Process ended prematurely: osmo-stp_10.42.42.5(pid=11284) [trial-2353↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11284)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11294): Process ended prematurely: osmo-stp_10.42.42.5(pid=11294) [trial-2353↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11294)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11304): Process ended prematurely: osmo-stp_10.42.42.5(pid=11304) [trial-2353↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11304)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11321): Process ended prematurely: osmo-stp_10.42.42.5(pid=11321) [trial-2353↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11321)] FAIL: iperf3.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11406): Process ended prematurely: osmo-stp_10.42.42.5(pid=11406) [trial-2353↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11406)] FAIL: iperf3m4.py (11.8 sec) Error: osmo-stp_10.42.42.5(pid=11622): Process ended prematurely: osmo-stp_10.42.42.5(pid=11622) [trial-2353↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11622)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11633): Process ended prematurely: osmo-stp_10.42.42.5(pid=11633) [trial-2353↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11633)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11643): Process ended prematurely: osmo-stp_10.42.42.5(pid=11643) [trial-2353↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11643)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11660): Process ended prematurely: osmo-stp_10.42.42.5(pid=11660) [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11660)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=11672): Process ended prematurely: osmo-stp_10.42.42.5(pid=11672) [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11672)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=11690): Process ended prematurely: osmo-stp_10.42.42.5(pid=11690) [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11690)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11701): Process ended prematurely: osmo-stp_10.42.42.5(pid=11701) [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11701)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11711): Process ended prematurely: osmo-stp_10.42.42.5(pid=11711) [trial-2353↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11711)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=11728): Process ended prematurely: osmo-stp_10.42.42.5(pid=11728) [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11728)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=11743): Process ended prematurely: osmo-stp_10.42.42.5(pid=11743) [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11743)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=11761): Process ended prematurely: osmo-stp_10.42.42.5(pid=11761) [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11761)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11772): Process ended prematurely: osmo-stp_10.42.42.5(pid=11772) [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11772)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11782): Process ended prematurely: osmo-stp_10.42.42.5(pid=11782) [trial-2353↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11782)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11796): Process ended prematurely: osmo-stp_10.42.42.5(pid=11796) [trial-2353↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11796)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11810): Process ended prematurely: osmo-stp_10.42.42.5(pid=11810) [trial-2353↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11810)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=11819): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11819) [trial-2353↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11819)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=11829): Process ended prematurely: osmo-stp_10.42.42.5(pid=11829) [trial-2353↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11829)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=11839): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11839) [trial-2353↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11839)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11850): Process ended prematurely: osmo-stp_10.42.42.5(pid=11850) [trial-2353↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11850)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11864): Process ended prematurely: osmo-stp_10.42.42.5(pid=11864) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11864)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11875): Process ended prematurely: osmo-stp_10.42.42.5(pid=11875) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11875)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11889): Process ended prematurely: osmo-stp_10.42.42.5(pid=11889) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11889)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11900): Process ended prematurely: osmo-stp_10.42.42.5(pid=11900) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11900)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11914): Process ended prematurely: osmo-stp_10.42.42.5(pid=11914) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11914)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11925): Process ended prematurely: osmo-stp_10.42.42.5(pid=11925) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11925)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11939): Process ended prematurely: osmo-stp_10.42.42.5(pid=11939) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11939)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11951): Process ended prematurely: osmo-stp_10.42.42.5(pid=11951) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11951)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11965): Process ended prematurely: osmo-stp_10.42.42.5(pid=11965) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11965)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11976): Process ended prematurely: osmo-stp_10.42.42.5(pid=11976) [trial-2353↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11976)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11990): Process ended prematurely: osmo-stp_10.42.42.5(pid=11990) [trial-2353↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11990)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12001): Process ended prematurely: osmo-stp_10.42.42.5(pid=12001) [trial-2353↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12001)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12015): Process ended prematurely: osmo-stp_10.42.42.5(pid=12015) [trial-2353↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12015)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12026): Process ended prematurely: osmo-stp_10.42.42.5(pid=12026) [trial-2353↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12026)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12040): Process ended prematurely: osmo-stp_10.42.42.5(pid=12040) [trial-2353↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12040)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12051): Process ended prematurely: osmo-stp_10.42.42.5(pid=12051) [trial-2353↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12051)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12065): Process ended prematurely: osmo-stp_10.42.42.5(pid=12065) [trial-2353↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12065)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12076): Process ended prematurely: osmo-stp_10.42.42.5(pid=12076) [trial-2353↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12076)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12090): Process ended prematurely: osmo-stp_10.42.42.5(pid=12090) [trial-2353↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12090)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12104): Process ended prematurely: osmo-stp_10.42.42.5(pid=12104) [trial-2353↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12104)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=12122): Process ended prematurely: osmo-stp_10.42.42.5(pid=12122) [trial-2353↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12122)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=12134): Process ended prematurely: osmo-stp_10.42.42.5(pid=12134) [trial-2353↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12134)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=12152): Process ended prematurely: osmo-stp_10.42.42.5(pid=12152) [trial-2353↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12152)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12162): Process ended prematurely: osmo-stp_10.42.42.5(pid=12162) [trial-2353↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12162)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12172): Process ended prematurely: osmo-stp_10.42.42.5(pid=12172) [trial-2353↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12172)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=12190): Process ended prematurely: osmo-stp_10.42.42.5(pid=12190) [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12190)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=12202): Process ended prematurely: osmo-stp_10.42.42.5(pid=12202) [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12202)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=12221): Process ended prematurely: osmo-stp_10.42.42.5(pid=12221) [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12221)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12232): Process ended prematurely: osmo-stp_10.42.42.5(pid=12232) [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12232)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12242): Process ended prematurely: osmo-stp_10.42.42.5(pid=12242) [trial-2353↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12242)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=12259): Process ended prematurely: osmo-stp_10.42.42.5(pid=12259) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12259)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=12273): Process ended prematurely: osmo-stp_10.42.42.5(pid=12273) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12273)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=12291): Process ended prematurely: osmo-stp_10.42.42.5(pid=12291) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12291)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12302): Process ended prematurely: osmo-stp_10.42.42.5(pid=12302) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12302)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=12312): Process ended prematurely: osmo-stp_10.42.42.5(pid=12312) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12312)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=12329): Process ended prematurely: osmo-stp_10.42.42.5(pid=12329) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12329)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=12341): Process ended prematurely: osmo-stp_10.42.42.5(pid=12341) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12341)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=12360): Process ended prematurely: osmo-stp_10.42.42.5(pid=12360) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12360)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12370): Process ended prematurely: osmo-stp_10.42.42.5(pid=12370) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12370)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12381): Process ended prematurely: osmo-stp_10.42.42.5(pid=12381) [trial-2353↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12381)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=12398): Process ended prematurely: osmo-stp_10.42.42.5(pid=12398) [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12398)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=12410): Process ended prematurely: osmo-stp_10.42.42.5(pid=12410) [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12410)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=12428): Process ended prematurely: osmo-stp_10.42.42.5(pid=12428) [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12428)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12441): Process ended prematurely: osmo-stp_10.42.42.5(pid=12441) [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12441)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=12451): Process ended prematurely: osmo-stp_10.42.42.5(pid=12451) [trial-2353↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12451)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12465): Process ended prematurely: osmo-stp_10.42.42.5(pid=12465) [trial-2353↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12465)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12479): Process ended prematurely: osmo-stp_10.42.42.5(pid=12479) [trial-2353↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12479)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=12488): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12488) [trial-2353↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12488)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12498): Process ended prematurely: osmo-stp_10.42.42.5(pid=12498) [trial-2353↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12498)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=12507): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12507) [trial-2353↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12507)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=12517): Process ended prematurely: osmo-stp_10.42.42.5(pid=12517) [trial-2353↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12517)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12531): Process ended prematurely: osmo-stp_10.42.42.5(pid=12531) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12531)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12542): Process ended prematurely: osmo-stp_10.42.42.5(pid=12542) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12542)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12556): Process ended prematurely: osmo-stp_10.42.42.5(pid=12556) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12556)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12569): Process ended prematurely: osmo-stp_10.42.42.5(pid=12569) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12569)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12584): Process ended prematurely: osmo-stp_10.42.42.5(pid=12584) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12584)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12595): Process ended prematurely: osmo-stp_10.42.42.5(pid=12595) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12595)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12609): Process ended prematurely: osmo-stp_10.42.42.5(pid=12609) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12609)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12620): Process ended prematurely: osmo-stp_10.42.42.5(pid=12620) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12620)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12634): Process ended prematurely: osmo-stp_10.42.42.5(pid=12634) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12634)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12645): Process ended prematurely: osmo-stp_10.42.42.5(pid=12645) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12645)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=12931): Process ended prematurely: osmo-stp_10.42.42.5(pid=12931) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12931)] FAIL: mo_mt_call_osmux.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=12942): Process ended prematurely: osmo-stp_10.42.42.5(pid=12942) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12942)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12956): Process ended prematurely: osmo-stp_10.42.42.5(pid=12956) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12956)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12967): Process ended prematurely: osmo-stp_10.42.42.5(pid=12967) [trial-2353↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12967)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12981): Process ended prematurely: osmo-stp_10.42.42.5(pid=12981) [trial-2353↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12981)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12992): Process ended prematurely: osmo-stp_10.42.42.5(pid=12992) [trial-2353↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12992)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13010): Process ended prematurely: osmo-stp_10.42.42.5(pid=13010) [trial-2353↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13010)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=13022): Process ended prematurely: osmo-stp_10.42.42.5(pid=13022) [trial-2353↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13022)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=13040): Process ended prematurely: osmo-stp_10.42.42.5(pid=13040) [trial-2353↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13040)] FAIL: ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=13050): Process ended prematurely: osmo-stp_10.42.42.5(pid=13050) [trial-2353↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13050)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13070): Process ended prematurely: osmo-stp_10.42.42.5(pid=13070) [trial-2353↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13070)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=13439): Process ended prematurely: osmo-stp_10.42.42.5(pid=13439) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13439)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=13629): Process ended prematurely: osmo-stp_10.42.42.5(pid=13629) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13629)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=13647): Process ended prematurely: osmo-stp_10.42.42.5(pid=13647) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13647)] FAIL: ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=13657): Process ended prematurely: osmo-stp_10.42.42.5(pid=13657) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13657)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13667): Process ended prematurely: osmo-stp_10.42.42.5(pid=13667) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13667)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13685): Process ended prematurely: osmo-stp_10.42.42.5(pid=13685) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13685)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13697): Process ended prematurely: osmo-stp_10.42.42.5(pid=13697) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13697)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=13715): Process ended prematurely: osmo-stp_10.42.42.5(pid=13715) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13715)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=13727): Process ended prematurely: osmo-stp_10.42.42.5(pid=13727) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13727)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13737): Process ended prematurely: osmo-stp_10.42.42.5(pid=13737) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13737)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=13755): Process ended prematurely: osmo-stp_10.42.42.5(pid=13755) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13755)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13767): Process ended prematurely: osmo-stp_10.42.42.5(pid=13767) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13767)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=13787): Process ended prematurely: osmo-stp_10.42.42.5(pid=13787) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13787)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13797): Process ended prematurely: osmo-stp_10.42.42.5(pid=13797) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13797)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13807): Process ended prematurely: osmo-stp_10.42.42.5(pid=13807) [trial-2353↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13807)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=13820): Process ended prematurely: osmo-stp_10.42.42.5(pid=13820) [trial-2353↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13820)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=13833): Process ended prematurely: osmo-stp_10.42.42.5(pid=13833) [trial-2353↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13833)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=13842): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13842) [trial-2353↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13842)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13852): Process ended prematurely: osmo-stp_10.42.42.5(pid=13852) [trial-2353↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13852)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=13862): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13862) [trial-2353↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13862)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=13872): Process ended prematurely: osmo-stp_10.42.42.5(pid=13872) [trial-2353↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13872)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=13886): Process ended prematurely: osmo-stp_10.42.42.5(pid=13886) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13886)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13897): Process ended prematurely: osmo-stp_10.42.42.5(pid=13897) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13897)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13911): Process ended prematurely: osmo-stp_10.42.42.5(pid=13911) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13911)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13922): Process ended prematurely: osmo-stp_10.42.42.5(pid=13922) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13922)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13936): Process ended prematurely: osmo-stp_10.42.42.5(pid=13936) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13936)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13957): Process ended prematurely: osmo-stp_10.42.42.5(pid=13957) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13957)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14322): Process ended prematurely: osmo-stp_10.42.42.5(pid=14322) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14322)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14509): Process ended prematurely: osmo-stp_10.42.42.5(pid=14509) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14509)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14523): Process ended prematurely: osmo-stp_10.42.42.5(pid=14523) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14523)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14534): Process ended prematurely: osmo-stp_10.42.42.5(pid=14534) [trial-2353↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14534)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14548): Process ended prematurely: osmo-stp_10.42.42.5(pid=14548) [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14548)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14559): Process ended prematurely: osmo-stp_10.42.42.5(pid=14559) [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14559)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14574): Process ended prematurely: osmo-stp_10.42.42.5(pid=14574) [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14574)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14585): Process ended prematurely: osmo-stp_10.42.42.5(pid=14585) [trial-2353↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14585)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14600): Process ended prematurely: osmo-stp_10.42.42.5(pid=14600) [trial-2353↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14600)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14611): Process ended prematurely: osmo-stp_10.42.42.5(pid=14611) [trial-2353↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14611)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14625): Process ended prematurely: osmo-stp_10.42.42.5(pid=14625) [trial-2353↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14625)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14636): Process ended prematurely: osmo-stp_10.42.42.5(pid=14636) [trial-2353↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14636)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=14656): Process ended prematurely: osmo-stp_10.42.42.5(pid=14656) [trial-2353↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14656)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=14668): Process ended prematurely: osmo-stp_10.42.42.5(pid=14668) [trial-2353↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14668)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=14686): Process ended prematurely: osmo-stp_10.42.42.5(pid=14686) [trial-2353↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14686)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14696): Process ended prematurely: osmo-stp_10.42.42.5(pid=14696) [trial-2353↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14696)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14706): Process ended prematurely: osmo-stp_10.42.42.5(pid=14706) [trial-2353↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14706)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=14723): Process ended prematurely: osmo-stp_10.42.42.5(pid=14723) [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14723)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=14735): Process ended prematurely: osmo-stp_10.42.42.5(pid=14735) [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14735)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=14753): Process ended prematurely: osmo-stp_10.42.42.5(pid=14753) [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14753)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=14765): Process ended prematurely: osmo-stp_10.42.42.5(pid=14765) [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14765)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14775): Process ended prematurely: osmo-stp_10.42.42.5(pid=14775) [trial-2353↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14775)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=14792): Process ended prematurely: osmo-stp_10.42.42.5(pid=14792) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14792)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14804): Process ended prematurely: osmo-stp_10.42.42.5(pid=14804) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14804)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=14822): Process ended prematurely: osmo-stp_10.42.42.5(pid=14822) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14822)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14835): Process ended prematurely: osmo-stp_10.42.42.5(pid=14835) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14835)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14845): Process ended prematurely: osmo-stp_10.42.42.5(pid=14845) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14845)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=14863): Process ended prematurely: osmo-stp_10.42.42.5(pid=14863) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14863)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14875): Process ended prematurely: osmo-stp_10.42.42.5(pid=14875) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14875)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=14893): Process ended prematurely: osmo-stp_10.42.42.5(pid=14893) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14893)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14903): Process ended prematurely: osmo-stp_10.42.42.5(pid=14903) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14903)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14913): Process ended prematurely: osmo-stp_10.42.42.5(pid=14913) [trial-2353↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14913)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=14931): Process ended prematurely: osmo-stp_10.42.42.5(pid=14931) [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14931)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=14943): Process ended prematurely: osmo-stp_10.42.42.5(pid=14943) [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14943)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=14961): Process ended prematurely: osmo-stp_10.42.42.5(pid=14961) [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14961)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14971): Process ended prematurely: osmo-stp_10.42.42.5(pid=14971) [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14971)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14981): Process ended prematurely: osmo-stp_10.42.42.5(pid=14981) [trial-2353↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14981)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14994): Process ended prematurely: osmo-stp_10.42.42.5(pid=14994) [trial-2353↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14994)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15010): Process ended prematurely: osmo-stp_10.42.42.5(pid=15010) [trial-2353↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15010)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=15018): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15018) [trial-2353↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15018)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=15084): Process ended prematurely: osmo-stp_10.42.42.5(pid=15084) [trial-2353↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15084)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=15309): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15309) [trial-2353↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15309)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=15319): Process ended prematurely: osmo-stp_10.42.42.5(pid=15319) [trial-2353↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15319)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15333): Process ended prematurely: osmo-stp_10.42.42.5(pid=15333) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15333)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15344): Process ended prematurely: osmo-stp_10.42.42.5(pid=15344) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15344)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15358): Process ended prematurely: osmo-stp_10.42.42.5(pid=15358) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15358)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15369): Process ended prematurely: osmo-stp_10.42.42.5(pid=15369) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15369)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15383): Process ended prematurely: osmo-stp_10.42.42.5(pid=15383) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15383)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15394): Process ended prematurely: osmo-stp_10.42.42.5(pid=15394) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15394)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15408): Process ended prematurely: osmo-stp_10.42.42.5(pid=15408) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15408)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15419): Process ended prematurely: osmo-stp_10.42.42.5(pid=15419) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15419)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15433): Process ended prematurely: osmo-stp_10.42.42.5(pid=15433) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15433)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15447): Process ended prematurely: osmo-stp_10.42.42.5(pid=15447) [trial-2353↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15447)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15461): Process ended prematurely: osmo-stp_10.42.42.5(pid=15461) [trial-2353↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15461)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15472): Process ended prematurely: osmo-stp_10.42.42.5(pid=15472) [trial-2353↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15472)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=15486): Process ended prematurely: osmo-stp_10.42.42.5(pid=15486) [trial-2353↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15486)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15497): Process ended prematurely: osmo-stp_10.42.42.5(pid=15497) [trial-2353↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15497)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15511): Process ended prematurely: osmo-stp_10.42.42.5(pid=15511) [trial-2353↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15511)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15522): Process ended prematurely: osmo-stp_10.42.42.5(pid=15522) [trial-2353↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15522)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=15541): Process ended prematurely: osmo-stp_10.42.42.5(pid=15541) [trial-2353↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15541)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=15553): Process ended prematurely: osmo-stp_10.42.42.5(pid=15553) [trial-2353↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15553)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=15571): Process ended prematurely: osmo-stp_10.42.42.5(pid=15571) [trial-2353↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15571)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15581): Process ended prematurely: osmo-stp_10.42.42.5(pid=15581) [trial-2353↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15581)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15591): Process ended prematurely: osmo-stp_10.42.42.5(pid=15591) [trial-2353↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15591)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=15608): Process ended prematurely: osmo-stp_10.42.42.5(pid=15608) [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15608)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=15623): Process ended prematurely: osmo-stp_10.42.42.5(pid=15623) [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15623)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=15642): Process ended prematurely: osmo-stp_10.42.42.5(pid=15642) [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15642)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15652): Process ended prematurely: osmo-stp_10.42.42.5(pid=15652) [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15652)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15662): Process ended prematurely: osmo-stp_10.42.42.5(pid=15662) [trial-2353↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15662)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=15680): Process ended prematurely: osmo-stp_10.42.42.5(pid=15680) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15680)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=15692): Process ended prematurely: osmo-stp_10.42.42.5(pid=15692) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15692)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=15710): Process ended prematurely: osmo-stp_10.42.42.5(pid=15710) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15710)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15721): Process ended prematurely: osmo-stp_10.42.42.5(pid=15721) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15721)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15731): Process ended prematurely: osmo-stp_10.42.42.5(pid=15731) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15731)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=15748): Process ended prematurely: osmo-stp_10.42.42.5(pid=15748) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15748)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=15760): Process ended prematurely: osmo-stp_10.42.42.5(pid=15760) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15760)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=15778): Process ended prematurely: osmo-stp_10.42.42.5(pid=15778) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15778)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15832): Process ended prematurely: osmo-stp_10.42.42.5(pid=15832) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15832)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15843): Process ended prematurely: osmo-stp_10.42.42.5(pid=15843) [trial-2353↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15843)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15858): Process ended prematurely: osmo-stp_10.42.42.5(pid=15858) [trial-2353↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15858)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15871): Process ended prematurely: osmo-stp_10.42.42.5(pid=15871) [trial-2353↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15871)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=15879): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15879) [trial-2353↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15879)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=15889): Process ended prematurely: osmo-stp_10.42.42.5(pid=15889) [trial-2353↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15889)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=15898): Process ended prematurely: osmo-nitb_10.42.42.2(pid=15898) [trial-2353↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=15898)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=15908): Process ended prematurely: osmo-stp_10.42.42.5(pid=15908) [trial-2353↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15908)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15922): Process ended prematurely: osmo-stp_10.42.42.5(pid=15922) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15922)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15933): Process ended prematurely: osmo-stp_10.42.42.5(pid=15933) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15933)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15947): Process ended prematurely: osmo-stp_10.42.42.5(pid=15947) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15947)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15958): Process ended prematurely: osmo-stp_10.42.42.5(pid=15958) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15958)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15972): Process ended prematurely: osmo-stp_10.42.42.5(pid=15972) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15972)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=15983): Process ended prematurely: osmo-stp_10.42.42.5(pid=15983) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15983)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15998): Process ended prematurely: osmo-stp_10.42.42.5(pid=15998) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15998)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16009): Process ended prematurely: osmo-stp_10.42.42.5(pid=16009) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16009)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16023): Process ended prematurely: osmo-stp_10.42.42.5(pid=16023) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16023)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16034): Process ended prematurely: osmo-stp_10.42.42.5(pid=16034) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16034)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=16051): Process ended prematurely: osmo-stp_10.42.42.5(pid=16051) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16051)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16062): Process ended prematurely: osmo-stp_10.42.42.5(pid=16062) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16062)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=16076): Process ended prematurely: osmo-stp_10.42.42.5(pid=16076) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16076)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16087): Process ended prematurely: osmo-stp_10.42.42.5(pid=16087) [trial-2353↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16087)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16102): Process ended prematurely: osmo-stp_10.42.42.5(pid=16102) [trial-2353↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16102)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16113): Process ended prematurely: osmo-stp_10.42.42.5(pid=16113) [trial-2353↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16113)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=16131): Process ended prematurely: osmo-stp_10.42.42.5(pid=16131) [trial-2353↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16131)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=16143): Process ended prematurely: osmo-stp_10.42.42.5(pid=16143) [trial-2353↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16143)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=16161): Process ended prematurely: osmo-stp_10.42.42.5(pid=16161) [trial-2353↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16161)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16171): Process ended prematurely: osmo-stp_10.42.42.5(pid=16171) [trial-2353↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16171)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16184): Process ended prematurely: osmo-stp_10.42.42.5(pid=16184) [trial-2353↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16184)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=16203): Process ended prematurely: osmo-stp_10.42.42.5(pid=16203) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16203)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16215): Process ended prematurely: osmo-stp_10.42.42.5(pid=16215) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16215)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=16233): Process ended prematurely: osmo-stp_10.42.42.5(pid=16233) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16233)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16243): Process ended prematurely: osmo-stp_10.42.42.5(pid=16243) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16243)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16253): Process ended prematurely: osmo-stp_10.42.42.5(pid=16253) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16253)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=16270): Process ended prematurely: osmo-stp_10.42.42.5(pid=16270) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16270)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=16282): Process ended prematurely: osmo-stp_10.42.42.5(pid=16282) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16282)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=16300): Process ended prematurely: osmo-stp_10.42.42.5(pid=16300) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16300)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16310): Process ended prematurely: osmo-stp_10.42.42.5(pid=16310) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16310)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16320): Process ended prematurely: osmo-stp_10.42.42.5(pid=16320) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16320)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=16337): Process ended prematurely: osmo-stp_10.42.42.5(pid=16337) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16337)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=16349): Process ended prematurely: osmo-stp_10.42.42.5(pid=16349) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16349)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=16372): Process ended prematurely: osmo-stp_10.42.42.5(pid=16372) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16372)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16382): Process ended prematurely: osmo-stp_10.42.42.5(pid=16382) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16382)] FAIL: ping_idle_ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=16661): Process ended prematurely: osmo-stp_10.42.42.5(pid=16661) [trial-2353↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16661)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=16677): Process ended prematurely: osmo-stp_10.42.42.5(pid=16677) [trial-2353↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16677)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=16691): Process ended prematurely: osmo-stp_10.42.42.5(pid=16691) [trial-2353↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16691)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=16699): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16699) [trial-2353↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16699)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16709): Process ended prematurely: osmo-stp_10.42.42.5(pid=16709) [trial-2353↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16709)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=16718): Process ended prematurely: osmo-nitb_10.42.42.2(pid=16718) [trial-2353↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=16718)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16729): Process ended prematurely: osmo-stp_10.42.42.5(pid=16729) [trial-2353↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16729)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16743): Process ended prematurely: osmo-stp_10.42.42.5(pid=16743) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16743)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16754): Process ended prematurely: osmo-stp_10.42.42.5(pid=16754) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16754)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16768): Process ended prematurely: osmo-stp_10.42.42.5(pid=16768) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16768)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=16779): Process ended prematurely: osmo-stp_10.42.42.5(pid=16779) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16779)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=16793): Process ended prematurely: osmo-stp_10.42.42.5(pid=16793) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16793)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16807): Process ended prematurely: osmo-stp_10.42.42.5(pid=16807) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16807)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=16821): Process ended prematurely: osmo-stp_10.42.42.5(pid=16821) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16821)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=16832): Process ended prematurely: osmo-stp_10.42.42.5(pid=16832) [trial-2353↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16832)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16848): Process ended prematurely: osmo-stp_10.42.42.5(pid=16848) [trial-2353↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16848)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16859): Process ended prematurely: osmo-stp_10.42.42.5(pid=16859) [trial-2353↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16859)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=16873): Process ended prematurely: osmo-stp_10.42.42.5(pid=16873) [trial-2353↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16873)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16884): Process ended prematurely: osmo-stp_10.42.42.5(pid=16884) [trial-2353↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16884)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=16903): Process ended prematurely: osmo-stp_10.42.42.5(pid=16903) [trial-2353↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16903)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=16917): Process ended prematurely: osmo-stp_10.42.42.5(pid=16917) [trial-2353↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16917)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=16935): Process ended prematurely: osmo-stp_10.42.42.5(pid=16935) [trial-2353↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16935)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16945): Process ended prematurely: osmo-stp_10.42.42.5(pid=16945) [trial-2353↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16945)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16955): Process ended prematurely: osmo-stp_10.42.42.5(pid=16955) [trial-2353↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16955)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=16972): Process ended prematurely: osmo-stp_10.42.42.5(pid=16972) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16972)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=16985): Process ended prematurely: osmo-stp_10.42.42.5(pid=16985) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16985)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=17003): Process ended prematurely: osmo-stp_10.42.42.5(pid=17003) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17003)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17013): Process ended prematurely: osmo-stp_10.42.42.5(pid=17013) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17013)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17023): Process ended prematurely: osmo-stp_10.42.42.5(pid=17023) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17023)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=17041): Process ended prematurely: osmo-stp_10.42.42.5(pid=17041) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17041)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=17054): Process ended prematurely: osmo-stp_10.42.42.5(pid=17054) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17054)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=17072): Process ended prematurely: osmo-stp_10.42.42.5(pid=17072) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17072)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17082): Process ended prematurely: osmo-stp_10.42.42.5(pid=17082) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17082)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17092): Process ended prematurely: osmo-stp_10.42.42.5(pid=17092) [trial-2353↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17092)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17106): Process ended prematurely: osmo-stp_10.42.42.5(pid=17106) [trial-2353↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17106)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17120): Process ended prematurely: osmo-stp_10.42.42.5(pid=17120) [trial-2353↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17120)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=17130): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17130) [trial-2353↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17130)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=17140): Process ended prematurely: osmo-stp_10.42.42.5(pid=17140) [trial-2353↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17140)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17154): Process ended prematurely: osmo-stp_10.42.42.5(pid=17154) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17154)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17168): Process ended prematurely: osmo-stp_10.42.42.5(pid=17168) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17168)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17182): Process ended prematurely: osmo-stp_10.42.42.5(pid=17182) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17182)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17193): Process ended prematurely: osmo-stp_10.42.42.5(pid=17193) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17193)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17207): Process ended prematurely: osmo-stp_10.42.42.5(pid=17207) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17207)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17218): Process ended prematurely: osmo-stp_10.42.42.5(pid=17218) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17218)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17232): Process ended prematurely: osmo-stp_10.42.42.5(pid=17232) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17232)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17243): Process ended prematurely: osmo-stp_10.42.42.5(pid=17243) [trial-2353↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17243)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17257): Process ended prematurely: osmo-stp_10.42.42.5(pid=17257) [trial-2353↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17257)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=17268): Process ended prematurely: osmo-stp_10.42.42.5(pid=17268) [trial-2353↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17268)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=17285): Process ended prematurely: osmo-stp_10.42.42.5(pid=17285) [trial-2353↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17285)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=17296): Process ended prematurely: osmo-stp_10.42.42.5(pid=17296) [trial-2353↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17296)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17313): Process ended prematurely: osmo-stp_10.42.42.5(pid=17313) [trial-2353↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17313)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17324): Process ended prematurely: osmo-stp_10.42.42.5(pid=17324) [trial-2353↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17324)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=17342): Process ended prematurely: osmo-stp_10.42.42.5(pid=17342) [trial-2353↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17342)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=17360): Process ended prematurely: osmo-stp_10.42.42.5(pid=17360) [trial-2353↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17360)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=17384): Process ended prematurely: osmo-stp_10.42.42.5(pid=17384) [trial-2353↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17384)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17394): Process ended prematurely: osmo-stp_10.42.42.5(pid=17394) [trial-2353↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17394)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17404): Process ended prematurely: osmo-stp_10.42.42.5(pid=17404) [trial-2353↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17404)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=17423): Process ended prematurely: osmo-stp_10.42.42.5(pid=17423) [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17423)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=17436): Process ended prematurely: osmo-stp_10.42.42.5(pid=17436) [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17436)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=17454): Process ended prematurely: osmo-stp_10.42.42.5(pid=17454) [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17454)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17467): Process ended prematurely: osmo-stp_10.42.42.5(pid=17467) [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17467)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17477): Process ended prematurely: osmo-stp_10.42.42.5(pid=17477) [trial-2353↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17477)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=17494): Process ended prematurely: osmo-stp_10.42.42.5(pid=17494) [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17494)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=17506): Process ended prematurely: osmo-stp_10.42.42.5(pid=17506) [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17506)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=17524): Process ended prematurely: osmo-stp_10.42.42.5(pid=17524) [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17524)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17537): Process ended prematurely: osmo-stp_10.42.42.5(pid=17537) [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17537)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=17547): Process ended prematurely: osmo-stp_10.42.42.5(pid=17547) [trial-2353↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17547)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=17564): Process ended prematurely: osmo-stp_10.42.42.5(pid=17564) [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17564)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=17576): Process ended prematurely: osmo-stp_10.42.42.5(pid=17576) [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17576)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=17594): Process ended prematurely: osmo-stp_10.42.42.5(pid=17594) [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17594)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17604): Process ended prematurely: osmo-stp_10.42.42.5(pid=17604) [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17604)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17614): Process ended prematurely: osmo-stp_10.42.42.5(pid=17614) [trial-2353↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17614)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17629): Process ended prematurely: osmo-stp_10.42.42.5(pid=17629) [trial-2353↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17629)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=17637): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17637) [trial-2353↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17637)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=17639): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17639) [trial-2353↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17639)] FAIL: esme_ms_sms_storeforward.py (2.7 sec) Error: osmo-nitb_10.42.42.2(pid=17641): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17641) [trial-2353↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17641)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=17643): Process ended prematurely: osmo-nitb_10.42.42.2(pid=17643) [trial-2353↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=17643)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.4 sec) Error: osmo-hlr_10.42.42.2(pid=17652): Process ended prematurely: osmo-hlr_10.42.42.2(pid=17652) [trial-2353↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17652)] FAIL: esme_connect_policy_closed.py (6.3 sec) Error: osmo-hlr_10.42.42.2(pid=17663): Process ended prematurely: osmo-hlr_10.42.42.2(pid=17663) [trial-2353↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=17663)] FAIL: esme_ms_sms_storeforward.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=17675): Process ended prematurely: osmo-stp_10.42.42.5(pid=17675) [trial-2353↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17675)] FAIL: esme_ms_sms_transaction.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=17686): Process ended prematurely: osmo-stp_10.42.42.5(pid=17686) [trial-2353↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17686)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17700): Process ended prematurely: osmo-stp_10.42.42.5(pid=17700) [trial-2353↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17700)] FAIL: register_a5_0_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=17712): Process ended prematurely: osmo-stp_10.42.42.5(pid=17712) [trial-2353↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17712)] FAIL: register_a5_1_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=17723): Process ended prematurely: osmo-stp_10.42.42.5(pid=17723) [trial-2353↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17723)] FAIL: register_a5_3_authreq.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=17734): Process ended prematurely: osmo-stp_10.42.42.5(pid=17734) [trial-2353↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=17734)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (21.3 sec) Error: srsepc(pid=18026): Process ended prematurely: srsepc(pid=18026) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18026)] FAIL: iperf3_bidir.py (19.4 sec) Error: srsepc(pid=18043): Process ended prematurely: srsepc(pid=18043) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18043)] FAIL: iperf3_dl.py (19.1 sec) Error: srsepc(pid=18060): Process ended prematurely: srsepc(pid=18060) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18060)] FAIL: iperf3_ul.py (19.0 sec) Error: srsepc(pid=18076): Process ended prematurely: srsepc(pid=18076) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18076)] FAIL: ping.py (18.4 sec) Error: srsepc(pid=18092): Process ended prematurely: srsepc(pid=18092) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18092)] FAIL: rrc_idle_mo_ping.py (18.3 sec) Error: srsepc(pid=18108): Process ended prematurely: srsepc(pid=18108) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18108)] FAIL: rrc_idle_mt_ping.py (18.5 sec) Error: srsepc(pid=18127): Process ended prematurely: srsepc(pid=18127) [trial-2353↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=18127)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18140): Process ended prematurely: osmo-stp_10.42.42.5(pid=18140) [trial-2353↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18140)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18156): Process ended prematurely: osmo-stp_10.42.42.5(pid=18156) [trial-2353↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18156)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=18170): Process ended prematurely: osmo-stp_10.42.42.5(pid=18170) [trial-2353↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18170)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18184): Process ended prematurely: osmo-stp_10.42.42.5(pid=18184) [trial-2353↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18184)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18198): Process ended prematurely: osmo-stp_10.42.42.5(pid=18198) [trial-2353↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18198)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18213): Process ended prematurely: osmo-stp_10.42.42.5(pid=18213) [trial-2353↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18213)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18227): Process ended prematurely: osmo-stp_10.42.42.5(pid=18227) [trial-2353↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18227)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=18241): Process ended prematurely: osmo-stp_10.42.42.5(pid=18241) [trial-2353↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18241)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18256): Process ended prematurely: osmo-stp_10.42.42.5(pid=18256) [trial-2353↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18256)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18270): Process ended prematurely: osmo-stp_10.42.42.5(pid=18270) [trial-2353↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18270)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18284): Process ended prematurely: osmo-stp_10.42.42.5(pid=18284) [trial-2353↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18284)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18298): Process ended prematurely: osmo-stp_10.42.42.5(pid=18298) [trial-2353↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18298)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18312): Process ended prematurely: osmo-stp_10.42.42.5(pid=18312) [trial-2353↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18312)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18326): Process ended prematurely: osmo-stp_10.42.42.5(pid=18326) [trial-2353↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18326)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18340): Process ended prematurely: osmo-stp_10.42.42.5(pid=18340) [trial-2353↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18340)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18354): Process ended prematurely: osmo-stp_10.42.42.5(pid=18354) [trial-2353↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18354)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18368): Process ended prematurely: osmo-stp_10.42.42.5(pid=18368) [trial-2353↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18368)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=18382): Process ended prematurely: osmo-stp_10.42.42.5(pid=18382) [trial-2353↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18382)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18397): Process ended prematurely: osmo-stp_10.42.42.5(pid=18397) [trial-2353↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18397)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18411): Process ended prematurely: osmo-stp_10.42.42.5(pid=18411) [trial-2353↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18411)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18425): Process ended prematurely: osmo-stp_10.42.42.5(pid=18425) [trial-2353↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18425)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=18439): Process ended prematurely: osmo-stp_10.42.42.5(pid=18439) [trial-2353↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18439)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=18453): Process ended prematurely: osmo-stp_10.42.42.5(pid=18453) [trial-2353↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18453)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=18467): Process ended prematurely: osmo-stp_10.42.42.5(pid=18467) [trial-2353↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18467)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=18491): Process ended prematurely: osmo-stp_10.42.42.5(pid=18491) [trial-2353↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18491)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=18856): Process ended prematurely: osmo-stp_10.42.42.5(pid=18856) [trial-2353↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=18856)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=19048): Process ended prematurely: osmo-stp_10.42.42.5(pid=19048) [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19048)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19062): Process ended prematurely: osmo-stp_10.42.42.5(pid=19062) [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19062)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19076): Process ended prematurely: osmo-stp_10.42.42.5(pid=19076) [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19076)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=19090): Process ended prematurely: osmo-stp_10.42.42.5(pid=19090) [trial-2353↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=19104): Process ended prematurely: osmo-stp_10.42.42.5(pid=19104) [trial-2353↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19104)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19118): Process ended prematurely: osmo-stp_10.42.42.5(pid=19118) [trial-2353↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19118)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=19132): Process ended prematurely: osmo-stp_10.42.42.5(pid=19132) [trial-2353↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19132)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=19146): Process ended prematurely: osmo-stp_10.42.42.5(pid=19146) [trial-2353↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19146)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=19160): Process ended prematurely: osmo-stp_10.42.42.5(pid=19160) [trial-2353↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19160)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=19174): Process ended prematurely: osmo-stp_10.42.42.5(pid=19174) [trial-2353↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19174)] + rm -rf trial-2353/inst + cd trial-2353 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 02:07:48 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353-run.tgz run.2022-12-09_02-07-59 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2353-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17650.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6677.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2942.tgz osmo-mgw.build-8942.tgz osmo-msc.build-29254.tgz osmo-nitb.build-12963.tgz osmo-pcu-oc2g.build-3905.tgz osmo-pcu-sysmo.build-5187.tgz osmo-pcu.build-5148.tgz osmo-sgsn.build-30031.tgz osmo-stp.build-9237.tgz osmo-trx.build-4673.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE